2019-11-29T11:07:12.309 INFO:root:teuthology version: 1.0.0-e749e7b 2019-11-29T11:07:12.310 DEBUG:teuthology.run:Teuthology command: teuthology /tmp/teuthology-worker.jy8fel.tmp -- --verbose --lock --description rgw:verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/https.yaml rgw_pool_type/replicated.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} --name yuvalif-2019-11-29_09:46:32-rgw:verify-wip-yuval-master-distro-basic-smithi --block --owner scheduled_yuvalif@teuthology --archive /home/teuthworker/archive/yuvalif-2019-11-29_09:46:32-rgw:verify-wip-yuval-master-distro-basic-smithi/4552909 2019-11-29T11:07:12.357 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2019-11-29T11:07:12.417 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuvalif-2019-11-29_09:46:32-rgw:verify-wip-yuval-master-distro-basic-smithi/4552909 branch: wip-yuval-master description: rgw:verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/https.yaml rgw_pool_type/replicated.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} email: yuvalif@yahoo.com first_in_suite: false job_id: '4552909' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: yuvalif-2019-11-29_09:46:32-rgw:verify-wip-yuval-master-distro-basic-smithi nuke-on-error: true openstack: - volumes: count: 4 size: 10 os_type: centos overrides: admin_socket: branch: wip-yuval-master ceph: conf: client: debug rgw: 20 rgw crypt require ssl: false rgw crypt s3 kms backend: testing rgw crypt s3 kms encryption keys: testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= rgw lc debug interval: 10 global: mon client directed command retry: 5 ms inject socket failures: 5000 osd heartbeat grace: 40 osd_max_pg_log_entries: 10 osd_min_pg_log_entries: 10 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon osd crush smoke test: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug filestore: 20 debug journal: 20 debug ms: 1 debug osd: 25 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd fast shutdown: false osd objectstore: bluestore osd shutdown pgref assert: true fs: xfs log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME sha1: 656c8e8049c2c1acd363143c842c2edf1fe09b64 valgrind: mds: - --tool=memcheck mon: - --tool=memcheck - --leak-check=full - --show-reachable=yes osd: - --tool=memcheck ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: notcmalloc sha1: 656c8e8049c2c1acd363143c842c2edf1fe09b64 openssl_keys: rgw.client.0: ca: root client: client.0 embed-key: true rgw.client.1: ca: root client: client.1 embed-key: true root: client: client.0 cn: teuthology install: - client.0 - client.1 key-type: rsa:4096 rgw: client.0: ssl certificate: rgw.client.0 client.1: ssl certificate: rgw.client.1 compression type: random ec-data-pool: false frontend: beast storage classes: LUKEWARM, FROZEN thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuval-master sha1: 656c8e8049c2c1acd363143c842c2edf1fe09b64 owner: scheduled_yuvalif@teuthology priority: 100 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 sha1: 656c8e8049c2c1acd363143c842c2edf1fe09b64 suite: rgw:verify suite_branch: wip-yuval-master suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_wip-yuval-master/qa suite_relpath: qa suite_repo: git://git.ceph.com/ceph-ci.git suite_sha1: 656c8e8049c2c1acd363143c842c2edf1fe09b64 tasks: - install: flavor: notcmalloc - ceph: null - openssl_keys: null - rgw: client.0: valgrind: - --tool=memcheck - --max-threads=1024 - workunit: clients: client.0: - cls/test_cls_lock.sh - cls/test_cls_log.sh - cls/test_cls_refcount.sh - cls/test_cls_rgw.sh - rgw/test_rgw_gc_log.sh - ragweed: client.0: default-branch: ceph-master rgw_server: client.0 stages: prepare,check - s3tests-java: client.0: force-branch: master force-repo: https://github.com/ceph/java_s3tests.git - s3tests: client.0: force-branch: ceph-master rgw_server: client.0 - swift: client.0: rgw_server: client.0 teuthology_branch: master tube: smithi verbose: false worker_log: /home/teuthworker/archive/worker_logs/worker.smithi.23608 2019-11-29T11:07:12.417 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_wip-yuval-master/qa; will attempt to use it 2019-11-29T11:07:12.418 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_wip-yuval-master/qa/tasks 2019-11-29T11:07:12.418 INFO:teuthology.run_tasks:Running task internal.check_packages... 2019-11-29T11:07:12.420 INFO:teuthology.task.internal:Checking packages... 2019-11-29T11:07:12.434 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'notcmalloc' and ceph hash '656c8e8049c2c1acd363143c842c2edf1fe09b64' 2019-11-29T11:07:12.434 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2019-11-29T11:07:12.434 INFO:teuthology.packaging:ref: None 2019-11-29T11:07:12.434 INFO:teuthology.packaging:tag: None 2019-11-29T11:07:12.434 INFO:teuthology.packaging:branch: wip-yuval-master 2019-11-29T11:07:12.435 INFO:teuthology.packaging:sha1: 656c8e8049c2c1acd363143c842c2edf1fe09b64 2019-11-29T11:07:12.435 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=notcmalloc&distros=centos%2F7%2Fx86_64&ref=wip-yuval-master 2019-11-29T11:07:12.599 INFO:teuthology.task.internal:Found packages for ceph version 15.0.0-7809.g656c8e8 2019-11-29T11:07:12.599 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2019-11-29T11:07:12.608 INFO:teuthology.task.internal:no buildpackages task found 2019-11-29T11:07:12.609 INFO:teuthology.run_tasks:Running task internal.lock_machines... 2019-11-29T11:07:12.845 INFO:teuthology.task.internal.lock_machines:Locking machines... 2019-11-29T11:07:12.845 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2019-11-29T11:07:12.893 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:07:22.909 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:07:32.925 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:07:42.942 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:07:52.953 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:08:02.971 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:08:12.985 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:08:23.000 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:08:33.016 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:08:43.032 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:08:53.047 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:09:03.065 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:09:13.081 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:09:23.101 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:09:33.119 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:09:43.136 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:09:53.152 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:10:03.173 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:10:13.188 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:10:23.204 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:10:33.220 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:10:43.236 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:10:53.252 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 0)... 2019-11-29T11:11:03.268 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:11:13.284 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:11:23.301 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:11:33.317 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:11:43.332 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:11:53.348 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:12:03.366 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:12:13.383 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:12:23.400 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:12:33.415 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:12:43.430 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:12:53.444 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:13:03.461 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:13:13.477 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:13:23.499 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:13:33.516 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:13:43.554 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:13:53.569 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:14:03.590 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:14:13.607 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:14:23.631 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:14:33.648 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:14:43.662 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:14:53.675 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-11-29T11:15:03.699 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:15:13.718 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:15:23.731 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:15:33.748 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:15:43.765 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:15:53.781 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:16:03.805 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:16:13.820 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:16:23.836 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:16:33.845 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:16:43.860 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:16:53.873 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:17:03.892 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:17:13.911 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:17:23.928 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:17:33.944 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:17:43.956 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:17:53.964 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:18:03.980 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:18:13.997 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:18:24.011 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:18:34.020 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:18:44.035 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:18:54.052 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:19:04.064 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:19:14.072 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:19:24.088 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:19:34.104 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:19:44.120 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:19:54.136 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:20:04.154 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:20:14.171 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:20:24.183 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:20:34.225 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:20:44.237 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:20:54.252 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:21:04.269 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:21:14.285 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:21:24.301 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-11-29T11:21:34.318 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-11-29T11:21:44.333 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-11-29T11:21:54.350 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-11-29T11:22:04.364 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-11-29T11:22:14.380 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-11-29T11:22:24.431 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-11-29T11:22:34.445 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-11-29T11:22:44.466 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-11-29T11:22:54.481 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-11-29T11:23:04.499 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-11-29T11:23:14.512 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-11-29T11:23:24.529 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-11-29T11:23:34.545 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-11-29T11:23:44.560 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-11-29T11:23:54.577 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-11-29T11:24:04.592 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-11-29T11:24:14.609 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-11-29T11:24:24.624 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-11-29T11:24:34.642 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-11-29T11:24:44.661 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-11-29T11:24:54.677 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-11-29T11:25:04.693 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:25:14.709 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:25:24.724 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:25:34.740 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:25:44.756 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:25:54.772 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:26:04.788 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:26:14.806 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:26:24.814 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:26:34.828 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:26:44.843 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 0)... 2019-11-29T11:26:54.861 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 0)... 2019-11-29T11:27:04.877 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 0)... 2019-11-29T11:27:14.894 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:27:24.913 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:27:34.925 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:27:44.940 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:27:54.957 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:28:04.974 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:28:14.994 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:28:25.012 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:28:35.029 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:28:45.045 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:28:55.063 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:29:05.080 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:29:15.097 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:29:25.114 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:29:35.132 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:29:45.148 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:29:55.164 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:30:05.182 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:30:15.213 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:30:25.230 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:30:35.247 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:30:45.274 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:30:55.292 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:31:05.311 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-11-29T11:31:15.328 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:31:25.344 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:31:35.360 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:31:45.377 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:31:55.391 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:32:05.404 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:32:15.420 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:32:25.436 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:32:35.452 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:32:45.465 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:32:55.481 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:33:05.498 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:33:15.512 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:33:25.529 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:33:35.544 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:33:45.561 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:33:55.576 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:34:05.585 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:34:15.600 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:34:25.646 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:34:35.660 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:34:45.680 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:34:55.689 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:35:05.700 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:35:15.716 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:35:25.734 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:35:35.752 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:35:45.769 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:35:55.784 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:36:05.800 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:36:15.816 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:36:25.834 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:36:35.849 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:36:45.860 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:36:55.876 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:37:05.891 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:37:15.908 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:37:25.925 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:37:35.943 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:37:45.956 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:37:55.972 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:38:05.988 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:38:16.004 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:38:26.020 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:38:36.038 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:38:46.054 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:38:56.069 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:39:06.084 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:39:16.115 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:39:26.133 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:39:36.150 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:39:46.164 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:39:56.174 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:40:06.185 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:40:16.199 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:40:26.215 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:40:36.228 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:40:46.244 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:40:56.262 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:41:06.276 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:41:16.287 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:41:26.299 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:41:36.316 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:41:46.332 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:41:56.348 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:42:06.358 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:42:16.375 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:42:26.387 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:42:36.404 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-11-29T11:42:46.420 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:42:56.437 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:43:06.445 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:43:16.461 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:43:26.472 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:43:36.488 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:43:46.496 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:43:56.510 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:44:06.526 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:44:16.543 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:44:26.559 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:44:36.575 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:44:46.593 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:44:56.601 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:45:06.614 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:45:16.628 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:45:26.644 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:45:36.663 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:45:46.680 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:45:56.696 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:46:06.713 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:46:16.725 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:46:26.735 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:46:36.745 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:46:46.761 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:46:56.770 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:47:06.788 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:47:16.796 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:47:26.814 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:47:36.823 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:47:46.840 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:47:56.857 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:48:06.874 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:48:16.883 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:48:26.892 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:48:36.906 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:48:46.923 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 0)... 2019-11-29T11:48:56.936 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 1)... 2019-11-29T11:49:06.945 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 1)... 2019-11-29T11:49:16.960 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 1)... 2019-11-29T11:49:26.977 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 1)... 2019-11-29T11:49:36.993 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 1)... 2019-11-29T11:49:47.011 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-11-29T11:49:57.025 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:50:07.043 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:50:17.052 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:50:27.070 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:50:37.079 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:50:47.095 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:50:57.112 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:51:07.128 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:51:17.142 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:51:27.160 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:51:37.178 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:51:47.196 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:51:57.205 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:52:07.223 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:52:17.239 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:52:27.255 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:52:37.268 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:52:47.286 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:52:57.302 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:53:07.320 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:53:17.337 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:53:27.346 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:53:37.363 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:53:47.378 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:53:57.397 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:54:07.413 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:54:17.429 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:54:27.438 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:54:37.448 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:54:47.464 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:54:57.479 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:55:07.493 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:55:17.509 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:55:27.521 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:55:37.542 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:55:47.559 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-11-29T11:55:57.575 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-11-29T11:56:07.588 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-11-29T11:56:17.598 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-11-29T11:56:27.612 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-11-29T11:56:37.629 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-11-29T11:56:47.650 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:56:57.666 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:57:07.684 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:57:17.702 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:57:27.720 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:57:37.738 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:57:47.754 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:57:57.770 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-11-29T11:58:07.789 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:58:17.804 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:58:27.819 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:58:37.836 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:58:47.853 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:58:57.870 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:59:07.885 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:59:17.900 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:59:27.935 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:59:37.952 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:59:47.965 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T11:59:57.981 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T12:00:07.995 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T12:00:18.012 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T12:00:28.026 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-11-29T12:00:38.040 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-11-29T12:00:48.053 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-11-29T12:00:58.070 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-11-29T12:01:08.080 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-11-29T12:01:18.105 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-11-29T12:01:28.121 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-11-29T12:01:38.135 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-11-29T12:01:48.148 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-11-29T12:01:58.164 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-11-29T12:02:08.177 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-11-29T12:02:18.193 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-11-29T12:02:28.202 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-11-29T12:02:38.214 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-11-29T12:02:48.232 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-11-29T12:02:58.248 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T12:03:08.260 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T12:03:18.275 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T12:03:28.289 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T12:03:38.304 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T12:03:48.321 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T12:03:58.338 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T12:04:08.357 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-11-29T12:04:18.374 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-11-29T12:04:28.392 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T12:04:38.401 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T12:04:48.410 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T12:04:58.425 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T12:05:08.441 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T12:05:18.451 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T12:05:28.464 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T12:05:38.474 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T12:05:48.489 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T12:05:58.512 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T12:06:08.523 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T12:06:18.534 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T12:06:28.549 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T12:06:38.565 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-11-29T12:06:48.579 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-11-29T12:06:58.597 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-11-29T12:07:08.615 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-11-29T12:07:18.628 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-11-29T12:07:28.644 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-11-29T12:07:38.661 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-11-29T12:07:48.680 DEBUG:teuthology.lock.ops:lock_many request: {'count': 2, 'locked_by': 'scheduled_yuvalif@teuthology', 'description': '/home/teuthworker/archive/yuvalif-2019-11-29_09:46:32-rgw:verify-wip-yuval-master-distro-basic-smithi/4552909', 'machine_type': 'smithi'} 2019-11-29T12:07:48.701 DEBUG:teuthology.lock.ops:locked ubuntu@smithi062.front.sepia.ceph.com, ubuntu@smithi022.front.sepia.ceph.com 2019-11-29T12:07:48.835 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=, signals=[15]) 2019-11-29T12:07:49.040 INFO:teuthology.provision.fog.smithi062:Scheduling deploy of centos 7.6 2019-11-29T12:07:49.045 INFO:teuthology.provision.fog.smithi022:Scheduling deploy of centos 7.6 2019-11-29T12:07:49.353 INFO:teuthology.orchestra.console:Power off smithi022 2019-11-29T12:07:49.354 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2019-11-29T12:07:49.403 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-11-29T12:07:49.456 INFO:teuthology.orchestra.console:Power off smithi062 2019-11-29T12:07:49.456 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2019-11-29T12:07:49.494 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-11-29T12:07:53.484 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-11-29T12:07:53.543 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-11-29T12:07:57.617 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-11-29T12:07:57.673 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-11-29T12:07:57.847 INFO:teuthology.orchestra.console:Power off for smithi022 completed 2019-11-29T12:07:57.948 INFO:teuthology.orchestra.console:Power on smithi022 2019-11-29T12:07:57.948 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2019-11-29T12:07:57.988 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-11-29T12:08:01.802 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-11-29T12:08:02.031 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-11-29T12:08:02.061 INFO:teuthology.orchestra.console:Power off for smithi062 completed 2019-11-29T12:08:02.163 INFO:teuthology.orchestra.console:Power on smithi062 2019-11-29T12:08:02.163 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2019-11-29T12:08:02.203 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-11-29T12:08:06.163 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-11-29T12:08:06.246 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-11-29T12:08:06.393 INFO:teuthology.orchestra.console:Power on for smithi022 completed 2019-11-29T12:08:06.494 INFO:teuthology.provision.fog.smithi022:Waiting for deploy to finish 2019-11-29T12:08:10.378 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-11-29T12:08:10.645 INFO:teuthology.orchestra.console:Power on for smithi062 completed 2019-11-29T12:08:10.746 INFO:teuthology.provision.fog.smithi062:Waiting for deploy to finish 2019-11-29T12:10:37.388 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi022.front.sepia.ceph.com', 'timeout': 60} 2019-11-29T12:10:46.445 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi022.front.sepia.ceph.com', 'timeout': 60} 2019-11-29T12:10:55.501 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi022.front.sepia.ceph.com', 'timeout': 60} 2019-11-29T12:10:56.678 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi062.front.sepia.ceph.com', 'timeout': 60} 2019-11-29T12:11:04.561 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi022.front.sepia.ceph.com', 'timeout': 60} 2019-11-29T12:11:05.737 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi062.front.sepia.ceph.com', 'timeout': 60} 2019-11-29T12:11:13.646 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi022.front.sepia.ceph.com', 'timeout': 60} 2019-11-29T12:11:14.794 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi062.front.sepia.ceph.com', 'timeout': 60} 2019-11-29T12:11:22.701 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi022.front.sepia.ceph.com', 'timeout': 60} 2019-11-29T12:11:23.850 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi062.front.sepia.ceph.com', 'timeout': 60} 2019-11-29T12:11:31.758 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi022.front.sepia.ceph.com', 'timeout': 60} 2019-11-29T12:11:32.909 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi062.front.sepia.ceph.com', 'timeout': 60} 2019-11-29T12:11:40.813 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi022.front.sepia.ceph.com', 'timeout': 60} 2019-11-29T12:11:41.962 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi062.front.sepia.ceph.com', 'timeout': 60} 2019-11-29T12:11:51.022 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi062.front.sepia.ceph.com', 'timeout': 60} 2019-11-29T12:12:00.079 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi062.front.sepia.ceph.com', 'timeout': 60} 2019-11-29T12:12:46.856 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi022.front.sepia.ceph.com', 'timeout': 60} 2019-11-29T12:12:47.058 INFO:teuthology.orchestra.run.smithi022:> hostname 2019-11-29T12:12:47.628 INFO:teuthology.orchestra.run.smithi022.stdout:smithi022.front.sepia.ceph.com 2019-11-29T12:12:47.628 INFO:teuthology.orchestra.run.smithi022:> grep smithi022.front.sepia.ceph.com /etc/hosts 2019-11-29T12:12:47.718 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.15.22 smithi022.front.sepia.ceph.com smithi022 2019-11-29T12:12:47.718 INFO:teuthology.orchestra.run.smithi022:> sudo hostname smithi022 2019-11-29T12:12:47.868 INFO:teuthology.orchestra.run.smithi022:> sudo sed -i -e 's/smithi022.front.sepia.ceph.com/smithi022/g' /etc/hosts 2019-11-29T12:12:47.984 INFO:teuthology.orchestra.run.smithi022:> sudo sed -i -e 's/172.21.15.22/172.21.15.22/g' /etc/hosts 2019-11-29T12:12:48.090 INFO:teuthology.orchestra.run.smithi022:> sudo sed -i -e 's/smithi022.front.sepia.ceph.com/smithi022/g' /etc/hostname 2019-11-29T12:12:48.183 INFO:teuthology.orchestra.run.smithi022:> sudo hostname smithi022 2019-11-29T12:12:48.260 INFO:teuthology.provision.fog.smithi022:Deploy complete! 2019-11-29T12:12:48.262 DEBUG:teuthology.parallel:result is None 2019-11-29T12:13:06.084 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi062.front.sepia.ceph.com', 'timeout': 60} 2019-11-29T12:13:06.406 INFO:teuthology.orchestra.run.smithi062:> hostname 2019-11-29T12:13:06.989 INFO:teuthology.orchestra.run.smithi062.stdout:smithi062 2019-11-29T12:13:06.990 INFO:teuthology.orchestra.run.smithi062:> grep smithi062 /etc/hosts 2019-11-29T12:13:07.077 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.62 smithi062.front.sepia.ceph.com smithi062 2019-11-29T12:13:07.077 INFO:teuthology.orchestra.run.smithi062:> sudo hostname smithi062 2019-11-29T12:13:07.239 INFO:teuthology.orchestra.run.smithi062:> sudo sed -i -e 's/smithi062/smithi062/g' /etc/hosts 2019-11-29T12:13:07.361 INFO:teuthology.orchestra.run.smithi062:> sudo sed -i -e 's/172.21.15.62/172.21.15.62/g' /etc/hosts 2019-11-29T12:13:07.475 INFO:teuthology.orchestra.run.smithi062:> sudo sed -i -e 's/smithi062/smithi062/g' /etc/hostname 2019-11-29T12:13:07.564 INFO:teuthology.orchestra.run.smithi062:> sudo hostname smithi062 2019-11-29T12:13:07.647 INFO:teuthology.provision.fog.smithi062:Deploy complete! 2019-11-29T12:13:07.649 DEBUG:teuthology.parallel:result is None 2019-11-29T12:13:07.850 INFO:teuthology.lock.ops:Checking smithi062.front.sepia.ceph.com 2019-11-29T12:13:07.851 INFO:teuthology.lock.ops:New key found. Updating... 2019-11-29T12:13:07.875 INFO:teuthology.lock.ops:Checking smithi022.front.sepia.ceph.com 2019-11-29T12:13:07.875 INFO:teuthology.lock.ops:New key found. Updating... 2019-11-29T12:13:07.891 INFO:teuthology.lock.ops:Updating [smithi062.front.sepia.ceph.com]: set os type and version on server 2019-11-29T12:13:07.892 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-29T12:13:07.893 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi062.front.sepia.ceph.com', 'timeout': 60} 2019-11-29T12:13:07.994 INFO:teuthology.orchestra.run.smithi062:> true 2019-11-29T12:13:08.413 INFO:teuthology.orchestra.run.smithi062:> uname -m 2019-11-29T12:13:08.477 INFO:teuthology.orchestra.run.smithi062.stdout:x86_64 2019-11-29T12:13:08.478 INFO:teuthology.orchestra.run.smithi062:> cat /etc/os-release 2019-11-29T12:13:08.547 INFO:teuthology.orchestra.run.smithi062.stdout:NAME="CentOS Linux" 2019-11-29T12:13:08.548 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION="7 (Core)" 2019-11-29T12:13:08.548 INFO:teuthology.orchestra.run.smithi062.stdout:ID="centos" 2019-11-29T12:13:08.548 INFO:teuthology.orchestra.run.smithi062.stdout:ID_LIKE="rhel fedora" 2019-11-29T12:13:08.548 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION_ID="7" 2019-11-29T12:13:08.548 INFO:teuthology.orchestra.run.smithi062.stdout:PRETTY_NAME="CentOS Linux 7 (Core)" 2019-11-29T12:13:08.548 INFO:teuthology.orchestra.run.smithi062.stdout:ANSI_COLOR="0;31" 2019-11-29T12:13:08.549 INFO:teuthology.orchestra.run.smithi062.stdout:CPE_NAME="cpe:/o:centos:centos:7" 2019-11-29T12:13:08.549 INFO:teuthology.orchestra.run.smithi062.stdout:HOME_URL="https://www.centos.org/" 2019-11-29T12:13:08.549 INFO:teuthology.orchestra.run.smithi062.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2019-11-29T12:13:08.549 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:13:08.549 INFO:teuthology.orchestra.run.smithi062.stdout:CENTOS_MANTISBT_PROJECT="CentOS-7" 2019-11-29T12:13:08.549 INFO:teuthology.orchestra.run.smithi062.stdout:CENTOS_MANTISBT_PROJECT_VERSION="7" 2019-11-29T12:13:08.549 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2019-11-29T12:13:08.550 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="7" 2019-11-29T12:13:08.550 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:13:08.550 INFO:teuthology.lock.ops:Updating smithi062.front.sepia.ceph.com on lock server 2019-11-29T12:13:08.565 INFO:teuthology.lock.ops:Updating [smithi022.front.sepia.ceph.com]: set os type and version on server 2019-11-29T12:13:08.566 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-29T12:13:08.566 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi022.front.sepia.ceph.com', 'timeout': 60} 2019-11-29T12:13:08.666 INFO:teuthology.orchestra.run.smithi022:> true 2019-11-29T12:13:09.096 INFO:teuthology.orchestra.run.smithi022:> uname -m 2019-11-29T12:13:09.166 INFO:teuthology.orchestra.run.smithi022.stdout:x86_64 2019-11-29T12:13:09.166 INFO:teuthology.orchestra.run.smithi022:> cat /etc/os-release 2019-11-29T12:13:09.231 INFO:teuthology.orchestra.run.smithi022.stdout:NAME="CentOS Linux" 2019-11-29T12:13:09.231 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION="7 (Core)" 2019-11-29T12:13:09.231 INFO:teuthology.orchestra.run.smithi022.stdout:ID="centos" 2019-11-29T12:13:09.231 INFO:teuthology.orchestra.run.smithi022.stdout:ID_LIKE="rhel fedora" 2019-11-29T12:13:09.231 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION_ID="7" 2019-11-29T12:13:09.231 INFO:teuthology.orchestra.run.smithi022.stdout:PRETTY_NAME="CentOS Linux 7 (Core)" 2019-11-29T12:13:09.232 INFO:teuthology.orchestra.run.smithi022.stdout:ANSI_COLOR="0;31" 2019-11-29T12:13:09.232 INFO:teuthology.orchestra.run.smithi022.stdout:CPE_NAME="cpe:/o:centos:centos:7" 2019-11-29T12:13:09.232 INFO:teuthology.orchestra.run.smithi022.stdout:HOME_URL="https://www.centos.org/" 2019-11-29T12:13:09.232 INFO:teuthology.orchestra.run.smithi022.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2019-11-29T12:13:09.232 INFO:teuthology.orchestra.run.smithi022.stdout: 2019-11-29T12:13:09.232 INFO:teuthology.orchestra.run.smithi022.stdout:CENTOS_MANTISBT_PROJECT="CentOS-7" 2019-11-29T12:13:09.233 INFO:teuthology.orchestra.run.smithi022.stdout:CENTOS_MANTISBT_PROJECT_VERSION="7" 2019-11-29T12:13:09.233 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2019-11-29T12:13:09.233 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="7" 2019-11-29T12:13:09.233 INFO:teuthology.orchestra.run.smithi022.stdout: 2019-11-29T12:13:09.234 INFO:teuthology.lock.ops:Updating smithi022.front.sepia.ceph.com on lock server 2019-11-29T12:13:09.250 INFO:teuthology.task.internal.lock_machines:2 smithi machines locked this try, 2/2 locked so far 2019-11-29T12:13:09.288 INFO:teuthology.task.internal.lock_machines:Locked targets: smithi022.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDm/x8c1kfyNunZ3EzvTi8PfYoLmp/q7nUVTBR288AN7MyTC7lRycGMxw3ZKs1KwWDCOevNLGZwOCMM9W6o+0nbjw6aBhpbQeFgkqg9ebMNqcvQRdAWjqnlKdL0QTcJ6KSiFdJEo3/IML2KxJ8PDpKdXoZSyPjdE83+lYcu01iCS2rrEasHcnXGagRlsMCN68Xo9CdB967zqr6ttpkpLFq8H2i/7j/9IzCU2S+9I9fj1CPKerPgJMNZiDxVHNQFhy0CnBKBOaST1kIv38YP/xjSfWkiuHU/XbPtwlYy1AzpH9ItbxhMkDkYLcLPkOu7rC6UocnD/j2NyPQ4x2mNQfg9 smithi062.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5+hf6FdqYFqh+AynmSxXQC5nbKMDF+q/g+G34IVXHpFRr4NAJrSWmKciu+zKJ47HLNjOJbcEnoZyXMHi1JXzMSG/VZYUt9bMfJSh+WxRjx2D+ZYr9cxdwpJ6+K7Jt8Ycc2Zx0zUo5HYmYUtCFGhLj/zojIaZg+eXpkm1jtxgXhRMnok1kzfpMbrhXCAiTf0olRJ7iIIcaJ2Cmacmsd+RVJ/TAgsqFJt7ATKajTul5XLKd++5t9CeIBNstKwn/aYaE68ZXBlLyD2oEGs7qe8ky8P8wK2mhEpm+2evuP+6bbHWXDknDdDrQ8zO+J7UpLtSRWQ/upR/hQpyCKM2NVvsj 2019-11-29T12:13:09.288 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2019-11-29T12:13:09.336 INFO:teuthology.run_tasks:Running task internal.save_config... 2019-11-29T12:13:09.342 INFO:teuthology.task.internal:Saving configuration 2019-11-29T12:13:09.381 INFO:teuthology.run_tasks:Running task internal.check_lock... 2019-11-29T12:13:09.407 INFO:teuthology.task.internal.check_lock:Checking locks... 2019-11-29T12:13:09.422 DEBUG:teuthology.task.internal.check_lock:machine status is {u'is_vm': False, u'locked': True, u'locked_since': u'2019-11-29 12:07:48.693845', u'locked_by': u'scheduled_yuvalif@teuthology', u'up': True, u'mac_address': None, u'name': u'smithi062.front.sepia.ceph.com', u'os_version': u'7', u'machine_type': u'smithi', u'vm_host': None, u'os_type': u'centos', u'arch': u'x86_64', u'ssh_pub_key': u'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKHxArmW5z9SqxAGvO8QBYiCC8mIbVKgv1sp5oDNe5Jq4Yt08dV28IIplzZlpqs0r+KUpRDV702bezZPAniKviw=', u'description': u'/home/teuthworker/archive/yuvalif-2019-11-29_09:46:32-rgw:verify-wip-yuval-master-distro-basic-smithi/4552909'} 2019-11-29T12:13:09.435 DEBUG:teuthology.task.internal.check_lock:machine status is {u'is_vm': False, u'locked': True, u'locked_since': u'2019-11-29 12:07:48.693826', u'locked_by': u'scheduled_yuvalif@teuthology', u'up': True, u'mac_address': None, u'name': u'smithi022.front.sepia.ceph.com', u'os_version': u'7', u'machine_type': u'smithi', u'vm_host': None, u'os_type': u'centos', u'arch': u'x86_64', u'ssh_pub_key': u'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFtfTKs/hqMl0QYSV81rD5EqD9gqv6fpDSD3T3kzwuxLDbbsZCWsTnqbAMr4JIP4i5ZXSh0DshQe8yoTf9Dun8k=', u'description': u'/home/teuthworker/archive/yuvalif-2019-11-29_09:46:32-rgw:verify-wip-yuval-master-distro-basic-smithi/4552909'} 2019-11-29T12:13:09.436 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2019-11-29T12:13:09.448 INFO:teuthology.task.internal:roles: ubuntu@smithi062.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2019-11-29T12:13:09.448 INFO:teuthology.task.internal:roles: ubuntu@smithi022.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1'] 2019-11-29T12:13:09.448 INFO:teuthology.run_tasks:Running task console_log... 2019-11-29T12:13:09.638 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=, signals=[15]) 2019-11-29T12:13:09.639 INFO:teuthology.run_tasks:Running task internal.connect... 2019-11-29T12:13:09.650 INFO:teuthology.task.internal:Opening connections... 2019-11-29T12:13:09.650 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi022.front.sepia.ceph.com 2019-11-29T12:13:09.651 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi022.front.sepia.ceph.com', 'timeout': 60} 2019-11-29T12:13:09.754 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi062.front.sepia.ceph.com 2019-11-29T12:13:09.755 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi062.front.sepia.ceph.com', 'timeout': 60} 2019-11-29T12:13:09.855 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2019-11-29T12:13:09.865 INFO:teuthology.orchestra.run.smithi022:> uname -m 2019-11-29T12:13:10.080 INFO:teuthology.orchestra.run.smithi022.stdout:x86_64 2019-11-29T12:13:10.081 INFO:teuthology.orchestra.run.smithi022:> cat /etc/os-release 2019-11-29T12:13:10.153 INFO:teuthology.orchestra.run.smithi022.stdout:NAME="CentOS Linux" 2019-11-29T12:13:10.154 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION="7 (Core)" 2019-11-29T12:13:10.154 INFO:teuthology.orchestra.run.smithi022.stdout:ID="centos" 2019-11-29T12:13:10.154 INFO:teuthology.orchestra.run.smithi022.stdout:ID_LIKE="rhel fedora" 2019-11-29T12:13:10.154 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION_ID="7" 2019-11-29T12:13:10.154 INFO:teuthology.orchestra.run.smithi022.stdout:PRETTY_NAME="CentOS Linux 7 (Core)" 2019-11-29T12:13:10.155 INFO:teuthology.orchestra.run.smithi022.stdout:ANSI_COLOR="0;31" 2019-11-29T12:13:10.155 INFO:teuthology.orchestra.run.smithi022.stdout:CPE_NAME="cpe:/o:centos:centos:7" 2019-11-29T12:13:10.155 INFO:teuthology.orchestra.run.smithi022.stdout:HOME_URL="https://www.centos.org/" 2019-11-29T12:13:10.155 INFO:teuthology.orchestra.run.smithi022.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2019-11-29T12:13:10.155 INFO:teuthology.orchestra.run.smithi022.stdout: 2019-11-29T12:13:10.156 INFO:teuthology.orchestra.run.smithi022.stdout:CENTOS_MANTISBT_PROJECT="CentOS-7" 2019-11-29T12:13:10.156 INFO:teuthology.orchestra.run.smithi022.stdout:CENTOS_MANTISBT_PROJECT_VERSION="7" 2019-11-29T12:13:10.156 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2019-11-29T12:13:10.156 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="7" 2019-11-29T12:13:10.157 INFO:teuthology.orchestra.run.smithi022.stdout: 2019-11-29T12:13:10.157 INFO:teuthology.lock.ops:Updating smithi022.front.sepia.ceph.com on lock server 2019-11-29T12:13:10.173 INFO:teuthology.orchestra.run.smithi062:> uname -m 2019-11-29T12:13:10.298 INFO:teuthology.orchestra.run.smithi062.stdout:x86_64 2019-11-29T12:13:10.298 INFO:teuthology.orchestra.run.smithi062:> cat /etc/os-release 2019-11-29T12:13:10.370 INFO:teuthology.orchestra.run.smithi062.stdout:NAME="CentOS Linux" 2019-11-29T12:13:10.370 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION="7 (Core)" 2019-11-29T12:13:10.371 INFO:teuthology.orchestra.run.smithi062.stdout:ID="centos" 2019-11-29T12:13:10.371 INFO:teuthology.orchestra.run.smithi062.stdout:ID_LIKE="rhel fedora" 2019-11-29T12:13:10.371 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION_ID="7" 2019-11-29T12:13:10.371 INFO:teuthology.orchestra.run.smithi062.stdout:PRETTY_NAME="CentOS Linux 7 (Core)" 2019-11-29T12:13:10.371 INFO:teuthology.orchestra.run.smithi062.stdout:ANSI_COLOR="0;31" 2019-11-29T12:13:10.371 INFO:teuthology.orchestra.run.smithi062.stdout:CPE_NAME="cpe:/o:centos:centos:7" 2019-11-29T12:13:10.371 INFO:teuthology.orchestra.run.smithi062.stdout:HOME_URL="https://www.centos.org/" 2019-11-29T12:13:10.371 INFO:teuthology.orchestra.run.smithi062.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2019-11-29T12:13:10.372 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:13:10.372 INFO:teuthology.orchestra.run.smithi062.stdout:CENTOS_MANTISBT_PROJECT="CentOS-7" 2019-11-29T12:13:10.372 INFO:teuthology.orchestra.run.smithi062.stdout:CENTOS_MANTISBT_PROJECT_VERSION="7" 2019-11-29T12:13:10.372 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2019-11-29T12:13:10.372 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="7" 2019-11-29T12:13:10.372 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:13:10.373 INFO:teuthology.lock.ops:Updating smithi062.front.sepia.ceph.com on lock server 2019-11-29T12:13:10.386 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2019-11-29T12:13:10.413 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2019-11-29T12:13:10.423 INFO:teuthology.task.internal:Checking for old test directory... 2019-11-29T12:13:10.424 INFO:teuthology.orchestra.run.smithi022:> test '!' -e /home/ubuntu/cephtest 2019-11-29T12:13:10.429 INFO:teuthology.orchestra.run.smithi062:> test '!' -e /home/ubuntu/cephtest 2019-11-29T12:13:10.509 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2019-11-29T12:13:10.520 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2019-11-29T12:13:10.520 INFO:teuthology.orchestra.run.smithi022:> test -z $(ls -A /var/lib/ceph) 2019-11-29T12:13:10.526 INFO:teuthology.orchestra.run.smithi062:> test -z $(ls -A /var/lib/ceph) 2019-11-29T12:13:10.628 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2019-11-29T12:13:10.669 INFO:teuthology.run_tasks:Running task kernel... 2019-11-29T12:13:10.701 DEBUG:teuthology.task.kernel:normalized config {'mon.a': {'sha1': 'distro', 'kdb': True}, 'mon.c': {'sha1': 'distro', 'kdb': True}, 'mon.b': {'sha1': 'distro', 'kdb': True}, 'osd.1': {'sha1': 'distro', 'kdb': True}, 'osd.0': {'sha1': 'distro', 'kdb': True}, 'client.1': {'sha1': 'distro', 'kdb': True}, 'osd.2': {'sha1': 'distro', 'kdb': True}, 'osd.5': {'sha1': 'distro', 'kdb': True}, 'osd.4': {'sha1': 'distro', 'kdb': True}, 'osd.7': {'sha1': 'distro', 'kdb': True}, 'osd.6': {'sha1': 'distro', 'kdb': True}, 'mgr.y': {'sha1': 'distro', 'kdb': True}, 'mgr.x': {'sha1': 'distro', 'kdb': True}, 'osd.3': {'sha1': 'distro', 'kdb': True}, 'client.0': {'sha1': 'distro', 'kdb': True}} 2019-11-29T12:13:10.702 INFO:teuthology.task.kernel:config {'mon.a': {'sha1': 'distro', 'kdb': True}, 'mon.b': {'sha1': 'distro', 'kdb': True}}, timeout 300 2019-11-29T12:13:10.702 INFO:teuthology.task.kernel:Removing old kernels from ubuntu@smithi022.front.sepia.ceph.com 2019-11-29T12:13:10.702 INFO:teuthology.orchestra.run.smithi022:> sudo package-cleanup -y --oldkernels 2019-11-29T12:13:11.570 INFO:teuthology.orchestra.run.smithi022.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-29T12:13:14.775 INFO:teuthology.orchestra.run.smithi022.stdout:No old kernels to remove 2019-11-29T12:13:14.791 INFO:teuthology.task.kernel:Removing old kernels from ubuntu@smithi062.front.sepia.ceph.com 2019-11-29T12:13:14.791 INFO:teuthology.orchestra.run.smithi062:> sudo package-cleanup -y --oldkernels 2019-11-29T12:13:15.707 INFO:teuthology.orchestra.run.smithi062.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-29T12:13:18.607 INFO:teuthology.orchestra.run.smithi062.stdout:No old kernels to remove 2019-11-29T12:13:18.629 INFO:teuthology.orchestra.run.smithi062:> uname -r 2019-11-29T12:13:18.725 INFO:teuthology.orchestra.run.smithi062.stdout:3.10.0-1062.4.1.el7.x86_64 2019-11-29T12:13:18.725 INFO:teuthology.task.kernel:Running kernel on smithi062: 3.10.0-1062.4.1.el7.x86_64 2019-11-29T12:13:18.726 INFO:teuthology.orchestra.run.smithi062:> sudo yum install -y kernel 2019-11-29T12:13:18.969 INFO:teuthology.orchestra.run.smithi062.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-29T12:13:19.009 INFO:teuthology.orchestra.run.smithi062.stdout:Determining fastest mirrors 2019-11-29T12:13:19.245 INFO:teuthology.orchestra.run.smithi062.stdout: * base: mirror.us-midwest-1.nexcess.net 2019-11-29T12:13:19.246 INFO:teuthology.orchestra.run.smithi062.stdout: * epel: ftp.linux.ncsu.edu 2019-11-29T12:13:19.247 INFO:teuthology.orchestra.run.smithi062.stdout: * extras: mirror.rackspace.com 2019-11-29T12:13:19.247 INFO:teuthology.orchestra.run.smithi062.stdout: * updates: reflector.westga.edu 2019-11-29T12:13:21.056 INFO:teuthology.orchestra.run.smithi062.stdout:Resolving Dependencies 2019-11-29T12:13:21.056 INFO:teuthology.orchestra.run.smithi062.stdout:--> Running transaction check 2019-11-29T12:13:21.057 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package kernel.x86_64 0:3.10.0-1062.4.3.el7 will be installed 2019-11-29T12:13:22.346 INFO:teuthology.orchestra.run.smithi062.stdout:--> Finished Dependency Resolution 2019-11-29T12:13:23.146 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:13:23.147 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies Resolved 2019-11-29T12:13:23.148 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:13:23.148 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2019-11-29T12:13:23.148 INFO:teuthology.orchestra.run.smithi062.stdout: Package Arch Version Repository Size 2019-11-29T12:13:23.148 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2019-11-29T12:13:23.149 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2019-11-29T12:13:23.149 INFO:teuthology.orchestra.run.smithi062.stdout: kernel x86_64 3.10.0-1062.4.3.el7 updates 50 M 2019-11-29T12:13:23.149 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:13:23.149 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2019-11-29T12:13:23.149 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2019-11-29T12:13:23.149 INFO:teuthology.orchestra.run.smithi062.stdout:Install 1 Package 2019-11-29T12:13:23.149 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:13:23.150 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 50 M 2019-11-29T12:13:23.150 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 64 M 2019-11-29T12:13:23.150 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading packages: 2019-11-29T12:13:23.150 INFO:teuthology.orchestra.run.smithi062.stdout:Delta RPMs disabled because /usr/bin/applydeltarpm not installed. 2019-11-29T12:13:26.512 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2019-11-29T12:13:26.717 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2019-11-29T12:13:27.626 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded 2019-11-29T12:13:27.627 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2019-11-29T12:14:04.785 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : kernel-3.10.0-1062.4.3.el7.x86_64 1/1 2019-11-29T12:14:05.321 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : kernel-3.10.0-1062.4.3.el7.x86_64 1/1 2019-11-29T12:14:05.321 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:14:05.322 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2019-11-29T12:14:05.322 INFO:teuthology.orchestra.run.smithi062.stdout: kernel.x86_64 0:3.10.0-1062.4.3.el7 2019-11-29T12:14:05.322 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:14:05.322 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2019-11-29T12:14:05.373 INFO:teuthology.orchestra.run.smithi062:> rpm -q kernel --last | head -n 1 2019-11-29T12:14:05.850 INFO:teuthology.orchestra.run.smithi062.stdout:kernel-3.10.0-1062.4.3.el7.x86_64 Fri 29 Nov 2019 12:13:30 PM UTC 2019-11-29T12:14:05.853 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 3.10.0-1062.4.3.el7.x86_64 2019-11-29T12:14:05.853 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 3.10.0-1062.4.1.el7.x86_64 Expected: 3.10.0-1062.4.3.el7.x86_64 2019-11-29T12:14:05.853 INFO:teuthology.orchestra.run.smithi022:> uname -r 2019-11-29T12:14:05.953 INFO:teuthology.orchestra.run.smithi022.stdout:3.10.0-1062.4.1.el7.x86_64 2019-11-29T12:14:05.955 INFO:teuthology.task.kernel:Running kernel on smithi022: 3.10.0-1062.4.1.el7.x86_64 2019-11-29T12:14:05.955 INFO:teuthology.orchestra.run.smithi022:> sudo yum install -y kernel 2019-11-29T12:14:06.252 INFO:teuthology.orchestra.run.smithi022.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-29T12:14:06.325 INFO:teuthology.orchestra.run.smithi022.stdout:Determining fastest mirrors 2019-11-29T12:14:06.511 INFO:teuthology.orchestra.run.smithi022.stdout: * base: mirror.us-midwest-1.nexcess.net 2019-11-29T12:14:06.512 INFO:teuthology.orchestra.run.smithi022.stdout: * epel: ftp.linux.ncsu.edu 2019-11-29T12:14:06.512 INFO:teuthology.orchestra.run.smithi022.stdout: * extras: www.gtlib.gatech.edu 2019-11-29T12:14:06.513 INFO:teuthology.orchestra.run.smithi022.stdout: * updates: reflector.westga.edu 2019-11-29T12:14:08.732 INFO:teuthology.orchestra.run.smithi022.stdout:Resolving Dependencies 2019-11-29T12:14:08.733 INFO:teuthology.orchestra.run.smithi022.stdout:--> Running transaction check 2019-11-29T12:14:08.733 INFO:teuthology.orchestra.run.smithi022.stdout:---> Package kernel.x86_64 0:3.10.0-1062.4.3.el7 will be installed 2019-11-29T12:14:10.003 INFO:teuthology.orchestra.run.smithi022.stdout:--> Finished Dependency Resolution 2019-11-29T12:14:10.782 INFO:teuthology.orchestra.run.smithi022.stdout: 2019-11-29T12:14:10.782 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies Resolved 2019-11-29T12:14:10.801 INFO:teuthology.orchestra.run.smithi022.stdout: 2019-11-29T12:14:10.801 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2019-11-29T12:14:10.801 INFO:teuthology.orchestra.run.smithi022.stdout: Package Arch Version Repository Size 2019-11-29T12:14:10.802 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2019-11-29T12:14:10.802 INFO:teuthology.orchestra.run.smithi022.stdout:Installing: 2019-11-29T12:14:10.802 INFO:teuthology.orchestra.run.smithi022.stdout: kernel x86_64 3.10.0-1062.4.3.el7 updates 50 M 2019-11-29T12:14:10.802 INFO:teuthology.orchestra.run.smithi022.stdout: 2019-11-29T12:14:10.802 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction Summary 2019-11-29T12:14:10.802 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2019-11-29T12:14:10.802 INFO:teuthology.orchestra.run.smithi022.stdout:Install 1 Package 2019-11-29T12:14:10.803 INFO:teuthology.orchestra.run.smithi022.stdout: 2019-11-29T12:14:10.803 INFO:teuthology.orchestra.run.smithi022.stdout:Total download size: 50 M 2019-11-29T12:14:10.803 INFO:teuthology.orchestra.run.smithi022.stdout:Installed size: 64 M 2019-11-29T12:14:10.803 INFO:teuthology.orchestra.run.smithi022.stdout:Downloading packages: 2019-11-29T12:14:10.816 INFO:teuthology.orchestra.run.smithi022.stdout:Delta RPMs disabled because /usr/bin/applydeltarpm not installed. 2019-11-29T12:14:14.399 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction check 2019-11-29T12:14:14.588 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction test 2019-11-29T12:14:15.447 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction test succeeded 2019-11-29T12:14:15.448 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction 2019-11-29T12:14:51.919 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : kernel-3.10.0-1062.4.3.el7.x86_64 1/1 2019-11-29T12:14:52.440 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : kernel-3.10.0-1062.4.3.el7.x86_64 1/1 2019-11-29T12:14:52.441 INFO:teuthology.orchestra.run.smithi022.stdout: 2019-11-29T12:14:52.441 INFO:teuthology.orchestra.run.smithi022.stdout:Installed: 2019-11-29T12:14:52.441 INFO:teuthology.orchestra.run.smithi022.stdout: kernel.x86_64 0:3.10.0-1062.4.3.el7 2019-11-29T12:14:52.441 INFO:teuthology.orchestra.run.smithi022.stdout: 2019-11-29T12:14:52.441 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2019-11-29T12:14:52.495 INFO:teuthology.orchestra.run.smithi022:> rpm -q kernel --last | head -n 1 2019-11-29T12:14:52.902 INFO:teuthology.orchestra.run.smithi022.stdout:kernel-3.10.0-1062.4.3.el7.x86_64 Fri 29 Nov 2019 12:14:18 PM UTC 2019-11-29T12:14:52.905 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 3.10.0-1062.4.3.el7.x86_64 2019-11-29T12:14:52.905 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 3.10.0-1062.4.1.el7.x86_64 Expected: 3.10.0-1062.4.3.el7.x86_64 2019-11-29T12:14:52.905 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2019-11-29T12:14:52.905 DEBUG:teuthology.task.kernel:src is distro, skipping download 2019-11-29T12:14:52.906 DEBUG:teuthology.task.kernel:src is distro, skipping download 2019-11-29T12:14:52.906 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2019-11-29T12:14:52.906 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi062.front.sepia.ceph.com, path=None, version=distro) 2019-11-29T12:14:52.906 INFO:teuthology.orchestra.run.smithi062:> rpm -q kernel --last | head -n 1 2019-11-29T12:14:53.280 INFO:teuthology.orchestra.run.smithi062.stdout:kernel-3.10.0-1062.4.3.el7.x86_64 Fri 29 Nov 2019 12:13:30 PM UTC 2019-11-29T12:14:53.282 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 3.10.0-1062.4.3.el7.x86_64 2019-11-29T12:14:53.283 INFO:teuthology.orchestra.run.smithi062:> sudo rpm -qi grub2 2019-11-29T12:14:53.419 INFO:teuthology.orchestra.run.smithi062.stdout:Name : grub2 2019-11-29T12:14:53.419 INFO:teuthology.orchestra.run.smithi062.stdout:Epoch : 1 2019-11-29T12:14:53.419 INFO:teuthology.orchestra.run.smithi062.stdout:Version : 2.02 2019-11-29T12:14:53.419 INFO:teuthology.orchestra.run.smithi062.stdout:Release : 0.76.el7.centos 2019-11-29T12:14:53.419 INFO:teuthology.orchestra.run.smithi062.stdout:Architecture: x86_64 2019-11-29T12:14:53.419 INFO:teuthology.orchestra.run.smithi062.stdout:Install Date: Tue 05 Nov 2019 03:41:14 PM UTC 2019-11-29T12:14:53.420 INFO:teuthology.orchestra.run.smithi062.stdout:Group : System Environment/Base 2019-11-29T12:14:53.420 INFO:teuthology.orchestra.run.smithi062.stdout:Size : 0 2019-11-29T12:14:53.420 INFO:teuthology.orchestra.run.smithi062.stdout:License : GPLv3+ 2019-11-29T12:14:53.420 INFO:teuthology.orchestra.run.smithi062.stdout:Signature : RSA/SHA256, Mon 12 Nov 2018 02:28:06 PM UTC, Key ID 24c6a8a7f4a80eb5 2019-11-29T12:14:53.420 INFO:teuthology.orchestra.run.smithi062.stdout:Source RPM : grub2-2.02-0.76.el7.centos.src.rpm 2019-11-29T12:14:53.420 INFO:teuthology.orchestra.run.smithi062.stdout:Build Date : Fri 09 Nov 2018 12:58:43 AM UTC 2019-11-29T12:14:53.421 INFO:teuthology.orchestra.run.smithi062.stdout:Build Host : kbuilder.bsys.centos.org 2019-11-29T12:14:53.421 INFO:teuthology.orchestra.run.smithi062.stdout:Relocations : (not relocatable) 2019-11-29T12:14:53.421 INFO:teuthology.orchestra.run.smithi062.stdout:Packager : CentOS BuildSystem 2019-11-29T12:14:53.421 INFO:teuthology.orchestra.run.smithi062.stdout:Vendor : CentOS 2019-11-29T12:14:53.421 INFO:teuthology.orchestra.run.smithi062.stdout:URL : http://www.gnu.org/software/grub/ 2019-11-29T12:14:53.421 INFO:teuthology.orchestra.run.smithi062.stdout:Summary : Bootloader with support for Linux, Multiboot and more 2019-11-29T12:14:53.421 INFO:teuthology.orchestra.run.smithi062.stdout:Description : 2019-11-29T12:14:53.421 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:14:53.422 INFO:teuthology.orchestra.run.smithi062.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2019-11-29T12:14:53.422 INFO:teuthology.orchestra.run.smithi062.stdout:customizable bootloader with modular architecture. It supports a rich 2019-11-29T12:14:53.422 INFO:teuthology.orchestra.run.smithi062.stdout:variety of kernel formats, file systems, computer architectures and 2019-11-29T12:14:53.422 INFO:teuthology.orchestra.run.smithi062.stdout:hardware devices. 2019-11-29T12:14:53.423 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2019-11-29T12:14:53.423 INFO:teuthology.task.kernel:Updating grub on smithi062 to boot 3.10.0-1062.4.3.el7.x86_64 2019-11-29T12:14:53.423 INFO:teuthology.orchestra.run.smithi062:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2019-11-29T12:14:53.941 INFO:teuthology.orchestra.run.smithi062.stderr:Generating grub configuration file ... 2019-11-29T12:14:54.079 INFO:teuthology.orchestra.run.smithi062.stderr:Found linux image: /boot/vmlinuz-3.10.0-1062.4.3.el7.x86_64 2019-11-29T12:14:54.096 INFO:teuthology.orchestra.run.smithi062.stderr:Found initrd image: /boot/initramfs-3.10.0-1062.4.3.el7.x86_64.img 2019-11-29T12:14:54.400 INFO:teuthology.orchestra.run.smithi062.stderr:Found linux image: /boot/vmlinuz-3.10.0-1062.4.1.el7.x86_64 2019-11-29T12:14:54.421 INFO:teuthology.orchestra.run.smithi062.stderr:Found initrd image: /boot/initramfs-3.10.0-1062.4.1.el7.x86_64.img 2019-11-29T12:14:54.461 INFO:teuthology.orchestra.run.smithi062.stderr:Found linux image: /boot/vmlinuz-3.10.0-957.el7.x86_64 2019-11-29T12:14:54.480 INFO:teuthology.orchestra.run.smithi062.stderr:Found initrd image: /boot/initramfs-3.10.0-957.el7.x86_64.img 2019-11-29T12:14:54.512 INFO:teuthology.orchestra.run.smithi062.stderr:Found linux image: /boot/vmlinuz-0-rescue-a1739c9c60b14f0891126d2e603bb003 2019-11-29T12:14:54.522 INFO:teuthology.orchestra.run.smithi062.stderr:Found initrd image: /boot/initramfs-0-rescue-a1739c9c60b14f0891126d2e603bb003.img 2019-11-29T12:14:55.845 INFO:teuthology.orchestra.run.smithi062.stderr:done 2019-11-29T12:14:55.848 INFO:teuthology.orchestra.run.smithi062:> mktemp 2019-11-29T12:14:55.942 INFO:teuthology.orchestra.run.smithi062.stdout:/tmp/tmp.qieo75Z2vw 2019-11-29T12:14:55.942 INFO:teuthology.orchestra.run.smithi062:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.qieo75Z2vw 2019-11-29T12:14:56.057 INFO:teuthology.orchestra.run.smithi062:> sudo chmod 0666 /tmp/tmp.qieo75Z2vw 2019-11-29T12:14:56.400 DEBUG:teuthology.orchestra.remote:smithi062:/tmp/tmp.qieo75Z2vw is 6KB 2019-11-29T12:14:56.498 INFO:teuthology.orchestra.run.smithi062:> rm -fr /tmp/tmp.qieo75Z2vw 2019-11-29T12:14:56.582 INFO:teuthology.orchestra.run.smithi062:> sudo grub2-set-default 0 2019-11-29T12:14:56.765 INFO:teuthology.orchestra.run.smithi062:> sudo shutdown -r now 2019-11-29T12:14:56.770 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2019-11-29T12:14:56.770 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi022.front.sepia.ceph.com, path=None, version=distro) 2019-11-29T12:14:56.770 INFO:teuthology.orchestra.run.smithi022:> rpm -q kernel --last | head -n 1 2019-11-29T12:14:57.137 INFO:teuthology.orchestra.run.smithi022.stdout:kernel-3.10.0-1062.4.3.el7.x86_64 Fri 29 Nov 2019 12:14:18 PM UTC 2019-11-29T12:14:57.140 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 3.10.0-1062.4.3.el7.x86_64 2019-11-29T12:14:57.140 INFO:teuthology.orchestra.run.smithi022:> sudo rpm -qi grub2 2019-11-29T12:14:57.309 INFO:teuthology.orchestra.run.smithi022.stdout:Name : grub2 2019-11-29T12:14:57.309 INFO:teuthology.orchestra.run.smithi022.stdout:Epoch : 1 2019-11-29T12:14:57.310 INFO:teuthology.orchestra.run.smithi022.stdout:Version : 2.02 2019-11-29T12:14:57.310 INFO:teuthology.orchestra.run.smithi022.stdout:Release : 0.76.el7.centos 2019-11-29T12:14:57.310 INFO:teuthology.orchestra.run.smithi022.stdout:Architecture: x86_64 2019-11-29T12:14:57.310 INFO:teuthology.orchestra.run.smithi022.stdout:Install Date: Tue 05 Nov 2019 03:41:14 PM UTC 2019-11-29T12:14:57.311 INFO:teuthology.orchestra.run.smithi022.stdout:Group : System Environment/Base 2019-11-29T12:14:57.311 INFO:teuthology.orchestra.run.smithi022.stdout:Size : 0 2019-11-29T12:14:57.311 INFO:teuthology.orchestra.run.smithi022.stdout:License : GPLv3+ 2019-11-29T12:14:57.311 INFO:teuthology.orchestra.run.smithi022.stdout:Signature : RSA/SHA256, Mon 12 Nov 2018 02:28:06 PM UTC, Key ID 24c6a8a7f4a80eb5 2019-11-29T12:14:57.312 INFO:teuthology.orchestra.run.smithi022.stdout:Source RPM : grub2-2.02-0.76.el7.centos.src.rpm 2019-11-29T12:14:57.312 INFO:teuthology.orchestra.run.smithi022.stdout:Build Date : Fri 09 Nov 2018 12:58:43 AM UTC 2019-11-29T12:14:57.312 INFO:teuthology.orchestra.run.smithi022.stdout:Build Host : kbuilder.bsys.centos.org 2019-11-29T12:14:57.312 INFO:teuthology.orchestra.run.smithi022.stdout:Relocations : (not relocatable) 2019-11-29T12:14:57.313 INFO:teuthology.orchestra.run.smithi022.stdout:Packager : CentOS BuildSystem 2019-11-29T12:14:57.313 INFO:teuthology.orchestra.run.smithi022.stdout:Vendor : CentOS 2019-11-29T12:14:57.313 INFO:teuthology.orchestra.run.smithi022.stdout:URL : http://www.gnu.org/software/grub/ 2019-11-29T12:14:57.313 INFO:teuthology.orchestra.run.smithi022.stdout:Summary : Bootloader with support for Linux, Multiboot and more 2019-11-29T12:14:57.314 INFO:teuthology.orchestra.run.smithi022.stdout:Description : 2019-11-29T12:14:57.314 INFO:teuthology.orchestra.run.smithi022.stdout: 2019-11-29T12:14:57.314 INFO:teuthology.orchestra.run.smithi022.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2019-11-29T12:14:57.314 INFO:teuthology.orchestra.run.smithi022.stdout:customizable bootloader with modular architecture. It supports a rich 2019-11-29T12:14:57.314 INFO:teuthology.orchestra.run.smithi022.stdout:variety of kernel formats, file systems, computer architectures and 2019-11-29T12:14:57.315 INFO:teuthology.orchestra.run.smithi022.stdout:hardware devices. 2019-11-29T12:14:57.316 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2019-11-29T12:14:57.316 INFO:teuthology.task.kernel:Updating grub on smithi022 to boot 3.10.0-1062.4.3.el7.x86_64 2019-11-29T12:14:57.317 INFO:teuthology.orchestra.run.smithi022:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2019-11-29T12:14:57.773 INFO:teuthology.orchestra.run.smithi022.stderr:Generating grub configuration file ... 2019-11-29T12:14:57.908 INFO:teuthology.orchestra.run.smithi022.stderr:Found linux image: /boot/vmlinuz-3.10.0-1062.4.3.el7.x86_64 2019-11-29T12:14:57.923 INFO:teuthology.orchestra.run.smithi022.stderr:Found initrd image: /boot/initramfs-3.10.0-1062.4.3.el7.x86_64.img 2019-11-29T12:14:58.214 INFO:teuthology.orchestra.run.smithi022.stderr:Found linux image: /boot/vmlinuz-3.10.0-1062.4.1.el7.x86_64 2019-11-29T12:14:58.230 INFO:teuthology.orchestra.run.smithi022.stderr:Found initrd image: /boot/initramfs-3.10.0-1062.4.1.el7.x86_64.img 2019-11-29T12:14:58.267 INFO:teuthology.orchestra.run.smithi022.stderr:Found linux image: /boot/vmlinuz-3.10.0-957.el7.x86_64 2019-11-29T12:14:58.290 INFO:teuthology.orchestra.run.smithi022.stderr:Found initrd image: /boot/initramfs-3.10.0-957.el7.x86_64.img 2019-11-29T12:14:58.322 INFO:teuthology.orchestra.run.smithi022.stderr:Found linux image: /boot/vmlinuz-0-rescue-a1739c9c60b14f0891126d2e603bb003 2019-11-29T12:14:58.333 INFO:teuthology.orchestra.run.smithi022.stderr:Found initrd image: /boot/initramfs-0-rescue-a1739c9c60b14f0891126d2e603bb003.img 2019-11-29T12:14:59.500 INFO:teuthology.orchestra.run.smithi022.stderr:done 2019-11-29T12:14:59.502 INFO:teuthology.orchestra.run.smithi022:> mktemp 2019-11-29T12:14:59.576 INFO:teuthology.orchestra.run.smithi022.stdout:/tmp/tmp.7Gk2ed9bEc 2019-11-29T12:14:59.577 INFO:teuthology.orchestra.run.smithi022:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.7Gk2ed9bEc 2019-11-29T12:14:59.663 INFO:teuthology.orchestra.run.smithi022:> sudo chmod 0666 /tmp/tmp.7Gk2ed9bEc 2019-11-29T12:14:59.825 DEBUG:teuthology.orchestra.remote:smithi022:/tmp/tmp.7Gk2ed9bEc is 6KB 2019-11-29T12:14:59.897 INFO:teuthology.orchestra.run.smithi022:> rm -fr /tmp/tmp.7Gk2ed9bEc 2019-11-29T12:14:59.964 INFO:teuthology.orchestra.run.smithi022:> sudo grub2-set-default 0 2019-11-29T12:15:00.123 INFO:teuthology.orchestra.run.smithi022:> sudo shutdown -r now 2019-11-29T12:15:00.127 INFO:teuthology.misc:Re-opening connections... 2019-11-29T12:15:00.128 INFO:teuthology.misc:trying to connect to ubuntu@smithi022.front.sepia.ceph.com 2019-11-29T12:15:00.129 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-29T12:15:00.130 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi022.front.sepia.ceph.com', 'timeout': 60} 2019-11-29T12:15:00.230 INFO:teuthology.orchestra.run.smithi022:> true 2019-11-29T12:15:00.585 DEBUG:teuthology.misc:waited 0.457400083542 2019-11-29T12:15:01.585 INFO:teuthology.misc:trying to connect to ubuntu@smithi062.front.sepia.ceph.com 2019-11-29T12:15:01.586 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-29T12:15:01.586 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi062.front.sepia.ceph.com', 'timeout': 60} 2019-11-29T12:15:36.124 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.62 2019-11-29T12:15:36.125 DEBUG:teuthology.misc:waited 35.9971830845 2019-11-29T12:15:37.125 INFO:teuthology.misc:trying to connect to ubuntu@smithi062.front.sepia.ceph.com 2019-11-29T12:15:37.126 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-29T12:15:37.126 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi062.front.sepia.ceph.com', 'timeout': 60} 2019-11-29T12:15:40.184 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.62 2019-11-29T12:15:40.185 DEBUG:teuthology.misc:waited 40.0571410656 2019-11-29T12:15:41.185 INFO:teuthology.misc:trying to connect to ubuntu@smithi062.front.sepia.ceph.com 2019-11-29T12:15:41.186 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-29T12:15:41.186 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi062.front.sepia.ceph.com', 'timeout': 60} 2019-11-29T12:15:43.256 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.62 2019-11-29T12:15:43.257 DEBUG:teuthology.misc:waited 43.1290831566 2019-11-29T12:15:44.257 INFO:teuthology.misc:trying to connect to ubuntu@smithi062.front.sepia.ceph.com 2019-11-29T12:15:44.258 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-29T12:15:44.258 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi062.front.sepia.ceph.com', 'timeout': 60} 2019-11-29T12:15:46.332 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.62 2019-11-29T12:15:46.333 DEBUG:teuthology.misc:waited 46.2051010132 2019-11-29T12:15:47.333 INFO:teuthology.misc:trying to connect to ubuntu@smithi062.front.sepia.ceph.com 2019-11-29T12:15:47.333 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-29T12:15:47.334 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi062.front.sepia.ceph.com', 'timeout': 60} 2019-11-29T12:15:49.400 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.62 2019-11-29T12:15:49.401 DEBUG:teuthology.misc:waited 49.2731821537 2019-11-29T12:15:50.401 INFO:teuthology.misc:trying to connect to ubuntu@smithi062.front.sepia.ceph.com 2019-11-29T12:15:50.402 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-29T12:15:50.402 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi062.front.sepia.ceph.com', 'timeout': 60} 2019-11-29T12:15:52.472 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.62 2019-11-29T12:15:52.473 DEBUG:teuthology.misc:waited 52.345072031 2019-11-29T12:15:53.476 INFO:teuthology.misc:trying to connect to ubuntu@smithi062.front.sepia.ceph.com 2019-11-29T12:15:53.476 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-29T12:15:53.476 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi062.front.sepia.ceph.com', 'timeout': 60} 2019-11-29T12:15:55.544 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.62 2019-11-29T12:15:55.545 DEBUG:teuthology.misc:waited 55.4170851707 2019-11-29T12:15:56.545 INFO:teuthology.misc:trying to connect to ubuntu@smithi062.front.sepia.ceph.com 2019-11-29T12:15:56.546 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-29T12:15:56.546 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi062.front.sepia.ceph.com', 'timeout': 60} 2019-11-29T12:15:58.620 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.62 2019-11-29T12:15:58.621 DEBUG:teuthology.misc:waited 58.4931111336 2019-11-29T12:15:59.621 INFO:teuthology.misc:trying to connect to ubuntu@smithi062.front.sepia.ceph.com 2019-11-29T12:15:59.622 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-29T12:15:59.622 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi062.front.sepia.ceph.com', 'timeout': 60} 2019-11-29T12:16:01.692 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.62 2019-11-29T12:16:01.693 DEBUG:teuthology.misc:waited 61.5651400089 2019-11-29T12:16:02.693 INFO:teuthology.misc:trying to connect to ubuntu@smithi062.front.sepia.ceph.com 2019-11-29T12:16:02.693 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-29T12:16:02.694 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi062.front.sepia.ceph.com', 'timeout': 60} 2019-11-29T12:16:04.760 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.62 2019-11-29T12:16:04.761 DEBUG:teuthology.misc:waited 64.6331400871 2019-11-29T12:16:05.761 INFO:teuthology.misc:trying to connect to ubuntu@smithi062.front.sepia.ceph.com 2019-11-29T12:16:05.762 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-29T12:16:05.762 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi062.front.sepia.ceph.com', 'timeout': 60} 2019-11-29T12:16:07.836 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.62 2019-11-29T12:16:07.837 DEBUG:teuthology.misc:waited 67.7091560364 2019-11-29T12:16:08.837 INFO:teuthology.misc:trying to connect to ubuntu@smithi062.front.sepia.ceph.com 2019-11-29T12:16:08.838 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-29T12:16:08.838 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi062.front.sepia.ceph.com', 'timeout': 60} 2019-11-29T12:16:10.908 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.62 2019-11-29T12:16:10.909 DEBUG:teuthology.misc:waited 70.7811181545 2019-11-29T12:16:11.909 INFO:teuthology.misc:trying to connect to ubuntu@smithi062.front.sepia.ceph.com 2019-11-29T12:16:11.910 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-29T12:16:11.910 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi062.front.sepia.ceph.com', 'timeout': 60} 2019-11-29T12:17:11.912 DEBUG:teuthology.orchestra.remote:timed out 2019-11-29T12:17:11.912 DEBUG:teuthology.misc:waited 131.784842968 2019-11-29T12:17:12.913 INFO:teuthology.misc:trying to connect to ubuntu@smithi062.front.sepia.ceph.com 2019-11-29T12:17:12.913 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-29T12:17:12.913 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi062.front.sepia.ceph.com', 'timeout': 60} 2019-11-29T12:17:13.044 INFO:teuthology.orchestra.run.smithi062:> true 2019-11-29T12:17:13.481 DEBUG:teuthology.misc:waited 133.353294134 2019-11-29T12:17:14.482 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2019-11-29T12:17:14.482 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "3.10.0-1062.4.3.el7.x86_64"... 2019-11-29T12:17:14.482 INFO:teuthology.orchestra.run.smithi062:> uname -r 2019-11-29T12:17:14.589 INFO:teuthology.orchestra.run.smithi062.stdout:3.10.0-1062.4.3.el7.x86_64 2019-11-29T12:17:14.589 DEBUG:teuthology.task.kernel:current kernel version is 3.10.0-1062.4.3.el7.x86_64 2019-11-29T12:17:14.589 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2019-11-29T12:17:14.589 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2019-11-29T12:17:14.590 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "3.10.0-1062.4.3.el7.x86_64"... 2019-11-29T12:17:14.590 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-29T12:17:14.590 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi022.front.sepia.ceph.com', 'timeout': 60} 2019-11-29T12:17:14.723 INFO:teuthology.orchestra.run.smithi022:> true 2019-11-29T12:17:15.162 INFO:teuthology.orchestra.run.smithi022:> uname -r 2019-11-29T12:17:15.267 INFO:teuthology.orchestra.run.smithi022.stdout:3.10.0-1062.4.3.el7.x86_64 2019-11-29T12:17:15.267 DEBUG:teuthology.task.kernel:current kernel version is 3.10.0-1062.4.3.el7.x86_64 2019-11-29T12:17:15.267 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2019-11-29T12:17:16.268 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2019-11-29T12:17:16.268 INFO:teuthology.orchestra.run.smithi062:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2019-11-29T12:17:16.525 INFO:teuthology.orchestra.run.smithi062.stdout:ttyS1 2019-11-29T12:17:16.539 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2019-11-29T12:17:16.539 INFO:teuthology.orchestra.run.smithi022:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2019-11-29T12:17:16.695 INFO:teuthology.orchestra.run.smithi022.stdout:ttyS1 2019-11-29T12:17:16.709 INFO:teuthology.run_tasks:Running task internal.base... 2019-11-29T12:17:16.719 INFO:teuthology.task.internal:Creating test directory... 2019-11-29T12:17:16.719 INFO:teuthology.orchestra.run.smithi022:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2019-11-29T12:17:16.724 INFO:teuthology.orchestra.run.smithi062:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2019-11-29T12:17:16.813 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2019-11-29T12:17:16.823 INFO:teuthology.run_tasks:Running task internal.archive... 2019-11-29T12:17:16.835 INFO:teuthology.task.internal:Creating archive directory... 2019-11-29T12:17:16.836 INFO:teuthology.orchestra.run.smithi022:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2019-11-29T12:17:16.842 INFO:teuthology.orchestra.run.smithi062:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2019-11-29T12:17:16.932 INFO:teuthology.run_tasks:Running task internal.coredump... 2019-11-29T12:17:16.942 INFO:teuthology.task.internal:Enabling coredump saving... 2019-11-29T12:17:16.942 INFO:teuthology.orchestra.run.smithi022:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2019-11-29T12:17:16.947 INFO:teuthology.orchestra.run.smithi062:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2019-11-29T12:17:17.058 INFO:teuthology.orchestra.run.smithi022.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2019-11-29T12:17:17.059 INFO:teuthology.orchestra.run.smithi062.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2019-11-29T12:17:17.061 INFO:teuthology.run_tasks:Running task internal.sudo... 2019-11-29T12:17:17.071 INFO:teuthology.task.internal:Configuring sudo... 2019-11-29T12:17:17.072 INFO:teuthology.orchestra.run.smithi022:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2019-11-29T12:17:17.076 INFO:teuthology.orchestra.run.smithi062:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2019-11-29T12:17:17.183 INFO:teuthology.run_tasks:Running task internal.syslog... 2019-11-29T12:17:17.194 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2019-11-29T12:17:17.194 INFO:teuthology.orchestra.run.smithi022:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2019-11-29T12:17:17.199 INFO:teuthology.orchestra.run.smithi062:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2019-11-29T12:17:17.264 INFO:teuthology.orchestra.run.smithi022:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2019-11-29T12:17:17.347 INFO:teuthology.orchestra.run.smithi022:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2019-11-29T12:17:17.493 INFO:teuthology.orchestra.run.smithi022:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2019-11-29T12:17:17.600 INFO:teuthology.orchestra.run.smithi022:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2019-11-29T12:17:17.713 INFO:teuthology.orchestra.run.smithi022:> sudo sh -c 'cat > /etc/rsyslog.d/80-cephtest.conf' 2019-11-29T12:17:17.812 INFO:teuthology.orchestra.run.smithi062:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2019-11-29T12:17:17.923 INFO:teuthology.orchestra.run.smithi062:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2019-11-29T12:17:18.055 INFO:teuthology.orchestra.run.smithi062:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2019-11-29T12:17:18.146 INFO:teuthology.orchestra.run.smithi062:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2019-11-29T12:17:18.252 INFO:teuthology.orchestra.run.smithi062:> sudo sh -c 'cat > /etc/rsyslog.d/80-cephtest.conf' 2019-11-29T12:17:18.361 INFO:teuthology.orchestra.run.smithi022:> sudo service rsyslog restart 2019-11-29T12:17:18.366 INFO:teuthology.orchestra.run.smithi062:> sudo service rsyslog restart 2019-11-29T12:17:18.492 INFO:teuthology.orchestra.run.smithi062.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2019-11-29T12:17:18.511 INFO:teuthology.orchestra.run.smithi022.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2019-11-29T12:17:18.591 INFO:teuthology.run_tasks:Running task internal.timer... 2019-11-29T12:17:18.602 INFO:teuthology.task.internal:Starting timer... 2019-11-29T12:17:18.603 INFO:teuthology.run_tasks:Running task pcp... 2019-11-29T12:17:18.648 INFO:teuthology.run_tasks:Running task selinux... 2019-11-29T12:17:18.667 INFO:teuthology.orchestra.run.smithi022:> sudo service auditd rotate 2019-11-29T12:17:18.839 INFO:teuthology.orchestra.run.smithi022.stdout:Rotating logs: [ OK ] 2019-11-29T12:17:18.842 INFO:teuthology.orchestra.run.smithi062:> sudo service auditd rotate 2019-11-29T12:17:19.069 INFO:teuthology.orchestra.run.smithi062.stdout:Rotating logs: [ OK ] 2019-11-29T12:17:19.071 DEBUG:teuthology.task.selinux:Getting current SELinux state 2019-11-29T12:17:19.071 INFO:teuthology.orchestra.run.smithi022:> /usr/sbin/getenforce 2019-11-29T12:17:19.169 INFO:teuthology.orchestra.run.smithi022.stdout:Permissive 2019-11-29T12:17:19.170 INFO:teuthology.orchestra.run.smithi062:> /usr/sbin/getenforce 2019-11-29T12:17:19.269 INFO:teuthology.orchestra.run.smithi062.stdout:Permissive 2019-11-29T12:17:19.269 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi062.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi022.front.sepia.ceph.com': 'permissive'} 2019-11-29T12:17:19.270 INFO:teuthology.orchestra.run.smithi022:> sudo grep 'avc: .*denied' /var/log/audit/audit.log | grep -v '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\)' 2019-11-29T12:17:19.390 DEBUG:teuthology.orchestra.run:got remote process result: 1 2019-11-29T12:17:19.390 INFO:teuthology.orchestra.run.smithi062:> sudo grep 'avc: .*denied' /var/log/audit/audit.log | grep -v '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\)' 2019-11-29T12:17:19.506 DEBUG:teuthology.orchestra.run:got remote process result: 1 2019-11-29T12:17:19.506 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2019-11-29T12:17:19.507 INFO:teuthology.orchestra.run.smithi022:> sudo /usr/sbin/setenforce permissive 2019-11-29T12:17:19.627 INFO:teuthology.orchestra.run.smithi062:> sudo /usr/sbin/setenforce permissive 2019-11-29T12:17:19.752 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2019-11-29T12:17:19.763 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master was just updated; assuming it is current 2019-11-29T12:17:19.763 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master to branch origin/master 2019-11-29T12:17:19.797 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}] 2019-11-29T12:17:19.800 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi022.front.sepia.ceph.com,smithi062.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml 2019-11-29T12:17:20.175 INFO:teuthology.task.ansible.out:Using /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/ansible.cfg as config file 2019-11-29T12:17:23.933 INFO:teuthology.task.ansible.out: PLAY [all] ********************************************************************* 2019-11-29T12:17:23.955 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:17:23 +0000 (0:00:00.062) 0:00:00.063 ******* 2019-11-29T12:17:23.967 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:17:23 +0000 (0:00:00.011) 0:00:00.074 ******* 2019-11-29T12:17:27.177 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi022.front.sepia.ceph.com] 2019-11-29T12:17:27.256 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:17:27 +0000 (0:00:03.288) 0:00:03.363 ******* 2019-11-29T12:17:27.308 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] 2019-11-29T12:17:27.383 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:17:27 +0000 (0:00:00.127) 0:00:03.490 ******* 2019-11-29T12:17:27.718 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the sudo group.] ******************************** 2019-11-29T12:17:27.720 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2019-11-29T12:17:27.755 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:17:27 +0000 (0:00:00.372) 0:00:03.863 ******* 2019-11-29T12:17:27.761 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2019-11-29T12:17:27.800 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:17:27 +0000 (0:00:00.044) 0:00:03.908 ******* 2019-11-29T12:17:28.358 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the ansible user.] ****************************** 2019-11-29T12:17:28.358 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2019-11-29T12:17:28.360 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2019-11-29T12:17:28.397 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:17:28 +0000 (0:00:00.597) 0:00:04.505 ******* 2019-11-29T12:17:28.429 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:17:28 +0000 (0:00:00.031) 0:00:04.537 ******* 2019-11-29T12:17:28.433 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Delete the ansible users password.] ******************** 2019-11-29T12:17:28.434 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:17:28.473 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:17:28 +0000 (0:00:00.043) 0:00:04.580 ******* 2019-11-29T12:17:28.478 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:17:28.521 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:17:28 +0000 (0:00:00.048) 0:00:04.629 ******* 2019-11-29T12:17:28.909 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Ensure includedir is present in sudoers.] ************** 2019-11-29T12:17:28.911 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-11-29T12:17:28.947 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:17:28 +0000 (0:00:00.425) 0:00:05.054 ******* 2019-11-29T12:17:28.953 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-11-29T12:17:28.992 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:17:28 +0000 (0:00:00.044) 0:00:05.099 ******* 2019-11-29T12:17:30.421 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the cephlab_sudo sudoers.d file.] *************** 2019-11-29T12:17:30.422 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1575029848.96-134439033149821/source", "state": "file", "uid": 0} 2019-11-29T12:17:30.460 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:17:30 +0000 (0:00:01.468) 0:00:06.568 ******* 2019-11-29T12:17:30.466 INFO:teuthology.task.ansible.out:changed: [smithi022.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1575029849.01-179103943983233/source", "state": "file", "uid": 0} 2019-11-29T12:17:30.504 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:17:30 +0000 (0:00:00.043) 0:00:06.612 ******* 2019-11-29T12:17:31.057 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Add authorized keys for the ansible user.] ************* 2019-11-29T12:17:31.059 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-11-29T12:17:31.080 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-11-29T12:17:31.395 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} ok: [smithi022.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com) => 2019-11-29T12:17:31.397 INFO:teuthology.task.ansible.out:{"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-11-29T12:17:31.727 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} ok: [smithi062.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYh 2019-11-29T12:17:31.729 INFO:teuthology.task.ansible.out:JNZr zack@zack-cerzas-macbook-pro.local) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-11-29T12:17:32.026 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-11-29T12:17:32.047 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-11-29T12:17:32.335 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-11-29T12:17:32.388 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-11-29T12:17:32.666 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-11-29T12:17:32.729 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-11-29T12:17:32.986 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-11-29T12:17:33.025 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-11-29T12:17:33.140 INFO:teuthology.task.ansible.out: PLAY [teuthology] ************************************************************** skipping: no hosts matched 2019-11-29T12:17:33.146 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2019-11-29T12:17:33.324 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:17:33 +0000 (0:00:02.819) 0:00:09.431 ******* 2019-11-29T12:17:33.356 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:17:33 +0000 (0:00:00.032) 0:00:09.463 ******* 2019-11-29T12:17:34.289 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* 2019-11-29T12:17:34.290 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] 2019-11-29T12:17:34.369 INFO:teuthology.task.ansible.out: [WARNING]: Using run_once with the free strategy is not currently supported. This task will still be executed for every host in the inventory list. 2019-11-29T12:17:34.370 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:17:34 +0000 (0:00:01.013) 0:00:10.476 ******* 2019-11-29T12:17:34.379 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] 2019-11-29T12:17:34.461 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:17:34 +0000 (0:00:00.091) 0:00:10.568 ******* 2019-11-29T12:17:34.849 INFO:teuthology.task.ansible.out: TASK [users : Check keys_repo HEAD sha1] *************************************** 2019-11-29T12:17:34.851 INFO:teuthology.task.ansible.out:changed: [smithi022.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.211439", "end": "2019-11-29 12:17:34.823899", "rc": 0, "start": "2019-11-29 12:17:34.612460", "stderr": "", "stderr_lines": [], "stdout": "4334b3798f2061758a627b6bdd54d0cd6b822faa", "stdout_lines": ["4334b3798f2061758a627b6bdd54d0cd6b822faa"]} changed: [smithi062.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.213525", "end": "2019-11-29 12:17:34.825224", "rc": 0, "start": "2019-11-29 12:17:34.611699", "stderr": "", "stderr_lines": [], "stdout": "4334b3798f2061758a627b6bdd54d0cd6b822faa", "stdout_lines": ["4334b3798f2061758a627b6bdd54d0cd6b822faa"]} 2019-11-29T12:17:34.886 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:17:34 +0000 (0:00:00.425) 0:00:10.994 ******* 2019-11-29T12:17:34.920 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:17:34 +0000 (0:00:00.034) 0:00:11.028 ******* 2019-11-29T12:17:35.204 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** 2019-11-29T12:17:35.205 INFO:teuthology.task.ansible.out:changed: [smithi022.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.011970", "end": "2019-11-29 12:17:35.181424", "failed_when_result": false, "rc": 0, "start": "2019-11-29 12:17:35.169454", "stderr": "", "stderr_lines": [], "stdout": "7b088106a1031364e6869fc2888a0e2542579008", "stdout_lines": ["7b088106a1031364e6869fc2888a0e2542579008"]} 2019-11-29T12:17:35.243 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:17:35 +0000 (0:00:00.322) 0:00:11.351 ******* 2019-11-29T12:17:35.249 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.010160", "end": "2019-11-29 12:17:35.212141", "failed_when_result": false, "rc": 0, "start": "2019-11-29 12:17:35.201981", "stderr": "", "stderr_lines": [], "stdout": "7b088106a1031364e6869fc2888a0e2542579008", "stdout_lines": ["7b088106a1031364e6869fc2888a0e2542579008"]} 2019-11-29T12:17:35.285 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:17:35 +0000 (0:00:00.041) 0:00:11.393 ******* 2019-11-29T12:17:35.290 INFO:teuthology.task.ansible.out: TASK [users : Determine if we can skip users and pubkeys updates] ************** 2019-11-29T12:17:35.290 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:17:35.327 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:17:35 +0000 (0:00:00.041) 0:00:11.434 ******* 2019-11-29T12:17:35.334 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:17:35.370 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:17:35 +0000 (0:00:00.043) 0:00:11.478 ******* 2019-11-29T12:17:35.375 INFO:teuthology.task.ansible.out: TASK [users : Merge extra_admin_users into managed_admin_users] **************** 2019-11-29T12:17:35.375 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:17:35.412 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:17:35 +0000 (0:00:00.042) 0:00:11.520 ******* 2019-11-29T12:17:35.418 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:17:35.460 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:17:35 +0000 (0:00:00.047) 0:00:11.568 ******* 2019-11-29T12:17:35.465 INFO:teuthology.task.ansible.out: TASK [users : Remove managed_admin_users from managed_users] ******************* 2019-11-29T12:17:35.465 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:17:35.502 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:17:35 +0000 (0:00:00.042) 0:00:11.610 ******* 2019-11-29T12:17:35.507 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:17:35.545 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:17:35 +0000 (0:00:00.042) 0:00:11.652 ******* 2019-11-29T12:17:35.551 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_users list] *********************************** 2019-11-29T12:17:35.553 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:17:35.588 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:17:35 +0000 (0:00:00.042) 0:00:11.695 ******* 2019-11-29T12:17:35.593 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:17:35.630 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:17:35 +0000 (0:00:00.042) 0:00:11.738 ******* 2019-11-29T12:17:35.635 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_admin_users list] ***************************** 2019-11-29T12:17:35.635 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:17:35.673 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:17:35 +0000 (0:00:00.043) 0:00:11.781 ******* 2019-11-29T12:17:35.679 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:17:35.721 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:17:35 +0000 (0:00:00.042) 0:00:11.823 ******* 2019-11-29T12:17:35.979 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* 2019-11-29T12:17:35.980 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-11-29T12:17:36.016 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:17:36 +0000 (0:00:00.300) 0:00:12.124 ******* 2019-11-29T12:17:36.044 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-11-29T12:17:36.080 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:17:36 +0000 (0:00:00.064) 0:00:12.188 ******* 2019-11-29T12:17:36.395 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2019-11-29T12:17:36.395 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2019-11-29T12:17:36.470 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2019-11-29T12:17:36.726 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2019-11-29T12:17:36.831 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2019-11-29T12:17:37.018 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2019-11-29T12:17:37.018 INFO:teuthology.task.ansible.out: 2019-11-29T12:17:37.186 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2019-11-29T12:17:37.187 INFO:teuthology.task.ansible.out: 2019-11-29T12:17:37.363 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47', u'name': u'adeza'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/adeza", "item": {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, "move_home": false, "name": "adeza", "shell": "/bin/bash", "state": "present", "uid": 1104} 2019-11-29T12:17:37.532 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47', u'name': u'adeza'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/adeza", "item": {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, "move_home": false, "name": "adeza", "shell": "/bin/bash", "state": "present", "uid": 1104} 2019-11-29T12:17:37.698 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1105} 2019-11-29T12:17:37.876 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1105} 2019-11-29T12:17:38.052 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1106} 2019-11-29T12:17:38.218 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1106} 2019-11-29T12:17:38.397 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1107} 2019-11-29T12:17:38.553 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1107} 2019-11-29T12:17:38.741 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1108} 2019-11-29T12:17:38.877 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1108} 2019-11-29T12:17:39.085 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2019-11-29T12:17:39.231 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2019-11-29T12:17:39.410 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2019-11-29T12:17:39.577 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2019-11-29T12:17:39.765 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2019-11-29T12:17:39.941 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2019-11-29T12:17:40.089 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2019-11-29T12:17:40.291 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2019-11-29T12:17:40.426 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9', u'name': u'sbillah', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/sbillah", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC", "name": "sbillah", "ovpn": "sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9"}, "move_home": false, "name": "sbillah", "shell": "/bin/bash", "state": "present", "uid": 1113} 2019-11-29T12:17:40.624 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9', u'name': u'sbillah', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/sbillah", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC", "name": "sbillah", "ovpn": "sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9"}, "move_home": false, "name": "sbillah", "shell": "/bin/bash", "state": "present", "uid": 1113} 2019-11-29T12:17:40.755 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1114} 2019-11-29T12:17:40.953 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1114} 2019-11-29T12:17:41.112 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1115} 2019-11-29T12:17:41.300 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1115} 2019-11-29T12:17:41.436 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1116} 2019-11-29T12:17:41.649 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1116} 2019-11-29T12:17:41.785 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1117} 2019-11-29T12:17:41.994 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1117} 2019-11-29T12:17:42.130 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1118, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1118} 2019-11-29T12:17:42.337 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1118, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1118} 2019-11-29T12:17:42.422 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/davidz", "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "move_home": false, "name": "davidz", "shell": "/bin/bash", "state": "present", "uid": 1119} 2019-11-29T12:17:42.670 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/davidz", "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "move_home": false, "name": "davidz", "shell": "/bin/bash", "state": "present", "uid": 1119} 2019-11-29T12:17:42.778 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/gmeno", "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "move_home": false, "name": "gmeno", "shell": "/bin/bash", "state": "present", "uid": 1120} 2019-11-29T12:17:43.028 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/gmeno", "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "move_home": false, "name": "gmeno", "shell": "/bin/bash", "state": "present", "uid": 1120} 2019-11-29T12:17:43.112 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1121, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1121} 2019-11-29T12:17:43.387 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1121, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1121} 2019-11-29T12:17:43.472 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/wusui", "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "move_home": false, "name": "wusui", "shell": "/bin/bash", "state": "present", "uid": 1122} 2019-11-29T12:17:43.711 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/wusui", "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "move_home": false, "name": "wusui", "shell": "/bin/bash", "state": "present", "uid": 1122} 2019-11-29T12:17:43.826 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/zyan", "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "move_home": false, "name": "zyan", "shell": "/bin/bash", "state": "present", "uid": 1123} 2019-11-29T12:17:44.045 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/zyan", "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "move_home": false, "name": "zyan", "shell": "/bin/bash", "state": "present", "uid": 1123} 2019-11-29T12:17:44.161 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1124} 2019-11-29T12:17:44.404 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1124} 2019-11-29T12:17:44.477 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1125} 2019-11-29T12:17:44.757 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1125} 2019-11-29T12:17:44.789 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1126} 2019-11-29T12:17:45.120 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1126} 2019-11-29T12:17:45.132 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1127} 2019-11-29T12:17:45.475 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1128} 2019-11-29T12:17:45.488 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1127} 2019-11-29T12:17:45.790 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1129} 2019-11-29T12:17:45.843 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1128} 2019-11-29T12:17:46.123 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1130} 2019-11-29T12:17:46.176 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1129} 2019-11-29T12:17:46.446 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1131} 2019-11-29T12:17:46.530 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1130} 2019-11-29T12:17:46.788 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1132} 2019-11-29T12:17:46.873 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1131} 2019-11-29T12:17:47.132 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1133, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1133} 2019-11-29T12:17:47.227 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1132} 2019-11-29T12:17:47.475 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1134} 2019-11-29T12:17:47.580 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1133, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1133} 2019-11-29T12:17:47.819 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n', u'name': u'jj'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/jj", "item": {"name": "jj", "ovpn": "jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n"}, "move_home": false, "name": "jj", "shell": "/bin/bash", "state": "present", "uid": 1135} 2019-11-29T12:17:47.914 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1134} 2019-11-29T12:17:48.168 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/nwatkins", "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "move_home": false, "name": "nwatkins", "shell": "/bin/bash", "state": "present", "uid": 1136} 2019-11-29T12:17:48.242 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n', u'name': u'jj'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/jj", "item": {"name": "jj", "ovpn": "jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n"}, "move_home": false, "name": "jj", "shell": "/bin/bash", "state": "present", "uid": 1135} 2019-11-29T12:17:48.493 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1137, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1137} 2019-11-29T12:17:48.577 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/nwatkins", "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "move_home": false, "name": "nwatkins", "shell": "/bin/bash", "state": "present", "uid": 1136} 2019-11-29T12:17:48.856 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1138} 2019-11-29T12:17:48.910 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1137, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1137} 2019-11-29T12:17:49.211 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1139} 2019-11-29T12:17:49.253 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1138} 2019-11-29T12:17:49.545 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/jdillaman", "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "move_home": false, "name": "jdillaman", "shell": "/bin/bash", "state": "present", "uid": 1140} 2019-11-29T12:17:49.578 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1139} 2019-11-29T12:17:49.899 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1141} 2019-11-29T12:17:49.911 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/jdillaman", "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "move_home": false, "name": "jdillaman", "shell": "/bin/bash", "state": "present", "uid": 1140} 2019-11-29T12:17:50.231 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1141} 2019-11-29T12:17:50.243 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1142} 2019-11-29T12:17:50.564 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1142} 2019-11-29T12:17:50.590 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1143} 2019-11-29T12:17:50.901 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1143} 2019-11-29T12:17:50.933 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1144} 2019-11-29T12:17:51.255 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1144} 2019-11-29T12:17:51.278 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9', u'name': u'abhishekvrshny'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/abhishekvrshny", "item": {"name": "abhishekvrshny", "ovpn": "abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9"}, "move_home": false, "name": "abhishekvrshny", "shell": "/bin/bash", "state": "present", "uid": 1145} 2019-11-29T12:17:51.579 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9', u'name': u'abhishekvrshny'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/abhishekvrshny", "item": {"name": "abhishekvrshny", "ovpn": "abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9"}, "move_home": false, "name": "abhishekvrshny", "shell": "/bin/bash", "state": "present", "uid": 1145} 2019-11-29T12:17:51.624 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1146} 2019-11-29T12:17:51.914 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1146} 2019-11-29T12:17:51.971 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1147} 2019-11-29T12:17:52.263 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1147} 2019-11-29T12:17:52.316 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1148} 2019-11-29T12:17:52.617 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1148} 2019-11-29T12:17:52.650 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246', u'name': u'shehbazj'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/shehbazj", "item": {"name": "shehbazj", "ovpn": "shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246"}, "move_home": false, "name": "shehbazj", "shell": "/bin/bash", "state": "present", "uid": 1149} 2019-11-29T12:17:52.931 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246', u'name': u'shehbazj'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/shehbazj", "item": {"name": "shehbazj", "ovpn": "shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246"}, "move_home": false, "name": "shehbazj", "shell": "/bin/bash", "state": "present", "uid": 1149} 2019-11-29T12:17:52.984 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1150} 2019-11-29T12:17:53.265 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1150} 2019-11-29T12:17:53.339 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3', u'name': u'fche'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/fche", "item": {"name": "fche", "ovpn": "fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3"}, "move_home": false, "name": "fche", "shell": "/bin/bash", "state": "present", "uid": 1151} 2019-11-29T12:17:53.588 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3', u'name': u'fche'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/fche", "item": {"name": "fche", "ovpn": "fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3"}, "move_home": false, "name": "fche", "shell": "/bin/bash", "state": "present", "uid": 1151} 2019-11-29T12:17:53.672 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4', u'name': u'onyb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/onyb", "item": {"name": "onyb", "ovpn": "ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4"}, "move_home": false, "name": "onyb", "shell": "/bin/bash", "state": "present", "uid": 1152} 2019-11-29T12:17:53.945 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4', u'name': u'onyb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/onyb", "item": {"name": "onyb", "ovpn": "ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4"}, "move_home": false, "name": "onyb", "shell": "/bin/bash", "state": "present", "uid": 1152} 2019-11-29T12:17:54.006 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1153} 2019-11-29T12:17:54.297 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1153} 2019-11-29T12:17:54.340 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3', u'name': u'oprypin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/oprypin", "item": {"name": "oprypin", "ovpn": "oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3"}, "move_home": false, "name": "oprypin", "shell": "/bin/bash", "state": "present", "uid": 1154} 2019-11-29T12:17:54.651 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3', u'name': u'oprypin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/oprypin", "item": {"name": "oprypin", "ovpn": "oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3"}, "move_home": false, "name": "oprypin", "shell": "/bin/bash", "state": "present", "uid": 1154} 2019-11-29T12:17:54.673 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1155} 2019-11-29T12:17:55.005 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1155} 2019-11-29T12:17:55.017 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1156} 2019-11-29T12:17:55.339 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1157} 2019-11-29T12:17:55.341 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1156} 2019-11-29T12:17:55.622 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1158} 2019-11-29T12:17:55.665 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1157} 2019-11-29T12:17:55.966 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1159} 2019-11-29T12:17:56.009 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1158} 2019-11-29T12:17:56.299 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051', u'name': u'asheplyakov'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/asheplyakov", "item": {"name": "asheplyakov", "ovpn": "asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051"}, "move_home": false, "name": "asheplyakov", "shell": "/bin/bash", "state": "present", "uid": 1160} 2019-11-29T12:17:56.373 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1159} 2019-11-29T12:17:56.611 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1161} 2019-11-29T12:17:56.706 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051', u'name': u'asheplyakov'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/asheplyakov", "item": {"name": "asheplyakov", "ovpn": "asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051"}, "move_home": false, "name": "asheplyakov", "shell": "/bin/bash", "state": "present", "uid": 1160} 2019-11-29T12:17:56.934 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1162} 2019-11-29T12:17:57.059 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1161} 2019-11-29T12:17:57.288 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1163} 2019-11-29T12:17:57.403 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1162} 2019-11-29T12:17:57.621 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1164} 2019-11-29T12:17:57.747 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1163} 2019-11-29T12:17:57.955 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1165} 2019-11-29T12:17:58.081 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1164} 2019-11-29T12:17:58.278 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0', u'name': u'jwilliamson'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/jwilliamson", "item": {"name": "jwilliamson", "ovpn": "jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0"}, "move_home": false, "name": "jwilliamson", "shell": "/bin/bash", "state": "present", "uid": 1166} 2019-11-29T12:17:58.445 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1165} 2019-11-29T12:17:58.614 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1167} 2019-11-29T12:17:58.770 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0', u'name': u'jwilliamson'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/jwilliamson", "item": {"name": "jwilliamson", "ovpn": "jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0"}, "move_home": false, "name": "jwilliamson", "shell": "/bin/bash", "state": "present", "uid": 1166} 2019-11-29T12:17:58.961 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1168} 2019-11-29T12:17:59.117 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1167} 2019-11-29T12:17:59.315 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1169} 2019-11-29T12:17:59.482 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1168} 2019-11-29T12:17:59.679 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1170} 2019-11-29T12:17:59.814 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1169} 2019-11-29T12:18:00.011 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1171} 2019-11-29T12:18:00.157 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1170} 2019-11-29T12:18:00.349 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1172} 2019-11-29T12:18:00.505 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1171} 2019-11-29T12:18:00.652 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77', u'name': u'liupan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/liupan", "item": {"name": "liupan", "ovpn": "liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77"}, "move_home": false, "name": "liupan", "shell": "/bin/bash", "state": "present", "uid": 1173} 2019-11-29T12:18:00.860 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1172} 2019-11-29T12:18:01.001 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1174} 2019-11-29T12:18:01.213 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77', u'name': u'liupan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/liupan", "item": {"name": "liupan", "ovpn": "liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77"}, "move_home": false, "name": "liupan", "shell": "/bin/bash", "state": "present", "uid": 1173} 2019-11-29T12:18:01.359 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6', u'name': u'amarangone'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/amarangone", "item": {"name": "amarangone", "ovpn": "amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6"}, "move_home": false, "name": "amarangone", "shell": "/bin/bash", "state": "present", "uid": 1175} 2019-11-29T12:18:01.546 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1174} 2019-11-29T12:18:01.702 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1142} 2019-11-29T12:18:01.902 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6', u'name': u'amarangone'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/amarangone", "item": {"name": "amarangone", "ovpn": "amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6"}, "move_home": false, "name": "amarangone", "shell": "/bin/bash", "state": "present", "uid": 1175} 2019-11-29T12:18:02.041 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57', u'name': u'kmroz'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/kmroz", "item": {"name": "kmroz", "ovpn": "kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57"}, "move_home": false, "name": "kmroz", "shell": "/bin/bash", "state": "present", "uid": 1176} 2019-11-29T12:18:02.229 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1142} 2019-11-29T12:18:02.385 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1177} 2019-11-29T12:18:02.543 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57', u'name': u'kmroz'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/kmroz", "item": {"name": "kmroz", "ovpn": "kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57"}, "move_home": false, "name": "kmroz", "shell": "/bin/bash", "state": "present", "uid": 1176} 2019-11-29T12:18:02.720 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1178} 2019-11-29T12:18:02.886 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1177} 2019-11-29T12:18:03.074 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1179} 2019-11-29T12:18:03.240 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1178} 2019-11-29T12:18:03.417 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1180} 2019-11-29T12:18:03.585 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1179} 2019-11-29T12:18:03.753 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1181} 2019-11-29T12:18:03.929 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1180} 2019-11-29T12:18:04.106 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1182} 2019-11-29T12:18:04.272 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1181} 2019-11-29T12:18:04.447 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n', u'name': u'adamyanova'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/adamyanova", "item": {"name": "adamyanova", "ovpn": "adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n"}, "move_home": false, "name": "adamyanova", "shell": "/bin/bash", "state": "present", "uid": 1183} 2019-11-29T12:18:04.634 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1182} 2019-11-29T12:18:04.758 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1184, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1184} 2019-11-29T12:18:04.965 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n', u'name': u'adamyanova'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/adamyanova", "item": {"name": "adamyanova", "ovpn": "adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n"}, "move_home": false, "name": "adamyanova", "shell": "/bin/bash", "state": "present", "uid": 1183} 2019-11-29T12:18:05.110 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1185} 2019-11-29T12:18:05.297 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1184, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1184} 2019-11-29T12:18:05.444 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1186} 2019-11-29T12:18:05.631 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1185} 2019-11-29T12:18:05.787 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1187} 2019-11-29T12:18:05.976 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1186} 2019-11-29T12:18:06.081 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1188} 2019-11-29T12:18:06.321 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1187} 2019-11-29T12:18:06.426 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1189} 2019-11-29T12:18:06.670 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1188} 2019-11-29T12:18:06.755 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1190} 2019-11-29T12:18:07.015 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1189} 2019-11-29T12:18:07.102 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1191} 2019-11-29T12:18:07.363 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1190} 2019-11-29T12:18:07.437 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1192} 2019-11-29T12:18:07.712 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1191} 2019-11-29T12:18:07.755 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1193} 2019-11-29T12:18:08.049 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1194} 2019-11-29T12:18:08.050 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1192} 2019-11-29T12:18:08.393 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1195} 2019-11-29T12:18:08.405 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1193} 2019-11-29T12:18:08.737 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1196} 2019-11-29T12:18:08.759 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1194} 2019-11-29T12:18:09.083 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1197} 2019-11-29T12:18:09.115 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1195} 2019-11-29T12:18:09.402 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/sidharthanup", "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "move_home": false, "name": "sidharthanup", "shell": "/bin/bash", "state": "present", "uid": 1198} 2019-11-29T12:18:09.466 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1196} 2019-11-29T12:18:09.748 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/varsha", "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "move_home": false, "name": "varsha", "shell": "/bin/bash", "state": "present", "uid": 1199} 2019-11-29T12:18:09.823 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1197} 2019-11-29T12:18:10.093 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1200} 2019-11-29T12:18:10.177 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/sidharthanup", "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "move_home": false, "name": "sidharthanup", "shell": "/bin/bash", "state": "present", "uid": 1198} 2019-11-29T12:18:10.447 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1201} 2019-11-29T12:18:10.490 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/varsha", "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "move_home": false, "name": "varsha", "shell": "/bin/bash", "state": "present", "uid": 1199} 2019-11-29T12:18:10.781 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1202} 2019-11-29T12:18:10.855 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1200} 2019-11-29T12:18:11.135 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1203} 2019-11-29T12:18:11.210 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1201} 2019-11-29T12:18:11.480 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1204} 2019-11-29T12:18:11.585 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1202} 2019-11-29T12:18:11.833 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1205} 2019-11-29T12:18:11.918 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1203} 2019-11-29T12:18:12.169 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1206} 2019-11-29T12:18:12.252 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1204} 2019-11-29T12:18:12.501 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1207} 2019-11-29T12:18:12.605 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1205} 2019-11-29T12:18:12.833 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1208} 2019-11-29T12:18:12.948 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1206} 2019-11-29T12:18:13.155 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1209} 2019-11-29T12:18:13.300 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1207} 2019-11-29T12:18:13.487 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1210} 2019-11-29T12:18:13.633 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1208} 2019-11-29T12:18:13.820 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1211} 2019-11-29T12:18:13.966 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1209} 2019-11-29T12:18:14.163 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1212} 2019-11-29T12:18:14.319 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1210} 2019-11-29T12:18:14.517 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1213} 2019-11-29T12:18:14.683 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1211} 2019-11-29T12:18:14.843 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1214} 2019-11-29T12:18:15.035 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1212} 2019-11-29T12:18:15.182 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1155} 2019-11-29T12:18:15.390 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1213} 2019-11-29T12:18:15.526 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10102, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 10102} 2019-11-29T12:18:15.744 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1214} 2019-11-29T12:18:16.099 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1155} 2019-11-29T12:18:16.227 INFO:teuthology.task.ansible.out:changed: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10104, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "name": "rraja", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10103} 2019-11-29T12:18:16.454 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10102, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 10102} 2019-11-29T12:18:16.490 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:18:16 +0000 (0:00:40.409) 0:00:52.598 ******* 2019-11-29T12:18:16.519 INFO:teuthology.task.ansible.out: TASK [users : Create all users without sudo access.] *************************** 2019-11-29T12:18:16.555 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:18:16 +0000 (0:00:00.064) 0:00:52.663 ******* 2019-11-29T12:18:16.608 INFO:teuthology.task.ansible.out: TASK [users : Merge managed_users and managed_admin users] ********************* 2019-11-29T12:18:16.612 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "tr 2019-11-29T12:18:16.613 INFO:teuthology.task.ansible.out:ociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04 2019-11-29T12:18:16.614 INFO:teuthology.task.ansible.out:okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC", "name": "sbillah", "ovpn": "sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "jos 2019-11-29T12:18:16.616 INFO:teuthology.task.ansible.out:hd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jo 2019-11-29T12:18:16.617 INFO:teuthology.task.ansible.out:wilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f 2019-11-29T12:18:16.619 INFO:teuthology.task.ansible.out:966b2794c94caa110d313e927a1c1b\n"}, {"name": "jj", "ovpn": "jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n"}, {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, {"name": "abhishekvrshny", "ovpn": "abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h 2019-11-29T12:18:16.620 INFO:teuthology.task.ansible.out:7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "shehbazj", "ovpn": "shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "fche", "ovpn": "fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3"}, {"name": "onyb", "ovpn": "ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "oprypin", "ovpn": "oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6 2019-11-29T12:18:16.621 INFO:teuthology.task.ansible.out:c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "asheplyakov", "ovpn": "asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, {"name": "jwilliamson", "ovpn": "jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa 2019-11-29T12:18:16.623 INFO:teuthology.task.ansible.out:2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "liupan", "ovpn": "liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "amarangone", "ovpn": "amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "kmroz", "ovpn": "kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db2 2019-11-29T12:18:16.624 INFO:teuthology.task.ansible.out:93dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "adamyanova", "ovpn": "adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.red 2019-11-29T12:18:16.625 INFO:teuthology.task.ansible.out:hat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f 2019-11-29T12:18:16.627 INFO:teuthology.task.ansible.out:57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}]}, "changed": false} 2019-11-29T12:18:16.663 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:18:16 +0000 (0:00:00.107) 0:00:52.770 ******* 2019-11-29T12:18:17.076 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2019-11-29T12:18:17.077 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10104, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "name": "rraja", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10103} 2019-11-29T12:18:17.341 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:18:17 +0000 (0:00:00.678) 0:00:53.448 ******* 2019-11-29T12:18:17.367 INFO:teuthology.task.ansible.out: TASK [users : Create all users without sudo access.] *************************** 2019-11-29T12:18:17.410 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:18:17 +0000 (0:00:00.068) 0:00:53.517 ******* 2019-11-29T12:18:17.458 INFO:teuthology.task.ansible.out: TASK [users : Merge managed_users and managed_admin users] ********************* 2019-11-29T12:18:17.462 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "tr 2019-11-29T12:18:17.464 INFO:teuthology.task.ansible.out:ociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04 2019-11-29T12:18:17.465 INFO:teuthology.task.ansible.out:okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC", "name": "sbillah", "ovpn": "sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "jos 2019-11-29T12:18:17.466 INFO:teuthology.task.ansible.out:hd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jo 2019-11-29T12:18:17.468 INFO:teuthology.task.ansible.out:wilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851 2019-11-29T12:18:17.469 INFO:teuthology.task.ansible.out:f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "jj", "ovpn": "jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n"}, {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde189 2019-11-29T12:18:17.471 INFO:teuthology.task.ansible.out:0af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, {"name": "abhishekvrshny", "ovpn": "abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "shehbazj", "ovpn": "shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "fche", "ovpn": "fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3"}, {"name": "onyb", "ovpn": "ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f45903 2019-11-29T12:18:17.472 INFO:teuthology.task.ansible.out:0cb7a195"}, {"name": "oprypin", "ovpn": "oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "asheplyakov", "ovpn": "asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, {"name": "jwilliamson", "ovpn": "jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d7 2019-11-29T12:18:17.474 INFO:teuthology.task.ansible.out:12ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "liupan", "ovpn": "liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "amarangone", "ovpn": "amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "kmroz", "ovpn": "kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006" 2019-11-29T12:18:17.475 INFO:teuthology.task.ansible.out:}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "adamyanova", "ovpn": "adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339 2019-11-29T12:18:17.476 INFO:teuthology.task.ansible.out:054088d257a16cf9fafcfe05b27fa678e"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b 2019-11-29T12:18:17.478 INFO:teuthology.task.ansible.out:02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69 2019-11-29T12:18:17.479 INFO:teuthology.task.ansible.out:088eda5efc"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}]}, "changed": false} 2019-11-29T12:18:17.521 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:18:17 +0000 (0:00:00.111) 0:00:53.628 ******* 2019-11-29T12:18:17.589 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2019-11-29T12:18:17.590 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com -> localhost] => {"after": "4334b3798f2061758a627b6bdd54d0cd6b822faa", "attempts": 1, "before": "4334b3798f2061758a627b6bdd54d0cd6b822faa", "changed": false, "remote_url_changed": false} 2019-11-29T12:18:17.630 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:18:17 +0000 (0:00:00.109) 0:00:53.738 ******* 2019-11-29T12:18:18.023 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-11-29T12:18:18.025 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2019-11-29T12:18:18.171 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2019-11-29T12:18:18.172 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com -> localhost] => {"after": "4334b3798f2061758a627b6bdd54d0cd6b822faa", "attempts": 1, "before": "4334b3798f2061758a627b6bdd54d0cd6b822faa", "changed": false, "remote_url_changed": false} 2019-11-29T12:18:18.208 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:18:18 +0000 (0:00:00.577) 0:00:54.316 ******* 2019-11-29T12:18:18.384 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-11-29T12:18:18.384 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2019-11-29T12:18:18.623 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2019-11-29T12:18:18.728 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2019-11-29T12:18:18.988 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2019-11-29T12:18:19.073 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47', u'name': u'adeza'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCWy2i6Iv6IWLh53Z44O4fQ0ctxR8odCAWIZAaSQXAxxC++RS+95Zr+BZ5wJwsBOyP1G4AAhl+9uwnn3NmDDG7fKGexPoQrTZZ27KdJ3bHpZRq5LJf9byWFwz4rDsqIqkGjI9sUkfa6nV7ci2BdEkIgLupTT2uXUzTb/njOjI7Fc+cQ7ac4QfJ+yeIcqxeje/YYDF3068V4z1yynk9q2KRXYdERKQghaWDNJlbdBhn/fmsam6okOtUnsXjE88qGPd+LVHWfK0EfYvYXiAoOaJDK8d4EXnJ4RKJceQPBk8ravuQtKVwnRIr8WtmILHuoztthfwqb2WvZ5iMDt6v7oQZ alfredo@papaya.local", "key_options": null, "keyfile": "/home/adeza/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adeza", "validate_certs": true} 2019-11-29T12:18:19.398 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZtIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "va 2019-11-29T12:18:19.400 INFO:teuthology.task.ansible.out:lidate_certs": true} 2019-11-29T12:18:19.441 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2019-11-29T12:18:19.735 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2019-11-29T12:18:19.819 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47', u'name': u'adeza'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCWy2i6Iv6IWLh53Z44O4fQ0ctxR8odCAWIZAaSQXAxxC++RS+95Zr+BZ5wJwsBOyP1G4AAhl+9uwnn3NmDDG7fKGexPoQrTZZ27KdJ3bHpZRq5LJf9byWFwz4rDsqIqkGjI9sUkfa6nV7ci2BdEkIgLupTT2uXUzTb/njOjI7Fc+cQ7ac4QfJ+yeIcqxeje/YYDF3068V4z1yynk9q2KRXYdERKQghaWDNJlbdBhn/fmsam6okOtUnsXjE88qGPd+LVHWfK0EfYvYXiAoOaJDK8d4EXnJ4RKJceQPBk8ravuQtKVwnRIr8WtmILHuoztthfwqb2WvZ5iMDt6v7oQZ alfredo@papaya.local", "key_options": null, "keyfile": "/home/adeza/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adeza", "validate_certs": true} 2019-11-29T12:18:20.091 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZtt 2019-11-29T12:18:20.092 INFO:teuthology.task.ansible.out:Edz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2019-11-29T12:18:20.185 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZtIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "va 2019-11-29T12:18:20.187 INFO:teuthology.task.ansible.out:lidate_certs": true} 2019-11-29T12:18:20.434 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2019-11-29T12:18:20.538 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2019-11-29T12:18:20.777 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2019-11-29T12:18:20.788 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:20.903 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZtt 2019-11-29T12:18:20.904 INFO:teuthology.task.ansible.out:Edz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2019-11-29T12:18:21.131 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uT 2019-11-29T12:18:21.133 INFO:teuthology.task.ansible.out:fMorbnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2019-11-29T12:18:21.153 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:21.154 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9', u'name': u'sbillah', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC", "name": "sbillah", "ovpn": "sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:21.168 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:21.176 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:21.219 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2019-11-29T12:18:21.520 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2019-11-29T12:18:21.590 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2019-11-29T12:18:21.601 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:21.902 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+ 2019-11-29T12:18:21.903 INFO:teuthology.task.ansible.out:2vtSoAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2019-11-29T12:18:21.955 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uT 2019-11-29T12:18:21.961 INFO:teuthology.task.ansible.out:fMorbnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2019-11-29T12:18:21.966 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:21.977 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9', u'name': u'sbillah', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC", "name": "sbillah", "ovpn": "sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:21.999 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:22.010 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:22.248 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2019-11-29T12:18:22.383 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2019-11-29T12:18:22.590 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCyOWnAdvzh5zR2ts9e8g0wG4wZ0uNr0YJUCncAOTJB0L8xkQU76jWzX3BRNU5Wk8VtLvpJAQ61P7UXyzgGWSO9FHZjD3RDrc2V9uh/lqRKmx1COtDvcart/JwzwHlsWdrYdcXvEaAiFrZJ6x1jJAjIL6tvMO7bqBz4YNruKpGWsQ6p5P/M5iIEPMj1oKanLoULXqReC6eYFTw3LNAXjberPY5GxYwaKS0HuzySRvSblShyA85jawTSlEbsOSnMqqGu5vGJiC415UFQQ5qKBtzrgAjlUgMbaqGTnTmBYn7L751gIWRetgWqwuHgfIe2ZGM3mmh0DX8E03DUbEt4UxyR dzafman@TrustyTahr\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDDtSwGzH7V5jzppggL0+nYlBSM1HqGjkInwxutra5iEyFoBuV73MNSBk3HrvIVGN13+PCdHf4Oy8ywbhC/4yKbxS1NG76d/GU8ijZFuBlEwxwHZpcThpSTuYrNx7FJVp8Yjl45DtD5s8FMI/0YZZhLlIqT6QCTxlTIPXDb6zefEWvAVziE0bmhRpe4B6AOLOGTB9fivQr5YzxhfaSS5Vu4U1x5gmosouSJ+aMFrQWLqa/eoCy8t9PnxdMjlHjHCZ7Qv1JfpaAPw3qOK30GrVeXR/hPN3aFodTuIJpzdynjk5HO6/VKW5+mWBO7pmQqn9LNQEjADXbLh7PG//nOONbH dzafman@ubuntu16", "key_options": null, "keyfile": "/home/davidz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "davidz", "validate_certs": true} 2019-11-29T12:18:22.757 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+ 2019-11-29T12:18:22.759 INFO:teuthology.task.ansible.out:2vtSoAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2019-11-29T12:18:22.932 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvWnKfzTd574C4GXg1mr4pbJOInKv4qMRf0DwksTzqtXStlhT+PaO2C8p48U2Xjz5hmPK9J+iHA2xKwI6lKI194wUo3tW283euRyTCN7LlbV6tgD9k78hDaeA+53MHYmwbxjHEqAadqrLU+68LfmL7gaaUSToP/Ap+hdcDC7H9lulMcxkUeahEiDfG2s1mD8IUM6XVuqZM9WEARKpF1oSEBKhMMob9YJZPpJWipuAGkPvDA0yHK1lB58Yr2x0yaezVjQc7V2dwaY1gXR6AscU5WzlwWNNwXHqPdyyWRaGx/9Fk00yfzX4V7ZqTvKdMLKwB7EnamduTMPsaoKBUBJCh gmeno@gmeno-virtual-machine", "key_options": null, "keyfile": "/home/gmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gmeno", "validate_certs": true} 2019-11-29T12:18:23.108 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2019-11-29T12:18:23.268 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2019-11-29T12:18:23.464 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCyOWnAdvzh5zR2ts9e8g0wG4wZ0uNr0YJUCncAOTJB0L8xkQU76jWzX3BRNU5Wk8VtLvpJAQ61P7UXyzgGWSO9FHZjD3RDrc2V9uh/lqRKmx1COtDvcart/JwzwHlsWdrYdcXvEaAiFrZJ6x1jJAjIL6tvMO7bqBz4YNruKpGWsQ6p5P/M5iIEPMj1oKanLoULXqReC6eYFTw3LNAXjberPY5GxYwaKS0HuzySRvSblShyA85jawTSlEbsOSnMqqGu5vGJiC415UFQQ5qKBtzrgAjlUgMbaqGTnTmBYn7L751gIWRetgWqwuHgfIe2ZGM3mmh0DX8E03DUbEt4UxyR dzafman@TrustyTahr\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDDtSwGzH7V5jzppggL0+nYlBSM1HqGjkInwxutra5iEyFoBuV73MNSBk3HrvIVGN13+PCdHf4Oy8ywbhC/4yKbxS1NG76d/GU8ijZFuBlEwxwHZpcThpSTuYrNx7FJVp8Yjl45DtD5s8FMI/0YZZhLlIqT6QCTxlTIPXDb6zefEWvAVziE0bmhRpe4B6AOLOGTB9fivQr5YzxhfaSS5Vu4U1x5gmosouSJ+aMFrQWLqa/eoCy8t9PnxdMjlHjHCZ7Qv1JfpaAPw3qOK30GrVeXR/hPN3aFodTuIJpzdynjk5HO6/VKW5+mWBO7pmQqn9LNQEjADXbLh7PG//nOONbH dzafman@ubuntu16", "key_options": null, "keyfile": "/home/davidz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "davidz", "validate_certs": true} 2019-11-29T12:18:23.621 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsTZI+b02boZv8jVLHQoFlloD2WF/3xT+ZfZxzwddL7Q6eqo7j8i21LAbLAMWXYMyhiClrloDeHfCZ42gG5bqSThF8LoCw+GspF6SahTI0lmptGu69/OeHqqCpW1DnsWB3wWqfi90XbQJrpg3cdRaqOCmkGVJrqfFWzff8Zg9IuojIH/aO9drCTRGa1pHHCyEdW9ZNeYFwrMjfP+wJi/mC/ABAoXyDy0NWT0uIA+36abNg2/ptok90rdan0r72hjFEz/1hpupKWri+VXAepiyDMuSgJm9uJCXDFaNTn3jocdX+sbVtltThQ2OBxe1T60vRLbXx3lvhxxZ1fUkcP/FF wusui@ubuntu\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD2UzyfBk1nZ8SLCtW9UjorMeOo4u9AM/YL8ZI74GdprR+odERZR17/QfwT5vmLVNa51+CQt1HcGodlQYfR/8n/OUl/gJyVagBuU2zgmLPO3tOor5RBfms5MZ2VZ9Vm3+WrCO/vrAq/5HVyGbQsKiQHXkIRSL2NIgfKRTOVTNmuTSXtZNDgdWGIBmcOFQv+Im9CRopoI8ZtJLQj7xfxtGtUas7FbWTcf0o92+xvWuGWq5WQgmZ8MUIfvBLYLmicuVfsWjZ1YsC1PNhuhkwrW7MhaD71Ej3ll243tG1QD7eAmo+psIp8phlU5s/5FeA5y5OzDZ2T963oHGhq018TYO0b wusui@teuthology", "key_options": null, "keyfile": "/home/wusui/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "wusui", "validate_certs": true} 2019-11-29T12:18:23.830 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvWnKfzTd574C4GXg1mr4pbJOInKv4qMRf0DwksTzqtXStlhT+PaO2C8p48U2Xjz5hmPK9J+iHA2xKwI6lKI194wUo3tW283euRyTCN7LlbV6tgD9k78hDaeA+53MHYmwbxjHEqAadqrLU+68LfmL7gaaUSToP/Ap+hdcDC7H9lulMcxkUeahEiDfG2s1mD8IUM6XVuqZM9WEARKpF1oSEBKhMMob9YJZPpJWipuAGkPvDA0yHK1lB58Yr2x0yaezVjQc7V2dwaY1gXR6AscU5WzlwWNNwXHqPdyyWRaGx/9Fk00yfzX4V7ZqTvKdMLKwB7EnamduTMPsaoKBUBJCh gmeno@gmeno-virtual-machine", "key_options": null, "keyfile": "/home/gmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gmeno", "validate_certs": true} 2019-11-29T12:18:23.974 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCtmxLK2rSomB14d9/fkAshmsXQfd6cJ+vEb0MZDaUT+OLmr1vAq0+H5g9w3hApJ2UEOFSaiz6ywgBAFeBeu/KmUALOhJIKKk0imoTunYclqxVPBK6tG/2b+ME8VE1afoEpMem3Bzfkrq0pDt6DLFBDlt9rRIqtO/ZlqEayWkEwTXJ7pwj+oJS03Z3Y7q0Iqw8PToKqJWwy2OvW1I9Pi0Q8s4YV9I34rSO7Wv4w43AXpFHRlvJWIcI5g5WFI5tnjel+kUAWMZft9ynFoAP5iXdByq897r4jAF74hapaxLMsHBz4MyYmPZqS76Cx2e3kGqXeetPinfcZxC3ViboR7o/1 root@zhyan-desk1", "key_options": null, "keyfile": "/home/zyan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zyan", "validate_certs": true} 2019-11-29T12:18:24.181 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2019-11-29T12:18:24.337 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1 2019-11-29T12:18:24.339 INFO:teuthology.task.ansible.out:Z9CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2019-11-29T12:18:24.524 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsTZI+b02boZv8jVLHQoFlloD2WF/3xT+ZfZxzwddL7Q6eqo7j8i21LAbLAMWXYMyhiClrloDeHfCZ42gG5bqSThF8LoCw+GspF6SahTI0lmptGu69/OeHqqCpW1DnsWB3wWqfi90XbQJrpg3cdRaqOCmkGVJrqfFWzff8Zg9IuojIH/aO9drCTRGa1pHHCyEdW9ZNeYFwrMjfP+wJi/mC/ABAoXyDy0NWT0uIA+36abNg2/ptok90rdan0r72hjFEz/1hpupKWri+VXAepiyDMuSgJm9uJCXDFaNTn3jocdX+sbVtltThQ2OBxe1T60vRLbXx3lvhxxZ1fUkcP/FF wusui@ubuntu\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD2UzyfBk1nZ8SLCtW9UjorMeOo4u9AM/YL8ZI74GdprR+odERZR17/QfwT5vmLVNa51+CQt1HcGodlQYfR/8n/OUl/gJyVagBuU2zgmLPO3tOor5RBfms5MZ2VZ9Vm3+WrCO/vrAq/5HVyGbQsKiQHXkIRSL2NIgfKRTOVTNmuTSXtZNDgdWGIBmcOFQv+Im9CRopoI8ZtJLQj7xfxtGtUas7FbWTcf0o92+xvWuGWq5WQgmZ8MUIfvBLYLmicuVfsWjZ1YsC1PNhuhkwrW7MhaD71Ej3ll243tG1QD7eAmo+psIp8phlU5s/5FeA5y5OzDZ2T963oHGhq018TYO0b wusui@teuthology", "key_options": null, "keyfile": "/home/wusui/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "wusui", "validate_certs": true} 2019-11-29T12:18:24.683 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkR 2019-11-29T12:18:24.685 INFO:teuthology.task.ansible.out:hoBYB0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2019-11-29T12:18:24.828 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCtmxLK2rSomB14d9/fkAshmsXQfd6cJ+vEb0MZDaUT+OLmr1vAq0+H5g9w3hApJ2UEOFSaiz6ywgBAFeBeu/KmUALOhJIKKk0imoTunYclqxVPBK6tG/2b+ME8VE1afoEpMem3Bzfkrq0pDt6DLFBDlt9rRIqtO/ZlqEayWkEwTXJ7pwj+oJS03Z3Y7q0Iqw8PToKqJWwy2OvW1I9Pi0Q8s4YV9I34rSO7Wv4w43AXpFHRlvJWIcI5g5WFI5tnjel+kUAWMZft9ynFoAP5iXdByq897r4jAF74hapaxLMsHBz4MyYmPZqS76Cx2e3kGqXeetPinfcZxC3ViboR7o/1 root@zhyan-desk1", "key_options": null, "keyfile": "/home/zyan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zyan", "validate_certs": true} 2019-11-29T12:18:25.016 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2019-11-29T12:18:25.172 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1 2019-11-29T12:18:25.173 INFO:teuthology.task.ansible.out:Z9CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2019-11-29T12:18:25.359 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2019-11-29T12:18:25.535 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkR 2019-11-29T12:18:25.537 INFO:teuthology.task.ansible.out:hoBYB0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2019-11-29T12:18:25.702 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlIQv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwm 2019-11-29T12:18:25.703 INFO:teuthology.task.ansible.out:ih46TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2019-11-29T12:18:25.895 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2019-11-29T12:18:26.040 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2019-11-29T12:18:26.258 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2019-11-29T12:18:26.382 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2019-11-29T12:18:26.629 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlIQv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwm 2019-11-29T12:18:26.631 INFO:teuthology.task.ansible.out:ih46TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2019-11-29T12:18:26.712 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2019-11-29T12:18:26.960 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2019-11-29T12:18:27.054 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2019-11-29T12:18:27.321 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2019-11-29T12:18:27.394 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2019-11-29T12:18:28.371 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxf 2019-11-29T12:18:28.372 INFO:teuthology.task.ansible.out:iRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2CfQvUxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': 2019-11-29T12:18:28.374 INFO:teuthology.task.ansible.out: u'ffilz'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n', u'name': u'jj'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jj", "ovpn": "jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXvd7F0n4DeBROTLYDE4lItYn/2S1cMM1uAkkwissUh4LGsMAVWi5tUI0EUC7I2BUxACvIIA4yfkhe2ATAu95UQxKWVql67sfCW6WwY7lNa 2019-11-29T12:18:28.375 INFO:teuthology.task.ansible.out:65kQC9S5dE/+d4vPxFoFSFnri981laJXOjbjTsWD7j1SGfqbRuAHQKL8y95DQ3y/B7/1oxTg1jjK8BTr3GAUp8/7lNlWE+x2S3gjHqqH92yWU7OBbPWRZjjkVkXS/5CbWDDUx8nbeGPcAIfM95rRQR0VkwzVi1FWsXd6qIbZ9TqOhYyLR0fCsnDuveNV68FB1ddvqCLdXRxPLmucwzdjGMbZ5EJ0H/CAAutj3Vjn6gh jj@newdream.net\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRXOkus/WHB3llEH1u4rWj0F/bZSslq4/o7pBUGFYrHKqa2iBiCj4DxBEsaReWUm0aDyesGuEVeoECTtzh7byJ6iZHFbf0McubxnuFMImneQ2mB0+raa3uWblwnyiwAqiZgtcJGQpCxCnrmLzyNN6xUUmzN27cDOMSDpbWr3VdPSBH+ixIuZI8r8UkSbmlX30V2bvk4lGl2SPV385tAvRPRU9KfMG9AgwNv+R2WCiA2GOrjes2VHm7LneqI/vE5yOxJsm4tPxEkOpCp3/0xt9L9cmPz47HnzJ2Qure3kZmOsCxOX1+9dXFIwhPaNconD4KDlv4MNs/M425Gp6KKnnV jj@laptop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBjrQ3drodiPr83uvpUUf6SXZ0utOFIfy5Cj3BGcn7bY29BKXCwomAUmmLMk76cGBZ7jHf3ZJYid1ESbHmvmSgKFShr9JFXBHvlMdnyewi7hFix+sjX9ZtuZfSaIsBbU5Jlz3RqHtDrScS1wJRh+oDlH6is5QWSCABVWhUk+hJtQFg4dfespqomt88NmPZuR0aR0b22hkrMYINXP0y3iz3Jjs5vg8td7VJ2hXb5yIBk+Izuq1LnjPyRCZv5LkZMuwofexpfflLKeVHw0t31HXuzBUZMoKqXiGJweyPDzY/xbeTVnYvQQEvoGxRDpaYuiGSfhFW0UHE3HSeuYfklO2x juanjose@aurora", "key_options": null, "keyfile": "/home/jj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jj", "validate_certs": true} 2019-11-29T12:18:28.388 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2019-11-29T12:18:28.419 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaetIvR7YgpCq142fBQtOYsJrOMW+Wxu1beNXPJ8qzT5MxD05sdKntVE0DPveUydaeI8/vHeNjXDKN8mt1eO7Lf/rDKHOW/Y/36bUfQAODru9sdNCEJfSPgq1y6+X1ISljvLBXOOl+nQXlx3n5OjThNQbmdthgCT2Fk4hEoK7gn4+ol6foTkTdUXIBam8LuPU6f1KIG6ae1oAVFWLeavAbvmxUTmVl04+hKJWSPnvZxWupaPuiHvsImaQ7GwBjKhzL1wSMly0+pa2zbVYZKkLBA7Fx6fzP7jcEieOOPM1YU0jR5JF+WVzeRFJ1V9n75yOw6S4ef/X/zwWx42cdfx3N nwatkins@martini\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDRivdSX6cbPrdMrjz1oYgn0hb8VQo+QU7wD+AcCQi/CH06ny+2QjSr7bfdpgQ81Wgwqt9+e3KcLD5qdt3tneC8sgSAR5QUQrWKhPejrqdV+3990k8k0KoKIOZ9MGFc1FBv5IpuT/2d535iHJb0ZEg8mFKqKDw71sBEoQT4WElatf5DeVC507hP7GnrhZgtTPcrVddOLkmmqTQtLE1zvo9Y/eel8O2JMImMd6mdVBIcFQ1alU1wV4jLdMpagoPelvVTVeNkGRnOgvvQac5RXtGSMP1R5PoGz+1FgRhDCtdTXRfOdtrlJPtUjYiGPpIoKIUymlvQGjUrrK3WiQIIkIfDtFFu48EN4drjgQpCEQ2D0NMKEmk74mjx3CJDOF1Nj/2Fa1kjECiz4EM7sR8dDG5cW5Y8XsDoomgugM+rsOH9kWFFClHUJmdlNGWLhJnu9UQHLYZjQw3zT0F+FXUsUxKJUVTUdxQx5HBO9QFsSe13NPDnX64+SQ2VVStt8oQAvFO+6260zbux0RVaJM5dTNwnIHD/uI3PeR1z2b+iKhyj/9VP2uBRpGydLw/etQu/lS2K30S+kZIDAp0sqwXH89bdq3AJBipcryrnW1Ov9K5Mfl1UlV95/MivrnOFISWN1F9XR1kuIIYdCkI7hq/FHZ9gd84AjTiERfxRv8VCIHBVEQ== nwatkins@redhat.com", "key_options": null, "keyfile": "/home/nwatkins/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nwatkins", "validate_certs": true} 2019-11-29T12:18:28.762 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2 2019-11-29T12:18:28.763 INFO:teuthology.task.ansible.out:CfQvUxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2019-11-29T12:18:29.115 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2019-11-29T12:18:29.126 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n', u'name': u'jj'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jj", "ovpn": "jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXvd7F0n4DeBROTLYDE4lItYn/2S1cMM1uAkkwissUh4LGsMAVWi5tUI0EUC7I2BUxACvIIA4yfkhe2ATAu95UQxKWVql67sfCW6WwY7lNa65kQC9S5dE/+d4vPxFoFSFnri981laJXOjbjTsWD7j1SGfqbRuAHQKL8y95DQ3y/B7/1oxTg1jjK8BTr3GAUp8/7lNlWE+x2S3gjHqqH92yWU7OBbPWRZjjkVkXS/5CbWDDUx8nbeGPcAIfM95rRQR0VkwzVi1FWsXd6qIbZ9TqOhYyLR0fCsnDuveNV68FB1ddvqCLdXRxPLmucwzdjGMbZ5EJ0H/CAAutj3Vjn6gh jj@newdream.net\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRXOkus/WHB3llEH1u4rWj0F/bZSslq4/o7pBUGFYrHKqa2iBiCj4DxBEsaReWUm0aDyesGuEVeoECTtzh7byJ6iZHFbf0McubxnuFMImneQ2mB0+raa3uWblwnyiwAqiZgtcJGQpCxCnrmLzyNN6xUUmzN27cDOMSDpbWr3VdPSBH+ixIuZI8r8UkSbmlX30V2bvk4lGl2SPV385tAvRPRU9KfMG9AgwNv+R2WCiA2GOrjes2VHm7LneqI/vE5yOxJsm4tPxEkOpCp3/0xt9L9cmPz47HnzJ2Qure3kZmOsCxOX1+9dXFIwhPaNconD4KDlv4MNs/M425Gp6KKnnV jj@laptop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBjrQ3drodiPr83uvpUUf6SXZ0utOFIfy5Cj3BGcn7bY29BKXCwomAUmmLMk76cGBZ7jHf3ZJYid1ESbHmvmSgKFShr9JFXBHvlMdnyewi7hFix+sjX9ZtuZfSaIsBbU5Jlz3RqHtDrScS1wJRh+ 2019-11-29T12:18:29.128 INFO:teuthology.task.ansible.out:oDlH6is5QWSCABVWhUk+hJtQFg4dfespqomt88NmPZuR0aR0b22hkrMYINXP0y3iz3Jjs5vg8td7VJ2hXb5yIBk+Izuq1LnjPyRCZv5LkZMuwofexpfflLKeVHw0t31HXuzBUZMoKqXiGJweyPDzY/xbeTVnYvQQEvoGxRDpaYuiGSfhFW0UHE3HSeuYfklO2x juanjose@aurora", "key_options": null, "keyfile": "/home/jj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jj", "validate_certs": true} 2019-11-29T12:18:29.468 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2019-11-29T12:18:29.479 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaetIvR7YgpCq142fBQtOYsJrOMW+Wxu1beNXPJ8qzT5MxD05sdKntVE0DPveUydaeI8/vHeNjXDKN8mt1eO7Lf/rDKHOW/Y/36bUfQAODru9sdNCEJfSPgq1y6+X1ISljvLBXOOl+nQXlx3n5OjThNQbmdthgCT2Fk4hEoK7gn4+ol6foTkTdUXIBam8LuPU6f1KIG6ae1oAVFWLeavAbvmxUTmVl04+hKJWSPnvZxWupaPuiHvsImaQ7GwBjKhzL1wSMly0+pa2zbVYZKkLBA7Fx6fzP7jcEieOOPM1YU0jR5JF+WVzeRFJ1V9n75yOw6S4ef/X/zwWx42cdfx3N nwatkins@martini\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDRivdSX6cbPrdMrjz1oYgn0hb8VQo+QU7wD+AcCQi/CH06ny+2QjSr7bfdpgQ81Wgwqt9+e3KcLD5qdt3tneC8sgSAR5QUQrWKhPejrqdV+3990k8k0KoKIOZ9MGFc1FBv5IpuT/2d535iHJb0ZEg8mFKqKDw71sBEoQT4WElatf5DeVC507hP7GnrhZgtTPcrVddOLkmmqTQtLE1zvo9Y/eel8O2JMImMd6mdVBIcFQ1alU1wV4jLdMpagoPelvVTVeNkGRnOgvvQac5RXtGSMP1R5PoGz+1FgRhDCtdTXRfOdtrlJPtUjYiGPpIoKIUymlvQGjUrrK3WiQIIkIfDtFFu48EN4drjgQpCEQ2D0NMKEmk74mjx3CJDOF1Nj/2Fa1kjECiz4EM7sR8dDG5cW5Y8XsDoomgugM+rsOH9kWFFClHUJmdlNGWLhJnu9UQHLYZjQw3zT0F+FXUsUxKJUVTUdxQx5HBO9QFsSe13NPDnX64+SQ2VVStt8oQAvFO+6260zbux0RVaJM5dTNwnIHD/uI3PeR1z2b+iKhyj/9VP2uBRpGydLw/etQu/lS2K30S+kZIDAp0sqwXH89bdq3AJBipcryrnW1Ov9K5Mfl1UlV95/MivrnOFISWN1F9XR1kuIIYdCkI7hq/FHZ9gd84AjTiERfxRv8VCIHBVEQ== nwatkins@redhat.com", "key_options": null, "keyfile": "/home/nwatkins/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nwatkins", "validate_certs": true} 2019-11-29T12:18:29.810 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA296in+8Sr9slF8hrzAV3dNz0q94Q4FlFaMYw08II5PQm6HOpabGOGOwOud/PPeh3lMUHhs45N5WnbgdfQdzz9lpDoNBcqxeACdMicdECMHtYWf2GuFUdTAnPBFVl8wFW5JcziQYJePUcAUJRXGGfdMLMppAi8VEuhMw/z3jz89UN+zf51Y9eT3rgAVSCR+Zn47kite4OB2S1aVMEcZBE0fPnh60i+rpN26s80fh3wG2N9JrPBEvst6LbL0aEixrlRUtoFHZuWNCIjntVMANa+idpuWSxN2dzfcoxpGLF1TFzqx0moznp0PnDs7ZAFFS1/EkeSCgBflyhPV6csG3VNw== jdillaman@ceph1.example.com", "key_options": null, "keyfile": "/home/jdillaman/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jdillaman", "validate_certs": true} 2019-11-29T12:18:29.842 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2019-11-29T12:18:30.156 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2019-11-29T12:18:30.188 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2019-11-29T12:18:30.509 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2019-11-29T12:18:30.541 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2019-11-29T12:18:30.853 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2019-11-29T12:18:30.916 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA296in+8Sr9slF8hrzAV3dNz0q94Q4FlFaMYw08II5PQm6HOpabGOGOwOud/PPeh3lMUHhs45N5WnbgdfQdzz9lpDoNBcqxeACdMicdECMHtYWf2GuFUdTAnPBFVl8wFW5JcziQYJePUcAUJRXGGfdMLMppAi8VEuhMw/z3jz89UN+zf51Y9eT3rgAVSCR+Zn47kite4OB2S1aVMEcZBE0fPnh60i+rpN26s80fh3wG2N9JrPBEvst6LbL0aEixrlRUtoFHZuWNCIjntVMANa+idpuWSxN2dzfcoxpGLF1TFzqx0moznp0PnDs7ZAFFS1/EkeSCgBflyhPV6csG3VNw== jdillaman@ceph1.example.com", "key_options": null, "keyfile": "/home/jdillaman/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jdillaman", "validate_certs": true} 2019-11-29T12:18:31.206 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDH/YT1mGZg50qDdngGQ4Ea+jfJGZ582J6pQbYkrvuGsyATMzNwk73sAbn7mgbpw7nkW/ol/vwahXHZ5heC056BFnqiZ7tjoDeotDx/1XxFtkbyIaVflUeD1vBww38v6IslLHcVhPilauPVZSfVzEHI7JB0a+9OwNrEH3+dt1B6vR+WRy2gHG/aEJffPMv4yv/0FgRWy3cEiUvGlLq0KVVTbsqqLQhw/u5k8bBIoibBtZLFAMTrjLYp9Dv8dxJROvmey6O2TuX6gCY1rLGTAArYULpXH73OLIqaksJKc3srgoJrTSZPO6bo3BQeLz4ODJ7uvTpvQIhacBpp/dq1ln7p owasserm@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCiqChxNdielMPBchs0u6bxWstqU9oeY2K9qf1PNwEIrwDYTrpDjsdoVnS750tOBjWY0wr9Gf9ATOJXi89151oao9GaUueQ1rTgmu7GtPlKsuBUVNMFzLEa0mqneqDA4AfknisFt/LnL8fLM4BddT25tmQ4oUGS7F17p4kXqwboK/DsJciCMWWc/5AT4NVwdnYFzIA6ta25/bB94kpktaZ6HDw7G8q/mK62Yza3EZfq8SP7p0sPL7oVsInQ9AutcVonmALgzPa9t1/MPGaXUIqARaWtwe4MSlNEIs4afLFyteBVeq+dgU01yeyjFivwVmuS+aPFTm6sjGGe8/gOsFDIJiVertOqi663m7q1WYGlVANfif7uL2+uJ9yrvOmrFh5s/CJMJBRG1SLfK1j/ivFwvPAQc/uMqEIRzrVZOsuNLPO4zHPWzmBAPUteb+2BqSdUFYMlBxb3lmhFFffroDqnOK1nbdAfmyKiosUizQgX2Gs2wjjtejuhS9dpYkNu+sBOujsxa2mZUouyWf4fXyWGVjthrCZaM+FyeSDpJrgwgRiSKNB8aRxB10ZNo9WZEy6eH2adp0Xf6v2KsKvryDndqBEkBI8zLbGrPVHGSEqiSBWc+NeAB06uSscJd0pHU3hDg0qW0EaxOXaial9qrBiwcFVKEr0g7LDURQ6KZsZy9w== owasserm@owasserm.redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2019-11-29T12:18:31.280 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2019-11-29T12:18:31.551 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9', u'name': u'abhishekvrshny'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhishekvrshny", "ovpn": "abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDAfEhx/xZpJV9ouKFW4QBC46cNicIQMzU8DSYl1GOP9+pnnD+AudVQubvrEePGA7TFkSar5Ccv4dnoQ2s1CaPAtbT+s+nQlf5OFO9P/qvhkM4JhlmH2XxgJAcOvZH2W1HXfGTc4WIuU/OtXM+yWMGlTXxqMqwCvGfqc+Yf8zkt0t3m0kBdWoFcZvdYqKuS15bvdVuiKz7GUxDrtw98yMXb/ob/E+Ygmmphn9dMatTeZ6SD1fbcrHh9oIVbYiY93+++jXzjEXrGzJh/gphgEtvIf8UPMF9HiXXPqwhxneRvghvZ/B05LGfcsqGAtyK09eF94hglyl9kJIdm/d7lmmM/ abhishek.varshney@VS-C02PJ2CSFVH5.local", "key_options": null, "keyfile": "/home/abhishekvrshny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhishekvrshny", "validate_certs": true} 2019-11-29T12:18:31.625 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2019-11-29T12:18:31.915 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6 2019-11-29T12:18:31.917 INFO:teuthology.task.ansible.out:AKY1OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2019-11-29T12:18:31.978 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2019-11-29T12:18:32.268 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2Ruq 2019-11-29T12:18:32.270 INFO:teuthology.task.ansible.out:iZyKz2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2019-11-29T12:18:32.332 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDH/YT1mGZg50qDdngGQ4Ea+jfJGZ582J6pQbYkrvuGsyATMzNwk73sAbn7mgbpw7nkW/ol/vwahXHZ5heC056BFnqiZ7tjoDeotDx/1XxFtkbyIaVflUeD1vBww38v6IslLHcVhPilauPVZSfVzEHI7JB0a+9OwNrEH3+dt1B6vR+WRy2gHG/aEJffPMv4yv/0FgRWy3cEiUvGlLq0KVVTbsqqLQhw/u5k8bBIoibBtZLFAMTrjLYp9Dv8dxJROvmey6O2TuX6gCY1rLGTAArYULpXH73OLIqaksJKc3srgoJrTSZPO6bo3BQeLz4ODJ7uvTpvQIhacBpp/dq1ln7p owasserm@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCiqChxNdielMPBchs0u6bxWstqU9oeY2K9qf1PNwEIrwDYTrpDjsdoVnS750tOBjWY0wr9Gf9ATOJXi89151oao9GaUueQ1rTgmu7GtPlKsuBUVNMFzLEa0mqneqDA4AfknisFt/LnL8fLM4BddT25tmQ4oUGS7F17p4kXqwboK/DsJciCMWWc/5AT4NVwdnYFzIA6ta25/bB94kpktaZ6HDw7G8q/mK62Yza3EZfq8SP7p0sPL7oVsInQ9AutcVonmALgzPa9t1/MPGaXUIqARaWtwe4MSlNEIs4afLFyteBVeq+dgU01yeyjFivwVmuS+aPFTm6sjGGe8/gOsFDIJiVertOqi663m7q1WYGlVANfif7uL2+uJ9yrvOmrFh5s/CJMJBRG1SLfK1j/ivFwvPAQc/uMqEIRzrVZOsuNLPO4zHPWzmBAPUteb+2BqSdUFYMlBxb3lmhFFffroDqnOK1nbdAfmyKiosUizQgX2Gs2wjjtejuhS9dpYkNu+sBOujsxa2mZUouyWf4fXyWGVjthrCZaM+FyeSDpJrgwgRiSKNB8aRxB10ZNo9WZEy6eH2adp0Xf6v2KsKvryDndqBEkBI8zLbGrPVHGSEqiSBWc+NeAB06uSscJd0pHU3hDg0qW0EaxOXaial9qrBiwcFVKEr0g7LDURQ6KZsZy9w== owasserm@owasserm.redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2019-11-29T12:18:32.620 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2019-11-29T12:18:32.683 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9', u'name': u'abhishekvrshny'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhishekvrshny", "ovpn": "abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDAfEhx/xZpJV9ouKFW4QBC46cNicIQMzU8DSYl1GOP9+pnnD+AudVQubvrEePGA7TFkSar5Ccv4dnoQ2s1CaPAtbT+s+nQlf5OFO9P/qvhkM4JhlmH2XxgJAcOvZH2W1HXfGTc4WIuU/OtXM+yWMGlTXxqMqwCvGfqc+Yf8zkt0t3m0kBdWoFcZvdYqKuS15bvdVuiKz7GUxDrtw98yMXb/ob/E+Ygmmphn9dMatTeZ6SD1fbcrHh9oIVbYiY93+++jXzjEXrGzJh/gphgEtvIf8UPMF9HiXXPqwhxneRvghvZ/B05LGfcsqGAtyK09eF94hglyl9kJIdm/d7lmmM/ abhishek.varshney@VS-C02PJ2CSFVH5.local", "key_options": null, "keyfile": "/home/abhishekvrshny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhishekvrshny", "validate_certs": true} 2019-11-29T12:18:32.951 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246', u'name': u'shehbazj'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shehbazj", "ovpn": "shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUqFGbkDz4L4BpIs2znPSWeawZZM2FBLrR3htaMBM6lcmiX2h+vgVGv2ZLpajGo7KB6J59kzWLBCJXN2DG0uUqa7dOdjEDuDrjZkNgDzXZ20lqzFAjLwNF6a9PcDN/oX6jzK9+3xArleQuTIJsOPRue2dQYGRnyIIrYpapJkkUgI+lXfwrEixCY3xjGNvVoh5bqQmkk3buLIvKEMwhPXJ94SGqsNTNC75HfKhVMjxA8QmuiXJVEgiW00V3Cctwv+yjiDMts4Dcs6yEzxXzjv0c0APxxN78bKlkwFgXiqawLiApk752/x2teSg7kvdrlGcCAWq/BhwphYjwaRlXIj1N shehbaz@donjaffer", "key_options": null, "keyfile": "/home/shehbazj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shehbazj", "validate_certs": true} 2019-11-29T12:18:33.045 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6 2019-11-29T12:18:33.047 INFO:teuthology.task.ansible.out:AKY1OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2019-11-29T12:18:33.283 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2019-11-29T12:18:33.418 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2Ruq 2019-11-29T12:18:33.420 INFO:teuthology.task.ansible.out:iZyKz2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2019-11-29T12:18:33.645 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3', u'name': u'fche'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "fche", "ovpn": "fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJorrIT68EZc7A4IHwQGv8uoblSAIUnMxhOq6rlnvmqx4clpUzKkbzzrZUctP47aeqaSX5Mc6mV8TY0sIH8fFQwahF3ueTKT3YecZvPwiK4ALmawkvFpmgnJKKYhTrEApbFBhtH0KnNLtozpl4RJds4p09maNeoUXJDy3A24tpXViU2Nrw8lSIT6VJzvqSlK+miNEf3VKI6gnRB7fGcJe913zITf09Rew7GexAyQUYHusZbJCf5rl6hkewkZMkgbXfG22f/XWcYjoRtA/ZqeWIP2UDO/H3tfJnlMxUshbDGLllMFJzwmwhkYbapqVmnu7Y01rEQ4LqvaHZMr/yKn+N fche@very.elastic.org", "key_options": null, "keyfile": "/home/fche/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "fche", "validate_certs": true} 2019-11-29T12:18:33.782 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2019-11-29T12:18:33.992 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4', u'name': u'onyb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "onyb", "ovpn": "ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmKchKXS6xKpo+25ZN5vMpbuL4OoFZWPfPSxur6iaBKdr6LSMejnAwkJOhfhH55pZLuAglHWdMcZi8H/ktzsZVd+ybvJNhpZsXdefNqqxUyjn320cT73pDdDC/W1519fUiokss23S6B4GR0B44VrVKezN5Dyhf4sATN8l76QnIALVK5hvYOI3v5k70weaPJM4fma7xYF5b6qSxauGofzMb5XwjNaaPE9F8U08nxGk5XK+S0rHoFnCjoKBlN9Ee1gk6PjsStQAyK5ujWvPGtG/UvuU9LewVbt6wuPbpwsf7Ck0u4wHECHK+185JF/X+qsWwv030pKShXblLVckNVhAx ani@orchid", "key_options": null, "keyfile": "/home/onyb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "onyb", "validate_certs": true} 2019-11-29T12:18:34.138 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246', u'name': u'shehbazj'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shehbazj", "ovpn": "shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUqFGbkDz4L4BpIs2znPSWeawZZM2FBLrR3htaMBM6lcmiX2h+vgVGv2ZLpajGo7KB6J59kzWLBCJXN2DG0uUqa7dOdjEDuDrjZkNgDzXZ20lqzFAjLwNF6a9PcDN/oX6jzK9+3xArleQuTIJsOPRue2dQYGRnyIIrYpapJkkUgI+lXfwrEixCY3xjGNvVoh5bqQmkk3buLIvKEMwhPXJ94SGqsNTNC75HfKhVMjxA8QmuiXJVEgiW00V3Cctwv+yjiDMts4Dcs6yEzxXzjv0c0APxxN78bKlkwFgXiqawLiApk752/x2teSg7kvdrlGcCAWq/BhwphYjwaRlXIj1N shehbaz@donjaffer", "key_options": null, "keyfile": "/home/shehbazj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shehbazj", "validate_certs": true} 2019-11-29T12:18:34.352 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2019-11-29T12:18:34.486 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2019-11-29T12:18:34.673 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3', u'name': u'oprypin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oprypin", "ovpn": "oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCzf8fjotuelTIdz7clDpSN/VDtXirYrmzM/r157Np9uTMgn/rhzzplp2DKqFrCEDwawJ1O1Fr/H5DqttPonyRmjPmAIf96P8KKLsC600R63xk4DNhnByY0WBU3o1e46LP7DJLsOOy6hZRbyjgoFfzcapH7aV+fa37k7/Ri5mpmdmENa6lYI38+YaItFJf0kTXdFou0iLAt7xogOTimgblMst6UjOhRIsMFA3QS4PvOFR+AedCHeVtYK9mAeRtQ530wKzjz8x4NFU3Y93jmygwTTG2RTEfRjfbObfFOQXJGKcl28pxGPUL9ZlrLx1juAekn2Uz+2oO/eQ8G5w+XW3rp", "key_options": null, "keyfile": "/home/oprypin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oprypin", "validate_certs": true} 2019-11-29T12:18:34.830 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3', u'name': u'fche'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "fche", "ovpn": "fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJorrIT68EZc7A4IHwQGv8uoblSAIUnMxhOq6rlnvmqx4clpUzKkbzzrZUctP47aeqaSX5Mc6mV8TY0sIH8fFQwahF3ueTKT3YecZvPwiK4ALmawkvFpmgnJKKYhTrEApbFBhtH0KnNLtozpl4RJds4p09maNeoUXJDy3A24tpXViU2Nrw8lSIT6VJzvqSlK+miNEf3VKI6gnRB7fGcJe913zITf09Rew7GexAyQUYHusZbJCf5rl6hkewkZMkgbXfG22f/XWcYjoRtA/ZqeWIP2UDO/H3tfJnlMxUshbDGLllMFJzwmwhkYbapqVmnu7Y01rEQ4LqvaHZMr/yKn+N fche@very.elastic.org", "key_options": null, "keyfile": "/home/fche/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "fche", "validate_certs": true} 2019-11-29T12:18:35.007 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options" 2019-11-29T12:18:35.009 INFO:teuthology.task.ansible.out:: null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2019-11-29T12:18:35.185 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4', u'name': u'onyb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "onyb", "ovpn": "ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmKchKXS6xKpo+25ZN5vMpbuL4OoFZWPfPSxur6iaBKdr6LSMejnAwkJOhfhH55pZLuAglHWdMcZi8H/ktzsZVd+ybvJNhpZsXdefNqqxUyjn320cT73pDdDC/W1519fUiokss23S6B4GR0B44VrVKezN5Dyhf4sATN8l76QnIALVK5hvYOI3v5k70weaPJM4fma7xYF5b6qSxauGofzMb5XwjNaaPE9F8U08nxGk5XK+S0rHoFnCjoKBlN9Ee1gk6PjsStQAyK5ujWvPGtG/UvuU9LewVbt6wuPbpwsf7Ck0u4wHECHK+185JF/X+qsWwv030pKShXblLVckNVhAx ani@orchid", "key_options": null, "keyfile": "/home/onyb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "onyb", "validate_certs": true} 2019-11-29T12:18:35.372 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+z 2019-11-29T12:18:35.374 INFO:teuthology.task.ansible.out:mfjEfdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbB 2019-11-29T12:18:35.375 INFO:teuthology.task.ansible.out:mS+dTzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2019-11-29T12:18:35.559 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2019-11-29T12:18:35.720 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2019-11-29T12:18:35.917 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3', u'name': u'oprypin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oprypin", "ovpn": "oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCzf8fjotuelTIdz7clDpSN/VDtXirYrmzM/r157Np9uTMgn/rhzzplp2DKqFrCEDwawJ1O1Fr/H5DqttPonyRmjPmAIf96P8KKLsC600R63xk4DNhnByY0WBU3o1e46LP7DJLsOOy6hZRbyjgoFfzcapH7aV+fa37k7/Ri5mpmdmENa6lYI38+YaItFJf0kTXdFou0iLAt7xogOTimgblMst6UjOhRIsMFA3QS4PvOFR+AedCHeVtYK9mAeRtQ530wKzjz8x4NFU3Y93jmygwTTG2RTEfRjfbObfFOQXJGKcl28pxGPUL9ZlrLx1juAekn2Uz+2oO/eQ8G5w+XW3rp", "key_options": null, "keyfile": "/home/oprypin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oprypin", "validate_certs": true} 2019-11-29T12:18:36.063 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2019-11-29T12:18:36.263 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options" 2019-11-29T12:18:36.264 INFO:teuthology.task.ansible.out:: null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2019-11-29T12:18:36.388 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2019-11-29T12:18:36.616 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+z 2019-11-29T12:18:36.618 INFO:teuthology.task.ansible.out:mfjEfdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbB 2019-11-29T12:18:36.619 INFO:teuthology.task.ansible.out:mS+dTzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2019-11-29T12:18:36.721 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051', u'name': u'asheplyakov'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "asheplyakov", "ovpn": "asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDLCJHta/5O2C2MXRegwo+bJUiqbkESr+RwoH/VIdb4L0JDlVsqV+K+BOBjLZy3vwzWCaSackvshoZHAwGvvfGXjtLbhAYs6QWWHODf/XWBvOW4a96fbTToNpV1dXkHAGqlJMYln3GKVD0o9b69iQUTcLILJhWQjCoTjZsvTtP9OYn9YLfuoxhaaU3PazZVhZYml4Ca/3ns9vNQ/m+v4nh82ysyflGKYozEq0pl8VH0Ydy/FtOO98PhQx3crrivu3qghubntVRQnULUmlDSFhMff+ukLVdj2U0AdSBatlJuaSofWUMAQkv0Ia/om9doDGv2TqkXhJnZdGaWJwmuh6rKIZr7d7TYTD6Uag3wJ1NKiDETRNtmMCLuniEJzPO4asBpSSWGyVatyrNmAgBb6XCeZRkRcYvTXdA5OESKG3HJeguk0XCrjosIEYcvxyye9SgA8U73jWdDUdh0yIHLWcfrgC2eynE1uBnTPNBvtnf9pKqMEp5opdRAUhckhPRxJQ2JHcYMAFnq7gz1bL2boL2ElZOqHBx9qgv0ZKnk+YXqhyp2EP2JK0urd0EHMqkGUsRc7D0FSrz+j4lSkd71sHu3tMgwIrgDR55wYMBBRXTrR8pGTMnGldDBaxvUCgWnlsTQJdjs9xCM5gcJzzgZgkRBmrTOUkw2ABre6KMRAmQ4Zg3HxO0MBr5rfV5glWXuDJXsEowLPp/NQ+3X7PIU9LAtKkcZPWC3MayoFdEdNpKieCgOfRAiwJ34fWz4ozM0IvENmUmCKz8+yDAOeupJJ1/367Rl3+U8XTsDNSsqcmsRdr8ZnUIN0662FGr/nHkVaDq79rEywt/V2eMLWyunF0FUUnbwBB8/J0hgIQPX1ncziuzPTF/YCTR6lgVEtvNHPI1xTQsaVQkF9Whu9Eq6Gz1cFq6H/abb1DLJAoO1Cy0HjoT8MjwOICVcsrqxGXsNRBsv4fCxOaz6+WyVWz2O5gpNKOLLmenr9JbiTGjamjfl9dDempRROSDjsJJY6TPdRb0WBuk3i6mOAsAYeBHoargi+a+dQ1IDzGdVY2mUXtDTA6HluZVvzEKnAR6QzuEdRLOrbteETRQ3cV9STXgscCTokzDNzhYbkLUIl/SRBYBdPMiR9TgW+m/0IJkBTEEUuDtYVzyHezV94F17vzpK+xbRdk3/WmWPScPDkc9tDp0AGLdZ/FAkNzGM1VE8G5OJ7OduogIdIQW6yR8y+CP1O4e2WYZ3M0IjJFX8pc/zBinUBNOBvgAzO8aSXTgxXbs/Q1fcv7htmJZ/3nnB4U6N85tq5oklCWulk3tIFI5pMGiQUoQCW8PH2nwasaKKtOInBZMWm8B2K0c5bU2/bKRcXJNJ asheplyakov@as-ubuntu", "key_options": null, "keyfile": "/home/asheplyakov/.ssh/authorized_keys 2019-11-29T12:18:36.723 INFO:teuthology.task.ansible.out:", "manage_dir": true, "path": null, "state": "present", "user": "asheplyakov", "validate_certs": true} 2019-11-29T12:18:36.959 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2019-11-29T12:18:37.064 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2019-11-29T12:18:37.323 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2019-11-29T12:18:37.418 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2019-11-29T12:18:37.670 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2019-11-29T12:18:37.773 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1r 2019-11-29T12:18:37.775 INFO:teuthology.task.ansible.out:J7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com", "key_options": null, "keyfile": "/home/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2019-11-29T12:18:38.012 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051', u'name': u'asheplyakov'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "asheplyakov", "ovpn": "asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDLCJHta/5O2C2MXRegwo+bJUiqbkESr+RwoH/VIdb4L0JDlVsqV+K+BOBjLZy3vwzWCaSackvshoZHAwGvvfGXjtLbhAYs6QWWHODf/XWBvOW4a96fbTToNpV1dXkHAGqlJMYln3GKVD0o9b69iQUTcLILJhWQjCoTjZsvTtP9OYn9YLfuoxhaaU3PazZVhZYml4Ca/3ns9vNQ/m+v4nh82ysyflGKYozEq0pl8VH0Ydy/FtOO98PhQx3crrivu3qghubntVRQnULUmlDSFhMff+ukLVdj2U0AdSBatlJuaSofWUMAQkv0Ia/om9doDGv2TqkXhJnZdGaWJwmuh6rKIZr7d7TYTD6Uag3wJ1NKiDETRNtmMCLuniEJzPO4asBpSSWGyVatyrNmAgBb6XCeZRkRcYvTXdA5OESKG3HJeguk0XCrjosIEYcvxyye9SgA8U73jWdDUdh0yIHLWcfrgC2eynE1uBnTPNBvtnf9pKqMEp5opdRAUhckhPRxJQ2JHcYMAFnq7gz1bL2boL2ElZOqHBx9qgv0ZKnk+YXqhyp2EP2JK0urd0EHMqkGUsRc7D0FSrz+j4lSkd71sHu3tMgwIrgDR55wYMBBRXTrR8pGTMnGldDBaxvUCgWnlsTQJdjs9xCM5gcJzzgZgkRBmrTOUkw2ABre6KMRAmQ4Zg3HxO0MBr5rfV5glWXuDJXsEowLPp/NQ+3X7PIU9LAtKkcZPWC3MayoFdEdNpKieCgOfRAiwJ34fWz4ozM0IvENmUmCKz8+yDAOeupJJ1/367Rl3+U8XTsDNSsqcmsRdr8ZnUIN0662FGr/nHkVaDq79rEywt/V2eMLWyunF0FUUnbwBB8/J0hgIQPX1ncziuzPTF/YCTR6lgVEtvNHPI1xTQsaVQkF9Whu9Eq6Gz1cFq6H/abb1DLJAoO1Cy0HjoT8MjwOICVcsrqxGXsNRBsv4fCxOaz6+WyVWz2O5gpNKOLLmenr9JbiTGjamjfl9dDempRROSDjsJJY6TPdRb0WBuk3i6mOAsAYeBHoargi+a+dQ1IDzGdVY2mUXtDTA6HluZVvzEKnAR6QzuEdRLOrbteETRQ3cV9STXgscCTokzDNzhYbkLUIl/SRBYBdPMiR9TgW+m/0IJkBTEEUuDtYVzyHezV94F17vzpK+xbRdk3/WmWPScPDkc9tDp0AGLdZ/FAkNzGM1VE8G5OJ7OduogIdIQW6yR8y+CP1O4e2WYZ3M0IjJFX8pc/zBinUBNOBvgAzO8aSXTgxXbs/Q1fcv7htmJZ/3nnB4U6N85tq5oklCWulk3tIFI5pMGiQUoQCW8PH2nwasaKKtOInBZMWm8B2K0c5bU2/bKRcXJNJ asheplyakov@as-ubuntu", "key_options": null, "keyfile": "/home/asheplyakov/.ssh/authorized_keys 2019-11-29T12:18:38.014 INFO:teuthology.task.ansible.out:", "manage_dir": true, "path": null, "state": "present", "user": "asheplyakov", "validate_certs": true} 2019-11-29T12:18:38.148 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9 ifed@37526", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2019-11-29T12:18:38.367 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2019-11-29T12:18:38.482 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEudQMGBPqfZBV8bXpdQOgVTDP6GFsr5oL4gdbHFMuJCGe0Sfq8LTaSEBQx0MH7tXc7JJ1fU51U7DSt0kfy/PFeV1Y5XnNATiZu/SzdO3jHe06/8CCr3DLnlEmzXASq+tqDJbY1eV011d/TX1jiC8Qd1VNbpdZYExEDsDzwJXnWdh6rjTL4anGjIgQWcmU0XdbUJXvRP4dGjVvZVHZnflAkxLPBbAx/8BBOuBmv6vP4hNs4poi4VLwR6S6Ha1fgMJmsn6StsCVuOvKBJFuGvaulHgHgdoDJ1ryUFikkXXCWoNx4IbwtpQIkSxWMuAovlwwk9G8ozSs+RrFzCavE0f omw@omw-dev", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2019-11-29T12:18:38.722 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2019-11-29T12:18:38.837 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0', u'name': u'jwilliamson'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jwilliamson", "ovpn": "jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCmp/WxBoQxK/3bI3N9X4INmChIFtG/75NULYt9CAAnoOhFHe8xHMOU4x/YS6JdoIBJXusrjbDhCksFSK/caoOow9CQp3VWytslRSjfjkjbwwWHSdcyGpSO4lS5F32SgLOZBuyktpkLDgi6Ou5OTNKokJO8qiZo9Uw0rEBNakfsVi+fpysUDL792Jk1ROUr0HUpwqrQfTPZaue+PomXPQSYIqf06EH1nJYho6D4jt/g6U0qc66WTW5dXTkWD2VVQjZbFGkamz0ICHBJ/Xpf4TjWQVotsYD5NtbvqPo6ygpJYNhKR2n2zA+L4Zu2n0AEib5S4ftNxc7gNDCCfVs/EEIvXp/3CjKVPxHf4xUUPUZj+SQFnSUPQfeY1iIydoX+IG9oj5kKmQBdQFxbAaZJ679bORIqlH73dUFGr2rfS1UlIgPW5ll77bixsB0GP3+Jw4FF5QbO+k1d5qJpUw+8D6FbWAppP7hnSAok9PTpBqfkMpFiX00ZTIFwKCBLxdtJOfbIhbOPCnyEoB2ZLfRiBJmXhBpLjGghWIPPnGZh+yeJiy/EyKwN57vLmjdmvcDgSsjHswT+rQ+QzPoF+/KcdU1LL6ME6i+R7o7aiLOdDpZo4p5d1kr3VMNjVNM+L9ECpTntPhyrglOX018Q8xcNRh2/z+G6NsiiV4t0YxFdk/ICTQ== Jesse.Williamson@suse.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCXsBAd8JfyMT352SjfhZ2Nj3gR2PkeyPS9yB6fKck5CW0Ns1EcUAOIFYw7a1R6zCDJbkkXZDRgM1W6v/UBgpOm69HaNCZuqx19mQRNgo1lhw6hDHc+9754wOmIbgu3gInIS/XPvGzAkGwBW3rWlOaNurY4Y/PH1QyiaujD1Ii9X2Q6yRP8hsDrccual36gngY6wV3G4xKbS8kTY4qQekHkgFT+ZDHv9ibliDfAxtzm5X8N25sICpvcnQkG+Co3QP2XADEhoQrs8L7QekKYPlX8zq6rJBO0cGYW50E58LJk7s67n7QQPCy04xeAf9KOZZBSMHTI8eSFHjb8B034IkHH jwilliamson@linux-z0c6", "key_options": null, "keyfile": "/home/jwilliamson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jwilliamson", "validate_certs": true} 2019-11-29T12:18:39.076 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com", "key_options": null, "keyfile": "/home/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2019-11-29T12:18:39.182 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user 2019-11-29T12:18:39.184 INFO:teuthology.task.ansible.out:": "gabrioux", "validate_certs": true} 2019-11-29T12:18:39.431 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9 ifed@37526", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2019-11-29T12:18:39.536 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2019-11-29T12:18:39.785 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEudQMGBPqfZBV8bXpdQOgVTDP6GFsr5oL4gdbHFMuJCGe0Sfq8LTaSEBQx0MH7tXc7JJ1fU51U7DSt0kfy/PFeV1Y5XnNATiZu/SzdO3jHe06/8CCr3DLnlEmzXASq+tqDJbY1eV011d/TX1jiC8Qd1VNbpdZYExEDsDzwJXnWdh6rjTL4anGjIgQWcmU0XdbUJXvRP4dGjVvZVHZnflAkxLPBbAx/8BBOuBmv6vP4hNs4poi4VLwR6S6Ha1fgMJmsn6StsCVuOvKBJFuGvaulHgHgdoDJ1ryUFikkXXCWoNx4IbwtpQIkSxWMuAovlwwk9G8ozSs+RrFzCavE0f omw@omw-dev", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2019-11-29T12:18:39.903 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2019-11-29T12:18:40.143 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0', u'name': u'jwilliamson'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jwilliamson", "ovpn": "jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCmp/WxBoQxK/3bI3N9X4INmChIFtG/75NULYt9CAAnoOhFHe8xHMOU4x/YS6JdoIBJXusrjbDhCksFSK/caoOow9CQp3VWytslRSjfjkjbwwWHSdcyGpSO4lS5F32SgLOZBuyktpkLDgi6Ou5OTNKokJO8qiZo9Uw0rEBNakfsVi+fpysUDL792Jk1ROUr0HUpwqrQfTPZaue+PomXPQSYIqf06EH1nJYho6D4jt/g6U0qc66WTW5dXTkWD2VVQjZbFGkamz0ICHBJ/Xpf4TjWQVotsYD5NtbvqPo6ygpJYNhKR2n2zA+L4Zu2n0AEib5S4ftNxc7gNDCCfVs/EEIvXp/3CjKVPxHf4xUUPUZj+SQFnSUPQfeY1iIydoX+IG9oj5kKmQBdQFxbAaZJ679bORIqlH73dUFGr2rfS1UlIgPW5ll77bixsB0GP3+Jw4FF5QbO+k1d5qJpUw+8D6FbWAppP7hnSAok9PTpBqfkMpFiX00ZTIFwKCBLxdtJOfbIhbOPCnyEoB2ZLfRiBJmXhBpLjGghWIPPnGZh+yeJiy/EyKwN57vLmjdmvcDgSsjHswT+rQ+QzPoF+/KcdU1LL6ME6i+R7o7aiLOdDpZo4p5d1kr3VMNjVNM+L9ECpTntPhyrglOX018Q8xcNRh2/z+G6NsiiV4t0YxFdk/ICTQ== Jesse.Williamson@suse.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCXsBAd8JfyMT352SjfhZ2Nj3gR2PkeyPS9yB6fKck5CW0Ns1EcUAOIFYw7a1R6zCDJbkkXZDRgM1W6v/UBgpOm69HaNCZuqx19mQRNgo1lhw6hDHc+9754wOmIbgu3gInIS/XPvGzAkGwBW3rWlOaNurY4Y/PH1QyiaujD1Ii9X2Q6yRP8hsDrccual36gngY6wV3G4xKbS8kTY4qQekHkgFT+ZDHv9ibliDfAxtzm5X8N25sICpvcnQkG+Co3QP2XADEhoQrs8L7QekKYPlX8zq6rJBO0cGYW50E58LJk7s67n7QQPCy04xeAf9KOZZBSMHTI8eSFHjb8B034IkHH jwilliamson@linux-z0c6", "key_options": null, "keyfile": "/home/jwilliamson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jwilliamson", "validate_certs": true} 2019-11-29T12:18:40.246 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS 2019-11-29T12:18:40.248 INFO:teuthology.task.ansible.out:33Kkke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2019-11-29T12:18:40.496 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user 2019-11-29T12:18:40.498 INFO:teuthology.task.ansible.out:": "gabrioux", "validate_certs": true} 2019-11-29T12:18:40.590 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2019-11-29T12:18:40.860 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2019-11-29T12:18:40.935 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2019-11-29T12:18:41.208 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2019-11-29T12:18:41.271 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77', u'name': u'liupan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "liupan", "ovpn": "liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDC3aWYoBDxRh13e+qver2xcmCtNsiVEt9NkN1cntdUxVbjfWgb+E/b54kPW456tswoVaYS+3xI5DYTPTN1tMhx8jnrgVKI2HhIYC3SO0+V+HNofzU1p7v5CfZxwyupXOgdfHmEWKOepPop8qWon8wZVUkj2t80w8Ifxh5gLVigGquc4kvMLyy6nBI0k6UGeRr9lSKmWLvzudWP70cWij3ynwxEeIuurU0HI9tDmjaVW5dJuu6IZHDhJrCpeUZBQIDqjH0pg1i1uXXwwiLI9NW8jWuALREDeMxAG4IgOZtoXdS7J9vVXHxKpa8ofb+qYNXI7B3OTLgjSS2ziiU1KEIr wanjun.lp@alibaba-inc.com", "key_options": null, "keyfile": "/home/liupan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "liupan", "validate_certs": true} 2019-11-29T12:18:41.552 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS 2019-11-29T12:18:41.553 INFO:teuthology.task.ansible.out:33Kkke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2019-11-29T12:18:41.615 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2019-11-29T12:18:41.851 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2019-11-29T12:18:41.956 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6', u'name': u'amarangone'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amarangone", "ovpn": "amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0PusmXbjqduPTosGmqFsi2cUjRIiWmMnATY/vuawopBxRNykGnyeh1MfVLgkulM6zBJ3cDZxLsZYykpsHGvaXgLL5r6bEOOKPu8sSMwaTfZWNewue6xa1vOYAggeWOt8KTd0IO/pZZfvFcJ80tjtcNvY8zOJ9TO5W7RpglfJhPneC9Kr726yZ4RX3Hqlx+nIMzrSlvZVtwsKikanImvGLDulRiHqgE5BcqGvDF1yCSIq4OYF2i2Sk+dnPnQtN2uePsxPYKikd0B/rua5q+hDDAz2I36NhaUIhLteE6acWJK5Z2s0o1rWAS5XMbF4qYM3nbaE1Au/nXHcjO3sf6mj3 amarangone@macair.local", "key_options": null, "keyfile": "/home/amarangone/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amarangone", "validate_certs": true} 2019-11-29T12:18:42.247 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2019-11-29T12:18:42.291 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2019-11-29T12:18:42.593 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77', u'name': u'liupan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "liupan", "ovpn": "liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDC3aWYoBDxRh13e+qver2xcmCtNsiVEt9NkN1cntdUxVbjfWgb+E/b54kPW456tswoVaYS+3xI5DYTPTN1tMhx8jnrgVKI2HhIYC3SO0+V+HNofzU1p7v5CfZxwyupXOgdfHmEWKOepPop8qWon8wZVUkj2t80w8Ifxh5gLVigGquc4kvMLyy6nBI0k6UGeRr9lSKmWLvzudWP70cWij3ynwxEeIuurU0HI9tDmjaVW5dJuu6IZHDhJrCpeUZBQIDqjH0pg1i1uXXwwiLI9NW8jWuALREDeMxAG4IgOZtoXdS7J9vVXHxKpa8ofb+qYNXI7B3OTLgjSS2ziiU1KEIr wanjun.lp@alibaba-inc.com", "key_options": null, "keyfile": "/home/liupan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "liupan", "validate_certs": true} 2019-11-29T12:18:42.638 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57', u'name': u'kmroz'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kmroz", "ovpn": "kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIGGibBaZykvZPLLQm/UIDUlqVxeyJvZEOO+/7pjqX3O47nilNILLnv/oWhQN1S5eGVev9lnTlTxqI0Mt0N/B9vbCxoxx3ujsSgc+FZL58rMBN4uaTvHhYgqOYo3ht6fciRqSvcqeOGNKU8HnXS0/C8bJrYoKUTnmaaZjQ0bSw/AMsAIxu3bZmWT+HfgVaMh9PjPgC+XnDypEcRkOLbeEIs+0s1TgSR7Hs/vEuVtLH3Ph4WZwKVKQhfugmbblLLNvHvTy0q5afdh2RQ9MEaUgxXMgVq4hJ/JcFNZp+ZU5irOPQosZfjSLWJKx/LH+Ye4/8nINi08w0MZgcK79CwukJ kmroz@suse.com", "key_options": null, "keyfile": "/home/kmroz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kmroz", "validate_certs": true} 2019-11-29T12:18:42.957 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2019-11-29T12:18:42.979 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2019-11-29T12:18:43.302 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6', u'name': u'amarangone'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amarangone", "ovpn": "amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0PusmXbjqduPTosGmqFsi2cUjRIiWmMnATY/vuawopBxRNykGnyeh1MfVLgkulM6zBJ3cDZxLsZYykpsHGvaXgLL5r6bEOOKPu8sSMwaTfZWNewue6xa1vOYAggeWOt8KTd0IO/pZZfvFcJ80tjtcNvY8zOJ9TO5W7RpglfJhPneC9Kr726yZ4RX3Hqlx+nIMzrSlvZVtwsKikanImvGLDulRiHqgE5BcqGvDF1yCSIq4OYF2i2Sk+dnPnQtN2uePsxPYKikd0B/rua5q+hDDAz2I36NhaUIhLteE6acWJK5Z2s0o1rWAS5XMbF4qYM3nbaE1Au/nXHcjO3sf6mj3 amarangone@macair.local", "key_options": null, "keyfile": "/home/amarangone/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amarangone", "validate_certs": true} 2019-11-29T12:18:43.334 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2019-11-29T12:18:43.654 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2019-11-29T12:18:43.666 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2019-11-29T12:18:44.009 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2019-11-29T12:18:44.010 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57', u'name': u'kmroz'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kmroz", "ovpn": "kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIGGibBaZykvZPLLQm/UIDUlqVxeyJvZEOO+/7pjqX3O47nilNILLnv/oWhQN1S5eGVev9lnTlTxqI0Mt0N/B9vbCxoxx3ujsSgc+FZL58rMBN4uaTvHhYgqOYo3ht6fciRqSvcqeOGNKU8HnXS0/C8bJrYoKUTnmaaZjQ0bSw/AMsAIxu3bZmWT+HfgVaMh9PjPgC+XnDypEcRkOLbeEIs+0s1TgSR7Hs/vEuVtLH3Ph4WZwKVKQhfugmbblLLNvHvTy0q5afdh2RQ9MEaUgxXMgVq4hJ/JcFNZp+ZU5irOPQosZfjSLWJKx/LH+Ye4/8nINi08w0MZgcK79CwukJ kmroz@suse.com", "key_options": null, "keyfile": "/home/kmroz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kmroz", "validate_certs": true} 2019-11-29T12:18:44.352 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2019-11-29T12:18:44.388 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2019-11-29T12:18:44.689 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2019-11-29T12:18:44.742 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2019-11-29T12:18:45.028 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n', u'name': u'adamyanova'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adamyanova", "ovpn": "adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDf1IrqEe8zPM6DWf8Y+WLRU+TwX8Xzki1CQDRwK/w/F7qxAuh9cbX8tCTkZUt0L3pUjGpM1C3bkTzLHaN4bxK1RQ/klB7C3AXjNOJSPJSjcn/N3YuKU3sKWuQkXnQTwqUdTzHuZ8lQWywFItmwQR2Y6T+xG/Ecig+vdU5lwQ479gtt/lB9buI+T10Lefk2bUiYq1PmKSCIF4KtsIdmSazmIQyvsbsBVblMEezCC0auwo7P7SdfSaobf4x4ZZyJfYkVxiL6eGJ8vmBSbJFrcVMkAO07wBtpn/gQa3Dt4xUdXXt7zBizpMmRPLm8m3Pl2kIJhqrIa1cFXPRr5GJ0YXzR mu3e@Mu3e\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNisR+EK2sG/E9dSeoEYCfgzIunFnuu+SFWGyWR3K6Q5Evt7bVAsGnjglNXdVgLbGV4Il+Z+FFgtR/oJgtUZ7G0IwWKG+nlx06hOu2DObsgM7gcIlhrf7SNsI13Bit0v5dQkyLwcmpdwioQyUx5hnx8UamqVo7lLtKsHS8melz7JE/+dnGwIMJLB1Ot/8PIRAb+/NRXpnD/lje5u8idr43bhreuJ6Lell+h8X2vomuvLlA5XjAoROY6L5qKoM3+bD4QXbU006VHg/7wl9tpZIi9XwAuHfaktsmfks+u3eYFCd9nYUKN20zbEecoAA1rOrCF1qhgwTYpa/Rmh7Iy53p mu3e@thinkpad-t510", "key_options": null, "keyfile": "/home/adamyanova/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adamyanova", "validate_certs": true} 2019-11-29T12:18:45.081 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2019-11-29T12:18:45.370 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2019-11-29T12:18:45.433 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2019-11-29T12:18:45.713 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2019-11-29T12:18:45.725 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2019-11-29T12:18:46.048 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2019-11-29T12:18:46.070 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2019-11-29T12:18:46.392 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2019-11-29T12:18:46.435 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n', u'name': u'adamyanova'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adamyanova", "ovpn": "adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDf1IrqEe8zPM6DWf8Y+WLRU+TwX8Xzki1CQDRwK/w/F7qxAuh9cbX8tCTkZUt0L3pUjGpM1C3bkTzLHaN4bxK1RQ/klB7C3AXjNOJSPJSjcn/N3YuKU3sKWuQkXnQTwqUdTzHuZ8lQWywFItmwQR2Y6T+xG/Ecig+vdU5lwQ479gtt/lB9buI+T10Lefk2bUiYq1PmKSCIF4KtsIdmSazmIQyvsbsBVblMEezCC0auwo7P7SdfSaobf4x4ZZyJfYkVxiL6eGJ8vmBSbJFrcVMkAO07wBtpn/gQa3Dt4xUdXXt7zBizpMmRPLm8m3Pl2kIJhqrIa1cFXPRr5GJ0YXzR mu3e@Mu3e\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNisR+EK2sG/E9dSeoEYCfgzIunFnuu+SFWGyWR3K6Q5Evt7bVAsGnjglNXdVgLbGV4Il+Z+FFgtR/oJgtUZ7G0IwWKG+nlx06hOu2DObsgM7gcIlhrf7SNsI13Bit0v5dQkyLwcmpdwioQyUx5hnx8UamqVo7lLtKsHS8melz7JE/+dnGwIMJLB1Ot/8PIRAb+/NRXpnD/lje5u8idr43bhreuJ6Lell+h8X2vomuvLlA5XjAoROY6L5qKoM3+bD4QXbU006VHg/7wl9tpZIi9XwAuHfaktsmfks+u3eYFCd9nYUKN20zbEecoAA1rOrCF1qhgwTYpa/Rmh7Iy53p mu3e@thinkpad-t510", "key_options": null, "keyfile": "/home/adamyanova/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adamyanova", "validate_certs": true} 2019-11-29T12:18:46.731 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9/Io6M3q8yQqoPNPKAPJ6Fzq18DMfmNtxcD8GUWNo0xcMxd7XOlarvYc7INDQjkpzx6s+aqMme55pSUZuN5plW+nuFmRPqBaIxyeCnNjzCch0wbtEZe5dzT270FhzM1Tu4W0dw+WD6zrGjXayLNs2uxNp3UrWtMTBRzd0IfxJ1R2aJtiCE/HNxIZn+bhS/OmEPV1izz23MvKXD+nRaeJK6Aqrg1zbnpoNskz2fZ/AnmhnAMc4EHl/NUyW1mi4g81KcQMwE8poWmw1NpZje9gWFcISVClLvvhk/A6at/v90P7PisX+/ulTA/QYJYvGBjgbNtURYu/PWzYBOAEZQGfj shilpa@dhcp35-184.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDqRSG3i8QY7t9sp6I8vDZ7LVdk+DDrMhI1QmvU2z+YQhUGDBOvvO6YP0gUXPDyalyj0sJXiwLWPmkrOsbnR96YCUcIt7Ba6R0d0w85JxcJ1WyPcsg2UyOBwq4A+s7VAFZm6FEWzlaubixsNp04gKDqBjSjaqA1Kwx8/Tg39byay8Hn3VJeZ1SkRukvhykz2e6gl7ydfuJQVmEyO3pTrd5157ZqgvQRABT10wc3vR2m4eC65hU/v0ci7HMY9oVtGEdWVBapWMuiocrOPCRWF5zrMJwW4vzPOCHa/47hBEIWfOWJidUVzAawnM3nOe7PykvvDK/iP8B6JpxKTE74eLeh shilpa@fedora.lab.eng.blr.redhat.com", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2019-11-29T12:18:46.794 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2019-11-29T12:18:47.065 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2019-11-29T12:18:47.118 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2019-11-29T12:18:47.394 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2019-11-29T12:18:47.488 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2019-11-29T12:18:47.731 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC709gIxs1RgiA95ddp2uymzgV84VHJVVMj71FyTlz6pa0gtlaxF+r16p8dnNWjhyJRUXMwBKFOwHx95bcdfiRA+BfC04UnI8VvBxoED5Nt9EbKD5h78ZoNEeQJKoG1dsM/kWWlTd9WCsCyzjRz32+YNWul0LOhrfloHP+LHnfjf/uOnzd8iRHgnpWr5Z9uB0MBu4y/L6AmHnR+8pMZQq6Bfno8ZLwNCzx9v+4MqOz3jY7FYv7SJIftQH0fJygIfCz3bKyUEWk9a/JJacETuJGBnHgNAXUr/FtM1IFiMl2SsTixRgnosEz4pX8EIe5LJyw/Qudro8BPEC8aIGy0XAkerGmTt5iALMnzmeeanZCFm4rF/YiFoHLMS/B0uv42MD64hB3knrV8Bcq+mRjwVOYgecO+xoiBsU6FZeXaBk5IsjmYTwataGv3ILEmNpss0WeqHxF9nd7oTLnw51cZfcaerOnJ5IZJZTXwLNVr7K176BunHggAhjvtvwdeKhphqt9f3ilLr6gzksEoAR4JBOYJJtd8sEqHwBtti+YbMGwH9Y+Z+SujlQBQIsom60xj5OzrwjsIi5JAtOhbc1Mq2fptSXRsR8ZBT8aUFqZ8R7ixEqq2F47OAznbhSQKidzwUNkWNI3WAKi38Oi4aya1k3iqtL04bGf8R/xD5Vq/2J+UlQ== vant alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2019-11-29T12:18:47.835 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2019-11-29T12:18:48.065 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2019-11-29T12:18:48.200 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9/Io6M3q8yQqoPNPKAPJ6Fzq18DMfmNtxcD8GUWNo0xcMxd7XOlarvYc7INDQjkpzx6s+aqMme55pSUZuN5plW+nuFmRPqBaIxyeCnNjzCch0wbtEZe5dzT270FhzM1Tu4W0dw+WD6zrGjXayLNs2uxNp3UrWtMTBRzd0IfxJ1R2aJtiCE/HNxIZn+bhS/OmEPV1izz23MvKXD+nRaeJK6Aqrg1zbnpoNskz2fZ/AnmhnAMc4EHl/NUyW1mi4g81KcQMwE8poWmw1NpZje9gWFcISVClLvvhk/A6at/v90P7PisX+/ulTA/QYJYvGBjgbNtURYu/PWzYBOAEZQGfj shilpa@dhcp35-184.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDqRSG3i8QY7t9sp6I8vDZ7LVdk+DDrMhI1QmvU2z+YQhUGDBOvvO6YP0gUXPDyalyj0sJXiwLWPmkrOsbnR96YCUcIt7Ba6R0d0w85JxcJ1WyPcsg2UyOBwq4A+s7VAFZm6FEWzlaubixsNp04gKDqBjSjaqA1Kwx8/Tg39byay8Hn3VJeZ1SkRukvhykz2e6gl7ydfuJQVmEyO3pTrd5157ZqgvQRABT10wc3vR2m4eC65hU/v0ci7HMY9oVtGEdWVBapWMuiocrOPCRWF5zrMJwW4vzPOCHa/47hBEIWfOWJidUVzAawnM3nOe7PykvvDK/iP8B6JpxKTE74eLeh shilpa@fedora.lab.eng.blr.redhat.com", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2019-11-29T12:18:48.418 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2019-11-29T12:18:48.532 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2019-11-29T12:18:48.773 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2019-11-29T12:18:48.888 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2019-11-29T12:18:49.106 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2019-11-29T12:18:49.242 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC709gIxs1RgiA95ddp2uymzgV84VHJVVMj71FyTlz6pa0gtlaxF+r16p8dnNWjhyJRUXMwBKFOwHx95bcdfiRA+BfC04UnI8VvBxoED5Nt9EbKD5h78ZoNEeQJKoG1dsM/kWWlTd9WCsCyzjRz32+YNWul0LOhrfloHP+LHnfjf/uOnzd8iRHgnpWr5Z9uB0MBu4y/L6AmHnR+8pMZQq6Bfno8ZLwNCzx9v+4MqOz3jY7FYv7SJIftQH0fJygIfCz3bKyUEWk9a/JJacETuJGBnHgNAXUr/FtM1IFiMl2SsTixRgnosEz4pX8EIe5LJyw/Qudro8BPEC8aIGy0XAkerGmTt5iALMnzmeeanZCFm4rF/YiFoHLMS/B0uv42MD64hB3knrV8Bcq+mRjwVOYgecO+xoiBsU6FZeXaBk5IsjmYTwataGv3ILEmNpss0WeqHxF9nd7oTLnw51cZfcaerOnJ5IZJZTXwLNVr7K176BunHggAhjvtvwdeKhphqt9f3ilLr6gzksEoAR4JBOYJJtd8sEqHwBtti+YbMGwH9Y+Z+SujlQBQIsom60xj5OzrwjsIi5JAtOhbc1Mq2fptSXRsR8ZBT8aUFqZ8R7ixEqq2F47OAznbhSQKidzwUNkWNI3WAKi38Oi4aya1k3iqtL04bGf8R/xD5Vq/2J+UlQ== vant alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2019-11-29T12:18:49.441 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2019-11-29T12:18:49.598 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2019-11-29T12:18:49.775 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2019-11-29T12:18:49.952 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2019-11-29T12:18:50.128 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC1OVCo0wMITAp8PNUqsTRPFz0SuBL0r1RzKFJUoxQm7gsP9qttZUQRlfiuZ7YRzkuGLOEBngPuIcV995o0lZ0+LVHA8jxWEJamb6sM9YgnonbGKDHfl4lT8LJd4YtjcWnMGvUUdPiPgIkfrpxXtx+RzJ7eCTmgRjAJziZrRh3AqXuKty+s9MDnmK8EQ2smpLdkMtZG5W3U2PiVaGgq2FIIOAoqr58xGqFgZ4tIpvWFpNxVsDZXIg2NdC+ouuKQvuJRWq9eERRHwq26CR+kDFNZeYSyhYKxNBqauLCsAoXNFCJzrdX5Oi9Ox4lJTsEtYX+SMziVipQS54F7MnRAUccukQ86IbXz8C5Ok2EzNo6smwRZ6UPKRvebWjIvfbeR/iwPRnrWcNgjGcaTR6yhlRJh8pBkW84nyY/bJa4WXsoNLgutdsYkjl18KKhbBldjdf0ovfL7FVgqYfAo/wpQYJJeMebP5QAczxvZIegjHRrAvbs/nbQTmuAkes3WL1hhBjSTwyIbWCzAuBJk8MNTmeZkVBvub7XoIyIySppfoJC/1a+ZsxGkzAlgrIxXPYrrBzTtXd/9YRiIgCYx3UtfdbPkE6hT6GblH6ST6QESfWyyvfGxwlOmu+F+icRyVVJbgM9T/PD2W6I04u2/1mcfoHwaQGdwvbbBkbjWzm+zwNSisQ== sanupkri@redhat.com", "key_options": null, "keyfile": "/home/sidharthanup/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sidharthanup", "validate_certs": true} 2019-11-29T12:18:50.294 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2019-11-29T12:18:50.492 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCkeYXWjU7wVdODC32U40QRFgFH7ZEuEsOeWWaKx3Y5EBuAcwkTHiF9Bq/2mrDu+c9W46S8L38Ogc9GZ0DcCXtN/Z4z8iKOIIi5U1GzvwdbKuiAPCd8bdYP0vo0MOIRgylJo5hcnB5BCwCXRN1hmci1ES5UbSeQg0rydMiyYXHZ64AT47+qVUpn/mVP6PVw00pPqt16l9YxhbPFG74Y/WnY4FyrqXGQJfv0tcP7+UR7GQdFiI4QQV3ZUSRHRLWGcmoiiOmGimLhtzEmP4Jzy4gF4wg9q8jyX54NjfxDRZs+YuaoqqWKz/HSz5ic7W2RGKHrRby2N9wNu19nmC1NzIn3 varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCW58OUR3pniaYgvr9xAExeNm4eMxgaJfFbEfEYPztTWv/xxqqihBYCeFltfgWbu7ERTy+hVNo1PJWyyczjl5Ivc3FdRmhykosygs7X74PPh02c7Em4MsSTr7SSPNN20rkJbWqiYMMOBbqbiZ7JXiSUNVilLHgZqZBEQc5Rf5I1PyBLHHJ2ZruPKnDPHCRLdwJ+MdXy2haKmGrQLhtzIKaDzh8VkfojL454k0aHCIh34Z0oBdP9757mNuYJUVEkKZF5t2oML84lWGMgwZxUWN2yO9ALTti4tNH1fXA6NipS9ztE+3hEJe1fWXEoUQDX9JNu4qEHTeCz0secQMkyZVDZSQk8yDUQxQ76yiett37sQB1WQR/3fclcahmqQ4dUS7M3Onyz6k6zia896PBK6G48TBUbFa1rw5Hx7WfNZluDMkv4YxkQvfz7XVzZx2/lhs45Kjh1UR9n7LaW/NID98vokcvASw1N6Bk/6pOd/45iPyEJemwovnQLs6ecwlMIikM= varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcQ8xMjwVf+KiFIQARcbFT+wg4NHysBRrFxk3Bx5X2k2hGKcEYR2tY/ApHZYfJ6me3LUvJEXg2c/6xa6ibVTUp/90l4y0cF6RmF5uB45J0xuBYoFJd8xJkVrhDIlZix4aFfb7TrmJEqjleBrkTwam7Q9aE3lss16nVOxU4hiViYiCANJ45wobK6tz7y5btfzrHE/iYpwniDvzLwK7EpkEK336VVd6f9wV0vG+ErEFxnNVxheXLLm05LuvdVQvFqJcTFrc7/GZ54yKg5IgwVwXqSAyOXIhgduUqk+oN1ciA7jnSqdiOKQPS/VmYkbhw2YP85l8wGVreIYUmOG19QEyVLB82oB9KS1LezM2KCH61XW22+85dHf4PvuL9DULhGt6wBCvpO10OHxw0JvHXbEgBPhiyd9j2yJmcQozbRPth/sMUvLKNXOGabZhhkPBYL7xZICHc+UwxrXs0h/j9jOjLyHzBAWMomF2lzgbvtzjcbxJ1a5oclJ6IW8yHJllkOh0= varsha@localhost.lo 2019-11-29T12:18:50.493 INFO:teuthology.task.ansible.out:caldomain", "key_options": null, "keyfile": "/home/varsha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "varsha", "validate_certs": true} 2019-11-29T12:18:50.649 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2019-11-29T12:18:50.845 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfb 2019-11-29T12:18:50.846 INFO:teuthology.task.ansible.out:smXq2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2019-11-29T12:18:51.012 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2019-11-29T12:18:51.187 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEJa/U9zUfZ7YFl0kwU7Mx3rHPn2O4sdh1J3XBUgoVdrJ4Qnh7i+QhN+fw0eaBWQE2GIsGEX6YWAL5xJ7EuYZyas8OVLNdP9cJIr79M51d8dG/ywqBpgcFnx7qhCSua3sKmP6GCTWGD9Y0eWL2Z6y9t3amb8dPXviMNqKGDz/DaDtp5bPaoG8mDHQ9QeADYYk3tx6V7+phIBXrI2GKt0BBlJeuZysiUI/XWO46JdMyHvCzvzcdquD446aoWS44waDGj501sgnHVQ7gwf4P1+vFOSEHzkWhbenpJmmTA26f4dim+Jo5JpBW/Ma5mMBvORFhH/Kt+S9P9sPCiF1shWc3 d@d", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2019-11-29T12:18:51.364 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2019-11-29T12:18:51.530 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2019-11-29T12:18:51.717 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC1OVCo0wMITAp8PNUqsTRPFz0SuBL0r1RzKFJUoxQm7gsP9qttZUQRlfiuZ7YRzkuGLOEBngPuIcV995o0lZ0+LVHA8jxWEJamb6sM9YgnonbGKDHfl4lT8LJd4YtjcWnMGvUUdPiPgIkfrpxXtx+RzJ7eCTmgRjAJziZrRh3AqXuKty+s9MDnmK8EQ2smpLdkMtZG5W3U2PiVaGgq2FIIOAoqr58xGqFgZ4tIpvWFpNxVsDZXIg2NdC+ouuKQvuJRWq9eERRHwq26CR+kDFNZeYSyhYKxNBqauLCsAoXNFCJzrdX5Oi9Ox4lJTsEtYX+SMziVipQS54F7MnRAUccukQ86IbXz8C5Ok2EzNo6smwRZ6UPKRvebWjIvfbeR/iwPRnrWcNgjGcaTR6yhlRJh8pBkW84nyY/bJa4WXsoNLgutdsYkjl18KKhbBldjdf0ovfL7FVgqYfAo/wpQYJJeMebP5QAczxvZIegjHRrAvbs/nbQTmuAkes3WL1hhBjSTwyIbWCzAuBJk8MNTmeZkVBvub7XoIyIySppfoJC/1a+ZsxGkzAlgrIxXPYrrBzTtXd/9YRiIgCYx3UtfdbPkE6hT6GblH6ST6QESfWyyvfGxwlOmu+F+icRyVVJbgM9T/PD2W6I04u2/1mcfoHwaQGdwvbbBkbjWzm+zwNSisQ== sanupkri@redhat.com", "key_options": null, "keyfile": "/home/sidharthanup/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sidharthanup", "validate_certs": true} 2019-11-29T12:18:51.879 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1q3k4RvLLCaG874GDJjja4eYqFwrMjsTU+aRzambaVuCmAJT3KQMGuwMjTuCIN7R1Fqr+/dxUClamsfsGqPMe0ASHT9X/0AyNgEkr6na1Fvk9NAwAFelwtiRIHhclzYf6KY8QHZN/eBy43prVKDXd30b15gwQyVqU0/xmny0GrYCN24k3N/R3divt2GVqptYgEwS2KEyFT5EMnJWjdIVG9mBOHrgec2VF/rc6w3BZ0s56iKdpOeCgk5ISYTcom+Xrf+fSDHirlviZv05tBP8ESmampUT/EnwF8Mdaln5XJvZPhrq2JpUisi9fVeR+zlzg6gRGubvokdA3AERrhCQ9 skoduri@rgw_vm", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2019-11-29T12:18:52.076 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCkeYXWjU7wVdODC32U40QRFgFH7ZEuEsOeWWaKx3Y5EBuAcwkTHiF9Bq/2mrDu+c9W46S8L38Ogc9GZ0DcCXtN/Z4z8iKOIIi5U1GzvwdbKuiAPCd8bdYP0vo0MOIRgylJo5hcnB5BCwCXRN1hmci1ES5UbSeQg0rydMiyYXHZ64AT47+qVUpn/mVP6PVw00pPqt16l9YxhbPFG74Y/WnY4FyrqXGQJfv0tcP7+UR7GQdFiI4QQV3ZUSRHRLWGcmoiiOmGimLhtzEmP4Jzy4gF4wg9q8jyX54NjfxDRZs+YuaoqqWKz/HSz5ic7W2RGKHrRby2N9wNu19nmC1NzIn3 varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCW58OUR3pniaYgvr9xAExeNm4eMxgaJfFbEfEYPztTWv/xxqqihBYCeFltfgWbu7ERTy+hVNo1PJWyyczjl5Ivc3FdRmhykosygs7X74PPh02c7Em4MsSTr7SSPNN20rkJbWqiYMMOBbqbiZ7JXiSUNVilLHgZqZBEQc5Rf5I1PyBLHHJ2ZruPKnDPHCRLdwJ+MdXy2haKmGrQLhtzIKaDzh8VkfojL454k0aHCIh34Z0oBdP9757mNuYJUVEkKZF5t2oML84lWGMgwZxUWN2yO9ALTti4tNH1fXA6NipS9ztE+3hEJe1fWXEoUQDX9JNu4qEHTeCz0secQMkyZVDZSQk8yDUQxQ76yiett37sQB1WQR/3fclcahmqQ4dUS7M3Onyz6k6zia896PBK6G48TBUbFa1rw5Hx7WfNZluDMkv4YxkQvfz7XVzZx2/lhs45Kjh1UR9n7LaW/NID98vokcvASw1N6Bk/6pOd/45iPyEJemwovnQLs6ecwlMIikM= varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcQ8xMjwVf+KiFIQARcbFT+wg4NHysBRrFxk3Bx5X2k2hGKcEYR2tY/ApHZYfJ6me3LUvJEXg2c/6xa6ibVTUp/90l4y0cF6RmF5uB45J0xuBYoFJd8xJkVrhDIlZix4aFfb7TrmJEqjleBrkTwam7Q9aE3lss16nVOxU4hiViYiCANJ45wobK6tz7y5btfzrHE/iYpwniDvzLwK7EpkEK336VVd6f9wV0vG+ErEFxnNVxheXLLm05LuvdVQvFqJcTFrc7/GZ54yKg5IgwVwXqSAyOXIhgduUqk+oN1ciA7jnSqdiOKQPS/VmYkbhw2YP85l8wGVreIYUmOG19QEyVLB82oB9KS1LezM2KCH61XW22+85dHf4PvuL9DULhGt6wBCvpO10OHxw0JvHXbEgBPhiyd9j2yJmcQozbRPth/sMUvLKNXOGabZhhkPBYL7xZICHc+UwxrXs0h/j9jOjLyHzBAWMomF2lzgbvtzjcbxJ1a5oclJ6IW8yHJllkOh0= varsha@localhost.lo 2019-11-29T12:18:52.078 INFO:teuthology.task.ansible.out:caldomain", "key_options": null, "keyfile": "/home/varsha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "varsha", "validate_certs": true} 2019-11-29T12:18:52.213 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2019-11-29T12:18:52.431 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfb 2019-11-29T12:18:52.433 INFO:teuthology.task.ansible.out:smXq2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2019-11-29T12:18:52.568 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2019-11-29T12:18:52.878 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEJa/U9zUfZ7YFl0kwU7Mx3rHPn2O4sdh1J3XBUgoVdrJ4Qnh7i+QhN+fw0eaBWQE2GIsGEX6YWAL5xJ7EuYZyas8OVLNdP9cJIr79M51d8dG/ywqBpgcFnx7qhCSua3sKmP6GCTWGD9Y0eWL2Z6y9t3amb8dPXviMNqKGDz/DaDtp5bPaoG8mDHQ9QeADYYk3tx6V7+phIBXrI2GKt0BBlJeuZysiUI/XWO46JdMyHvCzvzcdquD446aoWS44waDGj501sgnHVQ7gwf4P1+vFOSEHzkWhbenpJmmTA26f4dim+Jo5JpBW/Ma5mMBvORFhH/Kt+S9P9sPCiF1shWc3 d@d", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2019-11-29T12:18:52.910 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2019-11-29T12:18:53.230 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2019-11-29T12:18:53.252 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2019-11-29T12:18:53.584 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1q3k4RvLLCaG874GDJjja4eYqFwrMjsTU+aRzambaVuCmAJT3KQMGuwMjTuCIN7R1Fqr+/dxUClamsfsGqPMe0ASHT9X/0AyNgEkr6na1Fvk9NAwAFelwtiRIHhclzYf6KY8QHZN/eBy43prVKDXd30b15gwQyVqU0/xmny0GrYCN24k3N/R3divt2GVqptYgEwS2KEyFT5EMnJWjdIVG9mBOHrgec2VF/rc6w3BZ0s56iKdpOeCgk5ISYTcom+Xrf+fSDHirlviZv05tBP8ESmampUT/EnwF8Mdaln5XJvZPhrq2JpUisi9fVeR+zlzg6gRGubvokdA3AERrhCQ9 skoduri@rgw_vm", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2019-11-29T12:18:53.595 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2019-11-29T12:18:53.915 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2019-11-29T12:18:53.937 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2019-11-29T12:18:54.279 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2019-11-29T12:18:54.290 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2019-11-29T12:18:54.632 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2019-11-29T12:18:54.634 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2019-11-29T12:18:54.974 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2019-11-29T12:18:54.985 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2019-11-29T12:18:55.327 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2019-11-29T12:18:55.328 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2019-11-29T12:18:55.669 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2019-11-29T12:18:55.691 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2019-11-29T12:18:56.016 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_key 2019-11-29T12:18:56.017 INFO:teuthology.task.ansible.out:s", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2019-11-29T12:18:56.048 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2019-11-29T12:18:56.343 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlnlBzRdWRqns/9VrYuF9tLILUjeGd9z8Tf/dPZmxAt3nnZqpTvI2xXemQpyt/2lsD0U24EuTc1Y/dBsgqvXtZOw51TZE8RK26hvCCaKGfcKONjvR7goHAmkYPHK9+F6m7fgYkRzA0+ZW4HcWNh/xxhhL2G1EGfz5bzIoGQJHSdzc6VeVIsY7HiYEMTxvxdsgV72Kjq97BdmHm56RBzoH24oN0UzNZS8Syx5SuWj9dA3IyFBPwjLlozSk6U2Ofd7qaXuQKl807eD9g6RhRldzHPS+i0EK3EM6Jvho5Y08k1KqV4gIEwMdzDbD3SH0xq+nUPFKcDTUFNp+tkg10GxqN zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2019-11-29T12:18:56.386 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2019-11-29T12:18:56.687 INFO:teuthology.task.ansible.out:changed: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2019-11-29T12:18:56.753 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2019-11-29T12:18:56.790 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:18:56 +0000 (0:00:38.581) 0:01:32.898 ******* 2019-11-29T12:18:56.791 INFO:teuthology.task.ansible.out: 2019-11-29T12:18:56.833 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2019-11-29T12:18:56.834 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:56.844 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:56.845 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:56.847 INFO:teuthology.task.ansible.out: 2019-11-29T12:18:56.857 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47', u'name': u'adeza'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:56.868 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:56.869 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:56.879 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:56.891 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:56.891 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:57.099 INFO:teuthology.task.ansible.out: 2019-11-29T12:18:57.101 INFO:teuthology.task.ansible.out:TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2019-11-29T12:18:57.257 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} 2019-11-29T12:18:57.268 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:57.455 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2019-11-29T12:18:57.593 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemerson", "validate_certs": true} 2019-11-29T12:18:57.812 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsri 2019-11-29T12:18:57.814 INFO:teuthology.task.ansible.out:vas@redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2019-11-29T12:18:57.938 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9', u'name': u'sbillah', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC", "name": "sbillah", "ovpn": "sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC", "key_options": null, "keyfile": "/home/sbillah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sbillah", "validate_certs": true} 2019-11-29T12:18:58.156 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlnlBzRdWRqns/9VrYuF9tLILUjeGd9z8Tf/dPZmxAt3nnZqpTvI2xXemQpyt/2lsD0U24EuTc1Y/dBsgqvXtZOw51TZE8RK26hvCCaKGfcKONjvR7goHAmkYPHK9+F6m7fgYkRzA0+ZW4HcWNh/xxhhL2G1EGfz5bzIoGQJHSdzc6VeVIsY7HiYEMTxvxdsgV72Kjq97BdmHm56RBzoH24oN0UzNZS8Syx5SuWj9dA3IyFBPwjLlozSk6U2Ofd7qaXuQKl807eD9g6RhRldzHPS+i0EK3EM6Jvho5Y08k1KqV4gIEwMdzDbD3SH0xq+nUPFKcDTUFNp+tkg10GxqN zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2019-11-29T12:18:58.261 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2019-11-29T12:18:58.499 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** changed: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2019-11-29T12:18:58.596 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:18:58 +0000 (0:00:01.806) 0:01:34.704 ******* 2019-11-29T12:18:58.604 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2019-11-29T12:18:58.606 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2019-11-29T12:18:58.607 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:58.623 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:58.624 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:58.637 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:58.638 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:58.650 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:58.651 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:58.662 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:58.665 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:58.666 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47', u'name': u'adeza'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:58.668 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:58.669 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:58.680 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:58.681 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:58.682 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:58.693 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:58.694 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:58.697 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:58.706 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:58.708 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:58.709 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:58.720 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:58.732 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:58.733 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:58.744 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:58.755 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:58.757 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:58.768 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:58.779 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n', u'name': u'jj'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jj", "ovpn": "jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:58.790 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:58.791 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:58.802 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:58.803 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:58.815 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:58.826 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:58.837 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:58.838 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:58.849 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:58.860 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9', u'name': u'abhishekvrshny'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhishekvrshny", "ovpn": "abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:58.862 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:58.873 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:58.888 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:58.889 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246', u'name': u'shehbazj'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shehbazj", "ovpn": "shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:58.900 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:58.912 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3', u'name': u'fche'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "fche", "ovpn": "fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:58.913 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4', u'name': u'onyb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "onyb", "ovpn": "ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:58.924 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:58.936 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3', u'name': u'oprypin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oprypin", "ovpn": "oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:58.937 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:58.948 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:58.960 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:58.961 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:58.972 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:58.973 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051', u'name': u'asheplyakov'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "asheplyakov", "ovpn": "asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:58.984 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:58.996 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:58.997 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:59.009 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:59.020 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:59.031 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0', u'name': u'jwilliamson'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jwilliamson", "ovpn": "jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:59.032 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:59.044 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:59.055 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:59.056 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:59.067 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} 2019-11-29T12:18:59.069 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:59.070 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:59.071 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:59.082 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77', u'name': u'liupan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "liupan", "ovpn": "liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:59.093 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:59.105 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6', u'name': u'amarangone'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amarangone", "ovpn": "amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:59.106 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:59.117 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57', u'name': u'kmroz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kmroz", "ovpn": "kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:59.128 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:59.129 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:59.141 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:59.152 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:59.163 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:59.164 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:59.175 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n', u'name': u'adamyanova'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adamyanova", "ovpn": "adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:59.187 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:59.188 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:59.199 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:59.210 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:59.211 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:59.222 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:59.234 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:59.235 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:59.246 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:59.257 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:59.258 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:59.270 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:59.271 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:59.282 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:59.293 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:59.294 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:59.307 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:59.316 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:59.317 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:59.329 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:59.340 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:59.351 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:59.362 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:59.364 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:59.386 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:59.387 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:59.388 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:59.399 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:59.400 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemerson", "validate_certs": true} 2019-11-29T12:18:59.411 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:59.412 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:59.424 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:59.435 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:59.437 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:59.448 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:59.512 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:18:59 +0000 (0:00:00.912) 0:01:35.617 ******* 2019-11-29T12:18:59.539 INFO:teuthology.task.ansible.out: TASK [users : Filter the revoked_users list] *********************************** 2019-11-29T12:18:59.539 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:18:59.577 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:18:59 +0000 (0:00:00.067) 0:01:35.685 ******* 2019-11-29T12:18:59.750 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2019-11-29T12:18:59.752 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9', u'name': u'sbillah', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC", "name": "sbillah", "ovpn": "sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC", "key_options": null, "keyfile": "/home/sbillah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sbillah", "validate_certs": true} 2019-11-29T12:18:59.951 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi022.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2019-11-29T12:19:00.087 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2019-11-29T12:19:00.274 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi022.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2019-11-29T12:19:00.431 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2019-11-29T12:19:00.442 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:00.453 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:00.465 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:00.477 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:00.488 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:00.489 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:00.501 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:00.512 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:00.513 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:00.524 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:00.536 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:00.547 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:00.548 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:00.559 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:00.571 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:00.573 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:00.584 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:00.585 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:00.596 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n', u'name': u'jj'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jj", "ovpn": "jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:00.607 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:00.608 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-11-29T12:19:00.610 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2019-11-29T12:19:00.611 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:00.624 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:00.635 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:00.646 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:00.648 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:00.659 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:00.660 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:00.671 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:00.683 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9', u'name': u'abhishekvrshny'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhishekvrshny", "ovpn": "abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:00.694 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:00.695 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:00.706 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:00.717 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246', u'name': u'shehbazj'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shehbazj", "ovpn": "shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:00.717 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:00.728 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3', u'name': u'fche'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "fche", "ovpn": "fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:00.740 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4', u'name': u'onyb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "onyb", "ovpn": "ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:00.740 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:00.751 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3', u'name': u'oprypin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oprypin", "ovpn": "oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:00.762 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:00.773 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:00.774 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:00.785 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:00.796 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:00.796 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051', u'name': u'asheplyakov'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "asheplyakov", "ovpn": "asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:00.807 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:00.819 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:00.820 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:00.831 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:00.841 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:00.842 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0', u'name': u'jwilliamson'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jwilliamson", "ovpn": "jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:00.853 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:00.864 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:00.875 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:00.876 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:00.886 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:00.898 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:00.908 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77', u'name': u'liupan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "liupan", "ovpn": "liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:00.909 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:00.920 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6', u'name': u'amarangone'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amarangone", "ovpn": "amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:00.931 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:00.944 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57', u'name': u'kmroz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kmroz", "ovpn": "kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:00.952 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:00.953 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-11-29T12:19:00.955 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:00.965 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:00.976 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:00.977 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:00.988 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:00.999 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n', u'name': u'adamyanova'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adamyanova", "ovpn": "adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:01.000 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:01.011 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:01.022 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:01.040 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:01.040 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:01.042 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:01.052 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:01.062 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:01.074 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:01.074 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:01.085 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:01.096 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:01.097 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:01.107 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:01.119 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:01.119 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:01.130 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:01.256 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:01.266 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:01.267 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-11-29T12:19:01.269 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:01.279 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:01.290 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:01.291 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:01.302 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:01.313 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:01.313 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:01.324 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:01.335 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:01.335 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:01.348 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:01.360 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:01.361 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:01.372 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:01.384 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:01.470 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:01 +0000 (0:00:01.892) 0:01:37.577 ******* 2019-11-29T12:19:01.497 INFO:teuthology.task.ansible.out: TASK [users : Filter the revoked_users list] *********************************** 2019-11-29T12:19:01.499 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:01.534 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:01 +0000 (0:00:00.064) 0:01:37.641 ******* 2019-11-29T12:19:01.612 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-11-29T12:19:01.613 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2019-11-29T12:19:01.901 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2019-11-29T12:19:01.933 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2019-11-29T12:19:02.244 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2019-11-29T12:19:02.276 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2019-11-29T12:19:02.575 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2019-11-29T12:19:02.617 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2019-11-29T12:19:02.917 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2019-11-29T12:19:02.940 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2019-11-29T12:19:03.259 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2019-11-29T12:19:03.260 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2019-11-29T12:19:03.580 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2019-11-29T12:19:03.581 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2019-11-29T12:19:03.902 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2019-11-29T12:19:03.934 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2019-11-29T12:19:04.227 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2019-11-29T12:19:04.269 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2019-11-29T12:19:04.549 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2019-11-29T12:19:04.601 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2019-11-29T12:19:04.855 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2019-11-29T12:19:04.938 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2019-11-29T12:19:05.197 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2019-11-29T12:19:05.281 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2019-11-29T12:19:05.519 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2019-11-29T12:19:05.628 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2019-11-29T12:19:05.858 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2019-11-29T12:19:05.941 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2019-11-29T12:19:06.190 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "name": "loic", "state": "absent"} 2019-11-29T12:19:06.263 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2019-11-29T12:19:06.491 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2019-11-29T12:19:06.554 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2019-11-29T12:19:06.813 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2019-11-29T12:19:06.886 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2019-11-29T12:19:07.135 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2019-11-29T12:19:07.218 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2019-11-29T12:19:07.467 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2019-11-29T12:19:07.561 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2019-11-29T12:19:07.770 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2019-11-29T12:19:07.895 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2019-11-29T12:19:08.083 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2019-11-29T12:19:08.249 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "name": "loic", "state": "absent"} 2019-11-29T12:19:08.395 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2019-11-29T12:19:08.571 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2019-11-29T12:19:08.709 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2019-11-29T12:19:08.763 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:08 +0000 (0:00:07.228) 0:01:44.870 ******* 2019-11-29T12:19:08.924 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2019-11-29T12:19:09.265 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2019-11-29T12:19:09.607 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2019-11-29T12:19:09.855 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2019-11-29T12:19:09.857 INFO:teuthology.task.ansible.out:changed: [smithi022.front.sepia.ceph.com] => {"changed": true, "checksum": "50650ef8f5fa65d26a4b4e7fa94b1571b873d967", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "f08a845f35203e506ea1deb151ba8443", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1575029948.79-211746013715936/source", "state": "file", "uid": 0} 2019-11-29T12:19:09.892 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:09 +0000 (0:00:01.129) 0:01:46.000 ******* 2019-11-29T12:19:09.919 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2019-11-29T12:19:09.921 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => { "msg": "Host smithi022.front.sepia.ceph.com is running CentOS 7.6 (Core)" } 2019-11-29T12:19:09.957 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:09 +0000 (0:00:00.064) 0:01:46.064 ******* 2019-11-29T12:19:09.963 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-11-29T12:19:09.963 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2019-11-29T12:19:09.996 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2019-11-29T12:19:09.997 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2019-11-29T12:19:10.033 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:10 +0000 (0:00:00.076) 0:01:46.141 ******* 2019-11-29T12:19:10.060 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2019-11-29T12:19:10.061 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:10.097 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:10 +0000 (0:00:00.063) 0:01:46.204 ******* 2019-11-29T12:19:10.267 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-11-29T12:19:10.269 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2019-11-29T12:19:10.537 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2019-11-29T12:19:10.539 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => {"changed": false, "cmd": "timedatectl | grep -E \"Time ?zone\" | sed -e \"s/.*: \\(.*\\) (.*/\\1/\"", "delta": "0:00:00.100147", "end": "2019-11-29 12:19:10.501437", "rc": 0, "start": "2019-11-29 12:19:10.401290", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2019-11-29T12:19:10.573 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:10 +0000 (0:00:00.476) 0:01:46.681 ******* 2019-11-29T12:19:10.602 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2019-11-29T12:19:10.604 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** ok: [smithi062.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2019-11-29T12:19:10.639 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:10 +0000 (0:00:00.065) 0:01:46.746 ******* 2019-11-29T12:19:10.665 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2019-11-29T12:19:10.667 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:10.703 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:10 +0000 (0:00:00.064) 0:01:46.811 ******* 2019-11-29T12:19:10.729 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2019-11-29T12:19:10.731 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:10.766 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:10 +0000 (0:00:00.062) 0:01:46.874 ******* 2019-11-29T12:19:10.792 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2019-11-29T12:19:10.793 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:10.831 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:10 +0000 (0:00:00.065) 0:01:46.939 ******* 2019-11-29T12:19:10.858 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2019-11-29T12:19:10.859 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:10.897 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:10 +0000 (0:00:00.065) 0:01:47.004 ******* 2019-11-29T12:19:10.923 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-11-29T12:19:10.925 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2019-11-29T12:19:10.938 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2019-11-29T12:19:10.940 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:10.973 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:10 +0000 (0:00:00.076) 0:01:47.081 ******* 2019-11-29T12:19:11.010 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:11 +0000 (0:00:00.036) 0:01:47.118 ******* 2019-11-29T12:19:11.015 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2019-11-29T12:19:11.016 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-11-29T12:19:11.018 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-11-29T12:19:11.058 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:11 +0000 (0:00:00.047) 0:01:47.165 ******* 2019-11-29T12:19:11.084 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2019-11-29T12:19:11.086 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:11.121 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:11 +0000 (0:00:00.063) 0:01:47.228 ******* 2019-11-29T12:19:11.152 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2019-11-29T12:19:11.154 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:11.188 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:11 +0000 (0:00:00.067) 0:01:47.296 ******* 2019-11-29T12:19:11.215 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2019-11-29T12:19:11.217 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-11-29T12:19:11.258 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:11 +0000 (0:00:00.069) 0:01:47.366 ******* 2019-11-29T12:19:11.284 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2019-11-29T12:19:11.286 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:11.320 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:11 +0000 (0:00:00.061) 0:01:47.427 ******* 2019-11-29T12:19:11.346 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2019-11-29T12:19:11.347 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-11-29T12:19:11.383 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:11 +0000 (0:00:00.063) 0:01:47.491 ******* 2019-11-29T12:19:11.409 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2019-11-29T12:19:11.410 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:11.450 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:11 +0000 (0:00:00.067) 0:01:47.558 ******* 2019-11-29T12:19:11.477 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2019-11-29T12:19:11.478 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:11.513 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:11 +0000 (0:00:00.063) 0:01:47.621 ******* 2019-11-29T12:19:11.540 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2019-11-29T12:19:11.541 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:11.577 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:11 +0000 (0:00:00.063) 0:01:47.684 ******* 2019-11-29T12:19:11.603 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2019-11-29T12:19:11.605 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:11.641 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:11 +0000 (0:00:00.064) 0:01:47.749 ******* 2019-11-29T12:19:11.667 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2019-11-29T12:19:11.669 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-11-29T12:19:11.703 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:11 +0000 (0:00:00.062) 0:01:47.811 ******* 2019-11-29T12:19:11.729 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2019-11-29T12:19:11.730 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:11.765 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:11 +0000 (0:00:00.061) 0:01:47.873 ******* 2019-11-29T12:19:11.790 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2019-11-29T12:19:11.791 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:11.825 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:11 +0000 (0:00:00.060) 0:01:47.933 ******* 2019-11-29T12:19:11.850 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2019-11-29T12:19:11.851 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:11.886 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:11 +0000 (0:00:00.060) 0:01:47.994 ******* 2019-11-29T12:19:11.911 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2019-11-29T12:19:11.912 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:11.946 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:11 +0000 (0:00:00.059) 0:01:48.054 ******* 2019-11-29T12:19:11.981 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2019-11-29T12:19:11.982 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:12.022 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:12 +0000 (0:00:00.075) 0:01:48.130 ******* 2019-11-29T12:19:12.047 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2019-11-29T12:19:12.049 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:12.084 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:12 +0000 (0:00:00.061) 0:01:48.191 ******* 2019-11-29T12:19:12.109 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2019-11-29T12:19:12.110 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => {"changed": true, "checksum": "50650ef8f5fa65d26a4b4e7fa94b1571b873d967", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "f08a845f35203e506ea1deb151ba8443", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1575029951.03-239568096921378/source", "state": "file", "uid": 0} 2019-11-29T12:19:12.111 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** skipping: [smithi022.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-11-29T12:19:12.148 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:12 +0000 (0:00:00.064) 0:01:48.255 ******* 2019-11-29T12:19:12.180 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:12 +0000 (0:00:00.031) 0:01:48.287 ******* 2019-11-29T12:19:12.184 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2019-11-29T12:19:12.222 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:12 +0000 (0:00:00.041) 0:01:48.329 ******* 2019-11-29T12:19:12.227 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2019-11-29T12:19:12.227 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => { "msg": "Host smithi062.front.sepia.ceph.com is running CentOS 7.6 (Core)" } 2019-11-29T12:19:12.267 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:12 +0000 (0:00:00.045) 0:01:48.375 ******* 2019-11-29T12:19:12.272 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2019-11-29T12:19:12.272 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:12.313 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:12 +0000 (0:00:00.046) 0:01:48.421 ******* 2019-11-29T12:19:12.319 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2019-11-29T12:19:12.319 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2019-11-29T12:19:12.358 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:12 +0000 (0:00:00.044) 0:01:48.465 ******* 2019-11-29T12:19:12.385 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2019-11-29T12:19:12.386 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:12.420 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:12 +0000 (0:00:00.062) 0:01:48.528 ******* 2019-11-29T12:19:12.642 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2019-11-29T12:19:12.644 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-11-29T12:19:12.680 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:12 +0000 (0:00:00.259) 0:01:48.787 ******* 2019-11-29T12:19:12.852 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2019-11-29T12:19:12.853 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "cmd": "timedatectl | grep -E \"Time ?zone\" | sed -e \"s/.*: \\(.*\\) (.*/\\1/\"", "delta": "0:00:00.100055", "end": "2019-11-29 12:19:12.830986", "rc": 0, "start": "2019-11-29 12:19:12.730931", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2019-11-29T12:19:12.889 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:12 +0000 (0:00:00.209) 0:01:48.997 ******* 2019-11-29T12:19:12.914 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2019-11-29T12:19:12.916 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:12.950 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:12 +0000 (0:00:00.060) 0:01:49.057 ******* 2019-11-29T12:19:12.975 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2019-11-29T12:19:12.977 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:13.011 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:13 +0000 (0:00:00.061) 0:01:49.119 ******* 2019-11-29T12:19:13.037 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2019-11-29T12:19:13.039 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:13.074 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:13 +0000 (0:00:00.062) 0:01:49.182 ******* 2019-11-29T12:19:13.100 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2019-11-29T12:19:13.101 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:13.136 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:13 +0000 (0:00:00.061) 0:01:49.243 ******* 2019-11-29T12:19:13.160 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2019-11-29T12:19:13.162 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:13.199 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:13 +0000 (0:00:00.062) 0:01:49.306 ******* 2019-11-29T12:19:13.224 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2019-11-29T12:19:13.226 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:13.261 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:13 +0000 (0:00:00.062) 0:01:49.369 ******* 2019-11-29T12:19:13.297 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2019-11-29T12:19:13.299 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} skipping: [smithi062.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-11-29T12:19:13.336 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:13 +0000 (0:00:00.075) 0:01:49.444 ******* 2019-11-29T12:19:13.362 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2019-11-29T12:19:13.364 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:13.398 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:13 +0000 (0:00:00.062) 0:01:49.506 ******* 2019-11-29T12:19:13.424 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2019-11-29T12:19:13.426 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:13.462 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:13 +0000 (0:00:00.063) 0:01:49.570 ******* 2019-11-29T12:19:13.488 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2019-11-29T12:19:13.489 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-11-29T12:19:13.524 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:13 +0000 (0:00:00.062) 0:01:49.632 ******* 2019-11-29T12:19:13.549 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2019-11-29T12:19:13.551 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:13.585 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:13 +0000 (0:00:00.061) 0:01:49.693 ******* 2019-11-29T12:19:13.610 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2019-11-29T12:19:13.612 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-11-29T12:19:13.646 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:13 +0000 (0:00:00.061) 0:01:49.754 ******* 2019-11-29T12:19:13.671 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2019-11-29T12:19:13.672 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:13.712 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:13 +0000 (0:00:00.065) 0:01:49.819 ******* 2019-11-29T12:19:13.738 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2019-11-29T12:19:13.739 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:13.774 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:13 +0000 (0:00:00.062) 0:01:49.882 ******* 2019-11-29T12:19:13.811 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2019-11-29T12:19:13.812 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:13.852 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:13 +0000 (0:00:00.077) 0:01:49.959 ******* 2019-11-29T12:19:13.877 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2019-11-29T12:19:13.879 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:13.914 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:13 +0000 (0:00:00.062) 0:01:50.022 ******* 2019-11-29T12:19:13.920 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2019-11-29T12:19:13.921 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/7/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "1d6dcd385d1b7c9c2b757c62b841c887e90d7f66", "dest": "/etc/yum.repos.d/epel.repo", "gid": 0, "group": "root", "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/7/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 293, "state": "file", "uid": 0} 2019-11-29T12:19:13.944 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2019-11-29T12:19:13.946 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-11-29T12:19:13.981 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:13 +0000 (0:00:00.066) 0:01:50.089 ******* 2019-11-29T12:19:14.007 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2019-11-29T12:19:14.008 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:14.043 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:14 +0000 (0:00:00.061) 0:01:50.150 ******* 2019-11-29T12:19:14.068 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2019-11-29T12:19:14.070 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:14.103 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:14 +0000 (0:00:00.059) 0:01:50.210 ******* 2019-11-29T12:19:14.129 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2019-11-29T12:19:14.130 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:14.164 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:14 +0000 (0:00:00.061) 0:01:50.272 ******* 2019-11-29T12:19:14.190 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2019-11-29T12:19:14.191 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:14.227 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:14 +0000 (0:00:00.062) 0:01:50.335 ******* 2019-11-29T12:19:14.253 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2019-11-29T12:19:14.254 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:14.287 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:14 +0000 (0:00:00.060) 0:01:50.395 ******* 2019-11-29T12:19:14.313 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2019-11-29T12:19:14.314 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:14.352 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:14 +0000 (0:00:00.065) 0:01:50.460 ******* 2019-11-29T12:19:14.378 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2019-11-29T12:19:14.380 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-11-29T12:19:14.413 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:14 +0000 (0:00:00.060) 0:01:50.520 ******* 2019-11-29T12:19:14.438 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2019-11-29T12:19:14.474 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:14 +0000 (0:00:00.060) 0:01:50.581 ******* 2019-11-29T12:19:14.500 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2019-11-29T12:19:14.502 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:14.534 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:14 +0000 (0:00:00.060) 0:01:50.642 ******* 2019-11-29T12:19:14.830 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2019-11-29T12:19:14.831 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/7/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "d9691278f687ee76cfe8a3de60fcbd4f1f79a8c6", "dest": "/etc/yum.repos.d/epel-testing.repo", "gid": 0, "group": "root", "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/7/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 327, "state": "file", "uid": 0} 2019-11-29T12:19:14.872 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:14 +0000 (0:00:00.337) 0:01:50.980 ******* 2019-11-29T12:19:14.878 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2019-11-29T12:19:14.878 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-11-29T12:19:14.916 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:14 +0000 (0:00:00.044) 0:01:51.024 ******* 2019-11-29T12:19:15.860 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2019-11-29T12:19:15.861 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/7/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "1d6dcd385d1b7c9c2b757c62b841c887e90d7f66", "dest": "/etc/yum.repos.d/epel.repo", "gid": 0, "group": "root", "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/7/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 293, "state": "file", "uid": 0} 2019-11-29T12:19:15.997 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2019-11-29T12:19:15.998 INFO:teuthology.task.ansible.out:changed: [smithi022.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": true, "checksum": "73c387451a4fa299c9cb53e25b182ae50e8b8563", "dest": "/etc/yum.repos.d/epel-mirrorlist", "gid": 0, "group": "root", "item": "epel-mirrorlist", "md5sum": "6467980f3cbb5aa63a3cfe239626f53e", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:system_conf_t:s0", "size": 418, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1575029954.91-215585247702023/source", "state": "file", "uid": 0} 2019-11-29T12:19:16.743 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2019-11-29T12:19:16.745 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/7/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "d9691278f687ee76cfe8a3de60fcbd4f1f79a8c6", "dest": "/etc/yum.repos.d/epel-testing.repo", "gid": 0, "group": "root", "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/7/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 327, "state": "file", "uid": 0} 2019-11-29T12:19:16.785 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:16 +0000 (0:00:01.868) 0:01:52.892 ******* 2019-11-29T12:19:17.123 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2019-11-29T12:19:17.123 INFO:teuthology.task.ansible.out:changed: [smithi022.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": true, "checksum": "9d25e11bf71dfd21a39ace708c03408897a4f263", "dest": "/etc/yum.repos.d/epel-testing-mirrorlist", "gid": 0, "group": "root", "item": "epel-testing-mirrorlist", "md5sum": "0848bb8607c5b0c5706d8e1930fa7d55", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:system_conf_t:s0", "size": 474, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1575029956.01-145153753465445/source", "state": "file", "uid": 0} 2019-11-29T12:19:17.165 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:17 +0000 (0:00:00.380) 0:01:53.272 ******* 2019-11-29T12:19:17.166 INFO:teuthology.task.ansible.out: 2019-11-29T12:19:17.744 INFO:teuthology.task.ansible.out: TASK [common : Temporarily comment mirrorlist so we can update yum cache] ****** 2019-11-29T12:19:17.745 INFO:teuthology.task.ansible.out:changed: [smithi022.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/7/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/7/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "msg": "1 replacements made", "warnings": ["Module remote_tmp /root/.ansible/tmp did not exist and was created with a mode of 0700, this may cause issues when running as another user. To avoid this, create the remote_tmp dir with the correct permissions manually"]} 2019-11-29T12:19:17.830 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2019-11-29T12:19:17.831 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": true, "checksum": "73c387451a4fa299c9cb53e25b182ae50e8b8563", "dest": "/etc/yum.repos.d/epel-mirrorlist", "gid": 0, "group": "root", "item": "epel-mirrorlist", "md5sum": "6467980f3cbb5aa63a3cfe239626f53e", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:system_conf_t:s0", "size": 418, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1575029956.82-96388900457648/source", "state": "file", "uid": 0} 2019-11-29T12:19:18.053 INFO:teuthology.task.ansible.out: TASK [common : Temporarily comment mirrorlist so we can update yum cache] ****** 2019-11-29T12:19:18.054 INFO:teuthology.task.ansible.out:changed: [smithi022.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/7/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/7/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "msg": "1 replacements made"} 2019-11-29T12:19:18.056 INFO:teuthology.task.ansible.out: [WARNING]: Module remote_tmp /root/.ansible/tmp did not exist and was created with a mode of 0700, this may cause issues when running as another user. To avoid this, create the remote_tmp dir with the correct permissions manually 2019-11-29T12:19:18.091 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:18 +0000 (0:00:00.926) 0:01:54.198 ******* 2019-11-29T12:19:18.931 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2019-11-29T12:19:18.932 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": true, "checksum": "9d25e11bf71dfd21a39ace708c03408897a4f263", "dest": "/etc/yum.repos.d/epel-testing-mirrorlist", "gid": 0, "group": "root", "item": "epel-testing-mirrorlist", "md5sum": "0848bb8607c5b0c5706d8e1930fa7d55", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:system_conf_t:s0", "size": 474, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1575029957.84-199862913424933/source", "state": "file", "uid": 0} 2019-11-29T12:19:18.969 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:18 +0000 (0:00:00.878) 0:01:55.077 ******* 2019-11-29T12:19:19.329 INFO:teuthology.task.ansible.out: TASK [common : Temporarily comment mirrorlist so we can update yum cache] ****** 2019-11-29T12:19:19.330 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/7/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/7/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "msg": "1 replacements made", "warnings": ["Module remote_tmp /root/.ansible/tmp did not exist and was created with a mode of 0700, this may cause issues when running as another user. To avoid this, create the remote_tmp dir with the correct permissions manually"]} 2019-11-29T12:19:19.653 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/7/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/7/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "msg": "1 replacements made"} 2019-11-29T12:19:19.691 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:19 +0000 (0:00:00.722) 0:01:55.799 ******* 2019-11-29T12:19:30.814 INFO:teuthology.task.ansible.out: TASK [common : Update yum cache] *********************************************** 2019-11-29T12:19:30.816 INFO:teuthology.task.ansible.out: [WARNING]: Consider using the file module with state=absent rather than running 'rm'. If you need to use command because file is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. changed: [smithi022.front.sepia.ceph.com] => {"changed": true, "cmd": "rm -rf /var/cache/yum/*; yum clean all; yum makecache", "delta": "0:00:12.388458", "end": "2019-11-29 12:19:30.783370", "rc": 0, "start": "2019-11-29 12:19:18.394912", "stderr": "", "stderr_lines": [], "stdout": "Loaded plugins: fastestmirror, langpacks, priorities\nCleaning repos: base centos7-fcgi-ceph epel extras lab-extras updates\nLoaded plugins: fastestmirror, langpacks, priorities\nDetermining fastest mirrors\n * base: mirror.us-midwest-1.nexcess.net\n * extras: mirror.rackspace.com\n * updates: reflector.westga.edu\nMetadata Cache Created", "stdout_lines": ["Loaded plugins: fastestmirror, langpacks, priorities", "Cleaning repos: base centos7-fcgi-ceph epel extras lab-extras updates", "Loaded plugins: fastestmirror, langpacks, priorities", "Determining fastest mirrors", " * base: mirror.us-midwest-1.nexcess.net", " * extras: mirror.rackspace.com", " * updates: reflector.westga.edu", "Metadata Cache Created"]} 2019-11-29T12:19:30.853 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:30 +0000 (0:00:11.160) 0:02:06.960 ******* 2019-11-29T12:19:31.191 INFO:teuthology.task.ansible.out: TASK [common : Uncomment mirrorlist] ******************************************* 2019-11-29T12:19:31.192 INFO:teuthology.task.ansible.out:changed: [smithi022.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/7/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/7/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "msg": "1 replacements made"} 2019-11-29T12:19:31.515 INFO:teuthology.task.ansible.out:changed: [smithi022.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/7/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/7/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "msg": "1 replacements made"} 2019-11-29T12:19:31.553 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:31 +0000 (0:00:00.699) 0:02:07.660 ******* 2019-11-29T12:19:31.578 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2019-11-29T12:19:31.579 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:31.615 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:31 +0000 (0:00:00.061) 0:02:07.722 ******* 2019-11-29T12:19:31.640 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2019-11-29T12:19:31.641 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:31.677 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:31 +0000 (0:00:00.062) 0:02:07.785 ******* 2019-11-29T12:19:31.706 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2019-11-29T12:19:31.707 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:31.743 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:31 +0000 (0:00:00.065) 0:02:07.851 ******* 2019-11-29T12:19:31.770 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2019-11-29T12:19:31.772 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:31.807 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:31 +0000 (0:00:00.063) 0:02:07.915 ******* 2019-11-29T12:19:31.833 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2019-11-29T12:19:31.834 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:31.876 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:31 +0000 (0:00:00.068) 0:02:07.984 ******* 2019-11-29T12:19:31.903 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2019-11-29T12:19:31.904 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:31.946 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:31 +0000 (0:00:00.070) 0:02:08.054 ******* 2019-11-29T12:19:31.952 INFO:teuthology.task.ansible.out: TASK [common : Update yum cache] *********************************************** 2019-11-29T12:19:31.954 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => {"changed": true, "cmd": "rm -rf /var/cache/yum/*; yum clean all; yum makecache", "delta": "0:00:11.891073", "end": "2019-11-29 12:19:31.894777", "rc": 0, "start": "2019-11-29 12:19:20.003704", "stderr": "", "stderr_lines": [], "stdout": "Loaded plugins: fastestmirror, langpacks, priorities\nCleaning repos: base centos7-fcgi-ceph epel extras lab-extras updates\nLoaded plugins: fastestmirror, langpacks, priorities\nDetermining fastest mirrors\n * base: mirror.us-midwest-1.nexcess.net\n * extras: mirror.rackspace.com\n * updates: reflector.westga.edu\nMetadata Cache Created", "stdout_lines": ["Loaded plugins: fastestmirror, langpacks, priorities", "Cleaning repos: base centos7-fcgi-ceph epel extras lab-extras updates", "Loaded plugins: fastestmirror, langpacks, priorities", "Determining fastest mirrors", " * base: mirror.us-midwest-1.nexcess.net", " * extras: mirror.rackspace.com", " * updates: reflector.westga.edu", "Metadata Cache Created"]} 2019-11-29T12:19:31.995 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:31 +0000 (0:00:00.048) 0:02:08.103 ******* 2019-11-29T12:19:32.096 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2019-11-29T12:19:32.098 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:32.240 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:32 +0000 (0:00:00.244) 0:02:08.347 ******* 2019-11-29T12:19:32.267 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2019-11-29T12:19:32.268 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:32.305 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:32 +0000 (0:00:00.064) 0:02:08.412 ******* 2019-11-29T12:19:32.459 INFO:teuthology.task.ansible.out: TASK [common : Uncomment mirrorlist] ******************************************* 2019-11-29T12:19:32.459 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/7/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/7/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "msg": "1 replacements made"} 2019-11-29T12:19:32.760 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/7/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/7/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "msg": "1 replacements made"} 2019-11-29T12:19:32.802 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:32 +0000 (0:00:00.497) 0:02:08.910 ******* 2019-11-29T12:19:32.828 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2019-11-29T12:19:32.830 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:32.863 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:32 +0000 (0:00:00.061) 0:02:08.971 ******* 2019-11-29T12:19:32.889 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2019-11-29T12:19:32.890 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:32.925 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:32 +0000 (0:00:00.062) 0:02:09.033 ******* 2019-11-29T12:19:32.951 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2019-11-29T12:19:32.952 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:32.987 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:32 +0000 (0:00:00.061) 0:02:09.095 ******* 2019-11-29T12:19:33.013 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2019-11-29T12:19:33.014 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:33.050 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:33 +0000 (0:00:00.062) 0:02:09.158 ******* 2019-11-29T12:19:33.075 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2019-11-29T12:19:33.077 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:33.111 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:33 +0000 (0:00:00.061) 0:02:09.219 ******* 2019-11-29T12:19:33.136 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2019-11-29T12:19:33.138 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:33.173 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:33 +0000 (0:00:00.061) 0:02:09.280 ******* 2019-11-29T12:19:33.198 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2019-11-29T12:19:33.199 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:33.234 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:33 +0000 (0:00:00.061) 0:02:09.342 ******* 2019-11-29T12:19:33.259 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2019-11-29T12:19:33.261 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:33.295 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:33 +0000 (0:00:00.061) 0:02:09.403 ******* 2019-11-29T12:19:33.527 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2019-11-29T12:19:33.528 INFO:teuthology.task.ansible.out:changed: [smithi022.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.900624", "end": "2019-11-29 12:19:33.500473", "rc": 0, "start": "2019-11-29 12:19:32.599849", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-29T12:19:33.564 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:33 +0000 (0:00:00.268) 0:02:09.672 ******* 2019-11-29T12:19:34.355 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2019-11-29T12:19:34.356 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["krb5-workstation-1.15.1-37.el7_7.2.x86_64 providing krb5-workstation is already installed"]} 2019-11-29T12:19:34.393 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:34 +0000 (0:00:00.828) 0:02:10.500 ******* 2019-11-29T12:19:34.418 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2019-11-29T12:19:34.419 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:34.453 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:34 +0000 (0:00:00.060) 0:02:10.561 ******* 2019-11-29T12:19:34.478 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2019-11-29T12:19:34.479 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:34.516 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:34 +0000 (0:00:00.062) 0:02:10.623 ******* 2019-11-29T12:19:34.531 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2019-11-29T12:19:34.532 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.924080", "end": "2019-11-29 12:19:34.500476", "rc": 0, "start": "2019-11-29 12:19:33.576396", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-29T12:19:34.568 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:34 +0000 (0:00:00.052) 0:02:10.675 ******* 2019-11-29T12:19:34.572 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2019-11-29T12:19:34.573 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:34.610 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:34 +0000 (0:00:00.042) 0:02:10.718 ******* 2019-11-29T12:19:34.635 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2019-11-29T12:19:34.636 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:34.672 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:34 +0000 (0:00:00.061) 0:02:10.779 ******* 2019-11-29T12:19:35.103 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2019-11-29T12:19:35.104 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["krb5-workstation-1.15.1-37.el7_7.2.x86_64 providing krb5-workstation is already installed"]} 2019-11-29T12:19:35.140 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:35 +0000 (0:00:00.468) 0:02:11.248 ******* 2019-11-29T12:19:35.166 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2019-11-29T12:19:35.168 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:35.202 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:35 +0000 (0:00:00.061) 0:02:11.310 ******* 2019-11-29T12:19:35.228 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2019-11-29T12:19:35.229 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:35.264 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:35 +0000 (0:00:00.062) 0:02:11.372 ******* 2019-11-29T12:19:35.289 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2019-11-29T12:19:35.291 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:35.326 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:35 +0000 (0:00:00.061) 0:02:11.434 ******* 2019-11-29T12:19:35.351 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2019-11-29T12:19:35.353 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:35.388 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:35 +0000 (0:00:00.061) 0:02:11.495 ******* 2019-11-29T12:19:35.599 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2019-11-29T12:19:35.600 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "secontext": "system_u:object_r:krb5_conf_t:s0", "size": 131, "state": "file", "uid": 0} 2019-11-29T12:19:35.638 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:35 +0000 (0:00:00.249) 0:02:11.745 ******* 2019-11-29T12:19:36.285 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "secontext": "system_u:object_r:krb5_conf_t:s0", "size": 131, "state": "file", "uid": 0} 2019-11-29T12:19:36.321 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:36 +0000 (0:00:00.683) 0:02:12.429 ******* 2019-11-29T12:19:39.479 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2019-11-29T12:19:39.480 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => {"changed": false, "changes": {"installed": [], "updated": []}, "msg": "", "rc": 0, "results": ["All packages providing smartmontools are up to date", ""]} 2019-11-29T12:19:39.518 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:39 +0000 (0:00:03.196) 0:02:15.625 ******* 2019-11-29T12:19:40.139 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "changes": {"installed": [], "updated": []}, "msg": "", "rc": 0, "results": ["All packages providing smartmontools are up to date", ""]} 2019-11-29T12:19:40.176 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:40 +0000 (0:00:00.658) 0:02:16.284 ******* 2019-11-29T12:19:40.505 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2019-11-29T12:19:40.506 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "secontext": "system_u:object_r:bin_t:s0", "size": 2716736, "state": "file", "uid": 0} 2019-11-29T12:19:41.130 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "secontext": "system_u:object_r:bin_t:s0", "size": 2716736, "state": "file", "uid": 0} 2019-11-29T12:19:41.420 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "secontext": "system_u:object_r:bin_t:s0", "size": 1952038, "state": "file", "uid": 0} 2019-11-29T12:19:42.051 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "secontext": "system_u:object_r:bin_t:s0", "size": 1952038, "state": "file", "uid": 0} 2019-11-29T12:19:42.350 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "secontext": "system_u:object_r:bin_t:s0", "size": 580432, "state": "file", "uid": 0} 2019-11-29T12:19:42.388 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:42 +0000 (0:00:02.211) 0:02:18.495 ******* 2019-11-29T12:19:42.706 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2019-11-29T12:19:42.706 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "secontext": "system_u:object_r:bin_t:s0", "size": 4096, "state": "directory", "uid": 0} 2019-11-29T12:19:42.743 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:42 +0000 (0:00:00.355) 0:02:18.850 ******* 2019-11-29T12:19:42.974 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2019-11-29T12:19:42.975 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "secontext": "system_u:object_r:bin_t:s0", "size": 580432, "state": "file", "uid": 0} 2019-11-29T12:19:43.016 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:43 +0000 (0:00:00.273) 0:02:19.123 ******* 2019-11-29T12:19:43.345 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2019-11-29T12:19:43.346 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "secontext": "system_u:object_r:bin_t:s0", "size": 4096, "state": "directory", "uid": 0} 2019-11-29T12:19:43.388 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:43 +0000 (0:00:00.372) 0:02:19.496 ******* 2019-11-29T12:19:43.620 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2019-11-29T12:19:43.621 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "9a447e184389aadb9aaf1e77f30f0a7f8b716c4e", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "secontext": "system_u:object_r:bin_t:s0", "size": 12725, "state": "file", "uid": 0} 2019-11-29T12:19:44.316 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "9a447e184389aadb9aaf1e77f30f0a7f8b716c4e", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "secontext": "system_u:object_r:bin_t:s0", "size": 12725, "state": "file", "uid": 0} 2019-11-29T12:19:44.441 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 8602, "state": "file", "uid": 0} 2019-11-29T12:19:45.234 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 8602, "state": "file", "uid": 0} 2019-11-29T12:19:45.298 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 3605, "state": "file", "uid": 0} 2019-11-29T12:19:45.336 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:45 +0000 (0:00:01.947) 0:02:21.444 ******* 2019-11-29T12:19:45.363 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2019-11-29T12:19:45.365 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:45.400 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:45 +0000 (0:00:00.063) 0:02:21.507 ******* 2019-11-29T12:19:45.437 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2019-11-29T12:19:45.438 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib64/nagios/plugins", "nrpe_group": "nrpe", "nrpe_packages": ["nagios-common", "nrpe", "nagios-plugins", "nagios-plugins-load"], "nrpe_service_name": "nrpe", "nrpe_user": "nrpe"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/yum_systems.yml"], "changed": false} 2019-11-29T12:19:45.475 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:45 +0000 (0:00:00.075) 0:02:21.583 ******* 2019-11-29T12:19:45.819 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2019-11-29T12:19:45.821 INFO:teuthology.task.ansible.out:changed: [smithi022.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2019-11-29T12:19:45.856 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:45 +0000 (0:00:00.380) 0:02:21.963 ******* 2019-11-29T12:19:45.903 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2019-11-29T12:19:45.905 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-11-29T12:19:45.915 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-11-29T12:19:45.925 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-11-29T12:19:45.937 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-11-29T12:19:45.978 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:45 +0000 (0:00:00.122) 0:02:22.086 ******* 2019-11-29T12:19:46.118 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2019-11-29T12:19:46.119 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 3605, "state": "file", "uid": 0} 2019-11-29T12:19:46.166 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:46 +0000 (0:00:00.187) 0:02:22.273 ******* 2019-11-29T12:19:46.191 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2019-11-29T12:19:46.193 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:46.228 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:46 +0000 (0:00:00.062) 0:02:22.336 ******* 2019-11-29T12:19:46.264 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2019-11-29T12:19:46.265 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib64/nagios/plugins", "nrpe_group": "nrpe", "nrpe_packages": ["nagios-common", "nrpe", "nagios-plugins", "nagios-plugins-load"], "nrpe_service_name": "nrpe", "nrpe_user": "nrpe"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/yum_systems.yml"], "changed": false} 2019-11-29T12:19:46.303 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:46 +0000 (0:00:00.074) 0:02:22.411 ******* 2019-11-29T12:19:46.628 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2019-11-29T12:19:46.630 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2019-11-29T12:19:46.665 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:46 +0000 (0:00:00.362) 0:02:22.773 ******* 2019-11-29T12:19:46.712 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2019-11-29T12:19:46.714 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-11-29T12:19:46.724 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-11-29T12:19:46.735 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-11-29T12:19:46.746 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-11-29T12:19:46.785 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:46 +0000 (0:00:00.120) 0:02:22.893 ******* 2019-11-29T12:19:49.453 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2019-11-29T12:19:49.454 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => {"changed": false, "changes": {"installed": [], "updated": []}, "msg": "", "rc": 0, "results": ["All packages providing nagios-common are up to date", "All packages providing nrpe are up to date", "All packages providing nagios-plugins are up to date", "All packages providing nagios-plugins-load are up to date", ""]} 2019-11-29T12:19:49.491 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:49 +0000 (0:00:02.705) 0:02:25.599 ******* 2019-11-29T12:19:49.518 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu)] ***************** 2019-11-29T12:19:49.520 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:49.554 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:49 +0000 (0:00:00.063) 0:02:25.662 ******* 2019-11-29T12:19:50.217 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2019-11-29T12:19:50.219 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "changes": {"installed": [], "updated": []}, "msg": "", "rc": 0, "results": ["All packages providing nagios-common are up to date", "All packages providing nrpe are up to date", "All packages providing nagios-plugins are up to date", "All packages providing nagios-plugins-load are up to date", ""]} 2019-11-29T12:19:50.261 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:50 +0000 (0:00:00.706) 0:02:26.368 ******* 2019-11-29T12:19:50.287 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu)] ***************** 2019-11-29T12:19:50.289 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:50.326 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:50 +0000 (0:00:00.064) 0:02:26.433 ******* 2019-11-29T12:19:50.511 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2019-11-29T12:19:50.513 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => {"changed": false, "checksum": "b423b985ccbb69b65a711d372645a5f704b30e8b", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "secontext": "system_u:object_r:etc_t:s0", "size": 178, "state": "file", "uid": 0} 2019-11-29T12:19:50.573 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:50 +0000 (0:00:00.247) 0:02:26.680 ******* 2019-11-29T12:19:51.207 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "checksum": "b423b985ccbb69b65a711d372645a5f704b30e8b", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "secontext": "system_u:object_r:etc_t:s0", "size": 178, "state": "file", "uid": 0} 2019-11-29T12:19:51.246 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:51 +0000 (0:00:00.672) 0:02:27.353 ******* 2019-11-29T12:19:51.491 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2019-11-29T12:19:51.492 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib64/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib64/nagios/plugins/check_mem.sh", "secontext": "system_u:object_r:nagios_unconfined_plugin_exec_t:s0", "size": 1964, "state": "file", "uid": 0} 2019-11-29T12:19:51.530 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:51 +0000 (0:00:00.283) 0:02:27.637 ******* 2019-11-29T12:19:51.556 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2019-11-29T12:19:51.557 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:51.593 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:51 +0000 (0:00:00.063) 0:02:27.701 ******* 2019-11-29T12:19:51.915 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2019-11-29T12:19:51.917 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-11-29T12:19:51.954 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:51 +0000 (0:00:00.361) 0:02:28.062 ******* 2019-11-29T12:19:52.179 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2019-11-29T12:19:52.180 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib64/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib64/nagios/plugins/check_mem.sh", "secontext": "system_u:object_r:nagios_unconfined_plugin_exec_t:s0", "size": 1964, "state": "file", "uid": 0} 2019-11-29T12:19:52.218 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:52 +0000 (0:00:00.263) 0:02:28.326 ******* 2019-11-29T12:19:52.256 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2019-11-29T12:19:52.258 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:52.294 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:52 +0000 (0:00:00.075) 0:02:28.402 ******* 2019-11-29T12:19:52.310 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2019-11-29T12:19:52.312 INFO:teuthology.task.ansible.out:fatal: [smithi022.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} ...ignoring 2019-11-29T12:19:52.354 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:52 +0000 (0:00:00.059) 0:02:28.462 ******* 2019-11-29T12:19:52.399 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2019-11-29T12:19:52.401 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:52.438 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:52 +0000 (0:00:00.083) 0:02:28.546 ******* 2019-11-29T12:19:52.612 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2019-11-29T12:19:52.613 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-11-29T12:19:52.655 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:52 +0000 (0:00:00.217) 0:02:28.763 ******* 2019-11-29T12:19:52.993 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2019-11-29T12:19:52.994 INFO:teuthology.task.ansible.out:fatal: [smithi062.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} ...ignoring 2019-11-29T12:19:53.032 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:53 +0000 (0:00:00.376) 0:02:29.139 ******* 2019-11-29T12:19:53.057 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2019-11-29T12:19:53.059 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:19:53.097 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:53 +0000 (0:00:00.065) 0:02:29.205 ******* 2019-11-29T12:19:53.382 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2019-11-29T12:19:53.383 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => {"changed": false, "checksum": "333141ba5e85aea94f51511a52d9b115d2e0112f", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "secontext": "system_u:object_r:nrpe_etc_t:s0", "size": 1174, "state": "file", "uid": 0} 2019-11-29T12:19:53.420 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:53 +0000 (0:00:00.322) 0:02:29.528 ******* 2019-11-29T12:19:53.999 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "checksum": "333141ba5e85aea94f51511a52d9b115d2e0112f", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "secontext": "system_u:object_r:nrpe_etc_t:s0", "size": 1174, "state": "file", "uid": 0} 2019-11-29T12:19:54.038 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:54 +0000 (0:00:00.618) 0:02:30.146 ******* 2019-11-29T12:19:54.281 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2019-11-29T12:19:54.283 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nrpe", "state": "started", "status": {"ActiveEnterTimestamp": "Fri 2019-11-29 12:16:44 UTC", "ActiveEnterTimestampMonotonic": "18915509", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "network.target var-run.mount time-sync.target nss-lookup.target local-fs.target basic.target systemd-journald.socket system.slice", "AllowIsolate": "no", "AmbientCapabilities": "0", "AssertResult": "yes", "AssertTimestamp": "Fri 2019-11-29 12:16:44 UTC", "AssertTimestampMonotonic": "18914787", "Before": "xdm.service multi-user.target getty@tty1.service shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "18446744073709551615", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "18446744073709551615", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "18446744073709551615", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2019-11-29 12:16:44 UTC", "ConditionTimestampMonotonic": "18914785", "Conflicts": "nrpe.socket shutdown.target", "ControlGroup": "/system.slice/nrpe.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Program Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "EnvironmentFile": "/etc/sysconfig/nrpe (ignore_errors=no)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "8777", "ExecMainStartTimestamp": "Fri 2019-11-29 12:16:44 UTC", "ExecMainStartTimestampMonotonic": "18915462", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_SSL_OPT ; ignore_err 2019-11-29T12:19:54.285 INFO:teuthology.task.ansible.out:ors=no ; start_time=[Fri 2019-11-29 12:16:44 UTC] ; stop_time=[n/a] ; pid=8777 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nrpe/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/nrpe.service", "Group": "nrpe", "GuessMainPID": "yes", "IOScheduling": "0", "Id": "nrpe.service", "IgnoreOnIsolate": "no", "IgnoreOnSnapshot": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Fri 2019-11-29 12:16:44 UTC", "InactiveExitTimestampMonotonic": "18915509", "JobTimeoutAction": "none", "JobTimeoutUSec": "0", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "18446744073709551615", "LimitCORE": "18446744073709551615", "LimitCPU": "18446744073709551615", "LimitDATA": "18446744073709551615", "LimitFSIZE": "18446744073709551615", "LimitLOCKS": "18446744073709551615", "LimitMEMLOCK": "65536", "LimitMSGQUEUE": "819200", "LimitNICE": "0", "LimitNOFILE": "4096", "LimitNPROC": "127535", "LimitRSS": "18446744073709551615", "LimitRTPRIO": "0", "LimitRTTIME": "18446744073709551615", "LimitSIGPENDING": "127535", "LimitSTACK": "18446744073709551615", "LoadState": "loaded", "MainPID": "8777", "MemoryAccounting": "no", "MemoryCurrent": "18446744073709551615", "MemoryLimit": "18446744073709551615", "MountFlags": "0", "Names": "nrpe.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "ProtectHome": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "Requires": "basic.target network-online.target", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOn 2019-11-29T12:19:54.286 INFO:teuthology.task.ansible.out:ly": "no", "RuntimeDirectoryMode": "0755", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitInterval": "10000000", "StartupBlockIOWeight": "18446744073709551615", "StartupCPUShares": "18446744073709551615", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "no", "TasksCurrent": "18446744073709551615", "TasksMax": "18446744073709551615", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "User": "nrpe", "WantedBy": "multi-user.target", "Wants": "system.slice", "WatchdogTimestamp": "Fri 2019-11-29 12:16:44 UTC", "WatchdogTimestampMonotonic": "18915493", "WatchdogUSec": "0"}} 2019-11-29T12:19:54.323 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:54 +0000 (0:00:00.284) 0:02:30.431 ******* 2019-11-29T12:19:54.456 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nrpe", "state": "started", "status": {"ActiveEnterTimestamp": "Fri 2019-11-29 12:16:48 UTC", "ActiveEnterTimestampMonotonic": "19168253", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "nss-lookup.target var-run.mount system.slice local-fs.target systemd-journald.socket basic.target network.target time-sync.target", "AllowIsolate": "no", "AmbientCapabilities": "0", "AssertResult": "yes", "AssertTimestamp": "Fri 2019-11-29 12:16:48 UTC", "AssertTimestampMonotonic": "19167578", "Before": "xdm.service getty@tty1.service shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "18446744073709551615", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "18446744073709551615", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "18446744073709551615", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2019-11-29 12:16:48 UTC", "ConditionTimestampMonotonic": "19167578", "Conflicts": "shutdown.target nrpe.socket", "ControlGroup": "/system.slice/nrpe.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Program Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "EnvironmentFile": "/etc/sysconfig/nrpe (ignore_errors=no)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "8936", "ExecMainStartTimestamp": "Fri 2019-11-29 12:16:48 UTC", "ExecMainStartTimestampMonotonic": "19168201", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_SSL_OPT ; ignore_err 2019-11-29T12:19:54.457 INFO:teuthology.task.ansible.out:ors=no ; start_time=[Fri 2019-11-29 12:16:48 UTC] ; stop_time=[n/a] ; pid=8936 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nrpe/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/nrpe.service", "Group": "nrpe", "GuessMainPID": "yes", "IOScheduling": "0", "Id": "nrpe.service", "IgnoreOnIsolate": "no", "IgnoreOnSnapshot": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Fri 2019-11-29 12:16:48 UTC", "InactiveExitTimestampMonotonic": "19168253", "JobTimeoutAction": "none", "JobTimeoutUSec": "0", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "18446744073709551615", "LimitCORE": "18446744073709551615", "LimitCPU": "18446744073709551615", "LimitDATA": "18446744073709551615", "LimitFSIZE": "18446744073709551615", "LimitLOCKS": "18446744073709551615", "LimitMEMLOCK": "65536", "LimitMSGQUEUE": "819200", "LimitNICE": "0", "LimitNOFILE": "4096", "LimitNPROC": "127511", "LimitRSS": "18446744073709551615", "LimitRTPRIO": "0", "LimitRTTIME": "18446744073709551615", "LimitSIGPENDING": "127511", "LimitSTACK": "18446744073709551615", "LoadState": "loaded", "MainPID": "8936", "MemoryAccounting": "no", "MemoryCurrent": "18446744073709551615", "MemoryLimit": "18446744073709551615", "MountFlags": "0", "Names": "nrpe.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "ProtectHome": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "Requires": "network-online.target basic.target", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOn 2019-11-29T12:19:54.459 INFO:teuthology.task.ansible.out:ly": "no", "RuntimeDirectoryMode": "0755", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitInterval": "10000000", "StartupBlockIOWeight": "18446744073709551615", "StartupCPUShares": "18446744073709551615", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "no", "TasksCurrent": "18446744073709551615", "TasksMax": "18446744073709551615", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "User": "nrpe", "WantedBy": "multi-user.target", "Wants": "system.slice", "WatchdogTimestamp": "Fri 2019-11-29 12:16:48 UTC", "WatchdogTimestampMonotonic": "19168234", "WatchdogUSec": "0"}} 2019-11-29T12:19:54.496 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:54 +0000 (0:00:00.172) 0:02:30.603 ******* 2019-11-29T12:19:54.637 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2019-11-29T12:19:54.638 INFO:teuthology.task.ansible.out:changed: [smithi022.front.sepia.ceph.com] => {"changed": true, "cmd": ["getenforce"], "delta": "0:00:00.004772", "end": "2019-11-29 12:19:54.617160", "rc": 0, "start": "2019-11-29 12:19:54.612388", "stderr": "", "stderr_lines": [], "stdout": "Permissive", "stdout_lines": ["Permissive"]} 2019-11-29T12:19:54.677 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:54 +0000 (0:00:00.181) 0:02:30.785 ******* 2019-11-29T12:19:54.808 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => {"changed": true, "cmd": ["getenforce"], "delta": "0:00:00.004719", "end": "2019-11-29 12:19:54.782796", "rc": 0, "start": "2019-11-29 12:19:54.778077", "stderr": "", "stderr_lines": [], "stdout": "Permissive", "stdout_lines": ["Permissive"]} 2019-11-29T12:19:54.851 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:54 +0000 (0:00:00.173) 0:02:30.959 ******* 2019-11-29T12:19:55.168 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2019-11-29T12:19:55.169 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["libsemanage-python-2.5-14.el7.x86_64 providing libsemanage-python is already installed", "policycoreutils-python-2.5-29.el7.x86_64 providing policycoreutils-python is already installed"]} 2019-11-29T12:19:55.206 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:55 +0000 (0:00:00.354) 0:02:31.313 ******* 2019-11-29T12:19:55.357 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["libsemanage-python-2.5-14.el7.x86_64 providing libsemanage-python is already installed", "policycoreutils-python-2.5-29.el7.x86_64 providing policycoreutils-python is already installed"]} 2019-11-29T12:19:55.396 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:55 +0000 (0:00:00.190) 0:02:31.504 ******* 2019-11-29T12:19:57.691 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2019-11-29T12:19:57.692 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => {"changed": false, "changes": {"installed": [], "updated": []}, "msg": "", "rc": 0, "results": ["All packages providing selinux-policy-targeted are up to date", ""]} 2019-11-29T12:19:57.729 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:57 +0000 (0:00:02.332) 0:02:33.836 ******* 2019-11-29T12:19:57.913 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "changes": {"installed": [], "updated": []}, "msg": "", "rc": 0, "results": ["All packages providing selinux-policy-targeted are up to date", ""]} 2019-11-29T12:19:57.952 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:19:57 +0000 (0:00:00.222) 0:02:34.059 ******* 2019-11-29T12:19:59.583 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2019-11-29T12:19:59.715 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "name": "nagios_run_sudo", "persistent": true, "state": true} Friday 29 November 2019 12:19:59 +0000 (0:00:01.679) 0:02:35.739 ******* 2019-11-29T12:20:00.698 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => {"changed": false, "name": "nagios_run_sudo", "persistent": true, "state": true} 2019-11-29T12:20:00.736 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:20:00 +0000 (0:00:01.104) 0:02:36.843 ******* 2019-11-29T12:20:08.505 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2019-11-29T12:20:08.506 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-r", "nrpe"], "delta": "0:00:08.550332", "end": "2019-11-29 12:20:08.476564", "failed_when_result": false, "rc": 0, "start": "2019-11-29 12:19:59.926232", "stderr": "", "stderr_lines": [], "stdout": "libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority).", "stdout_lines": ["libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority)."]} 2019-11-29T12:20:08.541 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:20:08 +0000 (0:00:07.804) 0:02:44.648 ******* 2019-11-29T12:20:09.497 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2019-11-29T12:20:09.499 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "checksum": "99d9b2ea41fb2d6613898129718064833d2de428", "dest": "/tmp/nrpe.te", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/tmp/nrpe.te", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 934, "state": "file", "uid": 0} 2019-11-29T12:20:09.534 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:20:09 +0000 (0:00:00.992) 0:02:45.641 ******* 2019-11-29T12:20:09.560 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2019-11-29T12:20:09.561 INFO:teuthology.task.ansible.out:changed: [smithi022.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-r", "nrpe"], "delta": "0:00:08.503700", "end": "2019-11-29 12:20:09.528052", "failed_when_result": false, "rc": 0, "start": "2019-11-29 12:20:01.024352", "stderr": "", "stderr_lines": [], "stdout": "libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority).", "stdout_lines": ["libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority)."]} 2019-11-29T12:20:09.599 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:20:09 +0000 (0:00:00.065) 0:02:45.706 ******* 2019-11-29T12:20:09.874 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2019-11-29T12:20:09.874 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => {"changed": true, "cmd": ["checkmodule", "-M", "-m", "-o", "/tmp/nrpe.mod", "/tmp/nrpe.te"], "delta": "0:00:00.019018", "end": "2019-11-29 12:20:09.847611", "rc": 0, "start": "2019-11-29 12:20:09.828593", "stderr": "", "stderr_lines": [], "stdout": "checkmodule: loading policy configuration from /tmp/nrpe.te\ncheckmodule: policy configuration loaded\ncheckmodule: writing binary representation (version 19) to /tmp/nrpe.mod", "stdout_lines": ["checkmodule: loading policy configuration from /tmp/nrpe.te", "checkmodule: policy configuration loaded", "checkmodule: writing binary representation (version 19) to /tmp/nrpe.mod"]} 2019-11-29T12:20:09.912 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:20:09 +0000 (0:00:00.312) 0:02:46.019 ******* 2019-11-29T12:20:10.322 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2019-11-29T12:20:10.323 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule_package", "-o", "/tmp/nrpe.pp", "-m", "/tmp/nrpe.mod"], "delta": "0:00:00.097247", "end": "2019-11-29 12:20:10.295929", "rc": 0, "start": "2019-11-29 12:20:10.198682", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-29T12:20:10.359 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:20:10 +0000 (0:00:00.446) 0:02:46.466 ******* 2019-11-29T12:20:10.583 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2019-11-29T12:20:10.584 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => {"changed": false, "checksum": "99d9b2ea41fb2d6613898129718064833d2de428", "dest": "/tmp/nrpe.te", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/tmp/nrpe.te", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 934, "state": "file", "uid": 0} 2019-11-29T12:20:10.622 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:20:10 +0000 (0:00:00.262) 0:02:46.729 ******* 2019-11-29T12:20:10.969 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2019-11-29T12:20:10.970 INFO:teuthology.task.ansible.out:changed: [smithi022.front.sepia.ceph.com] => {"changed": true, "cmd": ["checkmodule", "-M", "-m", "-o", "/tmp/nrpe.mod", "/tmp/nrpe.te"], "delta": "0:00:00.016190", "end": "2019-11-29 12:20:10.941462", "rc": 0, "start": "2019-11-29 12:20:10.925272", "stderr": "", "stderr_lines": [], "stdout": "checkmodule: loading policy configuration from /tmp/nrpe.te\ncheckmodule: policy configuration loaded\ncheckmodule: writing binary representation (version 19) to /tmp/nrpe.mod", "stdout_lines": ["checkmodule: loading policy configuration from /tmp/nrpe.te", "checkmodule: policy configuration loaded", "checkmodule: writing binary representation (version 19) to /tmp/nrpe.mod"]} 2019-11-29T12:20:11.007 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:20:11 +0000 (0:00:00.385) 0:02:47.115 ******* 2019-11-29T12:20:11.344 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2019-11-29T12:20:11.346 INFO:teuthology.task.ansible.out:changed: [smithi022.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule_package", "-o", "/tmp/nrpe.pp", "-m", "/tmp/nrpe.mod"], "delta": "0:00:00.016276", "end": "2019-11-29 12:20:11.324515", "rc": 0, "start": "2019-11-29 12:20:11.308239", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-29T12:20:11.383 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:20:11 +0000 (0:00:00.375) 0:02:47.491 ******* 2019-11-29T12:20:19.170 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2019-11-29T12:20:19.171 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-i", "/tmp/nrpe.pp"], "delta": "0:00:08.494070", "end": "2019-11-29 12:20:19.136478", "rc": 0, "start": "2019-11-29 12:20:10.642408", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-29T12:20:19.207 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:20:19 +0000 (0:00:07.823) 0:02:55.314 ******* 2019-11-29T12:20:19.567 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2019-11-29T12:20:19.569 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "path": "/tmp/nrpe.*", "state": "absent"} 2019-11-29T12:20:19.604 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:20:19 +0000 (0:00:00.396) 0:02:55.711 ******* 2019-11-29T12:20:19.639 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2019-11-29T12:20:19.639 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"ansible_facts": {"ceph_dependency_packages_to_remove": ["boost-random", "boost-program-options", "leveldb", "xmlstarlet", "python-jinja2", "python-ceph", "python-flask", "python-requests", "boost-random", "python-urllib3", "python-babel", "hdparm", "python-markupsafe", "python-werkzeug", "python-itsdangerous"], "ceph_packages_to_remove": ["ceph", "ceph-base", "ceph-selinux", "ceph-common", "ceph-debuginfo", "ceph-release", "libcephfs1", "ceph-radosgw", "python-ceph", "python-rados", "python-rbd", "python-cephfs", "librbd1", "librados2", "mod_fastcgi", "iozone"], "ntp_service_name": "ntpd", "packages_to_remove": ["device-mapper-multipath"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "sshd"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/yum_systems.yml"], "changed": false} 2019-11-29T12:20:19.683 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:20:19 +0000 (0:00:00.078) 0:02:55.790 ******* 2019-11-29T12:20:19.719 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2019-11-29T12:20:19.719 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2019-11-29T12:20:19.756 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:20:19 +0000 (0:00:00.073) 0:02:55.864 ******* 2019-11-29T12:20:19.793 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2019-11-29T12:20:19.794 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_7.yml) => {"ansible_facts": {"epel_packages": ["cryptopp-devel", "cryptopp", "fcgi", "dbench", "fuse-sshfs", "bonnie++", "perl-JSON-XS"], "packages": ["@core", "@base", "yum-plugin-priorities", "yum-plugin-fastestmirror", "redhat-lsb", "sysstat", "gdb", "git-all", "python-configobj", "gcc-c++", "libedit", "openssl098e", "boost-thread", "xfsprogs", "gdisk", "parted", "libgcrypt", "fuse", "fuse-libs", "python-virtualenv", "openssl", "libuuid", "btrfs-progs", "attr", "valgrind", "python-nose", "mpich", "podman", "ant", "iozone", "libtool", "automake", "gettext", "libuuid-devel", "libacl-devel", "bc", "xfsdump", "xfsprogs-devel", "blktrace", "numpy", "python-matplotlib", "qemu-kvm", "usbredir", "genisoimage", "httpd", "httpd-devel", "httpd-tools", "mod_ssl", "mod_fastcgi-2.4.7-1.ceph.el7.centos", "libev-devel", "perl-XML-Twig", "java-1.6.0-openjdk-devel", "junit4", "nfs-utils", "ncurses-devel", "python-devel", "python-virtualenv", "perl-CPAN"], "yum_repos": {"centos7-fcgi-ceph": {"baseurl": "http://{{ gitbuilder_host }}/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/", "enabled": 1, "gpgcheck": 0, "name": "CentOS 7 Local fastcgi Repo"}, "lab-extras": {"baseurl": "http://{{ mirror_host }}/lab-extras/centos7/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_7.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_7.yml"} 2019-11-29T12:20:19.831 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:20:19 +0000 (0:00:00.075) 0:02:55.939 ******* 2019-11-29T12:20:19.867 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2019-11-29T12:20:19.869 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2019-11-29T12:20:19.905 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:20:19 +0000 (0:00:00.073) 0:02:56.012 ******* 2019-11-29T12:20:20.221 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2019-11-29T12:20:20.223 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2019-11-29T12:20:20.257 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:20:20 +0000 (0:00:00.352) 0:02:56.365 ******* 2019-11-29T12:20:20.303 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2019-11-29T12:20:20.305 INFO:teuthology.task.ansible.out:changed: [smithi022.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-i", "/tmp/nrpe.pp"], "delta": "0:00:08.585695", "end": "2019-11-29 12:20:20.268816", "rc": 0, "start": "2019-11-29 12:20:11.683121", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-29T12:20:20.344 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:20:20 +0000 (0:00:00.086) 0:02:56.451 ******* 2019-11-29T12:20:20.578 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2019-11-29T12:20:20.580 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "gid": 1215, "name": "ubuntu", "state": "present", "system": false} 2019-11-29T12:20:20.616 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:20:20 +0000 (0:00:00.272) 0:02:56.724 ******* 2019-11-29T12:20:20.642 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2019-11-29T12:20:20.644 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:20:20.680 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:20:20 +0000 (0:00:00.064) 0:02:56.788 ******* 2019-11-29T12:20:20.706 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2019-11-29T12:20:20.708 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:20:20.744 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:20:20 +0000 (0:00:00.063) 0:02:56.851 ******* 2019-11-29T12:20:20.749 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2019-11-29T12:20:20.749 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => {"changed": false, "path": "/tmp/nrpe.*", "state": "absent"} 2019-11-29T12:20:20.787 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:20:20 +0000 (0:00:00.043) 0:02:56.894 ******* 2019-11-29T12:20:20.823 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2019-11-29T12:20:20.825 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => {"ansible_facts": {"ceph_dependency_packages_to_remove": ["boost-random", "boost-program-options", "leveldb", "xmlstarlet", "python-jinja2", "python-ceph", "python-flask", "python-requests", "boost-random", "python-urllib3", "python-babel", "hdparm", "python-markupsafe", "python-werkzeug", "python-itsdangerous"], "ceph_packages_to_remove": ["ceph", "ceph-base", "ceph-selinux", "ceph-common", "ceph-debuginfo", "ceph-release", "libcephfs1", "ceph-radosgw", "python-ceph", "python-rados", "python-rbd", "python-cephfs", "librbd1", "librados2", "mod_fastcgi", "iozone"], "ntp_service_name": "ntpd", "packages_to_remove": ["device-mapper-multipath"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "sshd"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/yum_systems.yml"], "changed": false} 2019-11-29T12:20:20.861 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:20:20 +0000 (0:00:00.074) 0:02:56.969 ******* 2019-11-29T12:20:20.897 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2019-11-29T12:20:20.898 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2019-11-29T12:20:20.935 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:20:20 +0000 (0:00:00.073) 0:02:57.042 ******* 2019-11-29T12:20:20.971 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2019-11-29T12:20:20.972 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_7.yml) => {"ansible_facts": {"epel_packages": ["cryptopp-devel", "cryptopp", "fcgi", "dbench", "fuse-sshfs", "bonnie++", "perl-JSON-XS"], "packages": ["@core", "@base", "yum-plugin-priorities", "yum-plugin-fastestmirror", "redhat-lsb", "sysstat", "gdb", "git-all", "python-configobj", "gcc-c++", "libedit", "openssl098e", "boost-thread", "xfsprogs", "gdisk", "parted", "libgcrypt", "fuse", "fuse-libs", "python-virtualenv", "openssl", "libuuid", "btrfs-progs", "attr", "valgrind", "python-nose", "mpich", "podman", "ant", "iozone", "libtool", "automake", "gettext", "libuuid-devel", "libacl-devel", "bc", "xfsdump", "xfsprogs-devel", "blktrace", "numpy", "python-matplotlib", "qemu-kvm", "usbredir", "genisoimage", "httpd", "httpd-devel", "httpd-tools", "mod_ssl", "mod_fastcgi-2.4.7-1.ceph.el7.centos", "libev-devel", "perl-XML-Twig", "java-1.6.0-openjdk-devel", "junit4", "nfs-utils", "ncurses-devel", "python-devel", "python-virtualenv", "perl-CPAN"], "yum_repos": {"centos7-fcgi-ceph": {"baseurl": "http://{{ gitbuilder_host }}/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/", "enabled": 1, "gpgcheck": 0, "name": "CentOS 7 Local fastcgi Repo"}, "lab-extras": {"baseurl": "http://{{ mirror_host }}/lab-extras/centos7/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_7.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_7.yml"} 2019-11-29T12:20:21.009 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:20:21 +0000 (0:00:00.074) 0:02:57.117 ******* 2019-11-29T12:20:21.045 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2019-11-29T12:20:21.047 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2019-11-29T12:20:21.086 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:20:21 +0000 (0:00:00.076) 0:02:57.193 ******* 2019-11-29T12:20:21.092 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2019-11-29T12:20:21.093 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/bash", "state": "present", "uid": 10101} 2019-11-29T12:20:21.132 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:20:21 +0000 (0:00:00.046) 0:02:57.240 ******* 2019-11-29T12:20:21.418 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2019-11-29T12:20:21.420 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2019-11-29T12:20:21.456 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:20:21 +0000 (0:00:00.323) 0:02:57.564 ******* 2019-11-29T12:20:21.794 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2019-11-29T12:20:21.795 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => {"changed": false, "gid": 1215, "name": "ubuntu", "state": "present", "system": false} 2019-11-29T12:20:21.837 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:20:21 +0000 (0:00:00.381) 0:02:57.945 ******* 2019-11-29T12:20:21.864 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2019-11-29T12:20:21.866 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:20:21.900 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:20:21 +0000 (0:00:00.062) 0:02:58.008 ******* 2019-11-29T12:20:21.926 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2019-11-29T12:20:21.927 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:20:21.965 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:20:21 +0000 (0:00:00.064) 0:02:58.072 ******* 2019-11-29T12:20:22.148 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2019-11-29T12:20:22.150 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 112, "state": "file", "uid": 0} 2019-11-29T12:20:22.187 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:20:22 +0000 (0:00:00.222) 0:02:58.295 ******* 2019-11-29T12:20:22.214 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2019-11-29T12:20:22.216 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi062"}, "changed": false} 2019-11-29T12:20:22.250 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:20:22 +0000 (0:00:00.063) 0:02:58.358 ******* 2019-11-29T12:20:22.328 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** ok: [smithi022.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/bash", "state": "present", "uid": 10101} 2019-11-29T12:20:22.366 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:20:22 +0000 (0:00:00.116) 0:02:58.474 ******* 2019-11-29T12:20:23.205 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2019-11-29T12:20:23.207 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi062.front.sepia.ceph.com", "ansible_hostname": "smithi062", "ansible_nodename": "smithi062"}, "changed": true, "name": "smithi062"} 2019-11-29T12:20:23.245 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:20:23 +0000 (0:00:00.878) 0:02:59.353 ******* 2019-11-29T12:20:23.395 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2019-11-29T12:20:23.397 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 112, "state": "file", "uid": 0} 2019-11-29T12:20:23.433 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:20:23 +0000 (0:00:00.188) 0:02:59.541 ******* 2019-11-29T12:20:23.460 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2019-11-29T12:20:23.461 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi022"}, "changed": false} 2019-11-29T12:20:23.496 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:20:23 +0000 (0:00:00.062) 0:02:59.603 ******* 2019-11-29T12:20:24.038 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ changed: [smithi022.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi022.front.sepia.ceph.com", "ansible_hostname": "smithi022", "ansible_nodename": "smithi022"}, "changed": true, "name": "smithi022"} 2019-11-29T12:20:24.087 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:20:24 +0000 (0:00:00.591) 0:03:00.195 ******* 2019-11-29T12:20:24.147 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2019-11-29T12:20:24.148 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "checksum": "28e3f1fe12efa510f1199f3ab5f2a5a0feb586ff", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "secontext": "system_u:object_r:etc_t:s0", "size": 1042, "state": "file", "uid": 0} 2019-11-29T12:20:24.187 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:20:24 +0000 (0:00:00.099) 0:03:00.294 ******* 2019-11-29T12:20:25.018 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => {"changed": false, "checksum": "28e3f1fe12efa510f1199f3ab5f2a5a0feb586ff", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "secontext": "system_u:object_r:etc_t:s0", "size": 1042, "state": "file", "uid": 0} 2019-11-29T12:20:25.055 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:20:25 +0000 (0:00:00.868) 0:03:01.163 ******* 2019-11-29T12:20:25.072 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2019-11-29T12:20:25.073 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "secontext": "system_u:object_r:etc_t:s0", "size": 570, "state": "file", "uid": 0} 2019-11-29T12:20:25.113 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:20:25 +0000 (0:00:00.057) 0:03:01.220 ******* 2019-11-29T12:20:26.010 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "secontext": "system_u:object_r:etc_t:s0", "size": 570, "state": "file", "uid": 0} 2019-11-29T12:20:26.046 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:20:26 +0000 (0:00:00.933) 0:03:02.154 ******* 2019-11-29T12:20:26.104 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2019-11-29T12:20:26.106 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2019-11-29T12:20:26.143 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:20:26 +0000 (0:00:00.097) 0:03:02.251 ******* 2019-11-29T12:20:26.957 INFO:teuthology.task.ansible.out:changed: [smithi022.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2019-11-29T12:20:26.993 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:20:26 +0000 (0:00:00.849) 0:03:03.100 ******* 2019-11-29T12:20:27.071 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2019-11-29T12:20:27.072 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "checksum": "68d0b8ee2f88a77895f257aa69f32a42e47f455b", "dest": "/etc/security/limits.d/remote.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.d/remote.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 116, "state": "file", "uid": 0} 2019-11-29T12:20:27.111 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:20:27 +0000 (0:00:00.117) 0:03:03.218 ******* 2019-11-29T12:20:27.417 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2019-11-29T12:20:27.418 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "dest": "/etc/fuse.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 0, "state": "file", "uid": 0} 2019-11-29T12:20:27.456 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:20:27 +0000 (0:00:00.344) 0:03:03.563 ******* 2019-11-29T12:20:27.790 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2019-11-29T12:20:27.792 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "gid": 10103, "name": "kvm", "state": "present", "system": false} 2019-11-29T12:20:27.830 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:20:27 +0000 (0:00:00.374) 0:03:03.938 ******* 2019-11-29T12:20:27.908 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2019-11-29T12:20:27.908 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => {"changed": false, "checksum": "68d0b8ee2f88a77895f257aa69f32a42e47f455b", "dest": "/etc/security/limits.d/remote.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.d/remote.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 116, "state": "file", "uid": 0} 2019-11-29T12:20:27.948 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:20:27 +0000 (0:00:00.118) 0:03:04.056 ******* 2019-11-29T12:20:28.184 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2019-11-29T12:20:28.185 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1215, "groups": "kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2019-11-29T12:20:28.223 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:20:28 +0000 (0:00:00.274) 0:03:04.330 ******* 2019-11-29T12:20:28.291 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2019-11-29T12:20:28.292 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => {"changed": false, "dest": "/etc/fuse.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 0, "state": "file", "uid": 0} 2019-11-29T12:20:28.330 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:20:28 +0000 (0:00:00.107) 0:03:04.438 ******* 2019-11-29T12:20:28.645 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2019-11-29T12:20:28.646 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => {"changed": false, "gid": 10103, "name": "kvm", "state": "present", "system": false} 2019-11-29T12:20:28.681 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:20:28 +0000 (0:00:00.350) 0:03:04.789 ******* 2019-11-29T12:20:29.049 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2019-11-29T12:20:29.049 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1215, "groups": "kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2019-11-29T12:20:29.086 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:20:29 +0000 (0:00:00.404) 0:03:05.194 ******* 2019-11-29T12:20:29.169 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2019-11-29T12:20:29.170 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "checksum": "be3223c8b0917bde02657a5f9ddd95277cc3f812", "dest": "/etc/sudoers", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers", "secontext": "system_u:object_r:etc_t:s0", "size": 1808, "state": "file", "uid": 0} 2019-11-29T12:20:29.208 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:20:29 +0000 (0:00:00.121) 0:03:05.315 ******* 2019-11-29T12:20:30.022 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => {"changed": false, "checksum": "be3223c8b0917bde02657a5f9ddd95277cc3f812", "dest": "/etc/sudoers", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers", "secontext": "system_u:object_r:etc_t:s0", "size": 1808, "state": "file", "uid": 0} 2019-11-29T12:20:30.062 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:20:30 +0000 (0:00:00.854) 0:03:06.170 ******* 2019-11-29T12:20:30.131 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2019-11-29T12:20:30.132 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "checksum": "12a2e17405b9e00ea2061e25929905d08e5fe19f", "dest": "/etc/security/limits.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 854, "state": "file", "uid": 0} 2019-11-29T12:20:30.169 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:20:30 +0000 (0:00:00.107) 0:03:06.277 ******* 2019-11-29T12:20:31.069 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => {"changed": false, "checksum": "12a2e17405b9e00ea2061e25929905d08e5fe19f", "dest": "/etc/security/limits.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 854, "state": "file", "uid": 0} 2019-11-29T12:20:31.106 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:20:31 +0000 (0:00:00.936) 0:03:07.214 ******* 2019-11-29T12:20:32.701 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2019-11-29T12:20:32.703 INFO:teuthology.task.ansible.out: [WARNING]: Consider using the yum, dnf or zypper module rather than running 'rpm'. If you need to use command because yum, dnf or zypper is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. changed: [smithi062.front.sepia.ceph.com] => {"changed": true, "cmd": ["rpm", "--rebuilddb"], "delta": "0:00:02.201204", "end": "2019-11-29 12:20:32.673278", "rc": 0, "start": "2019-11-29 12:20:30.472074", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-29T12:20:32.738 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:20:32 +0000 (0:00:01.631) 0:03:08.846 ******* 2019-11-29T12:20:32.764 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2019-11-29T12:20:32.800 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:20:32 +0000 (0:00:00.061) 0:03:08.907 ******* 2019-11-29T12:20:33.565 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2019-11-29T12:20:33.566 INFO:teuthology.task.ansible.out:changed: [smithi022.front.sepia.ceph.com] => {"changed": true, "cmd": ["rpm", "--rebuilddb"], "delta": "0:00:02.142505", "end": "2019-11-29 12:20:33.540855", "rc": 0, "start": "2019-11-29 12:20:31.398350", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-29T12:20:33.603 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:20:33 +0000 (0:00:00.803) 0:03:09.711 ******* 2019-11-29T12:20:33.630 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2019-11-29T12:20:33.667 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:20:33 +0000 (0:00:00.063) 0:03:09.775 ******* 2019-11-29T12:20:33.746 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2019-11-29T12:20:33.747 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'enabled': 1, u'name': u'CentOS 7 Local fastcgi Repo', u'baseurl': u'http://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/'}, 'key': u'centos7-fcgi-ceph'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "58f6bfe213f63251ef8c4f03709a8fcef9b9e7bf", "dest": "/etc/yum.repos.d/centos7-fcgi-ceph.repo", "gid": 0, "group": "root", "item": {"key": "centos7-fcgi-ceph", "value": {"baseurl": "http://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/", "enabled": 1, "gpgcheck": 0, "name": "CentOS 7 Local fastcgi Repo"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/centos7-fcgi-ceph.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 250, "state": "file", "uid": 0} 2019-11-29T12:20:34.651 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'enabled': 1, u'name': u'CentOS 7 Local fastcgi Repo', u'baseurl': u'http://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/'}, 'key': u'centos7-fcgi-ceph'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "58f6bfe213f63251ef8c4f03709a8fcef9b9e7bf", "dest": "/etc/yum.repos.d/centos7-fcgi-ceph.repo", "gid": 0, "group": "root", "item": {"key": "centos7-fcgi-ceph", "value": {"baseurl": "http://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/", "enabled": 1, "gpgcheck": 0, "name": "CentOS 7 Local fastcgi Repo"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/centos7-fcgi-ceph.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 250, "state": "file", "uid": 0} 2019-11-29T12:20:34.653 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'enabled': 1, u'name': u'lab-extras', u'baseurl': u'http://apt-mirror.front.sepia.ceph.com/lab-extras/centos7/'}, 'key': u'lab-extras'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "765bacbb40da31f952344b310a4be4322cbee8a4", "dest": "/etc/yum.repos.d/lab-extras.repo", "gid": 0, "group": "root", "item": {"key": "lab-extras", "value": {"baseurl": "http://apt-mirror.front.sepia.ceph.com/lab-extras/centos7/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/lab-extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 209, "state": "file", "uid": 0} 2019-11-29T12:20:34.693 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:20:34 +0000 (0:00:01.025) 0:03:10.801 ******* 2019-11-29T12:20:34.723 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2019-11-29T12:20:34.724 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:20:34.760 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:20:34 +0000 (0:00:00.067) 0:03:10.868 ******* 2019-11-29T12:20:34.807 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2019-11-29T12:20:34.809 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2019-11-29T12:20:34.846 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:20:34 +0000 (0:00:00.085) 0:03:10.954 ******* 2019-11-29T12:20:34.889 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2019-11-29T12:20:34.891 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:20:34.933 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:20:34 +0000 (0:00:00.087) 0:03:11.041 ******* 2019-11-29T12:20:34.970 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-11-29T12:20:34.972 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"ansible_facts": {"skip_packaging": false}, "changed": false} 2019-11-29T12:20:35.012 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:20:35 +0000 (0:00:00.079) 0:03:11.120 ******* 2019-11-29T12:20:35.508 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2019-11-29T12:20:35.510 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["yum-utils-1.1.31-50.el7.noarch providing yum-utils is already installed"]} 2019-11-29T12:20:35.547 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:20:35 +0000 (0:00:00.534) 0:03:11.655 ******* 2019-11-29T12:20:35.574 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2019-11-29T12:20:35.575 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'enabled': 1, u'name': u'lab-extras', u'baseurl': u'http://apt-mirror.front.sepia.ceph.com/lab-extras/centos7/'}, 'key': u'lab-extras'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "765bacbb40da31f952344b310a4be4322cbee8a4", "dest": "/etc/yum.repos.d/lab-extras.repo", "gid": 0, "group": "root", "item": {"key": "lab-extras", "value": {"baseurl": "http://apt-mirror.front.sepia.ceph.com/lab-extras/centos7/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/lab-extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 209, "state": "file", "uid": 0} 2019-11-29T12:20:35.615 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:20:35 +0000 (0:00:00.068) 0:03:11.723 ******* 2019-11-29T12:20:35.642 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2019-11-29T12:20:35.643 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:20:35.679 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:20:35 +0000 (0:00:00.064) 0:03:11.787 ******* 2019-11-29T12:20:35.716 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2019-11-29T12:20:35.717 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2019-11-29T12:20:35.728 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2019-11-29T12:20:35.767 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:20:35 +0000 (0:00:00.087) 0:03:11.874 ******* 2019-11-29T12:20:35.803 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2019-11-29T12:20:35.805 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:20:35.841 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:20:35 +0000 (0:00:00.073) 0:03:11.948 ******* 2019-11-29T12:20:35.878 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-11-29T12:20:35.879 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => {"ansible_facts": {"skip_packaging": false}, "changed": false} 2019-11-29T12:20:35.916 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:20:35 +0000 (0:00:00.074) 0:03:12.023 ******* 2019-11-29T12:20:36.206 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2019-11-29T12:20:36.206 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "cmd": ["yum-complete-transaction", "--cleanup-only"], "delta": "0:00:00.313842", "end": "2019-11-29 12:20:36.172514", "rc": 0, "start": "2019-11-29 12:20:35.858672", "stderr": "", "stderr_lines": [], "stdout": "Loaded plugins: fastestmirror, langpacks, priorities\nLoading mirror speeds from cached hostfile\n * base: mirror.us-midwest-1.nexcess.net\n * epel: download-cc-rdu01.fedoraproject.org\n * extras: mirror.rackspace.com\n * updates: reflector.westga.edu\nNo unfinished transactions left.", "stdout_lines": ["Loaded plugins: fastestmirror, langpacks, priorities", "Loading mirror speeds from cached hostfile", " * base: mirror.us-midwest-1.nexcess.net", " * epel: download-cc-rdu01.fedoraproject.org", " * extras: mirror.rackspace.com", " * updates: reflector.westga.edu", "No unfinished transactions left."]} 2019-11-29T12:20:36.243 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:20:36 +0000 (0:00:00.327) 0:03:12.350 ******* 2019-11-29T12:20:36.405 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2019-11-29T12:20:36.407 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["yum-utils-1.1.31-50.el7.noarch providing yum-utils is already installed"]} 2019-11-29T12:20:36.443 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:20:36 +0000 (0:00:00.200) 0:03:12.551 ******* 2019-11-29T12:20:36.630 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2019-11-29T12:20:36.631 INFO:teuthology.task.ansible.out:fatal: [smithi062.front.sepia.ceph.com]: FAILED! => {"changed": false, "cmd": ["rpm", "-q", "ceph-debuginfo"], "delta": "0:00:00.058379", "end": "2019-11-29 12:20:36.601055", "msg": "non-zero return code", "rc": 1, "start": "2019-11-29 12:20:36.542676", "stderr": "", "stderr_lines": [], "stdout": "package ceph-debuginfo is not installed", "stdout_lines": ["package ceph-debuginfo is not installed"]} ...ignoring 2019-11-29T12:20:36.670 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:20:36 +0000 (0:00:00.226) 0:03:12.777 ******* 2019-11-29T12:20:36.707 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2019-11-29T12:20:36.708 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:20:36.744 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:20:36 +0000 (0:00:00.073) 0:03:12.851 ******* 2019-11-29T12:20:37.092 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2019-11-29T12:20:37.093 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => {"changed": false, "cmd": ["yum-complete-transaction", "--cleanup-only"], "delta": "0:00:00.327130", "end": "2019-11-29 12:20:37.060799", "rc": 0, "start": "2019-11-29 12:20:36.733669", "stderr": "", "stderr_lines": [], "stdout": "Loaded plugins: fastestmirror, langpacks, priorities\nLoading mirror speeds from cached hostfile\n * base: mirror.us-midwest-1.nexcess.net\n * epel: download-cc-rdu01.fedoraproject.org\n * extras: mirror.rackspace.com\n * updates: reflector.westga.edu\nNo unfinished transactions left.", "stdout_lines": ["Loaded plugins: fastestmirror, langpacks, priorities", "Loading mirror speeds from cached hostfile", " * base: mirror.us-midwest-1.nexcess.net", " * epel: download-cc-rdu01.fedoraproject.org", " * extras: mirror.rackspace.com", " * updates: reflector.westga.edu", "No unfinished transactions left."]} 2019-11-29T12:20:37.131 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:20:37 +0000 (0:00:00.386) 0:03:13.238 ******* 2019-11-29T12:20:37.536 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2019-11-29T12:20:37.537 INFO:teuthology.task.ansible.out:fatal: [smithi022.front.sepia.ceph.com]: FAILED! => {"changed": false, "cmd": ["rpm", "-q", "ceph-debuginfo"], "delta": "0:00:00.057991", "end": "2019-11-29 12:20:37.502455", "msg": "non-zero return code", "rc": 1, "start": "2019-11-29 12:20:37.444464", "stderr": "", "stderr_lines": [], "stdout": "package ceph-debuginfo is not installed", "stdout_lines": ["package ceph-debuginfo is not installed"]} ...ignoring 2019-11-29T12:20:37.574 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:20:37 +0000 (0:00:00.443) 0:03:13.682 ******* 2019-11-29T12:20:37.601 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2019-11-29T12:20:37.603 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:20:37.642 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:20:37 +0000 (0:00:00.067) 0:03:13.750 ******* 2019-11-29T12:20:47.384 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2019-11-29T12:20:47.386 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => {"changed": true, "changes": {"removed": ["librbd1", "librados2", "mod_fastcgi", "iozone"]}, "msg": "", "rc": 0, "results": ["ceph is not installed", "ceph-base is not installed", "ceph-selinux is not installed", "ceph-common is not installed", "ceph-debuginfo is not installed", "ceph-release is not installed", "libcephfs1 is not installed", "ceph-radosgw is not installed", "python-ceph is not installed", "python-rados is not installed", "python-rbd is not installed", "python-cephfs is not installed", "Loaded plugins: fastestmirror, langpacks, priorities\nResolving Dependencies\n--> Running transaction check\n---> Package iozone.x86_64 0:3.424-2_ceph.el7.centos will be erased\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be erased\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-img-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be erased\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos will be erased\n--> Running transaction check\n---> Package qemu-img.x86_64 10:1.5.3-167.el7_7.1 will be erased\n---> Package qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 will be erased\n---> Package qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 will be erased\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nRemoving:\n iozone x86_64 3.424-2_ceph.el7.centos @lab-extras 1.3 M\n librados2 x86_64 1:10.2.5-4.el7 @base 5.5 M\n librbd1 x86_64 1:10.2.5-4.el7 2019-11-29T12:20:47.387 INFO:teuthology.task.ansible.out: @base 7.4 M\n mod_fastcgi x86_64 2.4.7-1.ceph.el7.centos @centos7-fcgi-ceph 213 k\nRemoving for dependencies:\n qemu-img x86_64 10:1.5.3-167.el7_7.1 @updates 2.3 M\n qemu-kvm x86_64 10:1.5.3-167.el7_7.1 @updates 5.7 M\n qemu-kvm-common x86_64 10:1.5.3-167.el7_7.1 @updates 755 k\n\nTransaction Summary\n================================================================================\nRemove 4 Packages (+3 Dependent packages)\n\nInstalled size: 23 M\nDownloading packages:\nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Erasing : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 1/7 \n Erasing : 10:qemu-img-1.5.3-167.el7_7.1.x86_64 2/7 \n Erasing : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64 3/7 \n Erasing : 1:librbd1-10.2.5-4.el7.x86_64 4/7 \n Erasing : 1:librados2-10.2.5-4.el7.x86_64 5/7 \n Erasing : iozone-3.424-2_ceph.el7.centos.x86_64 6/7 \n Erasing : mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64 7/7 \nwarning: file /var/run/mod_fastcgi: remove failed: No such file or directory\n Verifying : 1:librbd1-10.2.5-4.el7.x86_64 1/7 \n Verifying : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64 2/7 \n Verifying : mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64 3/7 \n Verifying : 1:librados2-10.2.5-4.el7.x86_64 4/7 \n Verifying : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 5/7 \n Verifying : 10:qemu-img-1.5.3-167.el7_7.1.x86_64 6/7 \n Verifying : iozone-3.424-2_ceph.el7.centos.x86_64 7/7 \n\nRemoved:\n iozone.x86_64 0:3.424-2_ceph.el7.centos 2019-11-29T12:20:47.389 INFO:teuthology.task.ansible.out: \n librados2.x86_64 1:10.2.5-4.el7 \n librbd1.x86_64 1:10.2.5-4.el7 \n mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos \n\nDependency Removed:\n qemu-img.x86_64 10:1.5.3-167.el7_7.1 \n qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 \n qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 \n\nComplete!\n"]} 2019-11-29T12:20:47.424 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:20:47 +0000 (0:00:09.782) 0:03:23.532 ******* 2019-11-29T12:20:47.956 INFO:teuthology.task.ansible.out:changed: [smithi022.front.sepia.ceph.com] => {"changed": true, "changes": {"removed": ["librbd1", "librados2", "mod_fastcgi", "iozone"]}, "msg": "", "rc": 0, "results": ["ceph is not installed", "ceph-base is not installed", "ceph-selinux is not installed", "ceph-common is not installed", "ceph-debuginfo is not installed", "ceph-release is not installed", "libcephfs1 is not installed", "ceph-radosgw is not installed", "python-ceph is not installed", "python-rados is not installed", "python-rbd is not installed", "python-cephfs is not installed", "Loaded plugins: fastestmirror, langpacks, priorities\nResolving Dependencies\n--> Running transaction check\n---> Package iozone.x86_64 0:3.424-2_ceph.el7.centos will be erased\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be erased\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-img-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be erased\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos will be erased\n--> Running transaction check\n---> Package qemu-img.x86_64 10:1.5.3-167.el7_7.1 will be erased\n---> Package qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 will be erased\n---> Package qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 will be erased\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nRemoving:\n iozone x86_64 3.424-2_ceph.el7.centos @lab-extras 1.3 M\n librados2 x86_64 1:10.2.5-4.el7 @base 5.5 M\n librbd1 x86_64 1:10.2.5-4.el7 2019-11-29T12:20:47.958 INFO:teuthology.task.ansible.out: @base 7.4 M\n mod_fastcgi x86_64 2.4.7-1.ceph.el7.centos @centos7-fcgi-ceph 213 k\nRemoving for dependencies:\n qemu-img x86_64 10:1.5.3-167.el7_7.1 @updates 2.3 M\n qemu-kvm x86_64 10:1.5.3-167.el7_7.1 @updates 5.7 M\n qemu-kvm-common x86_64 10:1.5.3-167.el7_7.1 @updates 755 k\n\nTransaction Summary\n================================================================================\nRemove 4 Packages (+3 Dependent packages)\n\nInstalled size: 23 M\nDownloading packages:\nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Erasing : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 1/7 \n Erasing : 10:qemu-img-1.5.3-167.el7_7.1.x86_64 2/7 \n Erasing : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64 3/7 \n Erasing : 1:librbd1-10.2.5-4.el7.x86_64 4/7 \n Erasing : 1:librados2-10.2.5-4.el7.x86_64 5/7 \n Erasing : iozone-3.424-2_ceph.el7.centos.x86_64 6/7 \n Erasing : mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64 7/7 \nwarning: file /var/run/mod_fastcgi: remove failed: No such file or directory\n Verifying : 1:librbd1-10.2.5-4.el7.x86_64 1/7 \n Verifying : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64 2/7 \n Verifying : mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64 3/7 \n Verifying : 1:librados2-10.2.5-4.el7.x86_64 4/7 \n Verifying : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 5/7 \n Verifying : 10:qemu-img-1.5.3-167.el7_7.1.x86_64 6/7 \n Verifying : iozone-3.424-2_ceph.el7.centos.x86_64 7/7 \n\nRemoved:\n iozone.x86_64 0:3.424-2_ceph.el7.centos 2019-11-29T12:20:47.960 INFO:teuthology.task.ansible.out: \n librados2.x86_64 1:10.2.5-4.el7 \n librbd1.x86_64 1:10.2.5-4.el7 \n mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos \n\nDependency Removed:\n qemu-img.x86_64 10:1.5.3-167.el7_7.1 \n qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 \n qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 \n\nComplete!\n"]} 2019-11-29T12:20:47.993 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:20:47 +0000 (0:00:00.569) 0:03:24.101 ******* 2019-11-29T12:20:50.885 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2019-11-29T12:20:50.886 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => {"changed": true, "changes": {"removed": ["boost-random", "boost-random"]}, "msg": "", "rc": 0, "results": ["boost-program-options is not installed", "leveldb is not installed", "xmlstarlet is not installed", "python-jinja2 is not installed", "python-ceph is not installed", "python-flask is not installed", "python-requests is not installed", "python-urllib3 is not installed", "python-babel is not installed", "hdparm is not installed", "python-markupsafe is not installed", "python-werkzeug is not installed", "python-itsdangerous is not installed", "Loaded plugins: fastestmirror, langpacks, priorities\nResolving Dependencies\n--> Running transaction check\n---> Package boost-random.x86_64 0:1.53.0-27.el7 will be erased\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nRemoving:\n boost-random x86_64 1.53.0-27.el7 @base 28 k\n\nTransaction Summary\n================================================================================\nRemove 1 Package\n\nInstalled size: 28 k\nDownloading packages:\nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Erasing : boost-random-1.53.0-27.el7.x86_64 1/1 \n Verifying : boost-random-1.53.0-27.el7.x86_64 1/1 \n\nRemoved:\n boost-random.x86_64 0:1.53.0-27.el7 \n\nComplete!\n"]} 2019-11-29T12:20:50.920 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:20:50 +0000 (0:00:02.926) 0:03:27.028 ******* 2019-11-29T12:20:51.429 INFO:teuthology.task.ansible.out:changed: [smithi022.front.sepia.ceph.com] => {"changed": true, "changes": {"removed": ["boost-random", "boost-random"]}, "msg": "", "rc": 0, "results": ["boost-program-options is not installed", "leveldb is not installed", "xmlstarlet is not installed", "python-jinja2 is not installed", "python-ceph is not installed", "python-flask is not installed", "python-requests is not installed", "python-urllib3 is not installed", "python-babel is not installed", "hdparm is not installed", "python-markupsafe is not installed", "python-werkzeug is not installed", "python-itsdangerous is not installed", "Loaded plugins: fastestmirror, langpacks, priorities\nResolving Dependencies\n--> Running transaction check\n---> Package boost-random.x86_64 0:1.53.0-27.el7 will be erased\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nRemoving:\n boost-random x86_64 1.53.0-27.el7 @base 28 k\n\nTransaction Summary\n================================================================================\nRemove 1 Package\n\nInstalled size: 28 k\nDownloading packages:\nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Erasing : boost-random-1.53.0-27.el7.x86_64 1/1 \n Verifying : boost-random-1.53.0-27.el7.x86_64 1/1 \n\nRemoved:\n boost-random.x86_64 0:1.53.0-27.el7 \n\nComplete!\n"]} 2019-11-29T12:20:51.466 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:20:51 +0000 (0:00:00.546) 0:03:27.574 ******* 2019-11-29T12:21:10.428 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2019-11-29T12:21:10.430 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "changes": {"installed": ["@core", "@base", "iozone", "qemu-kvm", "mod_fastcgi-2.4.7-1.ceph.el7.centos"]}, "msg": "Warning: Group core does not have any packages to install.\nWarning: Group base does not have any packages to install.\nGroup base does have 1 conditional packages, which may get installed.\n", "rc": 0, "results": ["yum-plugin-priorities-1.1.31-52.el7.noarch providing yum-plugin-priorities is already installed", "yum-plugin-fastestmirror-1.1.31-50.el7.noarch providing yum-plugin-fastestmirror is already installed", "redhat-lsb-4.1-27.el7.centos.1.x86_64 providing redhat-lsb is already installed", "sysstat-10.1.5-17.el7.x86_64 providing sysstat is already installed", "gdb-7.6.1-114.el7.x86_64 providing gdb is already installed", "git-all-1.8.3.1-20.el7.noarch providing git-all is already installed", "python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed", "gcc-c++-4.8.5-39.el7.x86_64 providing gcc-c++ is already installed", "libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed", "openssl098e-0.9.8e-29.el7.centos.3.x86_64 providing openssl098e is already installed", "boost-thread-1.53.0-27.el7.x86_64 providing boost-thread is already installed", "xfsprogs-4.5.0-20.el7.x86_64 providing xfsprogs is already installed", "gdisk-0.8.10-2.el7.x86_64 providing gdisk is already installed", "parted-3.1-29.el7.x86_64 providing parted is already installed", "libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed", "fuse-2.9.2-11.el7.x86_64 providing fuse is already installed", "fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed", "python-virtualenv-15.1.0-2.el7.noarch providing python-virtualenv is already installed", "1:openssl-1.0.2k-16.el7.x86_64 providing openssl is already installed", "libuuid-2.23.2-61.el7.x86_64 providing libuuid is already installed", "btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is alrea 2019-11-29T12:21:10.431 INFO:teuthology.task.ansible.out:dy installed", "attr-2.4.46-13.el7.x86_64 providing attr is already installed", "1:valgrind-3.14.0-16.el7.x86_64 providing valgrind is already installed", "python-nose-1.3.7-1.el7.noarch providing python-nose is already installed", "mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed", "podman-1.4.4-4.el7.centos.x86_64 providing podman is already installed", "ant-1.9.4-2.el7.noarch providing ant is already installed", "libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed", "automake-1.13.4-3.el7.noarch providing automake is already installed", "gettext-0.19.8.1-2.el7.x86_64 providing gettext is already installed", "libuuid-devel-2.23.2-61.el7.x86_64 providing libuuid-devel is already installed", "libacl-devel-2.2.51-14.el7.x86_64 providing libacl-devel is already installed", "bc-1.06.95-13.el7.x86_64 providing bc is already installed", "xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed", "xfsprogs-devel-4.5.0-20.el7.x86_64 providing xfsprogs-devel is already installed", "blktrace-1.0.5-8.el7.x86_64 providing blktrace is already installed", "1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed", "python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed", "usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed", "genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed", "httpd-2.4.6-90.el7.centos.x86_64 providing httpd is already installed", "httpd-devel-2.4.6-90.el7.centos.x86_64 providing httpd-devel is already installed", "httpd-tools-2.4.6-90.el7.centos.x86_64 providing httpd-tools is already installed", "1:mod_ssl-2.4.6-90.el7.centos.x86_64 providing mod_ssl is already installed", "libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed", "perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed", "1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already insta 2019-11-29T12:21:10.433 INFO:teuthology.task.ansible.out:lled", "junit-4.11-8.el7.noarch providing junit4 is already installed", "1:nfs-utils-1.3.0-0.65.el7.x86_64 providing nfs-utils is already installed", "ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed", "python-devel-2.7.5-86.el7.x86_64 providing python-devel is already installed", "python-virtualenv-15.1.0-2.el7.noarch providing python-virtualenv is already installed", "perl-CPAN-1.9800-294.el7_6.noarch providing perl-CPAN is already installed", "Loaded plugins: fastestmirror, langpacks, priorities\nLoading mirror speeds from cached hostfile\n * base: mirror.us-midwest-1.nexcess.net\n * epel: download-cc-rdu01.fedoraproject.org\n * extras: mirror.rackspace.com\n * updates: reflector.westga.edu\nResolving Dependencies\n--> Running transaction check\n---> Package iozone.x86_64 0:3.424-2_ceph.el7.centos will be installed\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos will be installed\n---> Package qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 will be installed\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-167.el7_7.1 for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: qemu-img = 10:1.5.3-167.el7_7.1 for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Running transaction check\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\n---> Package qemu-img.x86_64 10:1.5.3-167.el7_7.1 will be installed\n---> Package qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 will be installed\n--> Running transaction check\n---> Package boost-random.x86_64 0:1.53.0-27.el7 will be installed\n--> Finished Dependency Resolution\n\nDepende 2019-11-29T12:21:10.434 INFO:teuthology.task.ansible.out:ncies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nInstalling:\n iozone x86_64 3.424-2_ceph.el7.centos lab-extras 800 k\n mod_fastcgi x86_64 2.4.7-1.ceph.el7.centos centos7-fcgi-ceph 70 k\n qemu-kvm x86_64 10:1.5.3-167.el7_7.1 updates 1.9 M\nInstalling for dependencies:\n boost-random x86_64 1.53.0-27.el7 base 39 k\n librados2 x86_64 1:10.2.5-4.el7 base 1.8 M\n librbd1 x86_64 1:10.2.5-4.el7 base 2.4 M\n qemu-img x86_64 10:1.5.3-167.el7_7.1 updates 699 k\n qemu-kvm-common x86_64 10:1.5.3-167.el7_7.1 updates 435 k\n\nTransaction Summary\n================================================================================\nInstall 3 Packages (+5 Dependent packages)\n\nTotal download size: 8.1 M\nInstalled size: 23 M\nDownloading packages:\n--------------------------------------------------------------------------------\nTotal 18 MB/s | 8.1 MB 00:00 \nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Installing : boost-random-1.53.0-27.el7.x86_64 1/8 \n Installing : 1:librados2-10.2.5-4.el7.x86_64 2/8 \n Installing : 1:librbd1-10.2.5-4.el7.x86_64 3/8 \n Installing : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64 4/8 \n Installing : 10:qemu-img-1.5.3-167.el7_7.1.x86_64 5/8 \n Installing : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 6/8 \n Installing : iozone-3.424-2_ceph.el7.centos.x86_64 2019-11-29T12:21:10.436 INFO:teuthology.task.ansible.out: 7/8 \n Installing : mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64 8/8 \n Verifying : 1:librbd1-10.2.5-4.el7.x86_64 1/8 \n Verifying : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64 2/8 \n Verifying : mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64 3/8 \n Verifying : 1:librados2-10.2.5-4.el7.x86_64 4/8 \n Verifying : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 5/8 \n Verifying : 10:qemu-img-1.5.3-167.el7_7.1.x86_64 6/8 \n Verifying : boost-random-1.53.0-27.el7.x86_64 7/8 \n Verifying : iozone-3.424-2_ceph.el7.centos.x86_64 8/8 \n\nInstalled:\n iozone.x86_64 0:3.424-2_ceph.el7.centos \n mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos \n qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 \n\nDependency Installed:\n boost-random.x86_64 0:1.53.0-27.el7 \n librados2.x86_64 1:10.2.5-4.el7 \n librbd1.x86_64 1:10.2.5-4.el7 \n qemu-img.x86_64 10:1.5.3-167.el7_7.1 \n qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 \n\nComplete!\n"]} 2019-11-29T12:21:10.468 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:10 +0000 (0:00:19.001) 0:03:46.576 ******* 2019-11-29T12:21:10.490 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => {"changed": false, "changes": {"installed": ["@core", "@base", "iozone", "qemu-kvm", "mod_fastcgi-2.4.7-1.ceph.el7.centos"]}, "msg": "Warning: Group core does not have any packages to install.\nWarning: Group base does not have any packages to install.\nGroup base does have 1 conditional packages, which may get installed.\n", "rc": 0, "results": ["yum-plugin-priorities-1.1.31-52.el7.noarch providing yum-plugin-priorities is already installed", "yum-plugin-fastestmirror-1.1.31-50.el7.noarch providing yum-plugin-fastestmirror is already installed", "redhat-lsb-4.1-27.el7.centos.1.x86_64 providing redhat-lsb is already installed", "sysstat-10.1.5-17.el7.x86_64 providing sysstat is already installed", "gdb-7.6.1-114.el7.x86_64 providing gdb is already installed", "git-all-1.8.3.1-20.el7.noarch providing git-all is already installed", "python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed", "gcc-c++-4.8.5-39.el7.x86_64 providing gcc-c++ is already installed", "libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed", "openssl098e-0.9.8e-29.el7.centos.3.x86_64 providing openssl098e is already installed", "boost-thread-1.53.0-27.el7.x86_64 providing boost-thread is already installed", "xfsprogs-4.5.0-20.el7.x86_64 providing xfsprogs is already installed", "gdisk-0.8.10-2.el7.x86_64 providing gdisk is already installed", "parted-3.1-29.el7.x86_64 providing parted is already installed", "libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed", "fuse-2.9.2-11.el7.x86_64 providing fuse is already installed", "fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed", "python-virtualenv-15.1.0-2.el7.noarch providing python-virtualenv is already installed", "1:openssl-1.0.2k-16.el7.x86_64 providing openssl is already installed", "libuuid-2.23.2-61.el7.x86_64 providing libuuid is already installed", "btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is alrea 2019-11-29T12:21:10.491 INFO:teuthology.task.ansible.out:dy installed", "attr-2.4.46-13.el7.x86_64 providing attr is already installed", "1:valgrind-3.14.0-16.el7.x86_64 providing valgrind is already installed", "python-nose-1.3.7-1.el7.noarch providing python-nose is already installed", "mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed", "podman-1.4.4-4.el7.centos.x86_64 providing podman is already installed", "ant-1.9.4-2.el7.noarch providing ant is already installed", "libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed", "automake-1.13.4-3.el7.noarch providing automake is already installed", "gettext-0.19.8.1-2.el7.x86_64 providing gettext is already installed", "libuuid-devel-2.23.2-61.el7.x86_64 providing libuuid-devel is already installed", "libacl-devel-2.2.51-14.el7.x86_64 providing libacl-devel is already installed", "bc-1.06.95-13.el7.x86_64 providing bc is already installed", "xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed", "xfsprogs-devel-4.5.0-20.el7.x86_64 providing xfsprogs-devel is already installed", "blktrace-1.0.5-8.el7.x86_64 providing blktrace is already installed", "1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed", "python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed", "usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed", "genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed", "httpd-2.4.6-90.el7.centos.x86_64 providing httpd is already installed", "httpd-devel-2.4.6-90.el7.centos.x86_64 providing httpd-devel is already installed", "httpd-tools-2.4.6-90.el7.centos.x86_64 providing httpd-tools is already installed", "1:mod_ssl-2.4.6-90.el7.centos.x86_64 providing mod_ssl is already installed", "libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed", "perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed", "1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already insta 2019-11-29T12:21:10.493 INFO:teuthology.task.ansible.out:lled", "junit-4.11-8.el7.noarch providing junit4 is already installed", "1:nfs-utils-1.3.0-0.65.el7.x86_64 providing nfs-utils is already installed", "ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed", "python-devel-2.7.5-86.el7.x86_64 providing python-devel is already installed", "python-virtualenv-15.1.0-2.el7.noarch providing python-virtualenv is already installed", "perl-CPAN-1.9800-294.el7_6.noarch providing perl-CPAN is already installed", "Loaded plugins: fastestmirror, langpacks, priorities\nLoading mirror speeds from cached hostfile\n * base: mirror.us-midwest-1.nexcess.net\n * epel: download-cc-rdu01.fedoraproject.org\n * extras: mirror.rackspace.com\n * updates: reflector.westga.edu\nResolving Dependencies\n--> Running transaction check\n---> Package iozone.x86_64 0:3.424-2_ceph.el7.centos will be installed\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos will be installed\n---> Package qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 will be installed\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-167.el7_7.1 for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: qemu-img = 10:1.5.3-167.el7_7.1 for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Running transaction check\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\n---> Package qemu-img.x86_64 10:1.5.3-167.el7_7.1 will be installed\n---> Package qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 will be installed\n--> Running transaction check\n---> Package boost-random.x86_64 0:1.53.0-27.el7 will be installed\n--> Finished Dependency Resolution\n\nDepende 2019-11-29T12:21:10.494 INFO:teuthology.task.ansible.out:ncies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nInstalling:\n iozone x86_64 3.424-2_ceph.el7.centos lab-extras 800 k\n mod_fastcgi x86_64 2.4.7-1.ceph.el7.centos centos7-fcgi-ceph 70 k\n qemu-kvm x86_64 10:1.5.3-167.el7_7.1 updates 1.9 M\nInstalling for dependencies:\n boost-random x86_64 1.53.0-27.el7 base 39 k\n librados2 x86_64 1:10.2.5-4.el7 base 1.8 M\n librbd1 x86_64 1:10.2.5-4.el7 base 2.4 M\n qemu-img x86_64 10:1.5.3-167.el7_7.1 updates 699 k\n qemu-kvm-common x86_64 10:1.5.3-167.el7_7.1 updates 435 k\n\nTransaction Summary\n================================================================================\nInstall 3 Packages (+5 Dependent packages)\n\nTotal download size: 8.1 M\nInstalled size: 23 M\nDownloading packages:\n--------------------------------------------------------------------------------\nTotal 19 MB/s | 8.1 MB 00:00 \nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Installing : boost-random-1.53.0-27.el7.x86_64 1/8 \n Installing : 1:librados2-10.2.5-4.el7.x86_64 2/8 \n Installing : 1:librbd1-10.2.5-4.el7.x86_64 3/8 \n Installing : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64 4/8 \n Installing : 10:qemu-img-1.5.3-167.el7_7.1.x86_64 5/8 \n Installing : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 6/8 \n Installing : iozone-3.424-2_ceph.el7.centos.x86_64 2019-11-29T12:21:10.496 INFO:teuthology.task.ansible.out: 7/8 \n Installing : mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64 8/8 \n Verifying : 1:librbd1-10.2.5-4.el7.x86_64 1/8 \n Verifying : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64 2/8 \n Verifying : mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64 3/8 \n Verifying : 1:librados2-10.2.5-4.el7.x86_64 4/8 \n Verifying : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 5/8 \n Verifying : 10:qemu-img-1.5.3-167.el7_7.1.x86_64 6/8 \n Verifying : boost-random-1.53.0-27.el7.x86_64 7/8 \n Verifying : iozone-3.424-2_ceph.el7.centos.x86_64 8/8 \n\nInstalled:\n iozone.x86_64 0:3.424-2_ceph.el7.centos \n mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos \n qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 \n\nDependency Installed:\n boost-random.x86_64 0:1.53.0-27.el7 \n librados2.x86_64 1:10.2.5-4.el7 \n librbd1.x86_64 1:10.2.5-4.el7 \n qemu-img.x86_64 10:1.5.3-167.el7_7.1 \n qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 \n\nComplete!\n"]} 2019-11-29T12:21:10.540 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:10 +0000 (0:00:00.071) 0:03:46.648 ******* 2019-11-29T12:21:11.280 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2019-11-29T12:21:11.281 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["cryptopp-devel-5.6.2-10.el7.x86_64 providing cryptopp-devel is already installed", "cryptopp-5.6.2-10.el7.x86_64 providing cryptopp is already installed", "fcgi-2.4.0-25.el7.x86_64 providing fcgi is already installed", "dbench-4.0-10.el7.x86_64 providing dbench is already installed", "fuse-sshfs-2.10-1.el7.x86_64 providing fuse-sshfs is already installed", "bonnie++-1.97.3-1.el7.x86_64 providing bonnie++ is already installed", "1:perl-JSON-XS-3.01-2.el7.x86_64 providing perl-JSON-XS is already installed"]} 2019-11-29T12:21:11.319 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:11 +0000 (0:00:00.778) 0:03:47.427 ******* 2019-11-29T12:21:11.347 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["cryptopp-devel-5.6.2-10.el7.x86_64 providing cryptopp-devel is already installed", "cryptopp-5.6.2-10.el7.x86_64 providing cryptopp is already installed", "fcgi-2.4.0-25.el7.x86_64 providing fcgi is already installed", "dbench-4.0-10.el7.x86_64 providing dbench is already installed", "fuse-sshfs-2.10-1.el7.x86_64 providing fuse-sshfs is already installed", "bonnie++-1.97.3-1.el7.x86_64 providing bonnie++ is already installed", "1:perl-JSON-XS-3.01-2.el7.x86_64 providing perl-JSON-XS is already installed"]} 2019-11-29T12:21:11.349 INFO:teuthology.task.ansible.out: 2019-11-29T12:21:11.399 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:11 +0000 (0:00:00.074) 0:03:47.501 ******* 2019-11-29T12:21:11.837 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2019-11-29T12:21:11.839 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["device-mapper-multipath is not installed"]} 2019-11-29T12:21:11.875 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:11 +0000 (0:00:00.480) 0:03:47.982 ******* 2019-11-29T12:21:11.912 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2019-11-29T12:21:11.913 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:11.950 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:11 +0000 (0:00:00.075) 0:03:48.057 ******* 2019-11-29T12:21:11.955 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2019-11-29T12:21:11.956 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["device-mapper-multipath is not installed"]} 2019-11-29T12:21:11.994 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:11 +0000 (0:00:00.044) 0:03:48.102 ******* 2019-11-29T12:21:12.031 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2019-11-29T12:21:12.033 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:12.068 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:12 +0000 (0:00:00.074) 0:03:48.176 ******* 2019-11-29T12:21:12.401 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2019-11-29T12:21:12.402 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "enabled": false, "name": "firewalld", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "dbus.service system.slice polkit.service basic.target", "AllowIsolate": "no", "AmbientCapabilities": "0", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "network-pre.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "18446744073709551615", "BusName": "org.fedoraproject.FirewallD1", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "18446744073709551615", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "18446744073709551615", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "Conflicts": "ebtables.service ip6tables.service shutdown.target iptables.service ipset.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "firewalld - dynamic firewall daemon", "DevicePolicy": "auto", "Documentation": "man:firewalld(1)", "EnvironmentFile": "/etc/sysconfig/firewalld (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/firewalld ; argv[]=/usr/sbin/firewalld --nofork --nopid $FIREWALLD_ARGS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/firewalld.service", "GuessMainPID": "yes", "IOScheduling": "0", "Id": "firewalld.service", "IgnoreOnIsolate": "no", "Igno 2019-11-29T12:21:12.406 INFO:teuthology.task.ansible.out:reOnSnapshot": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobTimeoutAction": "none", "JobTimeoutUSec": "0", "KillMode": "mixed", "KillSignal": "15", "LimitAS": "18446744073709551615", "LimitCORE": "18446744073709551615", "LimitCPU": "18446744073709551615", "LimitDATA": "18446744073709551615", "LimitFSIZE": "18446744073709551615", "LimitLOCKS": "18446744073709551615", "LimitMEMLOCK": "65536", "LimitMSGQUEUE": "819200", "LimitNICE": "0", "LimitNOFILE": "4096", "LimitNPROC": "127511", "LimitRSS": "18446744073709551615", "LimitRTPRIO": "0", "LimitRTTIME": "18446744073709551615", "LimitSIGPENDING": "127511", "LimitSTACK": "18446744073709551615", "LoadState": "loaded", "MainPID": "0", "MemoryAccounting": "no", "MemoryCurrent": "18446744073709551615", "MemoryLimit": "18446744073709551615", "MountFlags": "0", "Names": "firewalld.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "ProtectHome": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "Requires": "basic.target", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "null", "StandardInput": "null", "StandardOutput": "null", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitInterval": "10000000", "StartupBlockIOWeight": "18446744073709551615", "StartupCPUShares": "18446744073709551615", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", " 2019-11-29T12:21:12.408 INFO:teuthology.task.ansible.out:TTYVTDisallocate": "no", "TasksAccounting": "no", "TasksCurrent": "18446744073709551615", "TasksMax": "18446744073709551615", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "dbus", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "Wants": "network-pre.target system.slice", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2019-11-29T12:21:12.441 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:12 +0000 (0:00:00.372) 0:03:48.549 ******* 2019-11-29T12:21:12.511 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => {"changed": false, "enabled": false, "name": "firewalld", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "system.slice dbus.service polkit.service basic.target", "AllowIsolate": "no", "AmbientCapabilities": "0", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "network-pre.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "18446744073709551615", "BusName": "org.fedoraproject.FirewallD1", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "18446744073709551615", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "18446744073709551615", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "Conflicts": "shutdown.target iptables.service ipset.service ip6tables.service ebtables.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "firewalld - dynamic firewall daemon", "DevicePolicy": "auto", "Documentation": "man:firewalld(1)", "EnvironmentFile": "/etc/sysconfig/firewalld (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/firewalld ; argv[]=/usr/sbin/firewalld --nofork --nopid $FIREWALLD_ARGS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/firewalld.service", "GuessMainPID": "yes", "IOScheduling": "0", "Id": "firewalld.service", "IgnoreOnIsolate": "no", "Igno 2019-11-29T12:21:12.513 INFO:teuthology.task.ansible.out:reOnSnapshot": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobTimeoutAction": "none", "JobTimeoutUSec": "0", "KillMode": "mixed", "KillSignal": "15", "LimitAS": "18446744073709551615", "LimitCORE": "18446744073709551615", "LimitCPU": "18446744073709551615", "LimitDATA": "18446744073709551615", "LimitFSIZE": "18446744073709551615", "LimitLOCKS": "18446744073709551615", "LimitMEMLOCK": "65536", "LimitMSGQUEUE": "819200", "LimitNICE": "0", "LimitNOFILE": "4096", "LimitNPROC": "127535", "LimitRSS": "18446744073709551615", "LimitRTPRIO": "0", "LimitRTTIME": "18446744073709551615", "LimitSIGPENDING": "127535", "LimitSTACK": "18446744073709551615", "LoadState": "loaded", "MainPID": "0", "MemoryAccounting": "no", "MemoryCurrent": "18446744073709551615", "MemoryLimit": "18446744073709551615", "MountFlags": "0", "Names": "firewalld.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "ProtectHome": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "Requires": "basic.target", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "null", "StandardInput": "null", "StandardOutput": "null", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitInterval": "10000000", "StartupBlockIOWeight": "18446744073709551615", "StartupCPUShares": "18446744073709551615", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", " 2019-11-29T12:21:12.515 INFO:teuthology.task.ansible.out:TTYVTDisallocate": "no", "TasksAccounting": "no", "TasksCurrent": "18446744073709551615", "TasksMax": "18446744073709551615", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "dbus", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "Wants": "network-pre.target system.slice", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2019-11-29T12:21:12.547 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:12 +0000 (0:00:00.106) 0:03:48.655 ******* 2019-11-29T12:21:12.834 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2019-11-29T12:21:12.836 INFO:teuthology.task.ansible.out:fatal: [smithi062.front.sepia.ceph.com]: FAILED! => {"changed": false, "msg": "Could not find the requested service iptables: host"} ...ignoring 2019-11-29T12:21:12.872 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:12 +0000 (0:00:00.324) 0:03:48.980 ******* 2019-11-29T12:21:12.982 INFO:teuthology.task.ansible.out:fatal: [smithi022.front.sepia.ceph.com]: FAILED! => {"changed": false, "msg": "Could not find the requested service iptables: host"} ...ignoring 2019-11-29T12:21:13.021 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:13 +0000 (0:00:00.149) 0:03:49.129 ******* 2019-11-29T12:21:13.676 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2019-11-29T12:21:13.678 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "configfile": "/etc/selinux/config", "msg": "", "policy": "targeted", "reboot_required": false, "state": "permissive"} 2019-11-29T12:21:13.713 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:13 +0000 (0:00:00.691) 0:03:49.821 ******* 2019-11-29T12:21:13.719 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => {"changed": false, "configfile": "/etc/selinux/config", "msg": "", "policy": "targeted", "reboot_required": false, "state": "permissive"} 2019-11-29T12:21:13.757 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:13 +0000 (0:00:00.044) 0:03:49.865 ******* 2019-11-29T12:21:13.763 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2019-11-29T12:21:13.763 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:13.800 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:13 +0000 (0:00:00.043) 0:03:49.908 ******* 2019-11-29T12:21:13.805 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:13.845 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:13 +0000 (0:00:00.044) 0:03:49.953 ******* 2019-11-29T12:21:13.854 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2019-11-29T12:21:13.891 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:13 +0000 (0:00:00.045) 0:03:49.999 ******* 2019-11-29T12:21:13.934 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:13 +0000 (0:00:00.043) 0:03:50.042 ******* 2019-11-29T12:21:13.940 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2019-11-29T12:21:13.941 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:13.980 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:13 +0000 (0:00:00.045) 0:03:50.088 ******* 2019-11-29T12:21:13.986 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:14.024 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:14 +0000 (0:00:00.043) 0:03:50.131 ******* 2019-11-29T12:21:14.030 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2019-11-29T12:21:14.030 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:14.071 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:14 +0000 (0:00:00.047) 0:03:50.178 ******* 2019-11-29T12:21:14.077 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:14.115 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:14 +0000 (0:00:00.044) 0:03:50.223 ******* 2019-11-29T12:21:14.119 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2019-11-29T12:21:14.120 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2019-11-29T12:21:14.121 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2019-11-29T12:21:14.160 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:14 +0000 (0:00:00.044) 0:03:50.267 ******* 2019-11-29T12:21:14.165 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2019-11-29T12:21:14.166 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2019-11-29T12:21:14.203 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:14 +0000 (0:00:00.043) 0:03:50.311 ******* 2019-11-29T12:21:14.209 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2019-11-29T12:21:14.211 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:14.247 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:14 +0000 (0:00:00.043) 0:03:50.354 ******* 2019-11-29T12:21:14.254 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:14.290 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:14 +0000 (0:00:00.042) 0:03:50.397 ******* 2019-11-29T12:21:14.295 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2019-11-29T12:21:14.335 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:14 +0000 (0:00:00.045) 0:03:50.442 ******* 2019-11-29T12:21:14.377 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:14 +0000 (0:00:00.042) 0:03:50.485 ******* 2019-11-29T12:21:14.384 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2019-11-29T12:21:14.386 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:14.421 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:14 +0000 (0:00:00.044) 0:03:50.529 ******* 2019-11-29T12:21:14.427 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:14.466 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:14 +0000 (0:00:00.044) 0:03:50.574 ******* 2019-11-29T12:21:14.471 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2019-11-29T12:21:14.473 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:14.510 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:14 +0000 (0:00:00.044) 0:03:50.618 ******* 2019-11-29T12:21:14.515 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:14.553 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:14 +0000 (0:00:00.042) 0:03:50.661 ******* 2019-11-29T12:21:14.559 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2019-11-29T12:21:14.559 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:14.598 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:14 +0000 (0:00:00.045) 0:03:50.706 ******* 2019-11-29T12:21:14.604 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:14.641 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:14 +0000 (0:00:00.043) 0:03:50.749 ******* 2019-11-29T12:21:14.646 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2019-11-29T12:21:14.647 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:14.684 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:14 +0000 (0:00:00.042) 0:03:50.791 ******* 2019-11-29T12:21:14.690 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:14.727 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:14 +0000 (0:00:00.043) 0:03:50.835 ******* 2019-11-29T12:21:14.732 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2019-11-29T12:21:14.733 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:14.779 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:14 +0000 (0:00:00.051) 0:03:50.886 ******* 2019-11-29T12:21:14.784 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:14.822 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:14 +0000 (0:00:00.043) 0:03:50.930 ******* 2019-11-29T12:21:14.827 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2019-11-29T12:21:14.828 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:14.864 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:14 +0000 (0:00:00.042) 0:03:50.972 ******* 2019-11-29T12:21:14.872 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:14.908 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:14 +0000 (0:00:00.043) 0:03:51.016 ******* 2019-11-29T12:21:14.915 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2019-11-29T12:21:14.915 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:14.954 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:14 +0000 (0:00:00.045) 0:03:51.062 ******* 2019-11-29T12:21:14.959 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:14.998 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:14 +0000 (0:00:00.044) 0:03:51.106 ******* 2019-11-29T12:21:15.004 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2019-11-29T12:21:15.005 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:15.042 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:15 +0000 (0:00:00.044) 0:03:51.150 ******* 2019-11-29T12:21:15.048 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:15.085 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:15 +0000 (0:00:00.042) 0:03:51.193 ******* 2019-11-29T12:21:15.093 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:15.129 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:15 +0000 (0:00:00.043) 0:03:51.237 ******* 2019-11-29T12:21:15.135 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:15.172 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:15 +0000 (0:00:00.043) 0:03:51.280 ******* 2019-11-29T12:21:15.177 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2019-11-29T12:21:15.178 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:15.216 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:15 +0000 (0:00:00.044) 0:03:51.324 ******* 2019-11-29T12:21:15.222 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:15.260 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:15 +0000 (0:00:00.044) 0:03:51.368 ******* 2019-11-29T12:21:15.266 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2019-11-29T12:21:15.267 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:15.306 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:15 +0000 (0:00:00.045) 0:03:51.413 ******* 2019-11-29T12:21:15.311 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:15.349 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:15 +0000 (0:00:00.043) 0:03:51.456 ******* 2019-11-29T12:21:15.354 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2019-11-29T12:21:15.356 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:15.392 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:15 +0000 (0:00:00.043) 0:03:51.500 ******* 2019-11-29T12:21:15.400 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:15.437 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:15 +0000 (0:00:00.044) 0:03:51.545 ******* 2019-11-29T12:21:15.443 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2019-11-29T12:21:15.444 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:15.484 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:15 +0000 (0:00:00.046) 0:03:51.591 ******* 2019-11-29T12:21:15.489 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:15.530 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:15 +0000 (0:00:00.046) 0:03:51.638 ******* 2019-11-29T12:21:15.539 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:15.575 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:15 +0000 (0:00:00.044) 0:03:51.682 ******* 2019-11-29T12:21:15.580 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:15.616 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:15 +0000 (0:00:00.041) 0:03:51.724 ******* 2019-11-29T12:21:15.623 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2019-11-29T12:21:15.625 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:15.657 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:15 +0000 (0:00:00.041) 0:03:51.765 ******* 2019-11-29T12:21:15.662 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:15.702 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:15 +0000 (0:00:00.044) 0:03:51.809 ******* 2019-11-29T12:21:15.706 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2019-11-29T12:21:15.707 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:15.744 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:15 +0000 (0:00:00.042) 0:03:51.852 ******* 2019-11-29T12:21:15.751 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:15.789 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:15 +0000 (0:00:00.044) 0:03:51.897 ******* 2019-11-29T12:21:15.794 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2019-11-29T12:21:15.795 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:15.833 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:15 +0000 (0:00:00.044) 0:03:51.941 ******* 2019-11-29T12:21:15.840 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:15.879 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:15 +0000 (0:00:00.045) 0:03:51.987 ******* 2019-11-29T12:21:15.885 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2019-11-29T12:21:15.887 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:15.924 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:15 +0000 (0:00:00.044) 0:03:52.031 ******* 2019-11-29T12:21:15.928 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:15.966 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:15 +0000 (0:00:00.041) 0:03:52.073 ******* 2019-11-29T12:21:15.970 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2019-11-29T12:21:15.971 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:16.009 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:16 +0000 (0:00:00.043) 0:03:52.117 ******* 2019-11-29T12:21:16.014 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:16.053 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:16 +0000 (0:00:00.043) 0:03:52.160 ******* 2019-11-29T12:21:16.066 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2019-11-29T12:21:16.068 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:16.104 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:16 +0000 (0:00:00.051) 0:03:52.212 ******* 2019-11-29T12:21:16.110 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:16.149 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:16 +0000 (0:00:00.044) 0:03:52.256 ******* 2019-11-29T12:21:16.153 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2019-11-29T12:21:16.155 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:16.193 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:16 +0000 (0:00:00.044) 0:03:52.300 ******* 2019-11-29T12:21:16.199 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:16.238 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:16 +0000 (0:00:00.045) 0:03:52.345 ******* 2019-11-29T12:21:16.244 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2019-11-29T12:21:16.245 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:16.282 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:16 +0000 (0:00:00.044) 0:03:52.390 ******* 2019-11-29T12:21:16.289 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:16.328 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:16 +0000 (0:00:00.045) 0:03:52.436 ******* 2019-11-29T12:21:16.335 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2019-11-29T12:21:16.337 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:16.378 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:16 +0000 (0:00:00.049) 0:03:52.485 ******* 2019-11-29T12:21:16.383 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:16.423 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:16 +0000 (0:00:00.045) 0:03:52.531 ******* 2019-11-29T12:21:16.428 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2019-11-29T12:21:16.430 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:16.468 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:16 +0000 (0:00:00.044) 0:03:52.575 ******* 2019-11-29T12:21:16.472 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:16.512 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:16 +0000 (0:00:00.043) 0:03:52.619 ******* 2019-11-29T12:21:16.518 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2019-11-29T12:21:16.520 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:16.555 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:16 +0000 (0:00:00.043) 0:03:52.662 ******* 2019-11-29T12:21:16.560 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:16.598 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:16 +0000 (0:00:00.042) 0:03:52.705 ******* 2019-11-29T12:21:16.603 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2019-11-29T12:21:16.605 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:16.642 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:16 +0000 (0:00:00.044) 0:03:52.750 ******* 2019-11-29T12:21:16.648 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:16.687 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:16 +0000 (0:00:00.044) 0:03:52.794 ******* 2019-11-29T12:21:16.983 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2019-11-29T12:21:16.984 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/bin/lspci", "gid": 0, "group": "root", "mode": "0777", "owner": "root", "secontext": "unconfined_u:object_r:bin_t:s0", "size": 11, "src": "/sbin/lspci", "state": "link", "uid": 0} 2019-11-29T12:21:17.021 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:17 +0000 (0:00:00.334) 0:03:53.129 ******* 2019-11-29T12:21:17.027 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/bin/lspci", "gid": 0, "group": "root", "mode": "0777", "owner": "root", "secontext": "unconfined_u:object_r:bin_t:s0", "size": 11, "src": "/sbin/lspci", "state": "link", "uid": 0} 2019-11-29T12:21:17.065 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:17 +0000 (0:00:00.043) 0:03:53.172 ******* 2019-11-29T12:21:17.371 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2019-11-29T12:21:17.372 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/ltp/testcases/bin", "secontext": "unconfined_u:object_r:lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2019-11-29T12:21:17.409 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:17 +0000 (0:00:00.344) 0:03:53.517 ******* 2019-11-29T12:21:17.436 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/ltp/testcases/bin", "secontext": "unconfined_u:object_r:lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2019-11-29T12:21:17.473 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:17 +0000 (0:00:00.064) 0:03:53.581 ******* 2019-11-29T12:21:17.731 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2019-11-29T12:21:17.733 INFO:teuthology.task.ansible.out: [WARNING]: Cannot set fs attributes on a non-existent symlink target. follow should be set to False to avoid this. ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/lib/ltp/testcases/bin/fsstress", "src": "/usr/bin/fsstress"} 2019-11-29T12:21:17.775 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:17 +0000 (0:00:00.301) 0:03:53.882 ******* 2019-11-29T12:21:17.802 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2019-11-29T12:21:17.804 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:17.841 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:17 +0000 (0:00:00.065) 0:03:53.948 ******* 2019-11-29T12:21:17.846 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2019-11-29T12:21:17.847 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/lib/ltp/testcases/bin/fsstress", "src": "/usr/bin/fsstress"} 2019-11-29T12:21:17.889 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:17 +0000 (0:00:00.044) 0:03:53.993 ******* 2019-11-29T12:21:17.890 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2019-11-29T12:21:17.892 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:17.929 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:17 +0000 (0:00:00.043) 0:03:54.036 ******* 2019-11-29T12:21:17.934 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2019-11-29T12:21:17.937 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:17.974 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:17 +0000 (0:00:00.045) 0:03:54.082 ******* 2019-11-29T12:21:17.980 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2019-11-29T12:21:17.981 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:18.020 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:18 +0000 (0:00:00.045) 0:03:54.127 ******* 2019-11-29T12:21:18.024 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2019-11-29T12:21:18.025 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:18.063 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:18 +0000 (0:00:00.043) 0:03:54.171 ******* 2019-11-29T12:21:18.069 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2019-11-29T12:21:18.071 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:18.107 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:18 +0000 (0:00:00.043) 0:03:54.215 ******* 2019-11-29T12:21:18.113 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:18.150 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:18 +0000 (0:00:00.043) 0:03:54.258 ******* 2019-11-29T12:21:18.158 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2019-11-29T12:21:18.159 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:18.194 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:18 +0000 (0:00:00.043) 0:03:54.302 ******* 2019-11-29T12:21:18.199 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2019-11-29T12:21:18.199 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:18.237 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:18 +0000 (0:00:00.042) 0:03:54.344 ******* 2019-11-29T12:21:18.242 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2019-11-29T12:21:18.244 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:18.285 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:18 +0000 (0:00:00.048) 0:03:54.393 ******* 2019-11-29T12:21:18.291 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2019-11-29T12:21:18.292 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:18.330 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:18 +0000 (0:00:00.044) 0:03:54.438 ******* 2019-11-29T12:21:18.341 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:18.377 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:18 +0000 (0:00:00.046) 0:03:54.484 ******* 2019-11-29T12:21:18.382 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2019-11-29T12:21:18.383 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:18.421 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:18 +0000 (0:00:00.043) 0:03:54.528 ******* 2019-11-29T12:21:18.427 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2019-11-29T12:21:18.428 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:18.466 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:18 +0000 (0:00:00.045) 0:03:54.574 ******* 2019-11-29T12:21:18.475 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2019-11-29T12:21:18.476 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:18.512 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:18 +0000 (0:00:00.045) 0:03:54.620 ******* 2019-11-29T12:21:18.518 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2019-11-29T12:21:18.519 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:18.557 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:18 +0000 (0:00:00.045) 0:03:54.665 ******* 2019-11-29T12:21:18.563 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2019-11-29T12:21:18.564 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:18.603 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:18 +0000 (0:00:00.045) 0:03:54.711 ******* 2019-11-29T12:21:18.610 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2019-11-29T12:21:18.611 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:18.649 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:18 +0000 (0:00:00.045) 0:03:54.757 ******* 2019-11-29T12:21:18.655 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2019-11-29T12:21:18.655 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:18.693 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:18 +0000 (0:00:00.043) 0:03:54.801 ******* 2019-11-29T12:21:18.701 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2019-11-29T12:21:18.703 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:18.737 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:18 +0000 (0:00:00.044) 0:03:54.845 ******* 2019-11-29T12:21:18.743 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2019-11-29T12:21:18.745 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:18.781 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:18 +0000 (0:00:00.043) 0:03:54.889 ******* 2019-11-29T12:21:18.787 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2019-11-29T12:21:18.789 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:18.826 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:18 +0000 (0:00:00.044) 0:03:54.933 ******* 2019-11-29T12:21:18.831 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2019-11-29T12:21:18.831 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:18.869 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:18 +0000 (0:00:00.043) 0:03:54.977 ******* 2019-11-29T12:21:18.875 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2019-11-29T12:21:18.877 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:18.913 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:18 +0000 (0:00:00.044) 0:03:55.021 ******* 2019-11-29T12:21:18.919 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2019-11-29T12:21:18.920 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:18.957 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:18 +0000 (0:00:00.043) 0:03:55.065 ******* 2019-11-29T12:21:18.963 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2019-11-29T12:21:18.965 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:19.002 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:18 +0000 (0:00:00.044) 0:03:55.109 ******* 2019-11-29T12:21:19.010 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2019-11-29T12:21:19.012 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:19.047 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:19 +0000 (0:00:00.045) 0:03:55.155 ******* 2019-11-29T12:21:19.054 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2019-11-29T12:21:19.056 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:19.092 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:19 +0000 (0:00:00.044) 0:03:55.199 ******* 2019-11-29T12:21:19.097 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2019-11-29T12:21:19.099 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:19.136 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:19 +0000 (0:00:00.044) 0:03:55.243 ******* 2019-11-29T12:21:19.142 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2019-11-29T12:21:19.144 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:19.179 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:19 +0000 (0:00:00.043) 0:03:55.287 ******* 2019-11-29T12:21:19.184 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2019-11-29T12:21:19.185 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:19.223 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:19 +0000 (0:00:00.043) 0:03:55.331 ******* 2019-11-29T12:21:19.229 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2019-11-29T12:21:19.231 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:19.268 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:19 +0000 (0:00:00.044) 0:03:55.375 ******* 2019-11-29T12:21:19.273 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2019-11-29T12:21:19.275 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:19.332 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:19 +0000 (0:00:00.063) 0:03:55.439 ******* 2019-11-29T12:21:19.341 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2019-11-29T12:21:19.343 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:19.380 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:19 +0000 (0:00:00.048) 0:03:55.488 ******* 2019-11-29T12:21:19.386 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2019-11-29T12:21:19.387 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:19.424 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:19 +0000 (0:00:00.044) 0:03:55.532 ******* 2019-11-29T12:21:19.430 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2019-11-29T12:21:19.431 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:19.468 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:19 +0000 (0:00:00.043) 0:03:55.575 ******* 2019-11-29T12:21:19.473 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2019-11-29T12:21:19.475 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:19.513 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:19 +0000 (0:00:00.044) 0:03:55.620 ******* 2019-11-29T12:21:19.518 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2019-11-29T12:21:19.520 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:19.556 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:19 +0000 (0:00:00.042) 0:03:55.663 ******* 2019-11-29T12:21:19.569 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2019-11-29T12:21:19.571 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:19.605 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:19 +0000 (0:00:00.049) 0:03:55.713 ******* 2019-11-29T12:21:19.611 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2019-11-29T12:21:19.613 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:19.649 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:19 +0000 (0:00:00.044) 0:03:55.757 ******* 2019-11-29T12:21:19.655 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2019-11-29T12:21:19.657 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:19.696 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:19 +0000 (0:00:00.046) 0:03:55.803 ******* 2019-11-29T12:21:19.702 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2019-11-29T12:21:19.704 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:19.742 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:19 +0000 (0:00:00.046) 0:03:55.850 ******* 2019-11-29T12:21:19.747 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2019-11-29T12:21:19.748 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:19.787 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:19 +0000 (0:00:00.045) 0:03:55.895 ******* 2019-11-29T12:21:19.798 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** ok: [smithi062.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2019-11-29T12:21:19.832 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:19 +0000 (0:00:00.044) 0:03:55.939 ******* 2019-11-29T12:21:19.837 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2019-11-29T12:21:19.838 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:19.880 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:19 +0000 (0:00:00.048) 0:03:55.988 ******* 2019-11-29T12:21:19.886 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2019-11-29T12:21:19.887 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2019-11-29T12:21:19.888 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2019-11-29T12:21:19.899 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2019-11-29T12:21:19.900 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2019-11-29T12:21:19.910 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2019-11-29T12:21:19.911 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** ok: [smithi022.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2019-11-29T12:21:19.962 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:19 +0000 (0:00:00.081) 0:03:56.070 ******* 2019-11-29T12:21:19.972 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi062.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2019-11-29T12:21:20.012 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:20 +0000 (0:00:00.050) 0:03:56.120 ******* 2019-11-29T12:21:20.019 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2019-11-29T12:21:20.020 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2019-11-29T12:21:20.021 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2019-11-29T12:21:20.032 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2019-11-29T12:21:20.032 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2019-11-29T12:21:20.043 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2019-11-29T12:21:20.054 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2019-11-29T12:21:20.096 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:20 +0000 (0:00:00.083) 0:03:56.203 ******* 2019-11-29T12:21:20.157 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2019-11-29T12:21:20.159 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.003477", "end": "2019-11-29 12:21:20.130467", "rc": 0, "start": "2019-11-29 12:21:20.126990", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} 2019-11-29T12:21:20.204 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:20 +0000 (0:00:00.108) 0:03:56.312 ******* 2019-11-29T12:21:20.242 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2019-11-29T12:21:20.243 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check for teuthology-lock command] **************************** changed: [smithi022.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.004362", "end": "2019-11-29 12:21:20.226230", "rc": 0, "start": "2019-11-29 12:21:20.221868", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} 2019-11-29T12:21:20.294 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:20 +0000 (0:00:00.089) 0:03:56.401 ******* 2019-11-29T12:21:20.333 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:20 +0000 (0:00:00.039) 0:03:56.441 ******* 2019-11-29T12:21:20.342 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:20.379 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:20 +0000 (0:00:00.046) 0:03:56.487 ******* 2019-11-29T12:21:20.385 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2019-11-29T12:21:20.387 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:20.424 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:20 +0000 (0:00:00.044) 0:03:56.532 ******* 2019-11-29T12:21:20.435 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:20.467 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:20 +0000 (0:00:00.043) 0:03:56.575 ******* 2019-11-29T12:21:20.472 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2019-11-29T12:21:20.473 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:20.510 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:20 +0000 (0:00:00.042) 0:03:56.618 ******* 2019-11-29T12:21:20.516 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:20.555 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:20 +0000 (0:00:00.044) 0:03:56.662 ******* 2019-11-29T12:21:20.561 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2019-11-29T12:21:20.562 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:20.599 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:20 +0000 (0:00:00.044) 0:03:56.707 ******* 2019-11-29T12:21:20.605 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:20.645 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:20 +0000 (0:00:00.045) 0:03:56.753 ******* 2019-11-29T12:21:21.108 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2019-11-29T12:21:21.109 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["gdisk-0.8.10-2.el7.x86_64 providing gdisk is already installed", "7:device-mapper-1.02.149-8.el7.x86_64 providing device-mapper is already installed"]} 2019-11-29T12:21:21.146 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:21 +0000 (0:00:00.501) 0:03:57.254 ******* 2019-11-29T12:21:21.153 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["gdisk-0.8.10-2.el7.x86_64 providing gdisk is already installed", "7:device-mapper-1.02.149-8.el7.x86_64 providing device-mapper is already installed"]} 2019-11-29T12:21:21.191 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:21 +0000 (0:00:00.044) 0:03:57.298 ******* 2019-11-29T12:21:21.196 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2019-11-29T12:21:21.197 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'block_used': 13034938, u'uuid': u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67', u'size_total': 984369086464, u'block_total': 240324484, u'mount': u'/', u'block_available': 227289546, u'size_available': 930977980416, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60966955, u'device': u'/dev/sda1', u'inode_used': 88021, u'block_size': 4096, u'options': u'rw,seclabel,relatime,data=ordered'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 227289546, "block_size": 4096, "block_total": 240324484, "block_used": 13034938, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60966955, "inode_total": 61054976, "inode_used": 88021, "mount": "/", "options": "rw,seclabel,relatime,data=ordered", "size_available": 930977980416, "size_total": 984369086464, "uuid": "60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"}} 2019-11-29T12:21:21.235 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:21 +0000 (0:00:00.044) 0:03:57.343 ******* 2019-11-29T12:21:21.241 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={u'block_used': 13034939, u'uuid': u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67', u'size_total': 984369086464, u'block_total': 240324484, u'mount': u'/', u'block_available': 227289545, u'size_available': 930977976320, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60966948, u'device': u'/dev/sda1', u'inode_used': 88028, u'block_size': 4096, u'options': u'rw,seclabel,relatime,data=ordered'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 227289545, "block_size": 4096, "block_total": 240324484, "block_used": 13034939, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60966948, "inode_total": 61054976, "inode_used": 88028, "mount": "/", "options": "rw,seclabel,relatime,data=ordered", "size_available": 930977976320, "size_total": 984369086464, "uuid": "60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"}} 2019-11-29T12:21:21.282 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:21 +0000 (0:00:00.046) 0:03:57.390 ******* 2019-11-29T12:21:21.548 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2019-11-29T12:21:21.550 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.013769", "end": "2019-11-29 12:21:21.528196", "rc": 0, "start": "2019-11-29 12:21:21.514427", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-29T12:21:21.585 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:21 +0000 (0:00:00.303) 0:03:57.693 ******* 2019-11-29T12:21:21.637 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2019-11-29T12:21:21.639 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'block_used': 13034938, u'uuid': u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67', u'size_total': 984369086464, u'block_total': 240324484, u'mount': u'/', u'block_available': 227289546, u'size_available': 930977980416, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60966955, u'device': u'/dev/sda1', u'inode_used': 88021, u'block_size': 4096, u'options': u'rw,seclabel,relatime,data=ordered'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227289546, "block_size": 4096, "block_total": 240324484, "block_used": 13034938, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60966955, "inode_total": 61054976, "inode_used": 88021, "mount": "/", "options": "rw,seclabel,relatime,data=ordered", "size_available": 930977980416, "size_total": 984369086464, "uuid": "60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:21.640 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** changed: [smithi022.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.013931", "end": "2019-11-29 12:21:21.614487", "rc": 0, "start": "2019-11-29 12:21:21.600556", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-29T12:21:21.676 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:21 +0000 (0:00:00.090) 0:03:57.783 ******* 2019-11-29T12:21:21.710 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:21 +0000 (0:00:00.034) 0:03:57.818 ******* 2019-11-29T12:21:21.728 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2019-11-29T12:21:21.730 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={u'block_used': 13034939, u'uuid': u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67', u'size_total': 984369086464, u'block_total': 240324484, u'mount': u'/', u'block_available': 227289545, u'size_available': 930977976320, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60966948, u'device': u'/dev/sda1', u'inode_used': 88028, u'block_size': 4096, u'options': u'rw,seclabel,relatime,data=ordered'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227289545, "block_size": 4096, "block_total": 240324484, "block_used": 13034939, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60966948, "inode_total": 61054976, "inode_used": 88028, "mount": "/", "options": "rw,seclabel,relatime,data=ordered", "size_available": 930977976320, "size_total": 984369086464, "uuid": "60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:21.772 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:21 +0000 (0:00:00.061) 0:03:57.880 ******* 2019-11-29T12:21:21.778 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2019-11-29T12:21:21.822 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:21 +0000 (0:00:00.049) 0:03:57.929 ******* 2019-11-29T12:21:21.868 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:21 +0000 (0:00:00.046) 0:03:57.976 ******* 2019-11-29T12:21:21.876 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2019-11-29T12:21:21.878 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W4W5SV', u'wwn-0x5000c50087b99812'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W4W5SV', u'wwn': u'0x5000c50087b99812', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'deadline', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W4W5SV-part1', u'wwn-0x5000c50087b99812-part1'], u'uuids': [u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4W5SV", "wwn-0x5000c50087b99812"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4W5SV-part1", "wwn-0x5000c50087b99812-part1"], "labels": [], "masters": [], "uuids": ["60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W4W5SV", "size": "931.51 GB", "support_discard": "0", "vendor": " 2019-11-29T12:21:21.880 INFO:teuthology.task.ansible.out:ATA", "virtual": 1, "wwn": "0x5000c50087b99812"}}, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:21.914 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W4HQJ7', u'wwn-0x5000c500871a6c97'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W4HQJ7', u'wwn': u'0x5000c500871a6c97', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'deadline', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W4HQJ7-part1', u'wwn-0x5000c500871a6c97-part1'], u'uuids': [u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4HQJ7", "wwn-0x5000c500871a6c97"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4HQJ7-part1", "wwn-0x5000c500871a6c97-part1"], "labels": [], "masters": [], "uuids": ["60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W4HQJ7", "size": "931.51 GB", "support_discard": "0", "vendor": " 2019-11-29T12:21:21.916 INFO:teuthology.task.ansible.out:ATA", "virtual": 1, "wwn": "0x5000c500871a6c97"}}, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:23.708 INFO:teuthology.task.ansible.out:changed: [smithi022.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-OuPYc3-q7MS-weJm-JuEy-MhiD-aPJV-mZeuN8', u'nvme-INTEL_SSDPEDMD400G4_CVFT53300063400BGN', u'nvme-nvme.8086-43564654353333303030363334303042474e-494e54454c205353445045444d443430304734-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', u'support_discard': u'512', u'model': u'INTEL SSDPEDMD400G4', u'size': u'372.61 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'781422768', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [u'vg_nvme-lv_5', u'vg_nvme-lv_4', u'vg_nvme-lv_3', u'vg_nvme-lv_2', u'vg_nvme-lv_1'], u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.474424", "end": "2019-11-29 12:21:23.678792", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_5", "vg_nvme-lv_4", "vg_nvme-lv_3", "vg_nvme-lv_2", "vg_nvme-lv_1"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-OuPYc3-q7MS-weJm-JuEy-MhiD-aPJV-mZeuN8", "nvme-INTEL_SSDPEDMD400G4_CVFT53300063400BGN", "nvme-nvme.8086-43564654353333303030363334303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-29 12:21:22.204368", "stderr": "", "stderr_lines": [], "stdout": "Creating new GP 2019-11-29T12:21:23.710 INFO:teuthology.task.ansible.out:T entries.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-11-29T12:21:23.825 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-uqPMR7-34GW-Jvc7-fTY3-lUip-zh35-ieb33C', u'nvme-INTEL_SSDPEDMD400G4_CVFT53440094400BGN', u'nvme-nvme.8086-43564654353334343030393434303042474e-494e54454c205353445045444d443430304734-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', u'support_discard': u'512', u'model': u'INTEL SSDPEDMD400G4', u'size': u'372.61 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'781422768', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [u'vg_nvme-lv_5', u'vg_nvme-lv_4', u'vg_nvme-lv_3', u'vg_nvme-lv_2', u'vg_nvme-lv_1'], u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.638339", "end": "2019-11-29 12:21:23.789175", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_5", "vg_nvme-lv_4", "vg_nvme-lv_3", "vg_nvme-lv_2", "vg_nvme-lv_1"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-uqPMR7-34GW-Jvc7-fTY3-lUip-zh35-ieb33C", "nvme-INTEL_SSDPEDMD400G4_CVFT53440094400BGN", "nvme-nvme.8086-43564654353334343030393434303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-29 12:21:22.150836", "stderr": "", "stderr_lines": [], "stdout": "Creating new GP 2019-11-29T12:21:23.826 INFO:teuthology.task.ansible.out:T entries.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-11-29T12:21:25.067 INFO:teuthology.task.ansible.out:changed: [smithi022.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-YKgmjzg3PhwGsk1HCXC8jLJzGYHPlpxpYd8R7BqCMjh54b6JvDdsDZbfqBx2IZML'], u'uuids': [u'4462c926-5eb6-401e-bbf3-a8c85bff2600']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.054631", "end": "2019-11-29 12:21:25.036707", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-YKgmjzg3PhwGsk1HCXC8jLJzGYHPlpxpYd8R7BqCMjh54b6JvDdsDZbfqBx2IZML"], "labels": [], "masters": [], "uuids": ["4462c926-5eb6-401e-bbf3-a8c85bff2600"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-29 12:21:23.982076", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-11-29T12:21:25.192 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-zDEnbek1Rnkuj1tRMlSlQU6Vo081BGSN1XuFyJ3AY1Jg0NjbSlJxbP2O41FM7PeH'], u'uuids': [u'b3458296-ca79-4f25-876b-7081aab68734']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.062544", "end": "2019-11-29 12:21:25.157498", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-zDEnbek1Rnkuj1tRMlSlQU6Vo081BGSN1XuFyJ3AY1Jg0NjbSlJxbP2O41FM7PeH"], "labels": [], "masters": [], "uuids": ["b3458296-ca79-4f25-876b-7081aab68734"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-29 12:21:24.094954", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-11-29T12:21:26.473 INFO:teuthology.task.ansible.out:changed: [smithi022.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-YKgmjzg3PhwGsk1HCXC8jLJzGYHPlpxpBPtim7bicPNyBp6sCDnUAZvEkbdcLSSh'], u'uuids': [u'7ef8f041-61ec-42e5-812f-7f46d35ba50f']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.086007", "end": "2019-11-29 12:21:26.437010", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-YKgmjzg3PhwGsk1HCXC8jLJzGYHPlpxpBPtim7bicPNyBp6sCDnUAZvEkbdcLSSh"], "labels": [], "masters": [], "uuids": ["7ef8f041-61ec-42e5-812f-7f46d35ba50f"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-29 12:21:25.351003", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-11-29T12:21:26.577 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-zDEnbek1Rnkuj1tRMlSlQU6Vo081BGSNugDoILp6y3rIZsM9I1igC4UtQSRUkm0q'], u'uuids': [u'95ed8730-7fb4-4b31-bf07-5ea3afc6b434']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.066261", "end": "2019-11-29 12:21:26.541421", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-zDEnbek1Rnkuj1tRMlSlQU6Vo081BGSNugDoILp6y3rIZsM9I1igC4UtQSRUkm0q"], "labels": [], "masters": [], "uuids": ["95ed8730-7fb4-4b31-bf07-5ea3afc6b434"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-29 12:21:25.475160", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-11-29T12:21:27.854 INFO:teuthology.task.ansible.out:changed: [smithi022.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-YKgmjzg3PhwGsk1HCXC8jLJzGYHPlpxpQwmjrXdAlEYpNwVk7rsXlzSv8NKBZxUY'], u'uuids': [u'e32ac76f-37b7-4883-9003-e85d693d13c0']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.051648", "end": "2019-11-29 12:21:27.820880", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-YKgmjzg3PhwGsk1HCXC8jLJzGYHPlpxpQwmjrXdAlEYpNwVk7rsXlzSv8NKBZxUY"], "labels": [], "masters": [], "uuids": ["e32ac76f-37b7-4883-9003-e85d693d13c0"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-29 12:21:26.769232", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-11-29T12:21:27.939 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-zDEnbek1Rnkuj1tRMlSlQU6Vo081BGSNu12vD8M2sxzMzm1IdZgtfO89dZVofZe1'], u'uuids': [u'04d28579-49c5-4f85-86fb-ec439c12feb9']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.051998", "end": "2019-11-29 12:21:27.908041", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-zDEnbek1Rnkuj1tRMlSlQU6Vo081BGSNu12vD8M2sxzMzm1IdZgtfO89dZVofZe1"], "labels": [], "masters": [], "uuids": ["04d28579-49c5-4f85-86fb-ec439c12feb9"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-29 12:21:26.856043", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-11-29T12:21:29.286 INFO:teuthology.task.ansible.out:changed: [smithi022.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-YKgmjzg3PhwGsk1HCXC8jLJzGYHPlpxp0TkDb0Krv032DGRyQq6d7fUDm68Nkkni'], u'uuids': [u'4262a488-9394-4ee0-951a-8a51ad17d605']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.108208", "end": "2019-11-29 12:21:29.251335", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-YKgmjzg3PhwGsk1HCXC8jLJzGYHPlpxp0TkDb0Krv032DGRyQq6d7fUDm68Nkkni"], "labels": [], "masters": [], "uuids": ["4262a488-9394-4ee0-951a-8a51ad17d605"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-29 12:21:28.143127", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-11-29T12:21:29.330 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-zDEnbek1Rnkuj1tRMlSlQU6Vo081BGSNiTUwQmkpYYxKpWROdC05nmSqkHonNsup'], u'uuids': [u'2b93c626-b796-479e-b539-c463d03195a8']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.063580", "end": "2019-11-29 12:21:29.291406", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-zDEnbek1Rnkuj1tRMlSlQU6Vo081BGSNiTUwQmkpYYxKpWROdC05nmSqkHonNsup"], "labels": [], "masters": [], "uuids": ["2b93c626-b796-479e-b539-c463d03195a8"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-29 12:21:28.227826", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-11-29T12:21:30.654 INFO:teuthology.task.ansible.out:changed: [smithi022.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-YKgmjzg3PhwGsk1HCXC8jLJzGYHPlpxpjrgSLaLImmnBrMkNjhAAfJVeVCQ1QiaM'], u'uuids': [u'e4e5b7b5-c28d-4d6f-8afa-c3fc44098323']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.053495", "end": "2019-11-29 12:21:30.622192", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-YKgmjzg3PhwGsk1HCXC8jLJzGYHPlpxpjrgSLaLImmnBrMkNjhAAfJVeVCQ1QiaM"], "labels": [], "masters": [], "uuids": ["e4e5b7b5-c28d-4d6f-8afa-c3fc44098323"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-29 12:21:29.568697", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-11-29T12:21:30.708 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:30 +0000 (0:00:08.839) 0:04:06.815 ******* 2019-11-29T12:21:30.738 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-zDEnbek1Rnkuj1tRMlSlQU6Vo081BGSNtyiTJKdLBstCV4fj4jtSpp8doaab8hgc'], u'uuids': [u'b99d539a-35c8-436e-8042-625f6b9e136f']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.084270", "end": "2019-11-29 12:21:30.706365", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-zDEnbek1Rnkuj1tRMlSlQU6Vo081BGSNtyiTJKdLBstCV4fj4jtSpp8doaab8hgc"], "labels": [], "masters": [], "uuids": ["b99d539a-35c8-436e-8042-625f6b9e136f"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-29 12:21:29.622095", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-11-29T12:21:30.760 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2019-11-29T12:21:30.761 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W4HQJ7', u'wwn-0x5000c500871a6c97'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W4HQJ7', u'wwn': u'0x5000c500871a6c97', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'deadline', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W4HQJ7-part1', u'wwn-0x5000c500871a6c97-part1'], u'uuids': [u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4HQJ7", "wwn-0x5000c500871a6c97"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4HQJ7-part1", "wwn-0x5000c500871a6c97-part1"], "labels": [], "masters": [], "uuids": ["60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W4HQJ7", "size": "931.51 GB", "support_discard": "0", "vendor": " 2019-11-29T12:21:30.763 INFO:teuthology.task.ansible.out:ATA", "virtual": 1, "wwn": "0x5000c500871a6c97"}}, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:30.804 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:30 +0000 (0:00:00.096) 0:04:06.911 ******* 2019-11-29T12:21:30.846 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W4W5SV', u'wwn-0x5000c50087b99812'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W4W5SV', u'wwn': u'0x5000c50087b99812', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'deadline', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W4W5SV-part1', u'wwn-0x5000c50087b99812-part1'], u'uuids': [u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4W5SV", "wwn-0x5000c50087b99812"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4W5SV-part1", "wwn-0x5000c50087b99812-part1"], "labels": [], "masters": [], "uuids": ["60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W4W5SV", "size": "931.51 GB", "support_discard": "0", "vendor": " 2019-11-29T12:21:30.848 INFO:teuthology.task.ansible.out:ATA", "virtual": 1, "wwn": "0x5000c50087b99812"}}, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:31.112 INFO:teuthology.task.ansible.out:changed: [smithi022.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-OuPYc3-q7MS-weJm-JuEy-MhiD-aPJV-mZeuN8', u'nvme-INTEL_SSDPEDMD400G4_CVFT53300063400BGN', u'nvme-nvme.8086-43564654353333303030363334303042474e-494e54454c205353445045444d443430304734-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', u'support_discard': u'512', u'model': u'INTEL SSDPEDMD400G4', u'size': u'372.61 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'781422768', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [u'vg_nvme-lv_5', u'vg_nvme-lv_4', u'vg_nvme-lv_3', u'vg_nvme-lv_2', u'vg_nvme-lv_1'], u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.063755", "end": "2019-11-29 12:21:31.087962", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_5", "vg_nvme-lv_4", "vg_nvme-lv_3", "vg_nvme-lv_2", "vg_nvme-lv_1"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-OuPYc3-q7MS-weJm-JuEy-MhiD-aPJV-mZeuN8", "nvme-INTEL_SSDPEDMD400G4_CVFT53300063400BGN", "nvme-nvme.8086-43564654353333303030363334303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-29 12:21:31.024207", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) co 2019-11-29T12:21:31.113 INFO:teuthology.task.ansible.out:pied, 0.0575382 s, 2.0 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.0575382 s, 2.0 GB/s"], "stdout": "", "stdout_lines": []} 2019-11-29T12:21:31.237 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-uqPMR7-34GW-Jvc7-fTY3-lUip-zh35-ieb33C', u'nvme-INTEL_SSDPEDMD400G4_CVFT53440094400BGN', u'nvme-nvme.8086-43564654353334343030393434303042474e-494e54454c205353445045444d443430304734-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', u'support_discard': u'512', u'model': u'INTEL SSDPEDMD400G4', u'size': u'372.61 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'781422768', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [u'vg_nvme-lv_5', u'vg_nvme-lv_4', u'vg_nvme-lv_3', u'vg_nvme-lv_2', u'vg_nvme-lv_1'], u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.070240", "end": "2019-11-29 12:21:31.204329", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_5", "vg_nvme-lv_4", "vg_nvme-lv_3", "vg_nvme-lv_2", "vg_nvme-lv_1"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-uqPMR7-34GW-Jvc7-fTY3-lUip-zh35-ieb33C", "nvme-INTEL_SSDPEDMD400G4_CVFT53440094400BGN", "nvme-nvme.8086-43564654353334343030393434303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-29 12:21:31.134089", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) co 2019-11-29T12:21:31.239 INFO:teuthology.task.ansible.out:pied, 0.0638437 s, 1.8 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.0638437 s, 1.8 GB/s"], "stdout": "", "stdout_lines": []} 2019-11-29T12:21:31.536 INFO:teuthology.task.ansible.out:changed: [smithi022.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-YKgmjzg3PhwGsk1HCXC8jLJzGYHPlpxpYd8R7BqCMjh54b6JvDdsDZbfqBx2IZML'], u'uuids': [u'4462c926-5eb6-401e-bbf3-a8c85bff2600']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.176397", "end": "2019-11-29 12:21:31.507509", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-YKgmjzg3PhwGsk1HCXC8jLJzGYHPlpxpYd8R7BqCMjh54b6JvDdsDZbfqBx2IZML"], "labels": [], "masters": [], "uuids": ["4462c926-5eb6-401e-bbf3-a8c85bff2600"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-29 12:21:31.331112", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.170014 s, 678 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.170014 s, 678 MB/s"], "stdout": "", "stdout_lines": []} 2019-11-29T12:21:31.697 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-zDEnbek1Rnkuj1tRMlSlQU6Vo081BGSN1XuFyJ3AY1Jg0NjbSlJxbP2O41FM7PeH'], u'uuids': [u'b3458296-ca79-4f25-876b-7081aab68734']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.191548", "end": "2019-11-29 12:21:31.664701", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-zDEnbek1Rnkuj1tRMlSlQU6Vo081BGSN1XuFyJ3AY1Jg0NjbSlJxbP2O41FM7PeH"], "labels": [], "masters": [], "uuids": ["b3458296-ca79-4f25-876b-7081aab68734"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-29 12:21:31.473153", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.186477 s, 619 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.186477 s, 619 MB/s"], "stdout": "", "stdout_lines": []} 2019-11-29T12:21:32.008 INFO:teuthology.task.ansible.out:changed: [smithi022.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-YKgmjzg3PhwGsk1HCXC8jLJzGYHPlpxpBPtim7bicPNyBp6sCDnUAZvEkbdcLSSh'], u'uuids': [u'7ef8f041-61ec-42e5-812f-7f46d35ba50f']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.167800", "end": "2019-11-29 12:21:31.975185", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-YKgmjzg3PhwGsk1HCXC8jLJzGYHPlpxpBPtim7bicPNyBp6sCDnUAZvEkbdcLSSh"], "labels": [], "masters": [], "uuids": ["7ef8f041-61ec-42e5-812f-7f46d35ba50f"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-29 12:21:31.807385", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.16163 s, 714 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.16163 s, 714 MB/s"], "stdout": "", "stdout_lines": []} 2019-11-29T12:21:32.219 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-zDEnbek1Rnkuj1tRMlSlQU6Vo081BGSNugDoILp6y3rIZsM9I1igC4UtQSRUkm0q'], u'uuids': [u'95ed8730-7fb4-4b31-bf07-5ea3afc6b434']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.205692", "end": "2019-11-29 12:21:32.186106", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-zDEnbek1Rnkuj1tRMlSlQU6Vo081BGSNugDoILp6y3rIZsM9I1igC4UtQSRUkm0q"], "labels": [], "masters": [], "uuids": ["95ed8730-7fb4-4b31-bf07-5ea3afc6b434"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-29 12:21:31.980414", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.198999 s, 580 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.198999 s, 580 MB/s"], "stdout": "", "stdout_lines": []} 2019-11-29T12:21:32.478 INFO:teuthology.task.ansible.out:changed: [smithi022.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-YKgmjzg3PhwGsk1HCXC8jLJzGYHPlpxpQwmjrXdAlEYpNwVk7rsXlzSv8NKBZxUY'], u'uuids': [u'e32ac76f-37b7-4883-9003-e85d693d13c0']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.165714", "end": "2019-11-29 12:21:32.445867", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-YKgmjzg3PhwGsk1HCXC8jLJzGYHPlpxpQwmjrXdAlEYpNwVk7rsXlzSv8NKBZxUY"], "labels": [], "masters": [], "uuids": ["e32ac76f-37b7-4883-9003-e85d693d13c0"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-29 12:21:32.280153", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.159304 s, 724 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.159304 s, 724 MB/s"], "stdout": "", "stdout_lines": []} 2019-11-29T12:21:32.739 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-zDEnbek1Rnkuj1tRMlSlQU6Vo081BGSNu12vD8M2sxzMzm1IdZgtfO89dZVofZe1'], u'uuids': [u'04d28579-49c5-4f85-86fb-ec439c12feb9']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.199846", "end": "2019-11-29 12:21:32.707740", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-zDEnbek1Rnkuj1tRMlSlQU6Vo081BGSNu12vD8M2sxzMzm1IdZgtfO89dZVofZe1"], "labels": [], "masters": [], "uuids": ["04d28579-49c5-4f85-86fb-ec439c12feb9"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-29 12:21:32.507894", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.193219 s, 597 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.193219 s, 597 MB/s"], "stdout": "", "stdout_lines": []} 2019-11-29T12:21:32.968 INFO:teuthology.task.ansible.out:changed: [smithi022.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-YKgmjzg3PhwGsk1HCXC8jLJzGYHPlpxp0TkDb0Krv032DGRyQq6d7fUDm68Nkkni'], u'uuids': [u'4262a488-9394-4ee0-951a-8a51ad17d605']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.181388", "end": "2019-11-29 12:21:32.937245", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-YKgmjzg3PhwGsk1HCXC8jLJzGYHPlpxp0TkDb0Krv032DGRyQq6d7fUDm68Nkkni"], "labels": [], "masters": [], "uuids": ["4262a488-9394-4ee0-951a-8a51ad17d605"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-29 12:21:32.755857", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.17459 s, 661 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.17459 s, 661 MB/s"], "stdout": "", "stdout_lines": []} 2019-11-29T12:21:33.197 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-zDEnbek1Rnkuj1tRMlSlQU6Vo081BGSNiTUwQmkpYYxKpWROdC05nmSqkHonNsup'], u'uuids': [u'2b93c626-b796-479e-b539-c463d03195a8']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.192653", "end": "2019-11-29 12:21:33.162061", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-zDEnbek1Rnkuj1tRMlSlQU6Vo081BGSNiTUwQmkpYYxKpWROdC05nmSqkHonNsup"], "labels": [], "masters": [], "uuids": ["2b93c626-b796-479e-b539-c463d03195a8"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-29 12:21:32.969408", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.18642 s, 619 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.18642 s, 619 MB/s"], "stdout": "", "stdout_lines": []} 2019-11-29T12:21:33.487 INFO:teuthology.task.ansible.out:changed: [smithi022.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-YKgmjzg3PhwGsk1HCXC8jLJzGYHPlpxpjrgSLaLImmnBrMkNjhAAfJVeVCQ1QiaM'], u'uuids': [u'e4e5b7b5-c28d-4d6f-8afa-c3fc44098323']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.196623", "end": "2019-11-29 12:21:33.450917", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-YKgmjzg3PhwGsk1HCXC8jLJzGYHPlpxpjrgSLaLImmnBrMkNjhAAfJVeVCQ1QiaM"], "labels": [], "masters": [], "uuids": ["e4e5b7b5-c28d-4d6f-8afa-c3fc44098323"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-29 12:21:33.254294", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.190291 s, 606 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.190291 s, 606 MB/s"], "stdout": "", "stdout_lines": []} 2019-11-29T12:21:33.532 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:33 +0000 (0:00:02.728) 0:04:09.640 ******* 2019-11-29T12:21:33.731 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-zDEnbek1Rnkuj1tRMlSlQU6Vo081BGSNtyiTJKdLBstCV4fj4jtSpp8doaab8hgc'], u'uuids': [u'b99d539a-35c8-436e-8042-625f6b9e136f']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.219244", "end": "2019-11-29 12:21:33.690934", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-zDEnbek1Rnkuj1tRMlSlQU6Vo081BGSNtyiTJKdLBstCV4fj4jtSpp8doaab8hgc"], "labels": [], "masters": [], "uuids": ["b99d539a-35c8-436e-8042-625f6b9e136f"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-29 12:21:33.471690", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.21268 s, 542 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.21268 s, 542 MB/s"], "stdout": "", "stdout_lines": []} 2019-11-29T12:21:33.776 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:33 +0000 (0:00:00.243) 0:04:09.884 ******* 2019-11-29T12:21:33.937 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2019-11-29T12:21:33.938 INFO:teuthology.task.ansible.out:changed: [smithi022.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.098667", "end": "2019-11-29 12:21:33.905363", "rc": 0, "start": "2019-11-29 12:21:33.806696", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-29T12:21:33.974 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:33 +0000 (0:00:00.198) 0:04:10.082 ******* 2019-11-29T12:21:34.188 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.081762", "end": "2019-11-29 12:21:34.150707", "rc": 0, "start": "2019-11-29 12:21:34.068945", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-29T12:21:34.225 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:34 +0000 (0:00:00.250) 0:04:10.333 ******* 2019-11-29T12:21:34.357 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** changed: [smithi022.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.054145", "end": "2019-11-29 12:21:34.329610", "rc": 0, "start": "2019-11-29 12:21:34.275465", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-29T12:21:34.394 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:34 +0000 (0:00:00.168) 0:04:10.502 ******* 2019-11-29T12:21:34.424 INFO:teuthology.task.ansible.out: 2019-11-29T12:21:34.425 INFO:teuthology.task.ansible.out:TASK [testnode : Remove physical volumes] ************************************** 2019-11-29T12:21:34.463 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:34 +0000 (0:00:00.069) 0:04:10.571 ******* 2019-11-29T12:21:34.490 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2019-11-29T12:21:34.491 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:34.530 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:34 +0000 (0:00:00.067) 0:04:10.638 ******* 2019-11-29T12:21:34.557 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2019-11-29T12:21:34.558 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:34.595 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:34 +0000 (0:00:00.064) 0:04:10.702 ******* 2019-11-29T12:21:34.600 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2019-11-29T12:21:34.601 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.055359", "end": "2019-11-29 12:21:34.562636", "rc": 0, "start": "2019-11-29 12:21:34.507277", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-29T12:21:34.638 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:34 +0000 (0:00:00.043) 0:04:10.746 ******* 2019-11-29T12:21:34.642 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2019-11-29T12:21:34.644 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:34.682 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:34 +0000 (0:00:00.044) 0:04:10.790 ******* 2019-11-29T12:21:34.689 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2019-11-29T12:21:34.727 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:34 +0000 (0:00:00.044) 0:04:10.835 ******* 2019-11-29T12:21:34.733 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2019-11-29T12:21:34.734 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:34.770 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:34 +0000 (0:00:00.042) 0:04:10.878 ******* 2019-11-29T12:21:34.775 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2019-11-29T12:21:34.776 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:34.816 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:34 +0000 (0:00:00.045) 0:04:10.923 ******* 2019-11-29T12:21:34.841 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2019-11-29T12:21:34.842 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:34.877 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:34 +0000 (0:00:00.061) 0:04:10.985 ******* 2019-11-29T12:21:34.913 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2019-11-29T12:21:34.915 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:34.959 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:34 +0000 (0:00:00.081) 0:04:11.067 ******* 2019-11-29T12:21:34.985 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2019-11-29T12:21:34.987 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:35.024 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:35 +0000 (0:00:00.064) 0:04:11.131 ******* 2019-11-29T12:21:35.092 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2019-11-29T12:21:35.092 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-11-29T12:21:35.133 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:35 +0000 (0:00:00.109) 0:04:11.240 ******* 2019-11-29T12:21:35.170 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2019-11-29T12:21:35.171 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={u'block_used': 13034939, u'uuid': u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67', u'size_total': 984369086464, u'block_total': 240324484, u'mount': u'/', u'block_available': 227289545, u'size_available': 930977976320, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60966948, u'device': u'/dev/sda1', u'inode_used': 88028, u'block_size': 4096, u'options': u'rw,seclabel,relatime,data=ordered'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227289545, "block_size": 4096, "block_total": 240324484, "block_used": 13034939, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60966948, "inode_total": 61054976, "inode_used": 88028, "mount": "/", "options": "rw,seclabel,relatime,data=ordered", "size_available": 930977976320, "size_total": 984369086464, "uuid": "60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:35.209 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:35 +0000 (0:00:00.076) 0:04:11.317 ******* 2019-11-29T12:21:35.236 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2019-11-29T12:21:35.237 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:35.272 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:35 +0000 (0:00:00.063) 0:04:11.380 ******* 2019-11-29T12:21:35.309 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-11-29T12:21:35.312 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:35.347 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:35 +0000 (0:00:00.075) 0:04:11.455 ******* 2019-11-29T12:21:35.353 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2019-11-29T12:21:35.354 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-11-29T12:21:35.394 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:35 +0000 (0:00:00.046) 0:04:11.501 ******* 2019-11-29T12:21:35.399 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-11-29T12:21:35.400 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:35.438 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:35 +0000 (0:00:00.044) 0:04:11.546 ******* 2019-11-29T12:21:35.443 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2019-11-29T12:21:35.444 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'block_used': 13034938, u'uuid': u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67', u'size_total': 984369086464, u'block_total': 240324484, u'mount': u'/', u'block_available': 227289546, u'size_available': 930977980416, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60966955, u'device': u'/dev/sda1', u'inode_used': 88021, u'block_size': 4096, u'options': u'rw,seclabel,relatime,data=ordered'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227289546, "block_size": 4096, "block_total": 240324484, "block_used": 13034938, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60966955, "inode_total": 61054976, "inode_used": 88021, "mount": "/", "options": "rw,seclabel,relatime,data=ordered", "size_available": 930977980416, "size_total": 984369086464, "uuid": "60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"}, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:35.482 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:35 +0000 (0:00:00.043) 0:04:11.590 ******* 2019-11-29T12:21:35.487 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2019-11-29T12:21:35.488 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:35.528 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:35 +0000 (0:00:00.045) 0:04:11.636 ******* 2019-11-29T12:21:35.534 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2019-11-29T12:21:35.535 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:35.574 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:35 +0000 (0:00:00.045) 0:04:11.681 ******* 2019-11-29T12:21:35.582 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2019-11-29T12:21:35.584 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:35.624 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:35 +0000 (0:00:00.050) 0:04:11.732 ******* 2019-11-29T12:21:35.630 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-11-29T12:21:35.632 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:35.668 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:35 +0000 (0:00:00.044) 0:04:11.776 ******* 2019-11-29T12:21:35.674 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2019-11-29T12:21:35.675 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:35.723 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:35 +0000 (0:00:00.055) 0:04:11.831 ******* 2019-11-29T12:21:35.730 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-11-29T12:21:35.732 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:35.768 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:35 +0000 (0:00:00.044) 0:04:11.876 ******* 2019-11-29T12:21:35.795 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2019-11-29T12:21:35.796 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:35.832 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:35 +0000 (0:00:00.063) 0:04:11.939 ******* 2019-11-29T12:21:35.859 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2019-11-29T12:21:35.861 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:35.897 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:35 +0000 (0:00:00.065) 0:04:12.005 ******* 2019-11-29T12:21:35.923 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2019-11-29T12:21:35.925 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:35.960 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:35 +0000 (0:00:00.062) 0:04:12.067 ******* 2019-11-29T12:21:36.517 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2019-11-29T12:21:36.519 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => (item={'value': {u'pvs': u'/dev/nvme0n1'}, 'key': u'vg_nvme'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2019-11-29T12:21:36.556 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:36 +0000 (0:00:00.596) 0:04:12.663 ******* 2019-11-29T12:21:36.562 INFO:teuthology.task.ansible.out:changed: [smithi022.front.sepia.ceph.com] => (item={'value': {u'pvs': u'/dev/nvme0n1'}, 'key': u'vg_nvme'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2019-11-29T12:21:36.601 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:36 +0000 (0:00:00.044) 0:04:12.708 ******* 2019-11-29T12:21:37.335 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2019-11-29T12:21:37.336 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2019-11-29T12:21:37.338 INFO:teuthology.task.ansible.out:changed: [smithi022.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2019-11-29T12:21:37.814 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-11-29T12:21:37.836 INFO:teuthology.task.ansible.out:changed: [smithi022.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-11-29T12:21:38.293 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-11-29T12:21:38.325 INFO:teuthology.task.ansible.out:changed: [smithi022.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-11-29T12:21:38.788 INFO:teuthology.task.ansible.out:changed: [smithi022.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-11-29T12:21:38.824 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-11-29T12:21:39.283 INFO:teuthology.task.ansible.out:changed: [smithi022.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-11-29T12:21:39.334 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:39 +0000 (0:00:02.733) 0:04:15.441 ******* 2019-11-29T12:21:39.355 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-11-29T12:21:39.401 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:39 +0000 (0:00:00.067) 0:04:15.509 ******* 2019-11-29T12:21:39.649 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2019-11-29T12:21:39.650 INFO:teuthology.task.ansible.out:changed: [smithi022.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2019-11-29T12:21:39.691 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:39 +0000 (0:00:00.290) 0:04:15.799 ******* 2019-11-29T12:21:39.729 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2019-11-29T12:21:39.770 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:39 +0000 (0:00:00.078) 0:04:15.878 ******* 2019-11-29T12:21:39.775 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2019-11-29T12:21:39.776 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:39.819 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:40.070 INFO:teuthology.task.ansible.out:changed: [smithi022.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-11-29T12:21:40.145 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-11-29T12:21:40.376 INFO:teuthology.task.ansible.out:changed: [smithi022.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-11-29T12:21:40.471 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-11-29T12:21:40.681 INFO:teuthology.task.ansible.out:changed: [smithi022.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-11-29T12:21:40.787 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-11-29T12:21:40.976 INFO:teuthology.task.ansible.out:changed: [smithi022.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-11-29T12:21:41.027 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:41 +0000 (0:00:01.257) 0:04:17.135 ******* 2019-11-29T12:21:41.113 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-11-29T12:21:41.153 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:41 +0000 (0:00:00.125) 0:04:17.261 ******* 2019-11-29T12:21:41.346 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2019-11-29T12:21:41.347 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "secontext": "unconfined_u:object_r:var_lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2019-11-29T12:21:41.386 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:41 +0000 (0:00:00.232) 0:04:17.493 ******* 2019-11-29T12:21:41.424 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2019-11-29T12:21:41.425 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2019-11-29T12:21:41.467 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:41 +0000 (0:00:00.081) 0:04:17.575 ******* 2019-11-29T12:21:41.475 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2019-11-29T12:21:41.476 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "secontext": "unconfined_u:object_r:var_lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2019-11-29T12:21:41.537 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:41 +0000 (0:00:00.069) 0:04:17.644 ******* 2019-11-29T12:21:41.575 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2019-11-29T12:21:41.576 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2019-11-29T12:21:41.612 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:41 +0000 (0:00:00.075) 0:04:17.720 ******* 2019-11-29T12:21:42.200 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2019-11-29T12:21:42.202 INFO:teuthology.task.ansible.out:changed: [smithi022.front.sepia.ceph.com] => {"changed": true} changed: [smithi062.front.sepia.ceph.com] => {"changed": true} 2019-11-29T12:21:42.240 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:42 +0000 (0:00:00.628) 0:04:18.348 ******* 2019-11-29T12:21:42.273 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:42 +0000 (0:00:00.032) 0:04:18.380 ******* 2019-11-29T12:21:42.977 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2019-11-29T12:21:42.978 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2019-11-29T12:21:43.016 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:43 +0000 (0:00:00.743) 0:04:19.124 ******* 2019-11-29T12:21:43.041 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2019-11-29T12:21:43.043 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:43.079 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:43 +0000 (0:00:00.063) 0:04:19.187 ******* 2019-11-29T12:21:43.105 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2019-11-29T12:21:43.107 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:43.142 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:43 +0000 (0:00:00.062) 0:04:19.250 ******* 2019-11-29T12:21:43.168 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2019-11-29T12:21:43.170 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:43.212 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:43 +0000 (0:00:00.062) 0:04:19.313 ******* 2019-11-29T12:21:43.231 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2019-11-29T12:21:43.232 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:43.269 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:43 +0000 (0:00:00.063) 0:04:19.377 ******* 2019-11-29T12:21:43.294 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2019-11-29T12:21:43.296 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:43.332 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:43 +0000 (0:00:00.062) 0:04:19.439 ******* 2019-11-29T12:21:43.358 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2019-11-29T12:21:43.359 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:43.396 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:43 +0000 (0:00:00.064) 0:04:19.503 ******* 2019-11-29T12:21:43.422 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2019-11-29T12:21:43.423 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:43.459 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:43 +0000 (0:00:00.063) 0:04:19.567 ******* 2019-11-29T12:21:43.939 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2019-11-29T12:21:43.940 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["ntp-4.2.6p5-28.el7.centos.x86_64 providing ntp is already installed"]} 2019-11-29T12:21:43.977 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:43 +0000 (0:00:00.517) 0:04:20.084 ******* 2019-11-29T12:21:43.982 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2019-11-29T12:21:43.983 INFO:teuthology.task.ansible.out:changed: [smithi022.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2019-11-29T12:21:44.020 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:44 +0000 (0:00:00.043) 0:04:20.128 ******* 2019-11-29T12:21:44.026 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2019-11-29T12:21:44.026 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:44.064 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:44 +0000 (0:00:00.043) 0:04:20.171 ******* 2019-11-29T12:21:44.068 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2019-11-29T12:21:44.071 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:44.106 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:44 +0000 (0:00:00.042) 0:04:20.214 ******* 2019-11-29T12:21:44.112 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2019-11-29T12:21:44.113 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:44.151 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:44 +0000 (0:00:00.044) 0:04:20.259 ******* 2019-11-29T12:21:44.156 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2019-11-29T12:21:44.157 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:44.194 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:44 +0000 (0:00:00.043) 0:04:20.302 ******* 2019-11-29T12:21:44.220 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2019-11-29T12:21:44.221 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:44.274 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:44 +0000 (0:00:00.079) 0:04:20.382 ******* 2019-11-29T12:21:44.300 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2019-11-29T12:21:44.301 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:44.336 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:44 +0000 (0:00:00.061) 0:04:20.444 ******* 2019-11-29T12:21:44.361 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2019-11-29T12:21:44.363 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:44.396 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:44 +0000 (0:00:00.060) 0:04:20.504 ******* 2019-11-29T12:21:44.421 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2019-11-29T12:21:44.423 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:44.457 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:44 +0000 (0:00:00.060) 0:04:20.565 ******* 2019-11-29T12:21:44.484 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:44.520 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:44 +0000 (0:00:00.061) 0:04:20.626 ******* 2019-11-29T12:21:45.020 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** ok: [smithi022.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["ntp-4.2.6p5-28.el7.centos.x86_64 providing ntp is already installed"]} 2019-11-29T12:21:45.063 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:45 +0000 (0:00:00.544) 0:04:21.170 ******* 2019-11-29T12:21:45.090 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2019-11-29T12:21:45.091 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "secontext": "system_u:object_r:net_conf_t:s0", "size": 2767, "state": "file", "uid": 0} 2019-11-29T12:21:45.093 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2019-11-29T12:21:45.093 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:45.131 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:45 +0000 (0:00:00.068) 0:04:21.239 ******* 2019-11-29T12:21:45.168 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:45 +0000 (0:00:00.036) 0:04:21.276 ******* 2019-11-29T12:21:45.174 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2019-11-29T12:21:45.175 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:45.217 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:45 +0000 (0:00:00.049) 0:04:21.325 ******* 2019-11-29T12:21:45.224 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2019-11-29T12:21:45.225 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:45.265 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:45 +0000 (0:00:00.047) 0:04:21.372 ******* 2019-11-29T12:21:45.800 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2019-11-29T12:21:45.802 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => {"changed": true, "enabled": true, "name": "ntpd", "state": "started", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "systemd-journald.socket tmp.mount ntpdate.service syslog.target basic.target system.slice -.mount sntp.service", "AllowIsolate": "no", "AmbientCapabilities": "0", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "shutdown.target multi-user.target chronyd.service", "BlockIOAccounting": "no", "BlockIOWeight": "18446744073709551615", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "18446744073709551615", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "18446744073709551615", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConflictedBy": "chronyd.service", "Conflicts": "shutdown.target", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "EnvironmentFile": "/etc/sysconfig/ntpd (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/sbin/ntpd ; argv[]=/usr/sbin/ntpd -u ntp:ntp $OPTIONS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/ntpd.service", "GuessMainPID": "yes", "IOScheduling": "0", "Id": "ntpd.service", "IgnoreOnIsolate": "no", "IgnoreOnSnapshot": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobTimeoutAction": "none", "JobTimeoutUSec": "0", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "1844674407370955161 2019-11-29T12:21:45.803 INFO:teuthology.task.ansible.out:5", "LimitCORE": "18446744073709551615", "LimitCPU": "18446744073709551615", "LimitDATA": "18446744073709551615", "LimitFSIZE": "18446744073709551615", "LimitLOCKS": "18446744073709551615", "LimitMEMLOCK": "65536", "LimitMSGQUEUE": "819200", "LimitNICE": "0", "LimitNOFILE": "4096", "LimitNPROC": "127511", "LimitRSS": "18446744073709551615", "LimitRTPRIO": "0", "LimitRTTIME": "18446744073709551615", "LimitSIGPENDING": "127511", "LimitSTACK": "18446744073709551615", "LoadState": "loaded", "MainPID": "0", "MemoryAccounting": "no", "MemoryCurrent": "18446744073709551615", "MemoryLimit": "18446744073709551615", "MountFlags": "0", "Names": "ntpd.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "ProtectHome": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "Requires": "basic.target -.mount", "RequiresMountsFor": "/var/tmp", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitInterval": "10000000", "StartupBlockIOWeight": "18446744073709551615", "StartupCPUShares": "18446744073709551615", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "no", "TasksCurrent": "18446744073709551615", "TasksMax": "18446744073709551615", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec 2019-11-29T12:21:45.805 INFO:teuthology.task.ansible.out:": "50000", "Transient": "no", "Type": "forking", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "WantedBy": "multi-user.target", "Wants": "system.slice", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2019-11-29T12:21:45.848 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:45 +0000 (0:00:00.583) 0:04:21.956 ******* 2019-11-29T12:21:46.107 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2019-11-29T12:21:46.108 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "secontext": "system_u:object_r:net_conf_t:s0", "size": 2767, "state": "file", "uid": 0} 2019-11-29T12:21:46.167 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:46 +0000 (0:00:00.318) 0:04:22.274 ******* 2019-11-29T12:21:46.193 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2019-11-29T12:21:46.195 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:46.233 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:46 +0000 (0:00:00.065) 0:04:22.340 ******* 2019-11-29T12:21:46.733 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2019-11-29T12:21:46.735 INFO:teuthology.task.ansible.out:changed: [smithi022.front.sepia.ceph.com] => {"changed": true, "enabled": true, "name": "ntpd", "state": "started", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "systemd-journald.socket system.slice sntp.service basic.target tmp.mount syslog.target ntpdate.service -.mount", "AllowIsolate": "no", "AmbientCapabilities": "0", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "multi-user.target chronyd.service shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "18446744073709551615", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "18446744073709551615", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "18446744073709551615", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConflictedBy": "chronyd.service", "Conflicts": "shutdown.target", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "EnvironmentFile": "/etc/sysconfig/ntpd (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/sbin/ntpd ; argv[]=/usr/sbin/ntpd -u ntp:ntp $OPTIONS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/ntpd.service", "GuessMainPID": "yes", "IOScheduling": "0", "Id": "ntpd.service", "IgnoreOnIsolate": "no", "IgnoreOnSnapshot": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobTimeoutAction": "none", "JobTimeoutUSec": "0", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "1844674407370955161 2019-11-29T12:21:46.736 INFO:teuthology.task.ansible.out:5", "LimitCORE": "18446744073709551615", "LimitCPU": "18446744073709551615", "LimitDATA": "18446744073709551615", "LimitFSIZE": "18446744073709551615", "LimitLOCKS": "18446744073709551615", "LimitMEMLOCK": "65536", "LimitMSGQUEUE": "819200", "LimitNICE": "0", "LimitNOFILE": "4096", "LimitNPROC": "127535", "LimitRSS": "18446744073709551615", "LimitRTPRIO": "0", "LimitRTTIME": "18446744073709551615", "LimitSIGPENDING": "127535", "LimitSTACK": "18446744073709551615", "LoadState": "loaded", "MainPID": "0", "MemoryAccounting": "no", "MemoryCurrent": "18446744073709551615", "MemoryLimit": "18446744073709551615", "MountFlags": "0", "Names": "ntpd.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "ProtectHome": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "Requires": "-.mount basic.target", "RequiresMountsFor": "/var/tmp", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitInterval": "10000000", "StartupBlockIOWeight": "18446744073709551615", "StartupCPUShares": "18446744073709551615", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "no", "TasksCurrent": "18446744073709551615", "TasksMax": "18446744073709551615", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec 2019-11-29T12:21:46.738 INFO:teuthology.task.ansible.out:": "50000", "Transient": "no", "Type": "forking", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "WantedBy": "multi-user.target", "Wants": "system.slice", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2019-11-29T12:21:46.771 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:46 +0000 (0:00:00.538) 0:04:22.879 ******* 2019-11-29T12:21:46.787 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2019-11-29T12:21:46.788 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["python2-pip-8.1.2-10.el7.noarch providing python-pip is already installed"]} 2019-11-29T12:21:46.824 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:46 +0000 (0:00:00.052) 0:04:22.932 ******* 2019-11-29T12:21:46.850 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2019-11-29T12:21:46.852 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:46.887 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:46 +0000 (0:00:00.062) 0:04:22.994 ******* 2019-11-29T12:21:47.170 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2019-11-29T12:21:47.171 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "gid": 1215, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 4096, "state": "directory", "uid": 1000} 2019-11-29T12:21:47.208 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:47 +0000 (0:00:00.321) 0:04:23.315 ******* 2019-11-29T12:21:47.693 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2019-11-29T12:21:47.693 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["python2-pip-8.1.2-10.el7.noarch providing python-pip is already installed"]} 2019-11-29T12:21:47.730 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:47 +0000 (0:00:00.522) 0:04:23.838 ******* 2019-11-29T12:21:47.757 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2019-11-29T12:21:47.764 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:47.794 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:47 +0000 (0:00:00.064) 0:04:23.902 ******* 2019-11-29T12:21:48.111 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2019-11-29T12:21:48.112 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => {"changed": false, "gid": 1215, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 4096, "state": "directory", "uid": 1000} 2019-11-29T12:21:48.150 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:48 +0000 (0:00:00.356) 0:04:24.258 ******* 2019-11-29T12:21:48.157 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2019-11-29T12:21:48.157 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1215, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 73, "state": "file", "uid": 1000} 2019-11-29T12:21:48.197 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:48 +0000 (0:00:00.046) 0:04:24.305 ******* 2019-11-29T12:21:49.052 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1215, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 73, "state": "file", "uid": 1000} 2019-11-29T12:21:49.089 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:49 +0000 (0:00:00.892) 0:04:25.197 ******* 2019-11-29T12:21:50.041 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2019-11-29T12:21:50.041 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip2", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "You are using pip version 8.1.2, however version 19.3.1 is available.\nYou should consider upgrading via the 'pip install --upgrade pip' command.\n", "stderr_lines": ["You are using pip version 8.1.2, however version 19.3.1 is available.", "You should consider upgrading via the 'pip install --upgrade pip' command."], "stdout": "Requirement already satisfied (use --upgrade to upgrade): remoto>=0.0.35 in /usr/lib/python2.7/site-packages\nRequirement already satisfied (use --upgrade to upgrade): execnet in /usr/lib/python2.7/site-packages (from remoto>=0.0.35)\nRequirement already satisfied (use --upgrade to upgrade): apipkg>=1.4 in /usr/lib/python2.7/site-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied (use --upgrade to upgrade): remoto>=0.0.35 in /usr/lib/python2.7/site-packages", "Requirement already satisfied (use --upgrade to upgrade): execnet in /usr/lib/python2.7/site-packages (from remoto>=0.0.35)", "Requirement already satisfied (use --upgrade to upgrade): apipkg>=1.4 in /usr/lib/python2.7/site-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2019-11-29T12:21:50.078 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:50 +0000 (0:00:00.988) 0:04:26.185 ******* 2019-11-29T12:21:50.107 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2019-11-29T12:21:50.109 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:50.143 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:50 +0000 (0:00:00.064) 0:04:26.250 ******* 2019-11-29T12:21:50.169 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2019-11-29T12:21:50.170 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2019-11-29T12:21:50.209 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:50 +0000 (0:00:00.066) 0:04:26.317 ******* 2019-11-29T12:21:50.540 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2019-11-29T12:21:50.542 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2019-11-29T12:21:50.576 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:50 +0000 (0:00:00.366) 0:04:26.683 ******* 2019-11-29T12:21:50.602 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2019-11-29T12:21:50.604 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install packages via pip] ************************************* ok: [smithi022.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip2", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "You are using pip version 8.1.2, however version 19.3.1 is available.\nYou should consider upgrading via the 'pip install --upgrade pip' command.\n", "stderr_lines": ["You are using pip version 8.1.2, however version 19.3.1 is available.", "You should consider upgrading via the 'pip install --upgrade pip' command."], "stdout": "Requirement already satisfied (use --upgrade to upgrade): remoto>=0.0.35 in /usr/lib/python2.7/site-packages\nRequirement already satisfied (use --upgrade to upgrade): execnet in /usr/lib/python2.7/site-packages (from remoto>=0.0.35)\nRequirement already satisfied (use --upgrade to upgrade): apipkg>=1.4 in /usr/lib/python2.7/site-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied (use --upgrade to upgrade): remoto>=0.0.35 in /usr/lib/python2.7/site-packages", "Requirement already satisfied (use --upgrade to upgrade): execnet in /usr/lib/python2.7/site-packages (from remoto>=0.0.35)", "Requirement already satisfied (use --upgrade to upgrade): apipkg>=1.4 in /usr/lib/python2.7/site-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2019-11-29T12:21:50.639 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:50 +0000 (0:00:00.063) 0:04:26.747 ******* 2019-11-29T12:21:50.679 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:50 +0000 (0:00:00.039) 0:04:26.787 ******* 2019-11-29T12:21:50.684 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2019-11-29T12:21:50.685 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:50.725 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:50 +0000 (0:00:00.045) 0:04:26.832 ******* 2019-11-29T12:21:50.729 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2019-11-29T12:21:50.732 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2019-11-29T12:21:50.768 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:50 +0000 (0:00:00.042) 0:04:26.875 ******* 2019-11-29T12:21:50.772 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2019-11-29T12:21:50.773 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => {"ansible_facts": {"interface": "ens1f0"}, "changed": false} 2019-11-29T12:21:50.810 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:50 +0000 (0:00:00.042) 0:04:26.918 ******* 2019-11-29T12:21:50.815 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2019-11-29T12:21:50.817 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:50.853 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:50 +0000 (0:00:00.043) 0:04:26.961 ******* 2019-11-29T12:21:51.123 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2019-11-29T12:21:51.125 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2019-11-29T12:21:51.163 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:51 +0000 (0:00:00.309) 0:04:27.270 ******* 2019-11-29T12:21:51.168 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2019-11-29T12:21:51.169 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2019-11-29T12:21:51.207 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:51 +0000 (0:00:00.044) 0:04:27.315 ******* 2019-11-29T12:21:51.213 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2019-11-29T12:21:51.213 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:51.251 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:51 +0000 (0:00:00.043) 0:04:27.359 ******* 2019-11-29T12:21:51.289 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** ok: [smithi022.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2019-11-29T12:21:51.324 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:51 +0000 (0:00:00.073) 0:04:27.432 ******* 2019-11-29T12:21:51.362 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2019-11-29T12:21:51.371 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:51.406 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:51 +0000 (0:00:00.082) 0:04:27.514 ******* 2019-11-29T12:21:51.528 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2019-11-29T12:21:51.528 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2019-11-29T12:21:51.567 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:51 +0000 (0:00:00.160) 0:04:27.675 ******* 2019-11-29T12:21:51.594 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2019-11-29T12:21:51.596 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:51.632 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:51 +0000 (0:00:00.064) 0:04:27.740 ******* 2019-11-29T12:21:51.669 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2019-11-29T12:21:51.671 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2019-11-29T12:21:51.681 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2019-11-29T12:21:51.682 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2019-11-29T12:21:51.693 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} 2019-11-29T12:21:51.732 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:51 +0000 (0:00:00.099) 0:04:27.839 ******* 2019-11-29T12:21:51.749 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2019-11-29T12:21:51.750 INFO:teuthology.task.ansible.out:changed: [smithi022.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2019-11-29T12:21:51.790 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:51 +0000 (0:00:00.058) 0:04:27.898 ******* 2019-11-29T12:21:51.798 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** skipping: [smithi062.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'enp3s0f1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:51.799 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno2', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:51.801 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'lo', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'enp3s0f0', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:51.840 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:51 +0000 (0:00:00.049) 0:04:27.948 ******* 2019-11-29T12:21:51.867 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-11-29T12:21:51.868 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:51.906 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:51 +0000 (0:00:00.066) 0:04:28.014 ******* 2019-11-29T12:21:51.932 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2019-11-29T12:21:51.934 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:51.971 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:51 +0000 (0:00:00.064) 0:04:28.079 ******* 2019-11-29T12:21:51.997 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2019-11-29T12:21:51.999 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:52.037 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:52 +0000 (0:00:00.065) 0:04:28.144 ******* 2019-11-29T12:21:52.063 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2019-11-29T12:21:52.065 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:52.100 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:52 +0000 (0:00:00.063) 0:04:28.208 ******* 2019-11-29T12:21:52.117 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* changed: [smithi022.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2019-11-29T12:21:52.153 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:52 +0000 (0:00:00.053) 0:04:28.261 ******* 2019-11-29T12:21:52.159 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2019-11-29T12:21:52.161 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:52.199 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:52 +0000 (0:00:00.046) 0:04:28.307 ******* 2019-11-29T12:21:52.205 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2019-11-29T12:21:52.206 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:52.243 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:52 +0000 (0:00:00.043) 0:04:28.351 ******* 2019-11-29T12:21:52.249 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2019-11-29T12:21:52.250 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:52.299 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:52 +0000 (0:00:00.053) 0:04:28.404 ******* 2019-11-29T12:21:52.941 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* skipping: [smithi022.front.sepia.ceph.com] => (item=ens1f1) => {"ansible_loop_var": "item", "changed": false, "item": "ens1f1", "skip_reason": "Conditional result was False"} skipping: [smithi022.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} skipping: [smithi022.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} skipping: [smithi022.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} skipping: [smithi022.front.sepia.ceph.com] => (item=ens1f0) => {"ansible_loop_var": "item", "changed": false, "item": "ens1f0", "skip_reason": "Conditional result was False"} Friday 29 November 2019 12:21:52 +0000 (0:00:00.045) 0:04:28.450 ******* TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Friday 29 November 2019 12:21:52 +0000 (0:00:00.052) 0:04:28.502 ******* TASK [testnode : Define net_to_configure var] ********************************** skipping: [smithi022.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'ens1f1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "ens1f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi022.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': Fals 2019-11-29T12:21:52.943 INFO:teuthology.task.ansible.out:e}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi022.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno2', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi022.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'lo', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi022.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'ens1f0', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "ens1f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} Friday 29 November 2019 12:21:52 +0000 (0:00:00.047) 0:04:28.550 ******* TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Friday 29 November 2019 12:21:52 +0000 (0:00:00.053) 0:04:28.603 ******* TASK [testnode : set_fact] ***************************************************** skipping: [smithi022.front.sepia.ceph.com] => {"changed": fals 2019-11-29T12:21:52.944 INFO:teuthology.task.ansible.out:e, "skip_reason": "Conditional result was False"} Friday 29 November 2019 12:21:52 +0000 (0:00:00.059) 0:04:28.663 ******* TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Friday 29 November 2019 12:21:52 +0000 (0:00:00.075) 0:04:28.738 ******* TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Friday 29 November 2019 12:21:52 +0000 (0:00:00.067) 0:04:28.806 ******* TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Friday 29 November 2019 12:21:52 +0000 (0:00:00.073) 0:04:28.879 ******* TASK [testnode : Set MTU on Ubuntu] ******************************************** skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Friday 29 November 2019 12:21:52 +0000 (0:00:00.091) 0:04:28.971 ******* TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** ok: [smithi062.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.015626", "end": "2019-11-29 12:21:52.807089", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2019-11-29 12:21:52.791463", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Friday 29 November 2019 12:21:52 +0000 (0:00:00.066) 0:04:29.037 ******* 2019-11-29T12:21:52.955 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2019-11-29T12:21:52.956 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:52.994 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:52 +0000 (0:00:00.064) 0:04:29.101 ******* 2019-11-29T12:21:53.020 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2019-11-29T12:21:53.021 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T12:21:53.056 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:53 +0000 (0:00:00.062) 0:04:29.164 ******* 2019-11-29T12:21:53.175 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2019-11-29T12:21:53.176 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.008078", "end": "2019-11-29 12:21:53.138109", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2019-11-29 12:21:53.130031", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-29T12:21:53.415 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.015919", "end": "2019-11-29 12:21:53.380302", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2019-11-29 12:21:53.364383", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-29T12:21:53.468 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.006965", "end": "2019-11-29 12:21:53.439874", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2019-11-29 12:21:53.432909", "stderr": "find: ‘/etc/ceph’: No such file or directory", "stderr_lines": ["find: ‘/etc/ceph’: No such file or directory"], "stdout": "", "stdout_lines": []} 2019-11-29T12:21:53.717 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.007538", "end": "2019-11-29 12:21:53.685418", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2019-11-29 12:21:53.677880", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-29T12:21:53.835 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.041338", "end": "2019-11-29 12:21:53.794601", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2019-11-29 12:21:53.753263", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-29T12:21:53.878 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:53 +0000 (0:00:00.821) 0:04:29.986 ******* 2019-11-29T12:21:53.905 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2019-11-29T12:21:53.943 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:53 +0000 (0:00:00.065) 0:04:30.051 ******* 2019-11-29T12:21:54.015 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2019-11-29T12:21:54.016 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.007284", "end": "2019-11-29 12:21:53.983907", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2019-11-29 12:21:53.976623", "stderr": "find: ‘/etc/ceph’: No such file or directory", "stderr_lines": ["find: ‘/etc/ceph’: No such file or directory"], "stdout": "", "stdout_lines": []} 2019-11-29T12:21:54.245 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2019-11-29T12:21:54.247 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_runtime_t:s0", "size": 0, "state": "file", "uid": 0} 2019-11-29T12:21:54.381 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2019-11-29T12:21:54.383 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.053573", "end": "2019-11-29 12:21:54.341387", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2019-11-29 12:21:54.287814", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-29T12:21:54.419 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:54 +0000 (0:00:00.475) 0:04:30.527 ******* 2019-11-29T12:21:54.445 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2019-11-29T12:21:54.482 INFO:teuthology.task.ansible.out:Friday 29 November 2019 12:21:54 +0000 (0:00:00.062) 0:04:30.589 ******* 2019-11-29T12:21:54.818 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2019-11-29T12:21:54.818 INFO:teuthology.task.ansible.out:changed: [smithi022.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_runtime_t:s0", "size": 0, "state": "file", "uid": 0} 2019-11-29T12:21:54.921 INFO:teuthology.task.ansible.out: PLAY [cobbler] ***************************************************************** skipping: no hosts matched 2019-11-29T12:21:54.923 INFO:teuthology.task.ansible.out: PLAY [paddles] ***************************************************************** skipping: no hosts matched 2019-11-29T12:21:54.925 INFO:teuthology.task.ansible.out: PLAY [pulpito] ***************************************************************** skipping: no hosts matched 2019-11-29T12:21:54.927 INFO:teuthology.task.ansible.out: PLAY RECAP ********************************************************************* smithi022.front.sepia.ceph.com : ok=121 changed=39 unreachable=0 failed=0 skipped=159 rescued=0 ignored=3 smithi062.front.sepia.ceph.com : ok=121 changed=39 unreachable=0 failed=0 skipped=159 rescued=0 ignored=3 Friday 29 November 2019 12:21:54 +0000 (0:00:00.444) 0:04:31.034 ******* =============================================================================== users : Create all admin users with sudo access. ----------------------- 40.41s users : Update authorized_keys using the keys repo --------------------- 38.58s testnode : Install packages -------------------------------------------- 19.00s common : Update yum cache ---------------------------------------------- 11.16s testnode : Ensure ceph packages are not present. ------------------------ 9.78s testnode : Zap all non-root disks --------------------------------------- 8.84s common : nrpe - Load SELinux policy package ----------------------------- 7.82s common : nrpe - Remove SELinux policy package --------------------------- 7.80s 2019-11-29T12:21:54.928 INFO:teuthology.task.ansible.out:users : Remove revoked users -------------------------------------------- 7.23s Gathering Facts --------------------------------------------------------- 3.29s common : Make sure smartmontools is installed --------------------------- 3.20s testnode : Ensure ceph dependency packages are not present. ------------- 2.93s ansible-managed : Add authorized keys for the ansible user. ------------- 2.82s testnode : Create logical volume(s) ------------------------------------- 2.73s testnode : Blow away lingering OSD data and FSIDs ----------------------- 2.73s common : Install nrpe package and dependencies (RHEL/CentOS) ------------ 2.71s common : nrpe - Ensure SELinux policy is up to date --------------------- 2.33s common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/. --- 2.21s common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/. --- 1.95s common : Configure epel repos in /etc/yum.repos.d/ ---------------------- 1.87s 2019-11-29T12:21:55.195 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi022.front.sepia.ceph.com'), Remote(name='ubuntu@smithi062.front.sepia.ceph.com')] 2019-11-29T12:21:55.198 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-29T12:21:55.198 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi022.front.sepia.ceph.com', 'timeout': 60} 2019-11-29T12:21:55.306 INFO:teuthology.orchestra.run.smithi022:> true 2019-11-29T12:21:55.684 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-29T12:21:55.684 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi062.front.sepia.ceph.com', 'timeout': 60} 2019-11-29T12:21:55.783 INFO:teuthology.orchestra.run.smithi062:> true 2019-11-29T12:21:56.207 INFO:teuthology.run_tasks:Running task clock... 2019-11-29T12:21:56.218 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2019-11-29T12:21:56.218 INFO:teuthology.orchestra.run.smithi022:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2019-11-29T12:21:56.357 INFO:teuthology.orchestra.run.smithi022.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2019-11-29T12:22:06.449 INFO:teuthology.orchestra.run.smithi022.stdout:ntpd: time slew -0.002459s 2019-11-29T12:22:06.487 INFO:teuthology.orchestra.run.smithi022.stderr:Failed to start ntp.service: Unit not found. 2019-11-29T12:22:06.610 INFO:teuthology.orchestra.run.smithi022.stdout: remote refid st t when poll reach delay offset jitter 2019-11-29T12:22:06.610 INFO:teuthology.orchestra.run.smithi022.stdout:============================================================================== 2019-11-29T12:22:06.611 INFO:teuthology.orchestra.run.smithi022.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-11-29T12:22:06.611 INFO:teuthology.orchestra.run.smithi022.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-11-29T12:22:06.611 INFO:teuthology.orchestra.run.smithi022.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-11-29T12:22:06.611 INFO:teuthology.orchestra.run.smithi022.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-11-29T12:22:06.612 INFO:teuthology.orchestra.run.smithi062:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2019-11-29T12:22:06.754 INFO:teuthology.orchestra.run.smithi062.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2019-11-29T12:22:16.849 INFO:teuthology.orchestra.run.smithi062.stdout:ntpd: time slew -0.002261s 2019-11-29T12:22:16.886 INFO:teuthology.orchestra.run.smithi062.stderr:Failed to start ntp.service: Unit not found. 2019-11-29T12:22:17.016 INFO:teuthology.orchestra.run.smithi062.stdout: remote refid st t when poll reach delay offset jitter 2019-11-29T12:22:17.016 INFO:teuthology.orchestra.run.smithi062.stdout:============================================================================== 2019-11-29T12:22:17.017 INFO:teuthology.orchestra.run.smithi062.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-11-29T12:22:17.017 INFO:teuthology.orchestra.run.smithi062.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-11-29T12:22:17.017 INFO:teuthology.orchestra.run.smithi062.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-11-29T12:22:17.017 INFO:teuthology.orchestra.run.smithi062.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-11-29T12:22:17.018 INFO:teuthology.run_tasks:Running task install... 2019-11-29T12:22:17.038 DEBUG:teuthology.task.install:project ceph 2019-11-29T12:22:17.038 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'notcmalloc', 'sha1': '656c8e8049c2c1acd363143c842c2edf1fe09b64'}} 2019-11-29T12:22:17.038 DEBUG:teuthology.task.install:config {'flavor': 'notcmalloc', 'sha1': '656c8e8049c2c1acd363143c842c2edf1fe09b64'} 2019-11-29T12:22:17.038 INFO:teuthology.task.install:Using flavor: notcmalloc 2019-11-29T12:22:17.045 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'ceph-daemon', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python-ceph', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-daemon', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-cloud', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-ssh', 'ceph-fuse', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python-ceph', 'rbd-fuse']} 2019-11-29T12:22:17.045 INFO:teuthology.task.install:extra packages: [] 2019-11-29T12:22:17.045 INFO:teuthology.orchestra.run.smithi022:> sudo lsb_release -is 2019-11-29T12:22:17.209 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS 2019-11-29T12:22:17.211 DEBUG:teuthology.misc:System to be installed: CentOS 2019-11-29T12:22:17.211 INFO:teuthology.orchestra.run.smithi062:> sudo lsb_release -is 2019-11-29T12:22:17.212 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'sha1': '656c8e8049c2c1acd363143c842c2edf1fe09b64', 'exclude_packages': [], 'debuginfo': None, 'install_ceph_packages': True, 'wait_for_package': False, 'downgrade_packages': [], 'project': 'ceph', 'tag': None, 'extra_packages': [], 'branch': None, 'packages': {}, 'repos_only': False, 'extra_system_packages': [], 'flavor': 'notcmalloc', 'extras': None} 2019-11-29T12:22:17.212 INFO:teuthology.orchestra.run.smithi022:> sudo lsb_release -is 2019-11-29T12:22:17.361 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS 2019-11-29T12:22:17.363 DEBUG:teuthology.misc:System to be installed: CentOS 2019-11-29T12:22:17.364 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=notcmalloc&distros=centos%2F7%2Fx86_64&sha1=656c8e8049c2c1acd363143c842c2edf1fe09b64 2019-11-29T12:22:17.373 INFO:teuthology.orchestra.run.smithi062.stdout:CentOS 2019-11-29T12:22:17.376 DEBUG:teuthology.misc:System to be installed: CentOS 2019-11-29T12:22:17.376 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'sha1': '656c8e8049c2c1acd363143c842c2edf1fe09b64', 'exclude_packages': [], 'debuginfo': None, 'install_ceph_packages': True, 'wait_for_package': False, 'downgrade_packages': [], 'project': 'ceph', 'tag': None, 'extra_packages': [], 'branch': None, 'packages': {}, 'repos_only': False, 'extra_system_packages': [], 'flavor': 'notcmalloc', 'extras': None} 2019-11-29T12:22:17.376 INFO:teuthology.orchestra.run.smithi062:> sudo lsb_release -is 2019-11-29T12:22:17.514 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-yuval-master/656c8e8049c2c1acd363143c842c2edf1fe09b64/centos/7/flavors/notcmalloc/ 2019-11-29T12:22:17.515 INFO:teuthology.task.install.rpm:Package version is 15.0.0-7809.g656c8e8 2019-11-29T12:22:17.521 INFO:teuthology.orchestra.run.smithi062.stdout:CentOS 2019-11-29T12:22:17.523 DEBUG:teuthology.misc:System to be installed: CentOS 2019-11-29T12:22:17.523 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=notcmalloc&distros=centos%2F7%2Fx86_64&sha1=656c8e8049c2c1acd363143c842c2edf1fe09b64 2019-11-29T12:22:17.642 INFO:teuthology.orchestra.run.smithi022:> sudo sh -c 'cat > /etc/yum.repos.d/ceph.repo' 2019-11-29T12:22:17.671 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-yuval-master/656c8e8049c2c1acd363143c842c2edf1fe09b64/centos/7/flavors/notcmalloc/ 2019-11-29T12:22:17.671 INFO:teuthology.task.install.rpm:Package version is 15.0.0-7809.g656c8e8 2019-11-29T12:22:17.768 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-daemon, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-cloud, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-ssh, ceph-fuse, libcephfs2, libcephfs-devel, librados2, librbd1, python-ceph, rbd-fuse on remote rpm x86_64 2019-11-29T12:22:17.768 INFO:teuthology.orchestra.run.smithi022:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/656c8e8049c2c1acd363143c842c2edf1fe09b64/;g' /etc/yum.repos.d/ceph.repo ; fi 2019-11-29T12:22:17.794 INFO:teuthology.orchestra.run.smithi062:> sudo sh -c 'cat > /etc/yum.repos.d/ceph.repo' 2019-11-29T12:22:17.879 INFO:teuthology.orchestra.run.smithi022:> test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2019-11-29T12:22:17.920 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-daemon, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-cloud, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-ssh, ceph-fuse, libcephfs2, libcephfs-devel, librados2, librbd1, python-ceph, rbd-fuse on remote rpm x86_64 2019-11-29T12:22:17.920 INFO:teuthology.orchestra.run.smithi062:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/656c8e8049c2c1acd363143c842c2edf1fe09b64/;g' /etc/yum.repos.d/ceph.repo ; fi 2019-11-29T12:22:17.969 INFO:teuthology.orchestra.run.smithi022:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2019-11-29T12:22:18.026 INFO:teuthology.orchestra.run.smithi062:> test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2019-11-29T12:22:18.051 INFO:teuthology.orchestra.run.smithi022.stdout:check_obsoletes = 1 2019-11-29T12:22:18.053 INFO:teuthology.orchestra.run.smithi022:> sudo yum clean all 2019-11-29T12:22:18.138 INFO:teuthology.orchestra.run.smithi062:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2019-11-29T12:22:18.243 INFO:teuthology.orchestra.run.smithi062.stdout:check_obsoletes = 1 2019-11-29T12:22:18.245 INFO:teuthology.orchestra.run.smithi062:> sudo yum clean all 2019-11-29T12:22:18.269 INFO:teuthology.orchestra.run.smithi022.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-29T12:22:18.310 INFO:teuthology.orchestra.run.smithi022.stdout:Cleaning repos: base centos7-fcgi-ceph ceph ceph-noarch ceph-source epel extras 2019-11-29T12:22:18.310 INFO:teuthology.orchestra.run.smithi022.stdout: : lab-extras updates 2019-11-29T12:22:18.355 INFO:teuthology.orchestra.run.smithi022.stdout:Cleaning up list of fastest mirrors 2019-11-29T12:22:18.356 INFO:teuthology.orchestra.run.smithi022.stdout:Other repos take up 1.5 M of disk space (use --verbose for details) 2019-11-29T12:22:18.368 INFO:teuthology.orchestra.run.smithi022:> sudo yum -y install ceph-radosgw 2019-11-29T12:22:18.497 INFO:teuthology.orchestra.run.smithi062.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-29T12:22:18.542 INFO:teuthology.orchestra.run.smithi062.stdout:Cleaning repos: base centos7-fcgi-ceph ceph ceph-noarch ceph-source epel extras 2019-11-29T12:22:18.543 INFO:teuthology.orchestra.run.smithi062.stdout: : lab-extras updates 2019-11-29T12:22:18.588 INFO:teuthology.orchestra.run.smithi062.stdout:Cleaning up list of fastest mirrors 2019-11-29T12:22:18.589 INFO:teuthology.orchestra.run.smithi062.stdout:Other repos take up 1.5 M of disk space (use --verbose for details) 2019-11-29T12:22:18.602 INFO:teuthology.orchestra.run.smithi062:> sudo yum -y install ceph-radosgw 2019-11-29T12:22:18.629 INFO:teuthology.orchestra.run.smithi022.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-29T12:22:18.674 INFO:teuthology.orchestra.run.smithi022.stdout:Determining fastest mirrors 2019-11-29T12:22:18.840 INFO:teuthology.orchestra.run.smithi062.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-29T12:22:18.882 INFO:teuthology.orchestra.run.smithi062.stdout:Determining fastest mirrors 2019-11-29T12:22:19.295 INFO:teuthology.orchestra.run.smithi062.stdout: * base: mirror.us-midwest-1.nexcess.net 2019-11-29T12:22:19.296 INFO:teuthology.orchestra.run.smithi062.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-29T12:22:19.297 INFO:teuthology.orchestra.run.smithi062.stdout: * extras: www.gtlib.gatech.edu 2019-11-29T12:22:19.297 INFO:teuthology.orchestra.run.smithi062.stdout: * updates: reflector.westga.edu 2019-11-29T12:22:22.244 INFO:teuthology.orchestra.run.smithi022.stdout: * base: mirror.us-midwest-1.nexcess.net 2019-11-29T12:22:22.245 INFO:teuthology.orchestra.run.smithi022.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-29T12:22:22.245 INFO:teuthology.orchestra.run.smithi022.stdout: * extras: www.gtlib.gatech.edu 2019-11-29T12:22:22.246 INFO:teuthology.orchestra.run.smithi022.stdout: * updates: reflector.westga.edu 2019-11-29T12:22:26.960 INFO:teuthology.orchestra.run.smithi062.stdout:7 packages excluded due to repository priority protections 2019-11-29T12:22:27.323 INFO:teuthology.orchestra.run.smithi062.stdout:Resolving Dependencies 2019-11-29T12:22:27.324 INFO:teuthology.orchestra.run.smithi062.stdout:--> Running transaction check 2019-11-29T12:22:27.324 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package ceph-radosgw.x86_64 2:15.0.0-7809.g656c8e8.el7 will be installed 2019-11-29T12:22:27.337 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: librgw2 = 2:15.0.0-7809.g656c8e8.el7 for package: 2:ceph-radosgw-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T12:22:27.449 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: ceph-base = 2:15.0.0-7809.g656c8e8.el7 for package: 2:ceph-radosgw-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T12:22:27.450 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: ceph-selinux = 2:15.0.0-7809.g656c8e8.el7 for package: 2:ceph-radosgw-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T12:22:27.451 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: librados2 = 2:15.0.0-7809.g656c8e8.el7 for package: 2:ceph-radosgw-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T12:22:27.453 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: librados.so.2(LIBRADOS_14.2.0)(64bit) for package: 2:ceph-radosgw-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T12:22:27.453 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: librdkafka.so.1()(64bit) for package: 2:ceph-radosgw-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T12:22:27.455 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: libceph-common.so.2()(64bit) for package: 2:ceph-radosgw-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T12:22:27.456 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: librabbitmq.so.4()(64bit) for package: 2:ceph-radosgw-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T12:22:27.457 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: liboath.so.0()(64bit) for package: 2:ceph-radosgw-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T12:22:27.458 INFO:teuthology.orchestra.run.smithi062.stdout:--> Running transaction check 2019-11-29T12:22:27.459 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package ceph-base.x86_64 2:15.0.0-7809.g656c8e8.el7 will be installed 2019-11-29T12:22:27.467 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: ceph-common = 2:15.0.0-7809.g656c8e8.el7 for package: 2:ceph-base-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T12:22:27.469 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: librbd1 = 2:15.0.0-7809.g656c8e8.el7 for package: 2:ceph-base-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T12:22:27.470 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: libcephfs2 = 2:15.0.0-7809.g656c8e8.el7 for package: 2:ceph-base-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T12:22:27.472 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: libleveldb.so.1()(64bit) for package: 2:ceph-base-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T12:22:27.472 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: liblttng-ust.so.0()(64bit) for package: 2:ceph-base-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T12:22:27.473 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package ceph-selinux.x86_64 2:15.0.0-7809.g656c8e8.el7 will be installed 2019-11-29T12:22:27.476 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package liboath.x86_64 0:2.6.2-1.el7 will be installed 2019-11-29T12:22:27.477 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package librabbitmq.x86_64 0:0.8.0-2.el7 will be installed 2019-11-29T12:22:27.477 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package librados2.x86_64 1:10.2.5-4.el7 will be updated 2019-11-29T12:22:27.478 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package librados2.x86_64 2:15.0.0-7809.g656c8e8.el7 will be an update 2019-11-29T12:22:27.479 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package librdkafka.x86_64 0:0.11.5-1.el7 will be installed 2019-11-29T12:22:27.481 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package librgw2.x86_64 2:15.0.0-7809.g656c8e8.el7 will be installed 2019-11-29T12:22:27.481 INFO:teuthology.orchestra.run.smithi062.stdout:--> Running transaction check 2019-11-29T12:22:27.482 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package ceph-common.x86_64 2:15.0.0-7809.g656c8e8.el7 will be installed 2019-11-29T12:22:27.486 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: python-rgw = 2:15.0.0-7809.g656c8e8.el7 for package: 2:ceph-common-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T12:22:27.487 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: python-rbd = 2:15.0.0-7809.g656c8e8.el7 for package: 2:ceph-common-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T12:22:27.488 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: python-ceph-common = 2:15.0.0-7809.g656c8e8.el7 for package: 2:ceph-common-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T12:22:27.489 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: libradosstriper1 = 2:15.0.0-7809.g656c8e8.el7 for package: 2:ceph-common-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T12:22:27.490 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: python-cephfs = 2:15.0.0-7809.g656c8e8.el7 for package: 2:ceph-common-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T12:22:27.491 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: python-ceph-argparse = 2:15.0.0-7809.g656c8e8.el7 for package: 2:ceph-common-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T12:22:27.492 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: python-rados = 2:15.0.0-7809.g656c8e8.el7 for package: 2:ceph-common-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T12:22:27.493 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: python-prettytable for package: 2:ceph-common-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T12:22:27.494 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: libradosstriper.so.1()(64bit) for package: 2:ceph-common-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T12:22:27.494 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: libbabeltrace.so.1()(64bit) for package: 2:ceph-common-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T12:22:27.495 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: libbabeltrace-ctf.so.1()(64bit) for package: 2:ceph-common-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T12:22:27.496 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package leveldb.x86_64 0:1.12.0-11.el7 will be installed 2019-11-29T12:22:27.496 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package libcephfs2.x86_64 2:15.0.0-7809.g656c8e8.el7 will be installed 2019-11-29T12:22:27.496 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package librbd1.x86_64 1:10.2.5-4.el7 will be updated 2019-11-29T12:22:27.497 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package librbd1.x86_64 2:15.0.0-7809.g656c8e8.el7 will be an update 2019-11-29T12:22:27.497 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package lttng-ust.x86_64 0:2.4.1-4.el7 will be installed 2019-11-29T12:22:27.499 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: liburcu-bp.so.1()(64bit) for package: lttng-ust-2.4.1-4.el7.x86_64 2019-11-29T12:22:27.499 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: liburcu-cds.so.1()(64bit) for package: lttng-ust-2.4.1-4.el7.x86_64 2019-11-29T12:22:27.500 INFO:teuthology.orchestra.run.smithi062.stdout:--> Running transaction check 2019-11-29T12:22:27.500 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package libbabeltrace.x86_64 0:1.2.4-3.el7 will be installed 2019-11-29T12:22:27.501 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package libradosstriper1.x86_64 2:15.0.0-7809.g656c8e8.el7 will be installed 2019-11-29T12:22:27.502 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package python-ceph-argparse.x86_64 2:15.0.0-7809.g656c8e8.el7 will be installed 2019-11-29T12:22:27.502 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package python-ceph-common.x86_64 2:15.0.0-7809.g656c8e8.el7 will be installed 2019-11-29T12:22:27.502 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package python-cephfs.x86_64 2:15.0.0-7809.g656c8e8.el7 will be installed 2019-11-29T12:22:27.503 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package python-prettytable.noarch 0:0.7.2-3.el7 will be installed 2019-11-29T12:22:27.503 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package python-rados.x86_64 2:15.0.0-7809.g656c8e8.el7 will be installed 2019-11-29T12:22:27.504 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package python-rbd.x86_64 2:15.0.0-7809.g656c8e8.el7 will be installed 2019-11-29T12:22:27.504 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package python-rgw.x86_64 2:15.0.0-7809.g656c8e8.el7 will be installed 2019-11-29T12:22:27.504 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package userspace-rcu.x86_64 0:0.7.16-1.el7 will be installed 2019-11-29T12:22:28.412 INFO:teuthology.orchestra.run.smithi062.stdout:--> Finished Dependency Resolution 2019-11-29T12:22:28.501 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:22:28.501 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies Resolved 2019-11-29T12:22:28.505 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:22:28.505 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2019-11-29T12:22:28.505 INFO:teuthology.orchestra.run.smithi062.stdout: Package Arch Version Repository 2019-11-29T12:22:28.505 INFO:teuthology.orchestra.run.smithi062.stdout: Size 2019-11-29T12:22:28.505 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2019-11-29T12:22:28.506 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2019-11-29T12:22:28.506 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-radosgw x86_64 2:15.0.0-7809.g656c8e8.el7 ceph 6.2 M 2019-11-29T12:22:28.506 INFO:teuthology.orchestra.run.smithi062.stdout:Installing for dependencies: 2019-11-29T12:22:28.506 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-base x86_64 2:15.0.0-7809.g656c8e8.el7 ceph 5.6 M 2019-11-29T12:22:28.506 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-common x86_64 2:15.0.0-7809.g656c8e8.el7 ceph 19 M 2019-11-29T12:22:28.506 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-selinux x86_64 2:15.0.0-7809.g656c8e8.el7 ceph 20 k 2019-11-29T12:22:28.506 INFO:teuthology.orchestra.run.smithi062.stdout: leveldb x86_64 1.12.0-11.el7 epel 161 k 2019-11-29T12:22:28.506 INFO:teuthology.orchestra.run.smithi062.stdout: libbabeltrace x86_64 1.2.4-3.el7 epel 147 k 2019-11-29T12:22:28.507 INFO:teuthology.orchestra.run.smithi062.stdout: libcephfs2 x86_64 2:15.0.0-7809.g656c8e8.el7 ceph 490 k 2019-11-29T12:22:28.507 INFO:teuthology.orchestra.run.smithi062.stdout: liboath x86_64 2.6.2-1.el7 epel 51 k 2019-11-29T12:22:28.507 INFO:teuthology.orchestra.run.smithi062.stdout: librabbitmq x86_64 0.8.0-2.el7 base 37 k 2019-11-29T12:22:28.507 INFO:teuthology.orchestra.run.smithi062.stdout: libradosstriper1 x86_64 2:15.0.0-7809.g656c8e8.el7 ceph 374 k 2019-11-29T12:22:28.507 INFO:teuthology.orchestra.run.smithi062.stdout: librdkafka x86_64 0.11.5-1.el7 epel 368 k 2019-11-29T12:22:28.507 INFO:teuthology.orchestra.run.smithi062.stdout: librgw2 x86_64 2:15.0.0-7809.g656c8e8.el7 ceph 5.4 M 2019-11-29T12:22:28.507 INFO:teuthology.orchestra.run.smithi062.stdout: lttng-ust x86_64 2.4.1-4.el7 epel 176 k 2019-11-29T12:22:28.508 INFO:teuthology.orchestra.run.smithi062.stdout: python-ceph-argparse x86_64 2:15.0.0-7809.g656c8e8.el7 ceph 35 k 2019-11-29T12:22:28.508 INFO:teuthology.orchestra.run.smithi062.stdout: python-ceph-common x86_64 2:15.0.0-7809.g656c8e8.el7 ceph 42 k 2019-11-29T12:22:28.508 INFO:teuthology.orchestra.run.smithi062.stdout: python-cephfs x86_64 2:15.0.0-7809.g656c8e8.el7 ceph 102 k 2019-11-29T12:22:28.508 INFO:teuthology.orchestra.run.smithi062.stdout: python-prettytable noarch 0.7.2-3.el7 base 37 k 2019-11-29T12:22:28.508 INFO:teuthology.orchestra.run.smithi062.stdout: python-rados x86_64 2:15.0.0-7809.g656c8e8.el7 ceph 209 k 2019-11-29T12:22:28.508 INFO:teuthology.orchestra.run.smithi062.stdout: python-rbd x86_64 2:15.0.0-7809.g656c8e8.el7 ceph 199 k 2019-11-29T12:22:28.508 INFO:teuthology.orchestra.run.smithi062.stdout: python-rgw x86_64 2:15.0.0-7809.g656c8e8.el7 ceph 77 k 2019-11-29T12:22:28.508 INFO:teuthology.orchestra.run.smithi062.stdout: userspace-rcu x86_64 0.7.16-1.el7 epel 73 k 2019-11-29T12:22:28.509 INFO:teuthology.orchestra.run.smithi062.stdout:Updating for dependencies: 2019-11-29T12:22:28.509 INFO:teuthology.orchestra.run.smithi062.stdout: librados2 x86_64 2:15.0.0-7809.g656c8e8.el7 ceph 3.5 M 2019-11-29T12:22:28.509 INFO:teuthology.orchestra.run.smithi062.stdout: librbd1 x86_64 2:15.0.0-7809.g656c8e8.el7 ceph 1.8 M 2019-11-29T12:22:28.509 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:22:28.509 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2019-11-29T12:22:28.509 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2019-11-29T12:22:28.509 INFO:teuthology.orchestra.run.smithi062.stdout:Install 1 Package (+20 Dependent packages) 2019-11-29T12:22:28.510 INFO:teuthology.orchestra.run.smithi062.stdout:Upgrade ( 2 Dependent packages) 2019-11-29T12:22:28.510 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:22:28.510 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 45 M 2019-11-29T12:22:28.510 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading packages: 2019-11-29T12:22:28.510 INFO:teuthology.orchestra.run.smithi062.stdout:Delta RPMs disabled because /usr/bin/applydeltarpm not installed. 2019-11-29T12:22:29.833 INFO:teuthology.orchestra.run.smithi022.stdout:7 packages excluded due to repository priority protections 2019-11-29T12:22:30.191 INFO:teuthology.orchestra.run.smithi022.stdout:Resolving Dependencies 2019-11-29T12:22:30.192 INFO:teuthology.orchestra.run.smithi022.stdout:--> Running transaction check 2019-11-29T12:22:30.192 INFO:teuthology.orchestra.run.smithi022.stdout:---> Package ceph-radosgw.x86_64 2:15.0.0-7809.g656c8e8.el7 will be installed 2019-11-29T12:22:30.205 INFO:teuthology.orchestra.run.smithi022.stdout:--> Processing Dependency: librgw2 = 2:15.0.0-7809.g656c8e8.el7 for package: 2:ceph-radosgw-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T12:22:30.319 INFO:teuthology.orchestra.run.smithi022.stdout:--> Processing Dependency: ceph-base = 2:15.0.0-7809.g656c8e8.el7 for package: 2:ceph-radosgw-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T12:22:30.320 INFO:teuthology.orchestra.run.smithi022.stdout:--> Processing Dependency: ceph-selinux = 2:15.0.0-7809.g656c8e8.el7 for package: 2:ceph-radosgw-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T12:22:30.321 INFO:teuthology.orchestra.run.smithi022.stdout:--> Processing Dependency: librados2 = 2:15.0.0-7809.g656c8e8.el7 for package: 2:ceph-radosgw-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T12:22:30.323 INFO:teuthology.orchestra.run.smithi022.stdout:--> Processing Dependency: librados.so.2(LIBRADOS_14.2.0)(64bit) for package: 2:ceph-radosgw-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T12:22:30.323 INFO:teuthology.orchestra.run.smithi022.stdout:--> Processing Dependency: librdkafka.so.1()(64bit) for package: 2:ceph-radosgw-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T12:22:30.325 INFO:teuthology.orchestra.run.smithi022.stdout:--> Processing Dependency: libceph-common.so.2()(64bit) for package: 2:ceph-radosgw-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T12:22:30.326 INFO:teuthology.orchestra.run.smithi022.stdout:--> Processing Dependency: librabbitmq.so.4()(64bit) for package: 2:ceph-radosgw-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T12:22:30.327 INFO:teuthology.orchestra.run.smithi022.stdout:--> Processing Dependency: liboath.so.0()(64bit) for package: 2:ceph-radosgw-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T12:22:30.328 INFO:teuthology.orchestra.run.smithi022.stdout:--> Running transaction check 2019-11-29T12:22:30.329 INFO:teuthology.orchestra.run.smithi022.stdout:---> Package ceph-base.x86_64 2:15.0.0-7809.g656c8e8.el7 will be installed 2019-11-29T12:22:30.337 INFO:teuthology.orchestra.run.smithi022.stdout:--> Processing Dependency: ceph-common = 2:15.0.0-7809.g656c8e8.el7 for package: 2:ceph-base-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T12:22:30.339 INFO:teuthology.orchestra.run.smithi022.stdout:--> Processing Dependency: librbd1 = 2:15.0.0-7809.g656c8e8.el7 for package: 2:ceph-base-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T12:22:30.340 INFO:teuthology.orchestra.run.smithi022.stdout:--> Processing Dependency: libcephfs2 = 2:15.0.0-7809.g656c8e8.el7 for package: 2:ceph-base-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T12:22:30.341 INFO:teuthology.orchestra.run.smithi022.stdout:--> Processing Dependency: libleveldb.so.1()(64bit) for package: 2:ceph-base-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T12:22:30.342 INFO:teuthology.orchestra.run.smithi022.stdout:--> Processing Dependency: liblttng-ust.so.0()(64bit) for package: 2:ceph-base-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T12:22:30.343 INFO:teuthology.orchestra.run.smithi022.stdout:---> Package ceph-selinux.x86_64 2:15.0.0-7809.g656c8e8.el7 will be installed 2019-11-29T12:22:30.346 INFO:teuthology.orchestra.run.smithi022.stdout:---> Package liboath.x86_64 0:2.6.2-1.el7 will be installed 2019-11-29T12:22:30.346 INFO:teuthology.orchestra.run.smithi022.stdout:---> Package librabbitmq.x86_64 0:0.8.0-2.el7 will be installed 2019-11-29T12:22:30.347 INFO:teuthology.orchestra.run.smithi022.stdout:---> Package librados2.x86_64 1:10.2.5-4.el7 will be updated 2019-11-29T12:22:30.347 INFO:teuthology.orchestra.run.smithi022.stdout:---> Package librados2.x86_64 2:15.0.0-7809.g656c8e8.el7 will be an update 2019-11-29T12:22:30.349 INFO:teuthology.orchestra.run.smithi022.stdout:---> Package librdkafka.x86_64 0:0.11.5-1.el7 will be installed 2019-11-29T12:22:30.350 INFO:teuthology.orchestra.run.smithi022.stdout:---> Package librgw2.x86_64 2:15.0.0-7809.g656c8e8.el7 will be installed 2019-11-29T12:22:30.351 INFO:teuthology.orchestra.run.smithi022.stdout:--> Running transaction check 2019-11-29T12:22:30.351 INFO:teuthology.orchestra.run.smithi022.stdout:---> Package ceph-common.x86_64 2:15.0.0-7809.g656c8e8.el7 will be installed 2019-11-29T12:22:30.356 INFO:teuthology.orchestra.run.smithi022.stdout:--> Processing Dependency: python-rgw = 2:15.0.0-7809.g656c8e8.el7 for package: 2:ceph-common-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T12:22:30.357 INFO:teuthology.orchestra.run.smithi022.stdout:--> Processing Dependency: python-rbd = 2:15.0.0-7809.g656c8e8.el7 for package: 2:ceph-common-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T12:22:30.358 INFO:teuthology.orchestra.run.smithi022.stdout:--> Processing Dependency: python-ceph-common = 2:15.0.0-7809.g656c8e8.el7 for package: 2:ceph-common-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T12:22:30.359 INFO:teuthology.orchestra.run.smithi022.stdout:--> Processing Dependency: libradosstriper1 = 2:15.0.0-7809.g656c8e8.el7 for package: 2:ceph-common-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T12:22:30.360 INFO:teuthology.orchestra.run.smithi022.stdout:--> Processing Dependency: python-cephfs = 2:15.0.0-7809.g656c8e8.el7 for package: 2:ceph-common-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T12:22:30.361 INFO:teuthology.orchestra.run.smithi022.stdout:--> Processing Dependency: python-ceph-argparse = 2:15.0.0-7809.g656c8e8.el7 for package: 2:ceph-common-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T12:22:30.362 INFO:teuthology.orchestra.run.smithi022.stdout:--> Processing Dependency: python-rados = 2:15.0.0-7809.g656c8e8.el7 for package: 2:ceph-common-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T12:22:30.363 INFO:teuthology.orchestra.run.smithi022.stdout:--> Processing Dependency: python-prettytable for package: 2:ceph-common-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T12:22:30.364 INFO:teuthology.orchestra.run.smithi022.stdout:--> Processing Dependency: libradosstriper.so.1()(64bit) for package: 2:ceph-common-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T12:22:30.364 INFO:teuthology.orchestra.run.smithi022.stdout:--> Processing Dependency: libbabeltrace.so.1()(64bit) for package: 2:ceph-common-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T12:22:30.365 INFO:teuthology.orchestra.run.smithi022.stdout:--> Processing Dependency: libbabeltrace-ctf.so.1()(64bit) for package: 2:ceph-common-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T12:22:30.365 INFO:teuthology.orchestra.run.smithi022.stdout:---> Package leveldb.x86_64 0:1.12.0-11.el7 will be installed 2019-11-29T12:22:30.365 INFO:teuthology.orchestra.run.smithi022.stdout:---> Package libcephfs2.x86_64 2:15.0.0-7809.g656c8e8.el7 will be installed 2019-11-29T12:22:30.366 INFO:teuthology.orchestra.run.smithi022.stdout:---> Package librbd1.x86_64 1:10.2.5-4.el7 will be updated 2019-11-29T12:22:30.366 INFO:teuthology.orchestra.run.smithi022.stdout:---> Package librbd1.x86_64 2:15.0.0-7809.g656c8e8.el7 will be an update 2019-11-29T12:22:30.367 INFO:teuthology.orchestra.run.smithi022.stdout:---> Package lttng-ust.x86_64 0:2.4.1-4.el7 will be installed 2019-11-29T12:22:30.368 INFO:teuthology.orchestra.run.smithi022.stdout:--> Processing Dependency: liburcu-bp.so.1()(64bit) for package: lttng-ust-2.4.1-4.el7.x86_64 2019-11-29T12:22:30.369 INFO:teuthology.orchestra.run.smithi022.stdout:--> Processing Dependency: liburcu-cds.so.1()(64bit) for package: lttng-ust-2.4.1-4.el7.x86_64 2019-11-29T12:22:30.369 INFO:teuthology.orchestra.run.smithi022.stdout:--> Running transaction check 2019-11-29T12:22:30.369 INFO:teuthology.orchestra.run.smithi022.stdout:---> Package libbabeltrace.x86_64 0:1.2.4-3.el7 will be installed 2019-11-29T12:22:30.370 INFO:teuthology.orchestra.run.smithi022.stdout:---> Package libradosstriper1.x86_64 2:15.0.0-7809.g656c8e8.el7 will be installed 2019-11-29T12:22:30.371 INFO:teuthology.orchestra.run.smithi022.stdout:---> Package python-ceph-argparse.x86_64 2:15.0.0-7809.g656c8e8.el7 will be installed 2019-11-29T12:22:30.371 INFO:teuthology.orchestra.run.smithi022.stdout:---> Package python-ceph-common.x86_64 2:15.0.0-7809.g656c8e8.el7 will be installed 2019-11-29T12:22:30.371 INFO:teuthology.orchestra.run.smithi022.stdout:---> Package python-cephfs.x86_64 2:15.0.0-7809.g656c8e8.el7 will be installed 2019-11-29T12:22:30.373 INFO:teuthology.orchestra.run.smithi022.stdout:---> Package python-prettytable.noarch 0:0.7.2-3.el7 will be installed 2019-11-29T12:22:30.373 INFO:teuthology.orchestra.run.smithi022.stdout:---> Package python-rados.x86_64 2:15.0.0-7809.g656c8e8.el7 will be installed 2019-11-29T12:22:30.373 INFO:teuthology.orchestra.run.smithi022.stdout:---> Package python-rbd.x86_64 2:15.0.0-7809.g656c8e8.el7 will be installed 2019-11-29T12:22:30.373 INFO:teuthology.orchestra.run.smithi022.stdout:---> Package python-rgw.x86_64 2:15.0.0-7809.g656c8e8.el7 will be installed 2019-11-29T12:22:30.374 INFO:teuthology.orchestra.run.smithi022.stdout:---> Package userspace-rcu.x86_64 0:0.7.16-1.el7 will be installed 2019-11-29T12:22:30.922 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2019-11-29T12:22:30.922 INFO:teuthology.orchestra.run.smithi062.stdout:Total 18 MB/s | 45 MB 00:02 2019-11-29T12:22:30.939 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2019-11-29T12:22:31.013 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2019-11-29T12:22:31.262 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded 2019-11-29T12:22:31.275 INFO:teuthology.orchestra.run.smithi022.stdout:--> Finished Dependency Resolution 2019-11-29T12:22:31.294 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2019-11-29T12:22:31.363 INFO:teuthology.orchestra.run.smithi022.stdout: 2019-11-29T12:22:31.363 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies Resolved 2019-11-29T12:22:31.367 INFO:teuthology.orchestra.run.smithi022.stdout: 2019-11-29T12:22:31.367 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2019-11-29T12:22:31.367 INFO:teuthology.orchestra.run.smithi022.stdout: Package Arch Version Repository 2019-11-29T12:22:31.367 INFO:teuthology.orchestra.run.smithi022.stdout: Size 2019-11-29T12:22:31.367 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2019-11-29T12:22:31.367 INFO:teuthology.orchestra.run.smithi022.stdout:Installing: 2019-11-29T12:22:31.368 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-radosgw x86_64 2:15.0.0-7809.g656c8e8.el7 ceph 6.2 M 2019-11-29T12:22:31.368 INFO:teuthology.orchestra.run.smithi022.stdout:Installing for dependencies: 2019-11-29T12:22:31.368 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-base x86_64 2:15.0.0-7809.g656c8e8.el7 ceph 5.6 M 2019-11-29T12:22:31.368 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-common x86_64 2:15.0.0-7809.g656c8e8.el7 ceph 19 M 2019-11-29T12:22:31.368 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-selinux x86_64 2:15.0.0-7809.g656c8e8.el7 ceph 20 k 2019-11-29T12:22:31.368 INFO:teuthology.orchestra.run.smithi022.stdout: leveldb x86_64 1.12.0-11.el7 epel 161 k 2019-11-29T12:22:31.368 INFO:teuthology.orchestra.run.smithi022.stdout: libbabeltrace x86_64 1.2.4-3.el7 epel 147 k 2019-11-29T12:22:31.369 INFO:teuthology.orchestra.run.smithi022.stdout: libcephfs2 x86_64 2:15.0.0-7809.g656c8e8.el7 ceph 490 k 2019-11-29T12:22:31.369 INFO:teuthology.orchestra.run.smithi022.stdout: liboath x86_64 2.6.2-1.el7 epel 51 k 2019-11-29T12:22:31.369 INFO:teuthology.orchestra.run.smithi022.stdout: librabbitmq x86_64 0.8.0-2.el7 base 37 k 2019-11-29T12:22:31.369 INFO:teuthology.orchestra.run.smithi022.stdout: libradosstriper1 x86_64 2:15.0.0-7809.g656c8e8.el7 ceph 374 k 2019-11-29T12:22:31.369 INFO:teuthology.orchestra.run.smithi022.stdout: librdkafka x86_64 0.11.5-1.el7 epel 368 k 2019-11-29T12:22:31.369 INFO:teuthology.orchestra.run.smithi022.stdout: librgw2 x86_64 2:15.0.0-7809.g656c8e8.el7 ceph 5.4 M 2019-11-29T12:22:31.369 INFO:teuthology.orchestra.run.smithi022.stdout: lttng-ust x86_64 2.4.1-4.el7 epel 176 k 2019-11-29T12:22:31.370 INFO:teuthology.orchestra.run.smithi022.stdout: python-ceph-argparse x86_64 2:15.0.0-7809.g656c8e8.el7 ceph 35 k 2019-11-29T12:22:31.370 INFO:teuthology.orchestra.run.smithi022.stdout: python-ceph-common x86_64 2:15.0.0-7809.g656c8e8.el7 ceph 42 k 2019-11-29T12:22:31.370 INFO:teuthology.orchestra.run.smithi022.stdout: python-cephfs x86_64 2:15.0.0-7809.g656c8e8.el7 ceph 102 k 2019-11-29T12:22:31.370 INFO:teuthology.orchestra.run.smithi022.stdout: python-prettytable noarch 0.7.2-3.el7 base 37 k 2019-11-29T12:22:31.370 INFO:teuthology.orchestra.run.smithi022.stdout: python-rados x86_64 2:15.0.0-7809.g656c8e8.el7 ceph 209 k 2019-11-29T12:22:31.370 INFO:teuthology.orchestra.run.smithi022.stdout: python-rbd x86_64 2:15.0.0-7809.g656c8e8.el7 ceph 199 k 2019-11-29T12:22:31.370 INFO:teuthology.orchestra.run.smithi022.stdout: python-rgw x86_64 2:15.0.0-7809.g656c8e8.el7 ceph 77 k 2019-11-29T12:22:31.370 INFO:teuthology.orchestra.run.smithi022.stdout: userspace-rcu x86_64 0.7.16-1.el7 epel 73 k 2019-11-29T12:22:31.371 INFO:teuthology.orchestra.run.smithi022.stdout:Updating for dependencies: 2019-11-29T12:22:31.371 INFO:teuthology.orchestra.run.smithi022.stdout: librados2 x86_64 2:15.0.0-7809.g656c8e8.el7 ceph 3.5 M 2019-11-29T12:22:31.371 INFO:teuthology.orchestra.run.smithi022.stdout: librbd1 x86_64 2:15.0.0-7809.g656c8e8.el7 ceph 1.8 M 2019-11-29T12:22:31.371 INFO:teuthology.orchestra.run.smithi022.stdout: 2019-11-29T12:22:31.371 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction Summary 2019-11-29T12:22:31.371 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2019-11-29T12:22:31.371 INFO:teuthology.orchestra.run.smithi022.stdout:Install 1 Package (+20 Dependent packages) 2019-11-29T12:22:31.371 INFO:teuthology.orchestra.run.smithi022.stdout:Upgrade ( 2 Dependent packages) 2019-11-29T12:22:31.371 INFO:teuthology.orchestra.run.smithi022.stdout: 2019-11-29T12:22:31.372 INFO:teuthology.orchestra.run.smithi022.stdout:Total download size: 45 M 2019-11-29T12:22:31.372 INFO:teuthology.orchestra.run.smithi022.stdout:Downloading packages: 2019-11-29T12:22:31.372 INFO:teuthology.orchestra.run.smithi022.stdout:Delta RPMs disabled because /usr/bin/applydeltarpm not installed. 2019-11-29T12:22:32.019 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : liboath-2.6.2-1.el7.x86_64 1/25 2019-11-29T12:22:32.504 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : librabbitmq-0.8.0-2.el7.x86_64 2/25 2019-11-29T12:22:32.839 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : librdkafka-0.11.5-1.el7.x86_64 3/25 2019-11-29T12:22:33.147 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : 2:python-ceph-argparse-15.0.0-7809.g656c8e8.el7.x86_64 4/25 2019-11-29T12:22:33.499 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : leveldb-1.12.0-11.el7.x86_64 5/25 2019-11-29T12:22:33.715 INFO:teuthology.orchestra.run.smithi022.stdout:-------------------------------------------------------------------------------- 2019-11-29T12:22:33.716 INFO:teuthology.orchestra.run.smithi022.stdout:Total 19 MB/s | 45 MB 00:02 2019-11-29T12:22:33.733 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction check 2019-11-29T12:22:33.808 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction test 2019-11-29T12:22:33.878 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : userspace-rcu-0.7.16-1.el7.x86_64 6/25 2019-11-29T12:22:34.042 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction test succeeded 2019-11-29T12:22:34.042 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction 2019-11-29T12:22:34.696 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : liboath-2.6.2-1.el7.x86_64 1/25 2019-11-29T12:22:34.703 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : lttng-ust-2.4.1-4.el7.x86_64 7/25 2019-11-29T12:22:35.024 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : librabbitmq-0.8.0-2.el7.x86_64 2/25 2019-11-29T12:22:35.076 INFO:teuthology.orchestra.run.smithi062.stdout: Updating : 2:librados2-15.0.0-7809.g656c8e8.el7.x86_64 8/25 2019-11-29T12:22:35.349 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : librdkafka-0.11.5-1.el7.x86_64 3/25 2019-11-29T12:22:35.585 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : 2:python-rados-15.0.0-7809.g656c8e8.el7.x86_64 9/25 2019-11-29T12:22:35.624 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : 2:python-ceph-argparse-15.0.0-7809.g656c8e8.el7.x86_64 4/25 2019-11-29T12:22:35.977 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : leveldb-1.12.0-11.el7.x86_64 5/25 2019-11-29T12:22:36.347 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : userspace-rcu-0.7.16-1.el7.x86_64 6/25 2019-11-29T12:22:36.441 INFO:teuthology.orchestra.run.smithi062.stdout: Updating : 2:librbd1-15.0.0-7809.g656c8e8.el7.x86_64 10/25 2019-11-29T12:22:36.820 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : 2:librgw2-15.0.0-7809.g656c8e8.el7.x86_64 11/25 2019-11-29T12:22:37.099 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : lttng-ust-2.4.1-4.el7.x86_64 7/25 2019-11-29T12:22:37.168 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : 2:libcephfs2-15.0.0-7809.g656c8e8.el7.x86_64 12/25 2019-11-29T12:22:37.442 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : 2:python-cephfs-15.0.0-7809.g656c8e8.el7.x86_64 13/25 2019-11-29T12:22:37.506 INFO:teuthology.orchestra.run.smithi022.stdout: Updating : 2:librados2-15.0.0-7809.g656c8e8.el7.x86_64 8/25 2019-11-29T12:22:37.761 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : 2:python-rgw-15.0.0-7809.g656c8e8.el7.x86_64 14/25 2019-11-29T12:22:38.005 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : 2:python-rados-15.0.0-7809.g656c8e8.el7.x86_64 9/25 2019-11-29T12:22:38.116 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : 2:python-rbd-15.0.0-7809.g656c8e8.el7.x86_64 15/25 2019-11-29T12:22:38.431 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : 2:libradosstriper1-15.0.0-7809.g656c8e8.el7.x86_64 16/25 2019-11-29T12:22:38.735 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python-prettytable-0.7.2-3.el7.noarch 17/25 2019-11-29T12:22:38.893 INFO:teuthology.orchestra.run.smithi022.stdout: Updating : 2:librbd1-15.0.0-7809.g656c8e8.el7.x86_64 10/25 2019-11-29T12:22:39.040 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : 2:python-ceph-common-15.0.0-7809.g656c8e8.el7.x86_64 18/25 2019-11-29T12:22:39.274 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : 2:librgw2-15.0.0-7809.g656c8e8.el7.x86_64 11/25 2019-11-29T12:22:39.574 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : 2:libcephfs2-15.0.0-7809.g656c8e8.el7.x86_64 12/25 2019-11-29T12:22:39.838 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : 2:python-cephfs-15.0.0-7809.g656c8e8.el7.x86_64 13/25 2019-11-29T12:22:40.210 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : 2:python-rgw-15.0.0-7809.g656c8e8.el7.x86_64 14/25 2019-11-29T12:22:40.520 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : 2:python-rbd-15.0.0-7809.g656c8e8.el7.x86_64 15/25 2019-11-29T12:22:40.838 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : 2:libradosstriper1-15.0.0-7809.g656c8e8.el7.x86_64 16/25 2019-11-29T12:22:41.115 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python-prettytable-0.7.2-3.el7.noarch 17/25 2019-11-29T12:22:41.437 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : 2:python-ceph-common-15.0.0-7809.g656c8e8.el7.x86_64 18/25 2019-11-29T12:22:41.757 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libbabeltrace-1.2.4-3.el7.x86_64 19/25 2019-11-29T12:22:42.977 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : 2:ceph-common-15.0.0-7809.g656c8e8.el7.x86_64 20/25 2019-11-29T12:22:43.552 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : 2:ceph-base-15.0.0-7809.g656c8e8.el7.x86_64 21/25 2019-11-29T12:22:44.000 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libbabeltrace-1.2.4-3.el7.x86_64 19/25 2019-11-29T12:22:45.158 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : 2:ceph-common-15.0.0-7809.g656c8e8.el7.x86_64 20/25 2019-11-29T12:22:45.701 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : 2:ceph-base-15.0.0-7809.g656c8e8.el7.x86_64 21/25 2019-11-29T12:22:53.815 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : 2:ceph-selinux-15.0.0-7809.g656c8e8.el7.x86_64 22/25 2019-11-29T12:22:54.386 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : 2:ceph-radosgw-15.0.0-7809.g656c8e8.el7.x86_64 23/25 2019-11-29T12:22:54.694 INFO:teuthology.orchestra.run.smithi062.stdout: Cleanup : 1:librbd1-10.2.5-4.el7.x86_64 24/25 2019-11-29T12:22:55.030 INFO:teuthology.orchestra.run.smithi062.stdout: Cleanup : 1:librados2-10.2.5-4.el7.x86_64 25/25 2019-11-29T12:22:55.142 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : liboath-2.6.2-1.el7.x86_64 1/25 2019-11-29T12:22:55.293 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : leveldb-1.12.0-11.el7.x86_64 2/25 2019-11-29T12:22:55.393 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : 2:libradosstriper1-15.0.0-7809.g656c8e8.el7.x86_64 3/25 2019-11-29T12:22:55.502 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : 2:librbd1-15.0.0-7809.g656c8e8.el7.x86_64 4/25 2019-11-29T12:22:55.627 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : 2:python-ceph-argparse-15.0.0-7809.g656c8e8.el7.x86_64 5/25 2019-11-29T12:22:55.761 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : 2:ceph-radosgw-15.0.0-7809.g656c8e8.el7.x86_64 6/25 2019-11-29T12:22:55.841 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : 2:ceph-selinux-15.0.0-7809.g656c8e8.el7.x86_64 22/25 2019-11-29T12:22:55.870 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libbabeltrace-1.2.4-3.el7.x86_64 7/25 2019-11-29T12:22:55.987 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : 2:python-ceph-common-15.0.0-7809.g656c8e8.el7.x86_64 8/25 2019-11-29T12:22:56.138 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : 2:librgw2-15.0.0-7809.g656c8e8.el7.x86_64 9/25 2019-11-29T12:22:56.263 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : 2:python-rados-15.0.0-7809.g656c8e8.el7.x86_64 10/25 2019-11-29T12:22:56.298 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : 2:ceph-radosgw-15.0.0-7809.g656c8e8.el7.x86_64 23/25 2019-11-29T12:22:56.414 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : 2:ceph-base-15.0.0-7809.g656c8e8.el7.x86_64 11/25 2019-11-29T12:22:56.523 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librdkafka-0.11.5-1.el7.x86_64 12/25 2019-11-29T12:22:56.592 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : 1:librbd1-10.2.5-4.el7.x86_64 24/25 2019-11-29T12:22:56.674 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : lttng-ust-2.4.1-4.el7.x86_64 13/25 2019-11-29T12:22:56.807 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : 2:libcephfs2-15.0.0-7809.g656c8e8.el7.x86_64 14/25 2019-11-29T12:22:56.878 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : 1:librados2-10.2.5-4.el7.x86_64 25/25 2019-11-29T12:22:57.032 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : liboath-2.6.2-1.el7.x86_64 1/25 2019-11-29T12:22:57.266 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : leveldb-1.12.0-11.el7.x86_64 2/25 2019-11-29T12:22:57.392 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : 2:libradosstriper1-15.0.0-7809.g656c8e8.el7.x86_64 3/25 2019-11-29T12:22:57.517 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : 2:librbd1-15.0.0-7809.g656c8e8.el7.x86_64 4/25 2019-11-29T12:22:57.566 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : 2:python-rbd-15.0.0-7809.g656c8e8.el7.x86_64 15/25 2019-11-29T12:22:57.626 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : 2:python-ceph-argparse-15.0.0-7809.g656c8e8.el7.x86_64 5/25 2019-11-29T12:22:57.709 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : 2:ceph-common-15.0.0-7809.g656c8e8.el7.x86_64 16/25 2019-11-29T12:22:57.710 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : 2:ceph-radosgw-15.0.0-7809.g656c8e8.el7.x86_64 6/25 2019-11-29T12:22:57.792 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python-prettytable-0.7.2-3.el7.noarch 17/25 2019-11-29T12:22:57.794 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libbabeltrace-1.2.4-3.el7.x86_64 7/25 2019-11-29T12:22:57.860 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librabbitmq-0.8.0-2.el7.x86_64 18/25 2019-11-29T12:22:57.886 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : 2:python-ceph-common-15.0.0-7809.g656c8e8.el7.x86_64 8/25 2019-11-29T12:22:57.985 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : 2:librados2-15.0.0-7809.g656c8e8.el7.x86_64 19/25 2019-11-29T12:22:57.987 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : 2:librgw2-15.0.0-7809.g656c8e8.el7.x86_64 9/25 2019-11-29T12:22:58.102 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : 2:ceph-selinux-15.0.0-7809.g656c8e8.el7.x86_64 20/25 2019-11-29T12:22:58.121 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : 2:python-rados-15.0.0-7809.g656c8e8.el7.x86_64 10/25 2019-11-29T12:22:58.221 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : 2:ceph-base-15.0.0-7809.g656c8e8.el7.x86_64 11/25 2019-11-29T12:22:58.236 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : userspace-rcu-0.7.16-1.el7.x86_64 21/25 2019-11-29T12:22:58.314 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librdkafka-0.11.5-1.el7.x86_64 12/25 2019-11-29T12:22:58.345 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : 2:python-cephfs-15.0.0-7809.g656c8e8.el7.x86_64 22/25 2019-11-29T12:22:58.414 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : lttng-ust-2.4.1-4.el7.x86_64 13/25 2019-11-29T12:22:58.504 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : 2:python-rgw-15.0.0-7809.g656c8e8.el7.x86_64 23/25 2019-11-29T12:22:58.505 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : 1:librbd1-10.2.5-4.el7.x86_64 24/25 2019-11-29T12:22:58.531 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : 2:libcephfs2-15.0.0-7809.g656c8e8.el7.x86_64 14/25 2019-11-29T12:22:58.674 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : 2:python-rbd-15.0.0-7809.g656c8e8.el7.x86_64 15/25 2019-11-29T12:22:58.791 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : 2:ceph-common-15.0.0-7809.g656c8e8.el7.x86_64 16/25 2019-11-29T12:22:58.891 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python-prettytable-0.7.2-3.el7.noarch 17/25 2019-11-29T12:22:58.920 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : 1:librados2-10.2.5-4.el7.x86_64 25/25 2019-11-29T12:22:58.920 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:22:58.920 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2019-11-29T12:22:58.921 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-radosgw.x86_64 2:15.0.0-7809.g656c8e8.el7 2019-11-29T12:22:58.921 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:22:58.921 INFO:teuthology.orchestra.run.smithi062.stdout:Dependency Installed: 2019-11-29T12:22:58.921 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-base.x86_64 2:15.0.0-7809.g656c8e8.el7 2019-11-29T12:22:58.921 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-common.x86_64 2:15.0.0-7809.g656c8e8.el7 2019-11-29T12:22:58.921 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-selinux.x86_64 2:15.0.0-7809.g656c8e8.el7 2019-11-29T12:22:58.921 INFO:teuthology.orchestra.run.smithi062.stdout: leveldb.x86_64 0:1.12.0-11.el7 2019-11-29T12:22:58.922 INFO:teuthology.orchestra.run.smithi062.stdout: libbabeltrace.x86_64 0:1.2.4-3.el7 2019-11-29T12:22:58.922 INFO:teuthology.orchestra.run.smithi062.stdout: libcephfs2.x86_64 2:15.0.0-7809.g656c8e8.el7 2019-11-29T12:22:58.922 INFO:teuthology.orchestra.run.smithi062.stdout: liboath.x86_64 0:2.6.2-1.el7 2019-11-29T12:22:58.922 INFO:teuthology.orchestra.run.smithi062.stdout: librabbitmq.x86_64 0:0.8.0-2.el7 2019-11-29T12:22:58.922 INFO:teuthology.orchestra.run.smithi062.stdout: libradosstriper1.x86_64 2:15.0.0-7809.g656c8e8.el7 2019-11-29T12:22:58.922 INFO:teuthology.orchestra.run.smithi062.stdout: librdkafka.x86_64 0:0.11.5-1.el7 2019-11-29T12:22:58.922 INFO:teuthology.orchestra.run.smithi062.stdout: librgw2.x86_64 2:15.0.0-7809.g656c8e8.el7 2019-11-29T12:22:58.923 INFO:teuthology.orchestra.run.smithi062.stdout: lttng-ust.x86_64 0:2.4.1-4.el7 2019-11-29T12:22:58.923 INFO:teuthology.orchestra.run.smithi062.stdout: python-ceph-argparse.x86_64 2:15.0.0-7809.g656c8e8.el7 2019-11-29T12:22:58.923 INFO:teuthology.orchestra.run.smithi062.stdout: python-ceph-common.x86_64 2:15.0.0-7809.g656c8e8.el7 2019-11-29T12:22:58.923 INFO:teuthology.orchestra.run.smithi062.stdout: python-cephfs.x86_64 2:15.0.0-7809.g656c8e8.el7 2019-11-29T12:22:58.923 INFO:teuthology.orchestra.run.smithi062.stdout: python-prettytable.noarch 0:0.7.2-3.el7 2019-11-29T12:22:58.923 INFO:teuthology.orchestra.run.smithi062.stdout: python-rados.x86_64 2:15.0.0-7809.g656c8e8.el7 2019-11-29T12:22:58.923 INFO:teuthology.orchestra.run.smithi062.stdout: python-rbd.x86_64 2:15.0.0-7809.g656c8e8.el7 2019-11-29T12:22:58.924 INFO:teuthology.orchestra.run.smithi062.stdout: python-rgw.x86_64 2:15.0.0-7809.g656c8e8.el7 2019-11-29T12:22:58.924 INFO:teuthology.orchestra.run.smithi062.stdout: userspace-rcu.x86_64 0:0.7.16-1.el7 2019-11-29T12:22:58.924 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:22:58.924 INFO:teuthology.orchestra.run.smithi062.stdout:Dependency Updated: 2019-11-29T12:22:58.924 INFO:teuthology.orchestra.run.smithi062.stdout: librados2.x86_64 2:15.0.0-7809.g656c8e8.el7 2019-11-29T12:22:58.924 INFO:teuthology.orchestra.run.smithi062.stdout: librbd1.x86_64 2:15.0.0-7809.g656c8e8.el7 2019-11-29T12:22:58.925 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:22:58.925 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2019-11-29T12:22:58.992 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librabbitmq-0.8.0-2.el7.x86_64 18/25 2019-11-29T12:22:59.040 INFO:teuthology.orchestra.run.smithi062:> sudo yum -y install ceph-test 2019-11-29T12:22:59.092 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : 2:librados2-15.0.0-7809.g656c8e8.el7.x86_64 19/25 2019-11-29T12:22:59.235 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : 2:ceph-selinux-15.0.0-7809.g656c8e8.el7.x86_64 20/25 2019-11-29T12:22:59.336 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : userspace-rcu-0.7.16-1.el7.x86_64 21/25 2019-11-29T12:22:59.344 INFO:teuthology.orchestra.run.smithi062.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-29T12:22:59.389 INFO:teuthology.orchestra.run.smithi062.stdout:Loading mirror speeds from cached hostfile 2019-11-29T12:22:59.390 INFO:teuthology.orchestra.run.smithi062.stdout: * base: mirror.us-midwest-1.nexcess.net 2019-11-29T12:22:59.390 INFO:teuthology.orchestra.run.smithi062.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-29T12:22:59.390 INFO:teuthology.orchestra.run.smithi062.stdout: * extras: www.gtlib.gatech.edu 2019-11-29T12:22:59.391 INFO:teuthology.orchestra.run.smithi062.stdout: * updates: reflector.westga.edu 2019-11-29T12:22:59.428 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : 2:python-cephfs-15.0.0-7809.g656c8e8.el7.x86_64 22/25 2019-11-29T12:22:59.520 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : 2:python-rgw-15.0.0-7809.g656c8e8.el7.x86_64 23/25 2019-11-29T12:22:59.521 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : 1:librbd1-10.2.5-4.el7.x86_64 24/25 2019-11-29T12:22:59.911 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : 1:librados2-10.2.5-4.el7.x86_64 25/25 2019-11-29T12:22:59.912 INFO:teuthology.orchestra.run.smithi022.stdout: 2019-11-29T12:22:59.912 INFO:teuthology.orchestra.run.smithi022.stdout:Installed: 2019-11-29T12:22:59.912 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-radosgw.x86_64 2:15.0.0-7809.g656c8e8.el7 2019-11-29T12:22:59.912 INFO:teuthology.orchestra.run.smithi022.stdout: 2019-11-29T12:22:59.912 INFO:teuthology.orchestra.run.smithi022.stdout:Dependency Installed: 2019-11-29T12:22:59.912 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-base.x86_64 2:15.0.0-7809.g656c8e8.el7 2019-11-29T12:22:59.913 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-common.x86_64 2:15.0.0-7809.g656c8e8.el7 2019-11-29T12:22:59.913 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-selinux.x86_64 2:15.0.0-7809.g656c8e8.el7 2019-11-29T12:22:59.913 INFO:teuthology.orchestra.run.smithi022.stdout: leveldb.x86_64 0:1.12.0-11.el7 2019-11-29T12:22:59.913 INFO:teuthology.orchestra.run.smithi022.stdout: libbabeltrace.x86_64 0:1.2.4-3.el7 2019-11-29T12:22:59.913 INFO:teuthology.orchestra.run.smithi022.stdout: libcephfs2.x86_64 2:15.0.0-7809.g656c8e8.el7 2019-11-29T12:22:59.913 INFO:teuthology.orchestra.run.smithi022.stdout: liboath.x86_64 0:2.6.2-1.el7 2019-11-29T12:22:59.913 INFO:teuthology.orchestra.run.smithi022.stdout: librabbitmq.x86_64 0:0.8.0-2.el7 2019-11-29T12:22:59.914 INFO:teuthology.orchestra.run.smithi022.stdout: libradosstriper1.x86_64 2:15.0.0-7809.g656c8e8.el7 2019-11-29T12:22:59.914 INFO:teuthology.orchestra.run.smithi022.stdout: librdkafka.x86_64 0:0.11.5-1.el7 2019-11-29T12:22:59.914 INFO:teuthology.orchestra.run.smithi022.stdout: librgw2.x86_64 2:15.0.0-7809.g656c8e8.el7 2019-11-29T12:22:59.914 INFO:teuthology.orchestra.run.smithi022.stdout: lttng-ust.x86_64 0:2.4.1-4.el7 2019-11-29T12:22:59.914 INFO:teuthology.orchestra.run.smithi022.stdout: python-ceph-argparse.x86_64 2:15.0.0-7809.g656c8e8.el7 2019-11-29T12:22:59.914 INFO:teuthology.orchestra.run.smithi022.stdout: python-ceph-common.x86_64 2:15.0.0-7809.g656c8e8.el7 2019-11-29T12:22:59.914 INFO:teuthology.orchestra.run.smithi022.stdout: python-cephfs.x86_64 2:15.0.0-7809.g656c8e8.el7 2019-11-29T12:22:59.915 INFO:teuthology.orchestra.run.smithi022.stdout: python-prettytable.noarch 0:0.7.2-3.el7 2019-11-29T12:22:59.915 INFO:teuthology.orchestra.run.smithi022.stdout: python-rados.x86_64 2:15.0.0-7809.g656c8e8.el7 2019-11-29T12:22:59.915 INFO:teuthology.orchestra.run.smithi022.stdout: python-rbd.x86_64 2:15.0.0-7809.g656c8e8.el7 2019-11-29T12:22:59.915 INFO:teuthology.orchestra.run.smithi022.stdout: python-rgw.x86_64 2:15.0.0-7809.g656c8e8.el7 2019-11-29T12:22:59.915 INFO:teuthology.orchestra.run.smithi022.stdout: userspace-rcu.x86_64 0:0.7.16-1.el7 2019-11-29T12:22:59.915 INFO:teuthology.orchestra.run.smithi022.stdout: 2019-11-29T12:22:59.915 INFO:teuthology.orchestra.run.smithi022.stdout:Dependency Updated: 2019-11-29T12:22:59.915 INFO:teuthology.orchestra.run.smithi022.stdout: librados2.x86_64 2:15.0.0-7809.g656c8e8.el7 2019-11-29T12:22:59.916 INFO:teuthology.orchestra.run.smithi022.stdout: librbd1.x86_64 2:15.0.0-7809.g656c8e8.el7 2019-11-29T12:22:59.916 INFO:teuthology.orchestra.run.smithi022.stdout: 2019-11-29T12:22:59.916 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2019-11-29T12:23:00.037 INFO:teuthology.orchestra.run.smithi022:> sudo yum -y install ceph-test 2019-11-29T12:23:00.061 INFO:teuthology.orchestra.run.smithi062.stdout:7 packages excluded due to repository priority protections 2019-11-29T12:23:00.354 INFO:teuthology.orchestra.run.smithi022.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-29T12:23:00.401 INFO:teuthology.orchestra.run.smithi022.stdout:Loading mirror speeds from cached hostfile 2019-11-29T12:23:00.401 INFO:teuthology.orchestra.run.smithi022.stdout: * base: mirror.us-midwest-1.nexcess.net 2019-11-29T12:23:00.402 INFO:teuthology.orchestra.run.smithi022.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-29T12:23:00.402 INFO:teuthology.orchestra.run.smithi022.stdout: * extras: www.gtlib.gatech.edu 2019-11-29T12:23:00.402 INFO:teuthology.orchestra.run.smithi022.stdout: * updates: reflector.westga.edu 2019-11-29T12:23:00.417 INFO:teuthology.orchestra.run.smithi062.stdout:Resolving Dependencies 2019-11-29T12:23:00.417 INFO:teuthology.orchestra.run.smithi062.stdout:--> Running transaction check 2019-11-29T12:23:00.417 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package ceph-test.x86_64 2:15.0.0-7809.g656c8e8.el7 will be installed 2019-11-29T12:23:00.436 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: xmlstarlet for package: 2:ceph-test-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T12:23:00.466 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: jq for package: 2:ceph-test-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T12:23:00.467 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: socat for package: 2:ceph-test-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T12:23:00.468 INFO:teuthology.orchestra.run.smithi062.stdout:--> Running transaction check 2019-11-29T12:23:00.469 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package jq.x86_64 0:1.5-1.el7 will be installed 2019-11-29T12:23:00.469 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: libonig.so.2()(64bit) for package: jq-1.5-1.el7.x86_64 2019-11-29T12:23:00.470 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package socat.x86_64 0:1.7.3.2-2.el7 will be installed 2019-11-29T12:23:00.472 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package xmlstarlet.x86_64 0:1.6.1-1.el7 will be installed 2019-11-29T12:23:00.475 INFO:teuthology.orchestra.run.smithi062.stdout:--> Running transaction check 2019-11-29T12:23:00.475 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package oniguruma.x86_64 0:5.9.5-3.el7 will be installed 2019-11-29T12:23:00.857 INFO:teuthology.orchestra.run.smithi062.stdout:--> Finished Dependency Resolution 2019-11-29T12:23:01.070 INFO:teuthology.orchestra.run.smithi022.stdout:7 packages excluded due to repository priority protections 2019-11-29T12:23:01.084 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:23:01.085 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies Resolved 2019-11-29T12:23:01.086 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:23:01.086 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2019-11-29T12:23:01.086 INFO:teuthology.orchestra.run.smithi062.stdout: Package Arch Version Repository 2019-11-29T12:23:01.086 INFO:teuthology.orchestra.run.smithi062.stdout: Size 2019-11-29T12:23:01.086 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2019-11-29T12:23:01.087 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2019-11-29T12:23:01.087 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-test x86_64 2:15.0.0-7809.g656c8e8.el7 ceph 38 M 2019-11-29T12:23:01.087 INFO:teuthology.orchestra.run.smithi062.stdout:Installing for dependencies: 2019-11-29T12:23:01.087 INFO:teuthology.orchestra.run.smithi062.stdout: jq x86_64 1.5-1.el7 epel 153 k 2019-11-29T12:23:01.087 INFO:teuthology.orchestra.run.smithi062.stdout: oniguruma x86_64 5.9.5-3.el7 epel 129 k 2019-11-29T12:23:01.087 INFO:teuthology.orchestra.run.smithi062.stdout: socat x86_64 1.7.3.2-2.el7 base 290 k 2019-11-29T12:23:01.087 INFO:teuthology.orchestra.run.smithi062.stdout: xmlstarlet x86_64 1.6.1-1.el7 epel 62 k 2019-11-29T12:23:01.087 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:23:01.088 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2019-11-29T12:23:01.088 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2019-11-29T12:23:01.088 INFO:teuthology.orchestra.run.smithi062.stdout:Install 1 Package (+4 Dependent packages) 2019-11-29T12:23:01.088 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:23:01.088 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 38 M 2019-11-29T12:23:01.088 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 134 M 2019-11-29T12:23:01.088 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading packages: 2019-11-29T12:23:01.432 INFO:teuthology.orchestra.run.smithi022.stdout:Resolving Dependencies 2019-11-29T12:23:01.433 INFO:teuthology.orchestra.run.smithi022.stdout:--> Running transaction check 2019-11-29T12:23:01.433 INFO:teuthology.orchestra.run.smithi022.stdout:---> Package ceph-test.x86_64 2:15.0.0-7809.g656c8e8.el7 will be installed 2019-11-29T12:23:01.452 INFO:teuthology.orchestra.run.smithi022.stdout:--> Processing Dependency: xmlstarlet for package: 2:ceph-test-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T12:23:01.482 INFO:teuthology.orchestra.run.smithi022.stdout:--> Processing Dependency: jq for package: 2:ceph-test-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T12:23:01.483 INFO:teuthology.orchestra.run.smithi022.stdout:--> Processing Dependency: socat for package: 2:ceph-test-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T12:23:01.484 INFO:teuthology.orchestra.run.smithi022.stdout:--> Running transaction check 2019-11-29T12:23:01.484 INFO:teuthology.orchestra.run.smithi022.stdout:---> Package jq.x86_64 0:1.5-1.el7 will be installed 2019-11-29T12:23:01.485 INFO:teuthology.orchestra.run.smithi022.stdout:--> Processing Dependency: libonig.so.2()(64bit) for package: jq-1.5-1.el7.x86_64 2019-11-29T12:23:01.486 INFO:teuthology.orchestra.run.smithi022.stdout:---> Package socat.x86_64 0:1.7.3.2-2.el7 will be installed 2019-11-29T12:23:01.488 INFO:teuthology.orchestra.run.smithi022.stdout:---> Package xmlstarlet.x86_64 0:1.6.1-1.el7 will be installed 2019-11-29T12:23:01.490 INFO:teuthology.orchestra.run.smithi022.stdout:--> Running transaction check 2019-11-29T12:23:01.491 INFO:teuthology.orchestra.run.smithi022.stdout:---> Package oniguruma.x86_64 0:5.9.5-3.el7 will be installed 2019-11-29T12:23:01.869 INFO:teuthology.orchestra.run.smithi022.stdout:--> Finished Dependency Resolution 2019-11-29T12:23:02.097 INFO:teuthology.orchestra.run.smithi022.stdout: 2019-11-29T12:23:02.097 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies Resolved 2019-11-29T12:23:02.098 INFO:teuthology.orchestra.run.smithi022.stdout: 2019-11-29T12:23:02.098 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2019-11-29T12:23:02.098 INFO:teuthology.orchestra.run.smithi022.stdout: Package Arch Version Repository 2019-11-29T12:23:02.098 INFO:teuthology.orchestra.run.smithi022.stdout: Size 2019-11-29T12:23:02.098 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2019-11-29T12:23:02.098 INFO:teuthology.orchestra.run.smithi022.stdout:Installing: 2019-11-29T12:23:02.099 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-test x86_64 2:15.0.0-7809.g656c8e8.el7 ceph 38 M 2019-11-29T12:23:02.099 INFO:teuthology.orchestra.run.smithi022.stdout:Installing for dependencies: 2019-11-29T12:23:02.099 INFO:teuthology.orchestra.run.smithi022.stdout: jq x86_64 1.5-1.el7 epel 153 k 2019-11-29T12:23:02.099 INFO:teuthology.orchestra.run.smithi022.stdout: oniguruma x86_64 5.9.5-3.el7 epel 129 k 2019-11-29T12:23:02.099 INFO:teuthology.orchestra.run.smithi022.stdout: socat x86_64 1.7.3.2-2.el7 base 290 k 2019-11-29T12:23:02.099 INFO:teuthology.orchestra.run.smithi022.stdout: xmlstarlet x86_64 1.6.1-1.el7 epel 62 k 2019-11-29T12:23:02.099 INFO:teuthology.orchestra.run.smithi022.stdout: 2019-11-29T12:23:02.099 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction Summary 2019-11-29T12:23:02.100 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2019-11-29T12:23:02.100 INFO:teuthology.orchestra.run.smithi022.stdout:Install 1 Package (+4 Dependent packages) 2019-11-29T12:23:02.100 INFO:teuthology.orchestra.run.smithi022.stdout: 2019-11-29T12:23:02.100 INFO:teuthology.orchestra.run.smithi022.stdout:Total download size: 38 M 2019-11-29T12:23:02.101 INFO:teuthology.orchestra.run.smithi022.stdout:Installed size: 134 M 2019-11-29T12:23:02.101 INFO:teuthology.orchestra.run.smithi022.stdout:Downloading packages: 2019-11-29T12:23:02.902 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2019-11-29T12:23:02.902 INFO:teuthology.orchestra.run.smithi062.stdout:Total 21 MB/s | 38 MB 00:01 2019-11-29T12:23:02.904 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2019-11-29T12:23:02.923 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2019-11-29T12:23:03.031 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded 2019-11-29T12:23:03.032 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2019-11-29T12:23:03.758 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : xmlstarlet-1.6.1-1.el7.x86_64 1/5 2019-11-29T12:23:04.053 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : socat-1.7.3.2-2.el7.x86_64 2/5 2019-11-29T12:23:04.371 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : oniguruma-5.9.5-3.el7.x86_64 3/5 2019-11-29T12:23:04.793 INFO:teuthology.orchestra.run.smithi022.stdout:-------------------------------------------------------------------------------- 2019-11-29T12:23:04.793 INFO:teuthology.orchestra.run.smithi022.stdout:Total 14 MB/s | 38 MB 00:02 2019-11-29T12:23:04.796 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction check 2019-11-29T12:23:04.820 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction test 2019-11-29T12:23:04.926 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction test succeeded 2019-11-29T12:23:04.938 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction 2019-11-29T12:23:05.611 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : xmlstarlet-1.6.1-1.el7.x86_64 1/5 2019-11-29T12:23:05.883 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : socat-1.7.3.2-2.el7.x86_64 2/5 2019-11-29T12:23:06.186 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : oniguruma-5.9.5-3.el7.x86_64 3/5 2019-11-29T12:23:08.662 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : jq-1.5-1.el7.x86_64 4/5 2019-11-29T12:23:08.987 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : 2:ceph-test-15.0.0-7809.g656c8e8.el7.x86_64 5/5 2019-11-29T12:23:09.128 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : 2:ceph-test-15.0.0-7809.g656c8e8.el7.x86_64 1/5 2019-11-29T12:23:09.245 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : oniguruma-5.9.5-3.el7.x86_64 2/5 2019-11-29T12:23:09.421 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : socat-1.7.3.2-2.el7.x86_64 3/5 2019-11-29T12:23:09.530 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : jq-1.5-1.el7.x86_64 4/5 2019-11-29T12:23:10.107 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : xmlstarlet-1.6.1-1.el7.x86_64 5/5 2019-11-29T12:23:10.108 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:23:10.108 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2019-11-29T12:23:10.108 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-test.x86_64 2:15.0.0-7809.g656c8e8.el7 2019-11-29T12:23:10.108 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:23:10.108 INFO:teuthology.orchestra.run.smithi062.stdout:Dependency Installed: 2019-11-29T12:23:10.108 INFO:teuthology.orchestra.run.smithi062.stdout: jq.x86_64 0:1.5-1.el7 oniguruma.x86_64 0:5.9.5-3.el7 2019-11-29T12:23:10.109 INFO:teuthology.orchestra.run.smithi062.stdout: socat.x86_64 0:1.7.3.2-2.el7 xmlstarlet.x86_64 0:1.6.1-1.el7 2019-11-29T12:23:10.109 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:23:10.109 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2019-11-29T12:23:10.228 INFO:teuthology.orchestra.run.smithi062:> sudo yum -y install ceph 2019-11-29T12:23:10.449 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : jq-1.5-1.el7.x86_64 4/5 2019-11-29T12:23:10.482 INFO:teuthology.orchestra.run.smithi062.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-29T12:23:10.527 INFO:teuthology.orchestra.run.smithi062.stdout:Loading mirror speeds from cached hostfile 2019-11-29T12:23:10.528 INFO:teuthology.orchestra.run.smithi062.stdout: * base: mirror.us-midwest-1.nexcess.net 2019-11-29T12:23:10.529 INFO:teuthology.orchestra.run.smithi062.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-29T12:23:10.529 INFO:teuthology.orchestra.run.smithi062.stdout: * extras: www.gtlib.gatech.edu 2019-11-29T12:23:10.530 INFO:teuthology.orchestra.run.smithi062.stdout: * updates: reflector.westga.edu 2019-11-29T12:23:10.728 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : 2:ceph-test-15.0.0-7809.g656c8e8.el7.x86_64 5/5 2019-11-29T12:23:10.828 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : 2:ceph-test-15.0.0-7809.g656c8e8.el7.x86_64 1/5 2019-11-29T12:23:10.945 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : oniguruma-5.9.5-3.el7.x86_64 2/5 2019-11-29T12:23:11.062 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : socat-1.7.3.2-2.el7.x86_64 3/5 2019-11-29T12:23:11.163 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : jq-1.5-1.el7.x86_64 4/5 2019-11-29T12:23:11.184 INFO:teuthology.orchestra.run.smithi062.stdout:7 packages excluded due to repository priority protections 2019-11-29T12:23:11.531 INFO:teuthology.orchestra.run.smithi062.stdout:Resolving Dependencies 2019-11-29T12:23:11.532 INFO:teuthology.orchestra.run.smithi062.stdout:--> Running transaction check 2019-11-29T12:23:11.532 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package ceph.x86_64 2:15.0.0-7809.g656c8e8.el7 will be installed 2019-11-29T12:23:11.534 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: ceph-mon = 2:15.0.0-7809.g656c8e8.el7 for package: 2:ceph-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T12:23:11.564 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: ceph-mgr = 2:15.0.0-7809.g656c8e8.el7 for package: 2:ceph-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T12:23:11.565 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: ceph-mds = 2:15.0.0-7809.g656c8e8.el7 for package: 2:ceph-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T12:23:11.567 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: ceph-osd = 2:15.0.0-7809.g656c8e8.el7 for package: 2:ceph-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T12:23:11.568 INFO:teuthology.orchestra.run.smithi062.stdout:--> Running transaction check 2019-11-29T12:23:11.568 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package ceph-mds.x86_64 2:15.0.0-7809.g656c8e8.el7 will be installed 2019-11-29T12:23:11.579 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package ceph-mgr.x86_64 2:15.0.0-7809.g656c8e8.el7 will be installed 2019-11-29T12:23:11.581 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: pyOpenSSL for package: 2:ceph-mgr-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T12:23:11.582 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: python-requests for package: 2:ceph-mgr-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T12:23:11.584 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: python-werkzeug for package: 2:ceph-mgr-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T12:23:11.585 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: python-cherrypy for package: 2:ceph-mgr-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T12:23:11.586 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: python-bcrypt for package: 2:ceph-mgr-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T12:23:11.587 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: python-pecan for package: 2:ceph-mgr-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T12:23:11.588 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package ceph-mon.x86_64 2:15.0.0-7809.g656c8e8.el7 will be installed 2019-11-29T12:23:11.591 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package ceph-osd.x86_64 2:15.0.0-7809.g656c8e8.el7 will be installed 2019-11-29T12:23:11.596 INFO:teuthology.orchestra.run.smithi062.stdout:--> Running transaction check 2019-11-29T12:23:11.596 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package pyOpenSSL.x86_64 0:0.13.1-4.el7 will be installed 2019-11-29T12:23:11.597 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package python-cherrypy.noarch 0:3.2.2-4.el7 will be installed 2019-11-29T12:23:11.598 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package python-pecan.noarch 0:0.4.5-2.el7 will be installed 2019-11-29T12:23:11.598 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: python-mako >= 0.4.0 for package: python-pecan-0.4.5-2.el7.noarch 2019-11-29T12:23:11.599 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: python-simplegeneric >= 0.8 for package: python-pecan-0.4.5-2.el7.noarch 2019-11-29T12:23:11.600 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: python-webob >= 1.2 for package: python-pecan-0.4.5-2.el7.noarch 2019-11-29T12:23:11.601 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: python-webtest >= 1.3.1 for package: python-pecan-0.4.5-2.el7.noarch 2019-11-29T12:23:11.602 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: python-singledispatch for package: python-pecan-0.4.5-2.el7.noarch 2019-11-29T12:23:11.603 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package python-requests.noarch 0:2.6.0-7.el7_7 will be installed 2019-11-29T12:23:11.604 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: python-urllib3 >= 1.10.2-1 for package: python-requests-2.6.0-7.el7_7.noarch 2019-11-29T12:23:11.605 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package python-werkzeug.noarch 0:0.9.1-2.el7 will be installed 2019-11-29T12:23:11.605 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package python2-bcrypt.x86_64 0:3.1.6-2.el7 will be installed 2019-11-29T12:23:11.605 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: python2-six for package: python2-bcrypt-3.1.6-2.el7.x86_64 2019-11-29T12:23:11.606 INFO:teuthology.orchestra.run.smithi062.stdout:--> Running transaction check 2019-11-29T12:23:11.606 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package python-mako.noarch 0:0.8.1-2.el7 will be installed 2019-11-29T12:23:11.607 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: python-markupsafe for package: python-mako-0.8.1-2.el7.noarch 2019-11-29T12:23:11.607 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: python-beaker for package: python-mako-0.8.1-2.el7.noarch 2019-11-29T12:23:11.608 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package python-simplegeneric.noarch 0:0.8-7.el7 will be installed 2019-11-29T12:23:11.608 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package python-singledispatch.noarch 0:3.4.0.2-2.el7 will be installed 2019-11-29T12:23:11.609 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package python-urllib3.noarch 0:1.10.2-7.el7 will be installed 2019-11-29T12:23:11.612 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package python-webob.noarch 0:1.2.3-7.el7 will be installed 2019-11-29T12:23:11.612 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package python-webtest.noarch 0:1.3.4-6.el7 will be installed 2019-11-29T12:23:11.612 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package python2-six.noarch 0:1.9.0-0.el7 will be installed 2019-11-29T12:23:11.613 INFO:teuthology.orchestra.run.smithi062.stdout:--> Running transaction check 2019-11-29T12:23:11.613 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package python-beaker.noarch 0:1.5.4-10.el7 will be installed 2019-11-29T12:23:11.613 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: python-paste for package: python-beaker-1.5.4-10.el7.noarch 2019-11-29T12:23:11.613 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package python-markupsafe.x86_64 0:0.11-10.el7 will be installed 2019-11-29T12:23:11.613 INFO:teuthology.orchestra.run.smithi062.stdout:--> Running transaction check 2019-11-29T12:23:11.613 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package python-paste.noarch 0:1.7.5.1-9.20111221hg1498.el7 will be installed 2019-11-29T12:23:11.613 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: python-tempita for package: python-paste-1.7.5.1-9.20111221hg1498.el7.noarch 2019-11-29T12:23:11.614 INFO:teuthology.orchestra.run.smithi062.stdout:--> Running transaction check 2019-11-29T12:23:11.614 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package python-tempita.noarch 0:0.5.1-6.el7 will be installed 2019-11-29T12:23:11.840 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : xmlstarlet-1.6.1-1.el7.x86_64 5/5 2019-11-29T12:23:11.841 INFO:teuthology.orchestra.run.smithi022.stdout: 2019-11-29T12:23:11.841 INFO:teuthology.orchestra.run.smithi022.stdout:Installed: 2019-11-29T12:23:11.841 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-test.x86_64 2:15.0.0-7809.g656c8e8.el7 2019-11-29T12:23:11.841 INFO:teuthology.orchestra.run.smithi022.stdout: 2019-11-29T12:23:11.841 INFO:teuthology.orchestra.run.smithi022.stdout:Dependency Installed: 2019-11-29T12:23:11.841 INFO:teuthology.orchestra.run.smithi022.stdout: jq.x86_64 0:1.5-1.el7 oniguruma.x86_64 0:5.9.5-3.el7 2019-11-29T12:23:11.842 INFO:teuthology.orchestra.run.smithi022.stdout: socat.x86_64 0:1.7.3.2-2.el7 xmlstarlet.x86_64 0:1.6.1-1.el7 2019-11-29T12:23:11.842 INFO:teuthology.orchestra.run.smithi022.stdout: 2019-11-29T12:23:11.842 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2019-11-29T12:23:11.979 INFO:teuthology.orchestra.run.smithi022:> sudo yum -y install ceph 2019-11-29T12:23:11.993 INFO:teuthology.orchestra.run.smithi062.stdout:--> Finished Dependency Resolution 2019-11-29T12:23:12.222 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:23:12.222 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies Resolved 2019-11-29T12:23:12.224 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:23:12.225 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2019-11-29T12:23:12.225 INFO:teuthology.orchestra.run.smithi062.stdout: Package Arch Version Repository 2019-11-29T12:23:12.225 INFO:teuthology.orchestra.run.smithi062.stdout: Size 2019-11-29T12:23:12.225 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2019-11-29T12:23:12.225 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2019-11-29T12:23:12.225 INFO:teuthology.orchestra.run.smithi062.stdout: ceph x86_64 2:15.0.0-7809.g656c8e8.el7 ceph 2.0 k 2019-11-29T12:23:12.226 INFO:teuthology.orchestra.run.smithi062.stdout:Installing for dependencies: 2019-11-29T12:23:12.226 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mds x86_64 2:15.0.0-7809.g656c8e8.el7 ceph 1.9 M 2019-11-29T12:23:12.226 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr x86_64 2:15.0.0-7809.g656c8e8.el7 ceph 1.7 M 2019-11-29T12:23:12.226 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mon x86_64 2:15.0.0-7809.g656c8e8.el7 ceph 4.3 M 2019-11-29T12:23:12.226 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-osd x86_64 2:15.0.0-7809.g656c8e8.el7 ceph 16 M 2019-11-29T12:23:12.226 INFO:teuthology.orchestra.run.smithi062.stdout: pyOpenSSL x86_64 0.13.1-4.el7 base 135 k 2019-11-29T12:23:12.226 INFO:teuthology.orchestra.run.smithi062.stdout: python-beaker noarch 1.5.4-10.el7 base 80 k 2019-11-29T12:23:12.226 INFO:teuthology.orchestra.run.smithi062.stdout: python-cherrypy noarch 3.2.2-4.el7 base 422 k 2019-11-29T12:23:12.227 INFO:teuthology.orchestra.run.smithi062.stdout: python-mako noarch 0.8.1-2.el7 base 307 k 2019-11-29T12:23:12.227 INFO:teuthology.orchestra.run.smithi062.stdout: python-markupsafe x86_64 0.11-10.el7 base 25 k 2019-11-29T12:23:12.227 INFO:teuthology.orchestra.run.smithi062.stdout: python-paste noarch 1.7.5.1-9.20111221hg1498.el7 base 866 k 2019-11-29T12:23:12.227 INFO:teuthology.orchestra.run.smithi062.stdout: python-pecan noarch 0.4.5-2.el7 epel 255 k 2019-11-29T12:23:12.227 INFO:teuthology.orchestra.run.smithi062.stdout: python-requests noarch 2.6.0-7.el7_7 updates 95 k 2019-11-29T12:23:12.227 INFO:teuthology.orchestra.run.smithi062.stdout: python-simplegeneric noarch 0.8-7.el7 epel 12 k 2019-11-29T12:23:12.227 INFO:teuthology.orchestra.run.smithi062.stdout: python-singledispatch noarch 3.4.0.2-2.el7 epel 18 k 2019-11-29T12:23:12.227 INFO:teuthology.orchestra.run.smithi062.stdout: python-tempita noarch 0.5.1-6.el7 base 33 k 2019-11-29T12:23:12.228 INFO:teuthology.orchestra.run.smithi062.stdout: python-urllib3 noarch 1.10.2-7.el7 base 103 k 2019-11-29T12:23:12.228 INFO:teuthology.orchestra.run.smithi062.stdout: python-webob noarch 1.2.3-7.el7 base 202 k 2019-11-29T12:23:12.228 INFO:teuthology.orchestra.run.smithi062.stdout: python-webtest noarch 1.3.4-6.el7 base 102 k 2019-11-29T12:23:12.228 INFO:teuthology.orchestra.run.smithi062.stdout: python-werkzeug noarch 0.9.1-2.el7 extras 562 k 2019-11-29T12:23:12.228 INFO:teuthology.orchestra.run.smithi062.stdout: python2-bcrypt x86_64 3.1.6-2.el7 epel 39 k 2019-11-29T12:23:12.228 INFO:teuthology.orchestra.run.smithi062.stdout: python2-six noarch 1.9.0-0.el7 epel 2.9 k 2019-11-29T12:23:12.228 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:23:12.229 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2019-11-29T12:23:12.229 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2019-11-29T12:23:12.229 INFO:teuthology.orchestra.run.smithi062.stdout:Install 1 Package (+21 Dependent packages) 2019-11-29T12:23:12.229 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:23:12.230 INFO:teuthology.orchestra.run.smithi022.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-29T12:23:12.230 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 28 M 2019-11-29T12:23:12.230 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 87 M 2019-11-29T12:23:12.230 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading packages: 2019-11-29T12:23:12.274 INFO:teuthology.orchestra.run.smithi022.stdout:Loading mirror speeds from cached hostfile 2019-11-29T12:23:12.275 INFO:teuthology.orchestra.run.smithi022.stdout: * base: mirror.us-midwest-1.nexcess.net 2019-11-29T12:23:12.275 INFO:teuthology.orchestra.run.smithi022.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-29T12:23:12.276 INFO:teuthology.orchestra.run.smithi022.stdout: * extras: www.gtlib.gatech.edu 2019-11-29T12:23:12.276 INFO:teuthology.orchestra.run.smithi022.stdout: * updates: reflector.westga.edu 2019-11-29T12:23:12.933 INFO:teuthology.orchestra.run.smithi022.stdout:7 packages excluded due to repository priority protections 2019-11-29T12:23:13.282 INFO:teuthology.orchestra.run.smithi022.stdout:Resolving Dependencies 2019-11-29T12:23:13.283 INFO:teuthology.orchestra.run.smithi022.stdout:--> Running transaction check 2019-11-29T12:23:13.283 INFO:teuthology.orchestra.run.smithi022.stdout:---> Package ceph.x86_64 2:15.0.0-7809.g656c8e8.el7 will be installed 2019-11-29T12:23:13.285 INFO:teuthology.orchestra.run.smithi022.stdout:--> Processing Dependency: ceph-mon = 2:15.0.0-7809.g656c8e8.el7 for package: 2:ceph-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T12:23:13.316 INFO:teuthology.orchestra.run.smithi022.stdout:--> Processing Dependency: ceph-mgr = 2:15.0.0-7809.g656c8e8.el7 for package: 2:ceph-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T12:23:13.317 INFO:teuthology.orchestra.run.smithi022.stdout:--> Processing Dependency: ceph-mds = 2:15.0.0-7809.g656c8e8.el7 for package: 2:ceph-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T12:23:13.318 INFO:teuthology.orchestra.run.smithi022.stdout:--> Processing Dependency: ceph-osd = 2:15.0.0-7809.g656c8e8.el7 for package: 2:ceph-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T12:23:13.319 INFO:teuthology.orchestra.run.smithi022.stdout:--> Running transaction check 2019-11-29T12:23:13.320 INFO:teuthology.orchestra.run.smithi022.stdout:---> Package ceph-mds.x86_64 2:15.0.0-7809.g656c8e8.el7 will be installed 2019-11-29T12:23:13.330 INFO:teuthology.orchestra.run.smithi022.stdout:---> Package ceph-mgr.x86_64 2:15.0.0-7809.g656c8e8.el7 will be installed 2019-11-29T12:23:13.332 INFO:teuthology.orchestra.run.smithi022.stdout:--> Processing Dependency: pyOpenSSL for package: 2:ceph-mgr-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T12:23:13.333 INFO:teuthology.orchestra.run.smithi022.stdout:--> Processing Dependency: python-requests for package: 2:ceph-mgr-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T12:23:13.335 INFO:teuthology.orchestra.run.smithi022.stdout:--> Processing Dependency: python-werkzeug for package: 2:ceph-mgr-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T12:23:13.337 INFO:teuthology.orchestra.run.smithi022.stdout:--> Processing Dependency: python-cherrypy for package: 2:ceph-mgr-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T12:23:13.337 INFO:teuthology.orchestra.run.smithi022.stdout:--> Processing Dependency: python-bcrypt for package: 2:ceph-mgr-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T12:23:13.338 INFO:teuthology.orchestra.run.smithi022.stdout:--> Processing Dependency: python-pecan for package: 2:ceph-mgr-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T12:23:13.339 INFO:teuthology.orchestra.run.smithi022.stdout:---> Package ceph-mon.x86_64 2:15.0.0-7809.g656c8e8.el7 will be installed 2019-11-29T12:23:13.342 INFO:teuthology.orchestra.run.smithi022.stdout:---> Package ceph-osd.x86_64 2:15.0.0-7809.g656c8e8.el7 will be installed 2019-11-29T12:23:13.347 INFO:teuthology.orchestra.run.smithi022.stdout:--> Running transaction check 2019-11-29T12:23:13.347 INFO:teuthology.orchestra.run.smithi022.stdout:---> Package pyOpenSSL.x86_64 0:0.13.1-4.el7 will be installed 2019-11-29T12:23:13.348 INFO:teuthology.orchestra.run.smithi022.stdout:---> Package python-cherrypy.noarch 0:3.2.2-4.el7 will be installed 2019-11-29T12:23:13.349 INFO:teuthology.orchestra.run.smithi022.stdout:---> Package python-pecan.noarch 0:0.4.5-2.el7 will be installed 2019-11-29T12:23:13.349 INFO:teuthology.orchestra.run.smithi022.stdout:--> Processing Dependency: python-mako >= 0.4.0 for package: python-pecan-0.4.5-2.el7.noarch 2019-11-29T12:23:13.350 INFO:teuthology.orchestra.run.smithi022.stdout:--> Processing Dependency: python-simplegeneric >= 0.8 for package: python-pecan-0.4.5-2.el7.noarch 2019-11-29T12:23:13.351 INFO:teuthology.orchestra.run.smithi022.stdout:--> Processing Dependency: python-webob >= 1.2 for package: python-pecan-0.4.5-2.el7.noarch 2019-11-29T12:23:13.352 INFO:teuthology.orchestra.run.smithi022.stdout:--> Processing Dependency: python-webtest >= 1.3.1 for package: python-pecan-0.4.5-2.el7.noarch 2019-11-29T12:23:13.353 INFO:teuthology.orchestra.run.smithi022.stdout:--> Processing Dependency: python-singledispatch for package: python-pecan-0.4.5-2.el7.noarch 2019-11-29T12:23:13.354 INFO:teuthology.orchestra.run.smithi022.stdout:---> Package python-requests.noarch 0:2.6.0-7.el7_7 will be installed 2019-11-29T12:23:13.354 INFO:teuthology.orchestra.run.smithi022.stdout:--> Processing Dependency: python-urllib3 >= 1.10.2-1 for package: python-requests-2.6.0-7.el7_7.noarch 2019-11-29T12:23:13.355 INFO:teuthology.orchestra.run.smithi022.stdout:---> Package python-werkzeug.noarch 0:0.9.1-2.el7 will be installed 2019-11-29T12:23:13.356 INFO:teuthology.orchestra.run.smithi022.stdout:---> Package python2-bcrypt.x86_64 0:3.1.6-2.el7 will be installed 2019-11-29T12:23:13.356 INFO:teuthology.orchestra.run.smithi022.stdout:--> Processing Dependency: python2-six for package: python2-bcrypt-3.1.6-2.el7.x86_64 2019-11-29T12:23:13.357 INFO:teuthology.orchestra.run.smithi022.stdout:--> Running transaction check 2019-11-29T12:23:13.357 INFO:teuthology.orchestra.run.smithi022.stdout:---> Package python-mako.noarch 0:0.8.1-2.el7 will be installed 2019-11-29T12:23:13.357 INFO:teuthology.orchestra.run.smithi022.stdout:--> Processing Dependency: python-markupsafe for package: python-mako-0.8.1-2.el7.noarch 2019-11-29T12:23:13.358 INFO:teuthology.orchestra.run.smithi022.stdout:--> Processing Dependency: python-beaker for package: python-mako-0.8.1-2.el7.noarch 2019-11-29T12:23:13.359 INFO:teuthology.orchestra.run.smithi022.stdout:---> Package python-simplegeneric.noarch 0:0.8-7.el7 will be installed 2019-11-29T12:23:13.359 INFO:teuthology.orchestra.run.smithi022.stdout:---> Package python-singledispatch.noarch 0:3.4.0.2-2.el7 will be installed 2019-11-29T12:23:13.359 INFO:teuthology.orchestra.run.smithi022.stdout:---> Package python-urllib3.noarch 0:1.10.2-7.el7 will be installed 2019-11-29T12:23:13.361 INFO:teuthology.orchestra.run.smithi022.stdout:---> Package python-webob.noarch 0:1.2.3-7.el7 will be installed 2019-11-29T12:23:13.361 INFO:teuthology.orchestra.run.smithi022.stdout:---> Package python-webtest.noarch 0:1.3.4-6.el7 will be installed 2019-11-29T12:23:13.361 INFO:teuthology.orchestra.run.smithi022.stdout:---> Package python2-six.noarch 0:1.9.0-0.el7 will be installed 2019-11-29T12:23:13.361 INFO:teuthology.orchestra.run.smithi022.stdout:--> Running transaction check 2019-11-29T12:23:13.361 INFO:teuthology.orchestra.run.smithi022.stdout:---> Package python-beaker.noarch 0:1.5.4-10.el7 will be installed 2019-11-29T12:23:13.362 INFO:teuthology.orchestra.run.smithi022.stdout:--> Processing Dependency: python-paste for package: python-beaker-1.5.4-10.el7.noarch 2019-11-29T12:23:13.363 INFO:teuthology.orchestra.run.smithi022.stdout:---> Package python-markupsafe.x86_64 0:0.11-10.el7 will be installed 2019-11-29T12:23:13.363 INFO:teuthology.orchestra.run.smithi022.stdout:--> Running transaction check 2019-11-29T12:23:13.363 INFO:teuthology.orchestra.run.smithi022.stdout:---> Package python-paste.noarch 0:1.7.5.1-9.20111221hg1498.el7 will be installed 2019-11-29T12:23:13.363 INFO:teuthology.orchestra.run.smithi022.stdout:--> Processing Dependency: python-tempita for package: python-paste-1.7.5.1-9.20111221hg1498.el7.noarch 2019-11-29T12:23:13.363 INFO:teuthology.orchestra.run.smithi022.stdout:--> Running transaction check 2019-11-29T12:23:13.363 INFO:teuthology.orchestra.run.smithi022.stdout:---> Package python-tempita.noarch 0:0.5.1-6.el7 will be installed 2019-11-29T12:23:13.743 INFO:teuthology.orchestra.run.smithi022.stdout:--> Finished Dependency Resolution 2019-11-29T12:23:13.971 INFO:teuthology.orchestra.run.smithi022.stdout: 2019-11-29T12:23:13.971 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies Resolved 2019-11-29T12:23:13.974 INFO:teuthology.orchestra.run.smithi022.stdout: 2019-11-29T12:23:13.974 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2019-11-29T12:23:13.975 INFO:teuthology.orchestra.run.smithi022.stdout: Package Arch Version Repository 2019-11-29T12:23:13.975 INFO:teuthology.orchestra.run.smithi022.stdout: Size 2019-11-29T12:23:13.975 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2019-11-29T12:23:13.975 INFO:teuthology.orchestra.run.smithi022.stdout:Installing: 2019-11-29T12:23:13.975 INFO:teuthology.orchestra.run.smithi022.stdout: ceph x86_64 2:15.0.0-7809.g656c8e8.el7 ceph 2.0 k 2019-11-29T12:23:13.975 INFO:teuthology.orchestra.run.smithi022.stdout:Installing for dependencies: 2019-11-29T12:23:13.975 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mds x86_64 2:15.0.0-7809.g656c8e8.el7 ceph 1.9 M 2019-11-29T12:23:13.976 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr x86_64 2:15.0.0-7809.g656c8e8.el7 ceph 1.7 M 2019-11-29T12:23:13.976 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mon x86_64 2:15.0.0-7809.g656c8e8.el7 ceph 4.3 M 2019-11-29T12:23:13.976 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-osd x86_64 2:15.0.0-7809.g656c8e8.el7 ceph 16 M 2019-11-29T12:23:13.976 INFO:teuthology.orchestra.run.smithi022.stdout: pyOpenSSL x86_64 0.13.1-4.el7 base 135 k 2019-11-29T12:23:13.976 INFO:teuthology.orchestra.run.smithi022.stdout: python-beaker noarch 1.5.4-10.el7 base 80 k 2019-11-29T12:23:13.976 INFO:teuthology.orchestra.run.smithi022.stdout: python-cherrypy noarch 3.2.2-4.el7 base 422 k 2019-11-29T12:23:13.976 INFO:teuthology.orchestra.run.smithi022.stdout: python-mako noarch 0.8.1-2.el7 base 307 k 2019-11-29T12:23:13.977 INFO:teuthology.orchestra.run.smithi022.stdout: python-markupsafe x86_64 0.11-10.el7 base 25 k 2019-11-29T12:23:13.977 INFO:teuthology.orchestra.run.smithi022.stdout: python-paste noarch 1.7.5.1-9.20111221hg1498.el7 base 866 k 2019-11-29T12:23:13.977 INFO:teuthology.orchestra.run.smithi022.stdout: python-pecan noarch 0.4.5-2.el7 epel 255 k 2019-11-29T12:23:13.977 INFO:teuthology.orchestra.run.smithi022.stdout: python-requests noarch 2.6.0-7.el7_7 updates 95 k 2019-11-29T12:23:13.977 INFO:teuthology.orchestra.run.smithi022.stdout: python-simplegeneric noarch 0.8-7.el7 epel 12 k 2019-11-29T12:23:13.977 INFO:teuthology.orchestra.run.smithi022.stdout: python-singledispatch noarch 3.4.0.2-2.el7 epel 18 k 2019-11-29T12:23:13.977 INFO:teuthology.orchestra.run.smithi022.stdout: python-tempita noarch 0.5.1-6.el7 base 33 k 2019-11-29T12:23:13.978 INFO:teuthology.orchestra.run.smithi022.stdout: python-urllib3 noarch 1.10.2-7.el7 base 103 k 2019-11-29T12:23:13.978 INFO:teuthology.orchestra.run.smithi022.stdout: python-webob noarch 1.2.3-7.el7 base 202 k 2019-11-29T12:23:13.978 INFO:teuthology.orchestra.run.smithi022.stdout: python-webtest noarch 1.3.4-6.el7 base 102 k 2019-11-29T12:23:13.978 INFO:teuthology.orchestra.run.smithi022.stdout: python-werkzeug noarch 0.9.1-2.el7 extras 562 k 2019-11-29T12:23:13.978 INFO:teuthology.orchestra.run.smithi022.stdout: python2-bcrypt x86_64 3.1.6-2.el7 epel 39 k 2019-11-29T12:23:13.978 INFO:teuthology.orchestra.run.smithi022.stdout: python2-six noarch 1.9.0-0.el7 epel 2.9 k 2019-11-29T12:23:13.978 INFO:teuthology.orchestra.run.smithi022.stdout: 2019-11-29T12:23:13.978 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction Summary 2019-11-29T12:23:13.979 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2019-11-29T12:23:13.979 INFO:teuthology.orchestra.run.smithi022.stdout:Install 1 Package (+21 Dependent packages) 2019-11-29T12:23:13.979 INFO:teuthology.orchestra.run.smithi022.stdout: 2019-11-29T12:23:13.979 INFO:teuthology.orchestra.run.smithi022.stdout:Total download size: 28 M 2019-11-29T12:23:13.980 INFO:teuthology.orchestra.run.smithi022.stdout:Installed size: 87 M 2019-11-29T12:23:13.980 INFO:teuthology.orchestra.run.smithi022.stdout:Downloading packages: 2019-11-29T12:23:14.123 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2019-11-29T12:23:14.124 INFO:teuthology.orchestra.run.smithi062.stdout:Total 15 MB/s | 28 MB 00:01 2019-11-29T12:23:14.140 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2019-11-29T12:23:14.172 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2019-11-29T12:23:14.500 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded 2019-11-29T12:23:14.501 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2019-11-29T12:23:15.241 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python-webob-1.2.3-7.el7.noarch 1/22 2019-11-29T12:23:15.400 INFO:teuthology.orchestra.run.smithi022.stdout:-------------------------------------------------------------------------------- 2019-11-29T12:23:15.400 INFO:teuthology.orchestra.run.smithi022.stdout:Total 19 MB/s | 28 MB 00:01 2019-11-29T12:23:15.424 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction check 2019-11-29T12:23:15.468 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction test 2019-11-29T12:23:15.750 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : pyOpenSSL-0.13.1-4.el7.x86_64 2/22 2019-11-29T12:23:15.775 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction test succeeded 2019-11-29T12:23:15.776 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction 2019-11-29T12:23:17.376 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python-webob-1.2.3-7.el7.noarch 1/22 2019-11-29T12:23:17.659 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python-webtest-1.3.4-6.el7.noarch 3/22 2019-11-29T12:23:17.680 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : pyOpenSSL-0.13.1-4.el7.x86_64 2/22 2019-11-29T12:23:18.123 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : 2:ceph-osd-15.0.0-7809.g656c8e8.el7.x86_64 4/22 2019-11-29T12:23:18.621 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python-tempita-0.5.1-6.el7.noarch 5/22 2019-11-29T12:23:19.006 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python-paste-1.7.5.1-9.20111221hg1498.el7.noarch 6/22 2019-11-29T12:23:19.467 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python-beaker-1.5.4-10.el7.noarch 7/22 2019-11-29T12:23:19.624 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python-webtest-1.3.4-6.el7.noarch 3/22 2019-11-29T12:23:19.995 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python-cherrypy-3.2.2-4.el7.noarch 8/22 2019-11-29T12:23:20.039 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : 2:ceph-osd-15.0.0-7809.g656c8e8.el7.x86_64 4/22 2019-11-29T12:23:20.355 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python-werkzeug-0.9.1-2.el7.noarch 9/22 2019-11-29T12:23:20.484 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python-tempita-0.5.1-6.el7.noarch 5/22 2019-11-29T12:23:20.865 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python-paste-1.7.5.1-9.20111221hg1498.el7.noarch 6/22 2019-11-29T12:23:20.904 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python-singledispatch-3.4.0.2-2.el7.noarch 10/22 2019-11-29T12:23:21.295 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python-beaker-1.5.4-10.el7.noarch 7/22 2019-11-29T12:23:21.342 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : 2:ceph-mds-15.0.0-7809.g656c8e8.el7.x86_64 11/22 2019-11-29T12:23:21.622 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python2-six-1.9.0-0.el7.noarch 12/22 2019-11-29T12:23:21.802 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python-cherrypy-3.2.2-4.el7.noarch 8/22 2019-11-29T12:23:21.968 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python2-bcrypt-3.1.6-2.el7.x86_64 13/22 2019-11-29T12:23:22.096 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python-werkzeug-0.9.1-2.el7.noarch 9/22 2019-11-29T12:23:22.342 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python-urllib3-1.10.2-7.el7.noarch 14/22 2019-11-29T12:23:22.657 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python-singledispatch-3.4.0.2-2.el7.noarch 10/22 2019-11-29T12:23:23.035 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : 2:ceph-mds-15.0.0-7809.g656c8e8.el7.x86_64 11/22 2019-11-29T12:23:23.211 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python-requests-2.6.0-7.el7_7.noarch 15/22 2019-11-29T12:23:23.256 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python2-six-1.9.0-0.el7.noarch 12/22 2019-11-29T12:23:23.604 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : 2:ceph-mon-15.0.0-7809.g656c8e8.el7.x86_64 16/22 2019-11-29T12:23:23.735 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python2-bcrypt-3.1.6-2.el7.x86_64 13/22 2019-11-29T12:23:23.987 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python-markupsafe-0.11-10.el7.x86_64 17/22 2019-11-29T12:23:24.076 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python-urllib3-1.10.2-7.el7.noarch 14/22 2019-11-29T12:23:24.317 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python-mako-0.8.1-2.el7.noarch 18/22 2019-11-29T12:23:24.738 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python-simplegeneric-0.8-7.el7.noarch 19/22 2019-11-29T12:23:24.855 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python-requests-2.6.0-7.el7_7.noarch 15/22 2019-11-29T12:23:25.222 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : 2:ceph-mon-15.0.0-7809.g656c8e8.el7.x86_64 16/22 2019-11-29T12:23:25.563 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python-markupsafe-0.11-10.el7.x86_64 17/22 2019-11-29T12:23:25.578 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python-pecan-0.4.5-2.el7.noarch 20/22 2019-11-29T12:23:25.977 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python-mako-0.8.1-2.el7.noarch 18/22 2019-11-29T12:23:26.030 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : 2:ceph-mgr-15.0.0-7809.g656c8e8.el7.x86_64 21/22 2019-11-29T12:23:26.360 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : 2:ceph-15.0.0-7809.g656c8e8.el7.x86_64 22/22 2019-11-29T12:23:26.403 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python-simplegeneric-0.8-7.el7.noarch 19/22 2019-11-29T12:23:26.479 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python-simplegeneric-0.8-7.el7.noarch 1/22 2019-11-29T12:23:26.555 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python-markupsafe-0.11-10.el7.x86_64 2/22 2019-11-29T12:23:26.664 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : pyOpenSSL-0.13.1-4.el7.x86_64 3/22 2019-11-29T12:23:26.816 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python2-bcrypt-3.1.6-2.el7.x86_64 4/22 2019-11-29T12:23:26.915 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : 2:ceph-mon-15.0.0-7809.g656c8e8.el7.x86_64 5/22 2019-11-29T12:23:27.040 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python-urllib3-1.10.2-7.el7.noarch 6/22 2019-11-29T12:23:27.149 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python-mako-0.8.1-2.el7.noarch 7/22 2019-11-29T12:23:27.240 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python-pecan-0.4.5-2.el7.noarch 20/22 2019-11-29T12:23:27.303 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python2-six-1.9.0-0.el7.noarch 8/22 2019-11-29T12:23:27.665 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : 2:ceph-mgr-15.0.0-7809.g656c8e8.el7.x86_64 21/22 2019-11-29T12:23:27.808 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : 2:ceph-15.0.0-7809.g656c8e8.el7.x86_64 9/22 2019-11-29T12:23:27.945 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : 2:ceph-15.0.0-7809.g656c8e8.el7.x86_64 22/22 2019-11-29T12:23:27.950 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : 2:ceph-mds-15.0.0-7809.g656c8e8.el7.x86_64 10/22 2019-11-29T12:23:28.031 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python-simplegeneric-0.8-7.el7.noarch 1/22 2019-11-29T12:23:28.076 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python-requests-2.6.0-7.el7_7.noarch 11/22 2019-11-29T12:23:28.115 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python-markupsafe-0.11-10.el7.x86_64 2/22 2019-11-29T12:23:28.210 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python-pecan-0.4.5-2.el7.noarch 12/22 2019-11-29T12:23:28.215 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : pyOpenSSL-0.13.1-4.el7.x86_64 3/22 2019-11-29T12:23:28.327 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python-singledispatch-3.4.0.2-2.el7.noarch 13/22 2019-11-29T12:23:28.332 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python2-bcrypt-3.1.6-2.el7.x86_64 4/22 2019-11-29T12:23:28.466 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : 2:ceph-mon-15.0.0-7809.g656c8e8.el7.x86_64 5/22 2019-11-29T12:23:28.494 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : 2:ceph-mgr-15.0.0-7809.g656c8e8.el7.x86_64 14/22 2019-11-29T12:23:28.567 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python-urllib3-1.10.2-7.el7.noarch 6/22 2019-11-29T12:23:28.627 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python-paste-1.7.5.1-9.20111221hg1498.el7.noarch 15/22 2019-11-29T12:23:28.659 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python-mako-0.8.1-2.el7.noarch 7/22 2019-11-29T12:23:28.768 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python2-six-1.9.0-0.el7.noarch 8/22 2019-11-29T12:23:28.786 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python-webob-1.2.3-7.el7.noarch 16/22 2019-11-29T12:23:28.876 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : 2:ceph-15.0.0-7809.g656c8e8.el7.x86_64 9/22 2019-11-29T12:23:28.879 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python-werkzeug-0.9.1-2.el7.noarch 17/22 2019-11-29T12:23:28.996 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python-cherrypy-3.2.2-4.el7.noarch 18/22 2019-11-29T12:23:29.027 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : 2:ceph-mds-15.0.0-7809.g656c8e8.el7.x86_64 10/22 2019-11-29T12:23:29.105 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python-beaker-1.5.4-10.el7.noarch 19/22 2019-11-29T12:23:29.144 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python-requests-2.6.0-7.el7_7.noarch 11/22 2019-11-29T12:23:29.222 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python-tempita-0.5.1-6.el7.noarch 20/22 2019-11-29T12:23:29.244 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python-pecan-0.4.5-2.el7.noarch 12/22 2019-11-29T12:23:29.331 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python-webtest-1.3.4-6.el7.noarch 21/22 2019-11-29T12:23:29.353 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python-singledispatch-3.4.0.2-2.el7.noarch 13/22 2019-11-29T12:23:29.479 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : 2:ceph-mgr-15.0.0-7809.g656c8e8.el7.x86_64 14/22 2019-11-29T12:23:29.613 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python-paste-1.7.5.1-9.20111221hg1498.el7.noarch 15/22 2019-11-29T12:23:29.713 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python-webob-1.2.3-7.el7.noarch 16/22 2019-11-29T12:23:29.768 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : 2:ceph-osd-15.0.0-7809.g656c8e8.el7.x86_64 22/22 2019-11-29T12:23:29.768 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:23:29.768 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2019-11-29T12:23:29.768 INFO:teuthology.orchestra.run.smithi062.stdout: ceph.x86_64 2:15.0.0-7809.g656c8e8.el7 2019-11-29T12:23:29.768 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:23:29.769 INFO:teuthology.orchestra.run.smithi062.stdout:Dependency Installed: 2019-11-29T12:23:29.769 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mds.x86_64 2:15.0.0-7809.g656c8e8.el7 2019-11-29T12:23:29.769 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr.x86_64 2:15.0.0-7809.g656c8e8.el7 2019-11-29T12:23:29.769 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mon.x86_64 2:15.0.0-7809.g656c8e8.el7 2019-11-29T12:23:29.769 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-osd.x86_64 2:15.0.0-7809.g656c8e8.el7 2019-11-29T12:23:29.769 INFO:teuthology.orchestra.run.smithi062.stdout: pyOpenSSL.x86_64 0:0.13.1-4.el7 2019-11-29T12:23:29.770 INFO:teuthology.orchestra.run.smithi062.stdout: python-beaker.noarch 0:1.5.4-10.el7 2019-11-29T12:23:29.770 INFO:teuthology.orchestra.run.smithi062.stdout: python-cherrypy.noarch 0:3.2.2-4.el7 2019-11-29T12:23:29.770 INFO:teuthology.orchestra.run.smithi062.stdout: python-mako.noarch 0:0.8.1-2.el7 2019-11-29T12:23:29.770 INFO:teuthology.orchestra.run.smithi062.stdout: python-markupsafe.x86_64 0:0.11-10.el7 2019-11-29T12:23:29.770 INFO:teuthology.orchestra.run.smithi062.stdout: python-paste.noarch 0:1.7.5.1-9.20111221hg1498.el7 2019-11-29T12:23:29.770 INFO:teuthology.orchestra.run.smithi062.stdout: python-pecan.noarch 0:0.4.5-2.el7 2019-11-29T12:23:29.771 INFO:teuthology.orchestra.run.smithi062.stdout: python-requests.noarch 0:2.6.0-7.el7_7 2019-11-29T12:23:29.771 INFO:teuthology.orchestra.run.smithi062.stdout: python-simplegeneric.noarch 0:0.8-7.el7 2019-11-29T12:23:29.771 INFO:teuthology.orchestra.run.smithi062.stdout: python-singledispatch.noarch 0:3.4.0.2-2.el7 2019-11-29T12:23:29.771 INFO:teuthology.orchestra.run.smithi062.stdout: python-tempita.noarch 0:0.5.1-6.el7 2019-11-29T12:23:29.771 INFO:teuthology.orchestra.run.smithi062.stdout: python-urllib3.noarch 0:1.10.2-7.el7 2019-11-29T12:23:29.771 INFO:teuthology.orchestra.run.smithi062.stdout: python-webob.noarch 0:1.2.3-7.el7 2019-11-29T12:23:29.772 INFO:teuthology.orchestra.run.smithi062.stdout: python-webtest.noarch 0:1.3.4-6.el7 2019-11-29T12:23:29.772 INFO:teuthology.orchestra.run.smithi062.stdout: python-werkzeug.noarch 0:0.9.1-2.el7 2019-11-29T12:23:29.772 INFO:teuthology.orchestra.run.smithi062.stdout: python2-bcrypt.x86_64 0:3.1.6-2.el7 2019-11-29T12:23:29.772 INFO:teuthology.orchestra.run.smithi062.stdout: python2-six.noarch 0:1.9.0-0.el7 2019-11-29T12:23:29.772 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:23:29.772 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2019-11-29T12:23:29.797 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python-werkzeug-0.9.1-2.el7.noarch 17/22 2019-11-29T12:23:29.889 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python-cherrypy-3.2.2-4.el7.noarch 18/22 2019-11-29T12:23:29.902 INFO:teuthology.orchestra.run.smithi062:> sudo yum -y install ceph-daemon 2019-11-29T12:23:29.990 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python-beaker-1.5.4-10.el7.noarch 19/22 2019-11-29T12:23:30.195 INFO:teuthology.orchestra.run.smithi062.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-29T12:23:30.232 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python-tempita-0.5.1-6.el7.noarch 20/22 2019-11-29T12:23:30.242 INFO:teuthology.orchestra.run.smithi062.stdout:Loading mirror speeds from cached hostfile 2019-11-29T12:23:30.243 INFO:teuthology.orchestra.run.smithi062.stdout: * base: mirror.us-midwest-1.nexcess.net 2019-11-29T12:23:30.244 INFO:teuthology.orchestra.run.smithi062.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-29T12:23:30.244 INFO:teuthology.orchestra.run.smithi062.stdout: * extras: www.gtlib.gatech.edu 2019-11-29T12:23:30.244 INFO:teuthology.orchestra.run.smithi062.stdout: * updates: reflector.westga.edu 2019-11-29T12:23:30.336 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python-webtest-1.3.4-6.el7.noarch 21/22 2019-11-29T12:23:30.811 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : 2:ceph-osd-15.0.0-7809.g656c8e8.el7.x86_64 22/22 2019-11-29T12:23:30.811 INFO:teuthology.orchestra.run.smithi022.stdout: 2019-11-29T12:23:30.811 INFO:teuthology.orchestra.run.smithi022.stdout:Installed: 2019-11-29T12:23:30.811 INFO:teuthology.orchestra.run.smithi022.stdout: ceph.x86_64 2:15.0.0-7809.g656c8e8.el7 2019-11-29T12:23:30.811 INFO:teuthology.orchestra.run.smithi022.stdout: 2019-11-29T12:23:30.811 INFO:teuthology.orchestra.run.smithi022.stdout:Dependency Installed: 2019-11-29T12:23:30.812 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mds.x86_64 2:15.0.0-7809.g656c8e8.el7 2019-11-29T12:23:30.812 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr.x86_64 2:15.0.0-7809.g656c8e8.el7 2019-11-29T12:23:30.812 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mon.x86_64 2:15.0.0-7809.g656c8e8.el7 2019-11-29T12:23:30.812 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-osd.x86_64 2:15.0.0-7809.g656c8e8.el7 2019-11-29T12:23:30.812 INFO:teuthology.orchestra.run.smithi022.stdout: pyOpenSSL.x86_64 0:0.13.1-4.el7 2019-11-29T12:23:30.812 INFO:teuthology.orchestra.run.smithi022.stdout: python-beaker.noarch 0:1.5.4-10.el7 2019-11-29T12:23:30.812 INFO:teuthology.orchestra.run.smithi022.stdout: python-cherrypy.noarch 0:3.2.2-4.el7 2019-11-29T12:23:30.813 INFO:teuthology.orchestra.run.smithi022.stdout: python-mako.noarch 0:0.8.1-2.el7 2019-11-29T12:23:30.813 INFO:teuthology.orchestra.run.smithi022.stdout: python-markupsafe.x86_64 0:0.11-10.el7 2019-11-29T12:23:30.813 INFO:teuthology.orchestra.run.smithi022.stdout: python-paste.noarch 0:1.7.5.1-9.20111221hg1498.el7 2019-11-29T12:23:30.813 INFO:teuthology.orchestra.run.smithi022.stdout: python-pecan.noarch 0:0.4.5-2.el7 2019-11-29T12:23:30.813 INFO:teuthology.orchestra.run.smithi022.stdout: python-requests.noarch 0:2.6.0-7.el7_7 2019-11-29T12:23:30.813 INFO:teuthology.orchestra.run.smithi022.stdout: python-simplegeneric.noarch 0:0.8-7.el7 2019-11-29T12:23:30.813 INFO:teuthology.orchestra.run.smithi022.stdout: python-singledispatch.noarch 0:3.4.0.2-2.el7 2019-11-29T12:23:30.814 INFO:teuthology.orchestra.run.smithi022.stdout: python-tempita.noarch 0:0.5.1-6.el7 2019-11-29T12:23:30.814 INFO:teuthology.orchestra.run.smithi022.stdout: python-urllib3.noarch 0:1.10.2-7.el7 2019-11-29T12:23:30.814 INFO:teuthology.orchestra.run.smithi022.stdout: python-webob.noarch 0:1.2.3-7.el7 2019-11-29T12:23:30.814 INFO:teuthology.orchestra.run.smithi022.stdout: python-webtest.noarch 0:1.3.4-6.el7 2019-11-29T12:23:30.814 INFO:teuthology.orchestra.run.smithi022.stdout: python-werkzeug.noarch 0:0.9.1-2.el7 2019-11-29T12:23:30.814 INFO:teuthology.orchestra.run.smithi022.stdout: python2-bcrypt.x86_64 0:3.1.6-2.el7 2019-11-29T12:23:30.814 INFO:teuthology.orchestra.run.smithi022.stdout: python2-six.noarch 0:1.9.0-0.el7 2019-11-29T12:23:30.814 INFO:teuthology.orchestra.run.smithi022.stdout: 2019-11-29T12:23:30.815 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2019-11-29T12:23:30.916 INFO:teuthology.orchestra.run.smithi062.stdout:7 packages excluded due to repository priority protections 2019-11-29T12:23:30.941 INFO:teuthology.orchestra.run.smithi022:> sudo yum -y install ceph-daemon 2019-11-29T12:23:31.243 INFO:teuthology.orchestra.run.smithi022.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-29T12:23:31.277 INFO:teuthology.orchestra.run.smithi062.stdout:Resolving Dependencies 2019-11-29T12:23:31.278 INFO:teuthology.orchestra.run.smithi062.stdout:--> Running transaction check 2019-11-29T12:23:31.278 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package ceph-daemon.x86_64 2:15.0.0-7809.g656c8e8.el7 will be installed 2019-11-29T12:23:31.289 INFO:teuthology.orchestra.run.smithi022.stdout:Loading mirror speeds from cached hostfile 2019-11-29T12:23:31.291 INFO:teuthology.orchestra.run.smithi022.stdout: * base: mirror.us-midwest-1.nexcess.net 2019-11-29T12:23:31.291 INFO:teuthology.orchestra.run.smithi022.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-29T12:23:31.291 INFO:teuthology.orchestra.run.smithi022.stdout: * extras: www.gtlib.gatech.edu 2019-11-29T12:23:31.292 INFO:teuthology.orchestra.run.smithi022.stdout: * updates: reflector.westga.edu 2019-11-29T12:23:31.669 INFO:teuthology.orchestra.run.smithi062.stdout:--> Finished Dependency Resolution 2019-11-29T12:23:31.905 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:23:31.905 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies Resolved 2019-11-29T12:23:31.906 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:23:31.906 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2019-11-29T12:23:31.906 INFO:teuthology.orchestra.run.smithi062.stdout: Package Arch Version Repository 2019-11-29T12:23:31.906 INFO:teuthology.orchestra.run.smithi062.stdout: Size 2019-11-29T12:23:31.906 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2019-11-29T12:23:31.907 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2019-11-29T12:23:31.907 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-daemon x86_64 2:15.0.0-7809.g656c8e8.el7 ceph 17 k 2019-11-29T12:23:31.907 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:23:31.907 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2019-11-29T12:23:31.907 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2019-11-29T12:23:31.907 INFO:teuthology.orchestra.run.smithi062.stdout:Install 1 Package 2019-11-29T12:23:31.907 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:23:31.908 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 17 k 2019-11-29T12:23:31.908 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 68 k 2019-11-29T12:23:31.908 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading packages: 2019-11-29T12:23:31.958 INFO:teuthology.orchestra.run.smithi022.stdout:7 packages excluded due to repository priority protections 2019-11-29T12:23:32.229 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2019-11-29T12:23:32.236 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2019-11-29T12:23:32.237 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded 2019-11-29T12:23:32.238 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2019-11-29T12:23:32.306 INFO:teuthology.orchestra.run.smithi022.stdout:Resolving Dependencies 2019-11-29T12:23:32.306 INFO:teuthology.orchestra.run.smithi022.stdout:--> Running transaction check 2019-11-29T12:23:32.307 INFO:teuthology.orchestra.run.smithi022.stdout:---> Package ceph-daemon.x86_64 2:15.0.0-7809.g656c8e8.el7 will be installed 2019-11-29T12:23:32.693 INFO:teuthology.orchestra.run.smithi022.stdout:--> Finished Dependency Resolution 2019-11-29T12:23:32.925 INFO:teuthology.orchestra.run.smithi022.stdout: 2019-11-29T12:23:32.926 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies Resolved 2019-11-29T12:23:32.926 INFO:teuthology.orchestra.run.smithi022.stdout: 2019-11-29T12:23:32.927 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2019-11-29T12:23:32.927 INFO:teuthology.orchestra.run.smithi022.stdout: Package Arch Version Repository 2019-11-29T12:23:32.927 INFO:teuthology.orchestra.run.smithi022.stdout: Size 2019-11-29T12:23:32.927 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2019-11-29T12:23:32.927 INFO:teuthology.orchestra.run.smithi022.stdout:Installing: 2019-11-29T12:23:32.927 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-daemon x86_64 2:15.0.0-7809.g656c8e8.el7 ceph 17 k 2019-11-29T12:23:32.928 INFO:teuthology.orchestra.run.smithi022.stdout: 2019-11-29T12:23:32.928 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction Summary 2019-11-29T12:23:32.928 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2019-11-29T12:23:32.928 INFO:teuthology.orchestra.run.smithi022.stdout:Install 1 Package 2019-11-29T12:23:32.928 INFO:teuthology.orchestra.run.smithi022.stdout: 2019-11-29T12:23:32.928 INFO:teuthology.orchestra.run.smithi022.stdout:Total download size: 17 k 2019-11-29T12:23:32.929 INFO:teuthology.orchestra.run.smithi022.stdout:Installed size: 68 k 2019-11-29T12:23:32.929 INFO:teuthology.orchestra.run.smithi022.stdout:Downloading packages: 2019-11-29T12:23:33.165 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : 2:ceph-daemon-15.0.0-7809.g656c8e8.el7.x86_64 1/1 2019-11-29T12:23:33.217 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction check 2019-11-29T12:23:33.224 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction test 2019-11-29T12:23:33.225 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction test succeeded 2019-11-29T12:23:33.226 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction 2019-11-29T12:23:33.630 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : 2:ceph-daemon-15.0.0-7809.g656c8e8.el7.x86_64 1/1 2019-11-29T12:23:33.630 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:23:33.630 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2019-11-29T12:23:33.631 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-daemon.x86_64 2:15.0.0-7809.g656c8e8.el7 2019-11-29T12:23:33.631 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:23:33.631 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2019-11-29T12:23:33.760 INFO:teuthology.orchestra.run.smithi062:> sudo yum -y install ceph-mgr 2019-11-29T12:23:34.036 INFO:teuthology.orchestra.run.smithi062.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-29T12:23:34.082 INFO:teuthology.orchestra.run.smithi062.stdout:Loading mirror speeds from cached hostfile 2019-11-29T12:23:34.083 INFO:teuthology.orchestra.run.smithi062.stdout: * base: mirror.us-midwest-1.nexcess.net 2019-11-29T12:23:34.083 INFO:teuthology.orchestra.run.smithi062.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-29T12:23:34.083 INFO:teuthology.orchestra.run.smithi062.stdout: * extras: www.gtlib.gatech.edu 2019-11-29T12:23:34.084 INFO:teuthology.orchestra.run.smithi062.stdout: * updates: reflector.westga.edu 2019-11-29T12:23:34.186 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : 2:ceph-daemon-15.0.0-7809.g656c8e8.el7.x86_64 1/1 2019-11-29T12:23:34.667 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : 2:ceph-daemon-15.0.0-7809.g656c8e8.el7.x86_64 1/1 2019-11-29T12:23:34.667 INFO:teuthology.orchestra.run.smithi022.stdout: 2019-11-29T12:23:34.667 INFO:teuthology.orchestra.run.smithi022.stdout:Installed: 2019-11-29T12:23:34.667 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-daemon.x86_64 2:15.0.0-7809.g656c8e8.el7 2019-11-29T12:23:34.667 INFO:teuthology.orchestra.run.smithi022.stdout: 2019-11-29T12:23:34.667 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2019-11-29T12:23:34.752 INFO:teuthology.orchestra.run.smithi062.stdout:7 packages excluded due to repository priority protections 2019-11-29T12:23:34.797 INFO:teuthology.orchestra.run.smithi022:> sudo yum -y install ceph-mgr 2019-11-29T12:23:35.071 INFO:teuthology.orchestra.run.smithi022.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-29T12:23:35.109 INFO:teuthology.orchestra.run.smithi062.stdout:Package 2:ceph-mgr-15.0.0-7809.g656c8e8.el7.x86_64 already installed and latest version 2019-11-29T12:23:35.110 INFO:teuthology.orchestra.run.smithi062.stdout:Nothing to do 2019-11-29T12:23:35.115 INFO:teuthology.orchestra.run.smithi022.stdout:Loading mirror speeds from cached hostfile 2019-11-29T12:23:35.116 INFO:teuthology.orchestra.run.smithi022.stdout: * base: mirror.us-midwest-1.nexcess.net 2019-11-29T12:23:35.116 INFO:teuthology.orchestra.run.smithi022.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-29T12:23:35.117 INFO:teuthology.orchestra.run.smithi022.stdout: * extras: www.gtlib.gatech.edu 2019-11-29T12:23:35.117 INFO:teuthology.orchestra.run.smithi022.stdout: * updates: reflector.westga.edu 2019-11-29T12:23:35.171 INFO:teuthology.orchestra.run.smithi062:> sudo yum -y install ceph-mgr-dashboard 2019-11-29T12:23:35.333 INFO:teuthology.orchestra.run.smithi062.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-29T12:23:35.370 INFO:teuthology.orchestra.run.smithi062.stdout:Loading mirror speeds from cached hostfile 2019-11-29T12:23:35.371 INFO:teuthology.orchestra.run.smithi062.stdout: * base: mirror.us-midwest-1.nexcess.net 2019-11-29T12:23:35.372 INFO:teuthology.orchestra.run.smithi062.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-29T12:23:35.372 INFO:teuthology.orchestra.run.smithi062.stdout: * extras: www.gtlib.gatech.edu 2019-11-29T12:23:35.372 INFO:teuthology.orchestra.run.smithi062.stdout: * updates: reflector.westga.edu 2019-11-29T12:23:35.787 INFO:teuthology.orchestra.run.smithi022.stdout:7 packages excluded due to repository priority protections 2019-11-29T12:23:35.987 INFO:teuthology.orchestra.run.smithi062.stdout:7 packages excluded due to repository priority protections 2019-11-29T12:23:36.134 INFO:teuthology.orchestra.run.smithi022.stdout:Package 2:ceph-mgr-15.0.0-7809.g656c8e8.el7.x86_64 already installed and latest version 2019-11-29T12:23:36.134 INFO:teuthology.orchestra.run.smithi022.stdout:Nothing to do 2019-11-29T12:23:36.195 INFO:teuthology.orchestra.run.smithi022:> sudo yum -y install ceph-mgr-dashboard 2019-11-29T12:23:36.326 INFO:teuthology.orchestra.run.smithi062.stdout:Resolving Dependencies 2019-11-29T12:23:36.327 INFO:teuthology.orchestra.run.smithi062.stdout:--> Running transaction check 2019-11-29T12:23:36.327 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package ceph-mgr-dashboard.noarch 2:15.0.0-7809.g656c8e8.el7 will be installed 2019-11-29T12:23:36.330 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: ceph-grafana-dashboards = 2:15.0.0-7809.g656c8e8.el7 for package: 2:ceph-mgr-dashboard-15.0.0-7809.g656c8e8.el7.noarch 2019-11-29T12:23:36.360 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: python-routes for package: 2:ceph-mgr-dashboard-15.0.0-7809.g656c8e8.el7.noarch 2019-11-29T12:23:36.361 INFO:teuthology.orchestra.run.smithi062.stdout:--> Running transaction check 2019-11-29T12:23:36.362 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package ceph-grafana-dashboards.noarch 2:15.0.0-7809.g656c8e8.el7 will be installed 2019-11-29T12:23:36.362 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package python-routes.noarch 0:1.13-2.el7 will be installed 2019-11-29T12:23:36.362 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: python-repoze-lru for package: python-routes-1.13-2.el7.noarch 2019-11-29T12:23:36.363 INFO:teuthology.orchestra.run.smithi062.stdout:--> Running transaction check 2019-11-29T12:23:36.363 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package python-repoze-lru.noarch 0:0.4-3.el7 will be installed 2019-11-29T12:23:36.403 INFO:teuthology.orchestra.run.smithi022.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-29T12:23:36.441 INFO:teuthology.orchestra.run.smithi022.stdout:Loading mirror speeds from cached hostfile 2019-11-29T12:23:36.442 INFO:teuthology.orchestra.run.smithi022.stdout: * base: mirror.us-midwest-1.nexcess.net 2019-11-29T12:23:36.443 INFO:teuthology.orchestra.run.smithi022.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-29T12:23:36.443 INFO:teuthology.orchestra.run.smithi022.stdout: * extras: www.gtlib.gatech.edu 2019-11-29T12:23:36.443 INFO:teuthology.orchestra.run.smithi022.stdout: * updates: reflector.westga.edu 2019-11-29T12:23:36.750 INFO:teuthology.orchestra.run.smithi062.stdout:--> Finished Dependency Resolution 2019-11-29T12:23:36.981 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:23:36.981 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies Resolved 2019-11-29T12:23:36.982 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:23:36.982 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2019-11-29T12:23:36.982 INFO:teuthology.orchestra.run.smithi062.stdout: Package Arch Version Repository Size 2019-11-29T12:23:36.982 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2019-11-29T12:23:36.982 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2019-11-29T12:23:36.983 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-dashboard noarch 2:15.0.0-7809.g656c8e8.el7 ceph-noarch 3.9 M 2019-11-29T12:23:36.983 INFO:teuthology.orchestra.run.smithi062.stdout:Installing for dependencies: 2019-11-29T12:23:36.983 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-grafana-dashboards noarch 2:15.0.0-7809.g656c8e8.el7 ceph-noarch 18 k 2019-11-29T12:23:36.983 INFO:teuthology.orchestra.run.smithi062.stdout: python-repoze-lru noarch 0.4-3.el7 epel 13 k 2019-11-29T12:23:36.983 INFO:teuthology.orchestra.run.smithi062.stdout: python-routes noarch 1.13-2.el7 epel 640 k 2019-11-29T12:23:36.983 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:23:36.983 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2019-11-29T12:23:36.983 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2019-11-29T12:23:36.984 INFO:teuthology.orchestra.run.smithi062.stdout:Install 1 Package (+3 Dependent packages) 2019-11-29T12:23:36.984 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:23:36.984 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 4.6 M 2019-11-29T12:23:36.984 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 20 M 2019-11-29T12:23:36.984 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading packages: 2019-11-29T12:23:37.068 INFO:teuthology.orchestra.run.smithi022.stdout:7 packages excluded due to repository priority protections 2019-11-29T12:23:37.406 INFO:teuthology.orchestra.run.smithi022.stdout:Resolving Dependencies 2019-11-29T12:23:37.406 INFO:teuthology.orchestra.run.smithi022.stdout:--> Running transaction check 2019-11-29T12:23:37.406 INFO:teuthology.orchestra.run.smithi022.stdout:---> Package ceph-mgr-dashboard.noarch 2:15.0.0-7809.g656c8e8.el7 will be installed 2019-11-29T12:23:37.409 INFO:teuthology.orchestra.run.smithi022.stdout:--> Processing Dependency: ceph-grafana-dashboards = 2:15.0.0-7809.g656c8e8.el7 for package: 2:ceph-mgr-dashboard-15.0.0-7809.g656c8e8.el7.noarch 2019-11-29T12:23:37.440 INFO:teuthology.orchestra.run.smithi022.stdout:--> Processing Dependency: python-routes for package: 2:ceph-mgr-dashboard-15.0.0-7809.g656c8e8.el7.noarch 2019-11-29T12:23:37.441 INFO:teuthology.orchestra.run.smithi022.stdout:--> Running transaction check 2019-11-29T12:23:37.441 INFO:teuthology.orchestra.run.smithi022.stdout:---> Package ceph-grafana-dashboards.noarch 2:15.0.0-7809.g656c8e8.el7 will be installed 2019-11-29T12:23:37.441 INFO:teuthology.orchestra.run.smithi022.stdout:---> Package python-routes.noarch 0:1.13-2.el7 will be installed 2019-11-29T12:23:37.442 INFO:teuthology.orchestra.run.smithi022.stdout:--> Processing Dependency: python-repoze-lru for package: python-routes-1.13-2.el7.noarch 2019-11-29T12:23:37.443 INFO:teuthology.orchestra.run.smithi022.stdout:--> Running transaction check 2019-11-29T12:23:37.443 INFO:teuthology.orchestra.run.smithi022.stdout:---> Package python-repoze-lru.noarch 0:0.4-3.el7 will be installed 2019-11-29T12:23:37.747 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2019-11-29T12:23:37.747 INFO:teuthology.orchestra.run.smithi062.stdout:Total 6.0 MB/s | 4.6 MB 00:00 2019-11-29T12:23:37.754 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2019-11-29T12:23:37.764 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2019-11-29T12:23:37.829 INFO:teuthology.orchestra.run.smithi022.stdout:--> Finished Dependency Resolution 2019-11-29T12:23:38.060 INFO:teuthology.orchestra.run.smithi022.stdout: 2019-11-29T12:23:38.060 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies Resolved 2019-11-29T12:23:38.061 INFO:teuthology.orchestra.run.smithi022.stdout: 2019-11-29T12:23:38.061 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2019-11-29T12:23:38.061 INFO:teuthology.orchestra.run.smithi022.stdout: Package Arch Version Repository Size 2019-11-29T12:23:38.061 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2019-11-29T12:23:38.062 INFO:teuthology.orchestra.run.smithi022.stdout:Installing: 2019-11-29T12:23:38.062 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-dashboard noarch 2:15.0.0-7809.g656c8e8.el7 ceph-noarch 3.9 M 2019-11-29T12:23:38.062 INFO:teuthology.orchestra.run.smithi022.stdout:Installing for dependencies: 2019-11-29T12:23:38.062 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-grafana-dashboards noarch 2:15.0.0-7809.g656c8e8.el7 ceph-noarch 18 k 2019-11-29T12:23:38.062 INFO:teuthology.orchestra.run.smithi022.stdout: python-repoze-lru noarch 0.4-3.el7 epel 13 k 2019-11-29T12:23:38.062 INFO:teuthology.orchestra.run.smithi022.stdout: python-routes noarch 1.13-2.el7 epel 640 k 2019-11-29T12:23:38.062 INFO:teuthology.orchestra.run.smithi022.stdout: 2019-11-29T12:23:38.063 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction Summary 2019-11-29T12:23:38.063 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2019-11-29T12:23:38.063 INFO:teuthology.orchestra.run.smithi022.stdout:Install 1 Package (+3 Dependent packages) 2019-11-29T12:23:38.063 INFO:teuthology.orchestra.run.smithi022.stdout: 2019-11-29T12:23:38.063 INFO:teuthology.orchestra.run.smithi022.stdout:Total download size: 4.6 M 2019-11-29T12:23:38.063 INFO:teuthology.orchestra.run.smithi022.stdout:Installed size: 20 M 2019-11-29T12:23:38.063 INFO:teuthology.orchestra.run.smithi022.stdout:Downloading packages: 2019-11-29T12:23:38.108 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded 2019-11-29T12:23:38.110 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2019-11-29T12:23:38.685 INFO:teuthology.orchestra.run.smithi022.stdout:-------------------------------------------------------------------------------- 2019-11-29T12:23:38.685 INFO:teuthology.orchestra.run.smithi022.stdout:Total 7.3 MB/s | 4.6 MB 00:00 2019-11-29T12:23:38.691 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction check 2019-11-29T12:23:38.701 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction test 2019-11-29T12:23:38.896 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction test succeeded 2019-11-29T12:23:38.897 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction 2019-11-29T12:23:39.067 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : 2:ceph-grafana-dashboards-15.0.0-7809.g656c8e8.el7.noarch 1/4 2019-11-29T12:23:39.514 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python-repoze-lru-0.4-3.el7.noarch 2/4 2019-11-29T12:23:39.552 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : 2:ceph-grafana-dashboards-15.0.0-7809.g656c8e8.el7.noarch 1/4 2019-11-29T12:23:39.993 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python-repoze-lru-0.4-3.el7.noarch 2/4 2019-11-29T12:23:40.719 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python-routes-1.13-2.el7.noarch 3/4 2019-11-29T12:23:41.172 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python-routes-1.13-2.el7.noarch 3/4 2019-11-29T12:23:41.224 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : 2:ceph-mgr-dashboard-15.0.0-7809.g656c8e8.el7.noarch 4/4 2019-11-29T12:23:41.350 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python-repoze-lru-0.4-3.el7.noarch 1/4 2019-11-29T12:23:41.526 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : 2:ceph-mgr-dashboard-15.0.0-7809.g656c8e8.el7.noarch 2/4 2019-11-29T12:23:41.634 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : 2:ceph-mgr-dashboard-15.0.0-7809.g656c8e8.el7.noarch 4/4 2019-11-29T12:23:41.679 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : 2:ceph-grafana-dashboards-15.0.0-7809.g656c8e8.el7.noarch 3/4 2019-11-29T12:23:42.204 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python-routes-1.13-2.el7.noarch 4/4 2019-11-29T12:23:42.204 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:23:42.204 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2019-11-29T12:23:42.204 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-dashboard.noarch 2:15.0.0-7809.g656c8e8.el7 2019-11-29T12:23:42.204 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:23:42.204 INFO:teuthology.orchestra.run.smithi062.stdout:Dependency Installed: 2019-11-29T12:23:42.205 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-grafana-dashboards.noarch 2:15.0.0-7809.g656c8e8.el7 2019-11-29T12:23:42.205 INFO:teuthology.orchestra.run.smithi062.stdout: python-repoze-lru.noarch 0:0.4-3.el7 2019-11-29T12:23:42.205 INFO:teuthology.orchestra.run.smithi062.stdout: python-routes.noarch 0:1.13-2.el7 2019-11-29T12:23:42.205 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:23:42.205 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2019-11-29T12:23:42.342 INFO:teuthology.orchestra.run.smithi062:> sudo yum -y install ceph-mgr-diskprediction-cloud 2019-11-29T12:23:42.587 INFO:teuthology.orchestra.run.smithi062.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-29T12:23:42.629 INFO:teuthology.orchestra.run.smithi062.stdout:Loading mirror speeds from cached hostfile 2019-11-29T12:23:42.630 INFO:teuthology.orchestra.run.smithi062.stdout: * base: mirror.us-midwest-1.nexcess.net 2019-11-29T12:23:42.631 INFO:teuthology.orchestra.run.smithi062.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-29T12:23:42.631 INFO:teuthology.orchestra.run.smithi062.stdout: * extras: www.gtlib.gatech.edu 2019-11-29T12:23:42.631 INFO:teuthology.orchestra.run.smithi062.stdout: * updates: reflector.westga.edu 2019-11-29T12:23:42.711 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python-repoze-lru-0.4-3.el7.noarch 1/4 2019-11-29T12:23:42.820 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : 2:ceph-mgr-dashboard-15.0.0-7809.g656c8e8.el7.noarch 2/4 2019-11-29T12:23:42.946 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : 2:ceph-grafana-dashboards-15.0.0-7809.g656c8e8.el7.noarch 3/4 2019-11-29T12:23:43.307 INFO:teuthology.orchestra.run.smithi062.stdout:7 packages excluded due to repository priority protections 2019-11-29T12:23:43.455 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python-routes-1.13-2.el7.noarch 4/4 2019-11-29T12:23:43.456 INFO:teuthology.orchestra.run.smithi022.stdout: 2019-11-29T12:23:43.456 INFO:teuthology.orchestra.run.smithi022.stdout:Installed: 2019-11-29T12:23:43.456 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-dashboard.noarch 2:15.0.0-7809.g656c8e8.el7 2019-11-29T12:23:43.456 INFO:teuthology.orchestra.run.smithi022.stdout: 2019-11-29T12:23:43.456 INFO:teuthology.orchestra.run.smithi022.stdout:Dependency Installed: 2019-11-29T12:23:43.457 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-grafana-dashboards.noarch 2:15.0.0-7809.g656c8e8.el7 2019-11-29T12:23:43.457 INFO:teuthology.orchestra.run.smithi022.stdout: python-repoze-lru.noarch 0:0.4-3.el7 2019-11-29T12:23:43.457 INFO:teuthology.orchestra.run.smithi022.stdout: python-routes.noarch 0:1.13-2.el7 2019-11-29T12:23:43.457 INFO:teuthology.orchestra.run.smithi022.stdout: 2019-11-29T12:23:43.457 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2019-11-29T12:23:43.586 INFO:teuthology.orchestra.run.smithi022:> sudo yum -y install ceph-mgr-diskprediction-cloud 2019-11-29T12:23:43.655 INFO:teuthology.orchestra.run.smithi062.stdout:Resolving Dependencies 2019-11-29T12:23:43.656 INFO:teuthology.orchestra.run.smithi062.stdout:--> Running transaction check 2019-11-29T12:23:43.656 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package ceph-mgr-diskprediction-cloud.noarch 2:15.0.0-7809.g656c8e8.el7 will be installed 2019-11-29T12:23:43.852 INFO:teuthology.orchestra.run.smithi022.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-29T12:23:43.897 INFO:teuthology.orchestra.run.smithi022.stdout:Loading mirror speeds from cached hostfile 2019-11-29T12:23:43.898 INFO:teuthology.orchestra.run.smithi022.stdout: * base: mirror.us-midwest-1.nexcess.net 2019-11-29T12:23:43.898 INFO:teuthology.orchestra.run.smithi022.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-29T12:23:43.899 INFO:teuthology.orchestra.run.smithi022.stdout: * extras: www.gtlib.gatech.edu 2019-11-29T12:23:43.899 INFO:teuthology.orchestra.run.smithi022.stdout: * updates: reflector.westga.edu 2019-11-29T12:23:44.042 INFO:teuthology.orchestra.run.smithi062.stdout:--> Finished Dependency Resolution 2019-11-29T12:23:44.277 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:23:44.277 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies Resolved 2019-11-29T12:23:44.278 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:23:44.278 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2019-11-29T12:23:44.278 INFO:teuthology.orchestra.run.smithi062.stdout: Package Arch Version Repository Size 2019-11-29T12:23:44.278 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2019-11-29T12:23:44.278 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2019-11-29T12:23:44.278 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-diskprediction-cloud 2019-11-29T12:23:44.279 INFO:teuthology.orchestra.run.smithi062.stdout: noarch 2:15.0.0-7809.g656c8e8.el7 ceph-noarch 82 k 2019-11-29T12:23:44.279 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:23:44.279 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2019-11-29T12:23:44.279 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2019-11-29T12:23:44.279 INFO:teuthology.orchestra.run.smithi062.stdout:Install 1 Package 2019-11-29T12:23:44.279 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:23:44.279 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 82 k 2019-11-29T12:23:44.280 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 411 k 2019-11-29T12:23:44.280 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading packages: 2019-11-29T12:23:44.573 INFO:teuthology.orchestra.run.smithi022.stdout:7 packages excluded due to repository priority protections 2019-11-29T12:23:44.586 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2019-11-29T12:23:44.590 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2019-11-29T12:23:44.640 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded 2019-11-29T12:23:44.641 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2019-11-29T12:23:44.921 INFO:teuthology.orchestra.run.smithi022.stdout:Resolving Dependencies 2019-11-29T12:23:44.922 INFO:teuthology.orchestra.run.smithi022.stdout:--> Running transaction check 2019-11-29T12:23:44.922 INFO:teuthology.orchestra.run.smithi022.stdout:---> Package ceph-mgr-diskprediction-cloud.noarch 2:15.0.0-7809.g656c8e8.el7 will be installed 2019-11-29T12:23:45.291 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : 2:ceph-mgr-diskprediction-cloud-15.0.0-7809.g656c8e8.el7.n 1/1 2019-11-29T12:23:45.423 INFO:teuthology.orchestra.run.smithi022.stdout:--> Finished Dependency Resolution 2019-11-29T12:23:45.540 INFO:teuthology.orchestra.run.smithi022.stdout: 2019-11-29T12:23:45.540 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies Resolved 2019-11-29T12:23:45.541 INFO:teuthology.orchestra.run.smithi022.stdout: 2019-11-29T12:23:45.541 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2019-11-29T12:23:45.541 INFO:teuthology.orchestra.run.smithi022.stdout: Package Arch Version Repository Size 2019-11-29T12:23:45.542 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2019-11-29T12:23:45.542 INFO:teuthology.orchestra.run.smithi022.stdout:Installing: 2019-11-29T12:23:45.542 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-diskprediction-cloud 2019-11-29T12:23:45.542 INFO:teuthology.orchestra.run.smithi022.stdout: noarch 2:15.0.0-7809.g656c8e8.el7 ceph-noarch 82 k 2019-11-29T12:23:45.542 INFO:teuthology.orchestra.run.smithi022.stdout: 2019-11-29T12:23:45.542 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction Summary 2019-11-29T12:23:45.542 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2019-11-29T12:23:45.543 INFO:teuthology.orchestra.run.smithi022.stdout:Install 1 Package 2019-11-29T12:23:45.543 INFO:teuthology.orchestra.run.smithi022.stdout: 2019-11-29T12:23:45.543 INFO:teuthology.orchestra.run.smithi022.stdout:Total download size: 82 k 2019-11-29T12:23:45.543 INFO:teuthology.orchestra.run.smithi022.stdout:Installed size: 411 k 2019-11-29T12:23:45.543 INFO:teuthology.orchestra.run.smithi022.stdout:Downloading packages: 2019-11-29T12:23:45.815 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : 2:ceph-mgr-diskprediction-cloud-15.0.0-7809.g656c8e8.el7.n 1/1 2019-11-29T12:23:45.815 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:23:45.815 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2019-11-29T12:23:45.815 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-diskprediction-cloud.noarch 2:15.0.0-7809.g656c8e8.el7 2019-11-29T12:23:45.815 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:23:45.815 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2019-11-29T12:23:45.877 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction check 2019-11-29T12:23:45.881 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction test 2019-11-29T12:23:45.924 INFO:teuthology.orchestra.run.smithi062:> sudo yum -y install ceph-mgr-diskprediction-local 2019-11-29T12:23:45.933 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction test succeeded 2019-11-29T12:23:45.934 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction 2019-11-29T12:23:46.160 INFO:teuthology.orchestra.run.smithi062.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-29T12:23:46.204 INFO:teuthology.orchestra.run.smithi062.stdout:Loading mirror speeds from cached hostfile 2019-11-29T12:23:46.205 INFO:teuthology.orchestra.run.smithi062.stdout: * base: mirror.us-midwest-1.nexcess.net 2019-11-29T12:23:46.205 INFO:teuthology.orchestra.run.smithi062.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-29T12:23:46.206 INFO:teuthology.orchestra.run.smithi062.stdout: * extras: www.gtlib.gatech.edu 2019-11-29T12:23:46.206 INFO:teuthology.orchestra.run.smithi062.stdout: * updates: reflector.westga.edu 2019-11-29T12:23:46.695 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : 2:ceph-mgr-diskprediction-cloud-15.0.0-7809.g656c8e8.el7.n 1/1 2019-11-29T12:23:46.864 INFO:teuthology.orchestra.run.smithi062.stdout:7 packages excluded due to repository priority protections 2019-11-29T12:23:47.192 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : 2:ceph-mgr-diskprediction-cloud-15.0.0-7809.g656c8e8.el7.n 1/1 2019-11-29T12:23:47.193 INFO:teuthology.orchestra.run.smithi022.stdout: 2019-11-29T12:23:47.193 INFO:teuthology.orchestra.run.smithi022.stdout:Installed: 2019-11-29T12:23:47.193 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-diskprediction-cloud.noarch 2:15.0.0-7809.g656c8e8.el7 2019-11-29T12:23:47.193 INFO:teuthology.orchestra.run.smithi022.stdout: 2019-11-29T12:23:47.193 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2019-11-29T12:23:47.210 INFO:teuthology.orchestra.run.smithi062.stdout:Resolving Dependencies 2019-11-29T12:23:47.210 INFO:teuthology.orchestra.run.smithi062.stdout:--> Running transaction check 2019-11-29T12:23:47.211 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package ceph-mgr-diskprediction-local.noarch 2:15.0.0-7809.g656c8e8.el7 will be installed 2019-11-29T12:23:47.213 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: scipy for package: 2:ceph-mgr-diskprediction-local-15.0.0-7809.g656c8e8.el7.noarch 2019-11-29T12:23:47.244 INFO:teuthology.orchestra.run.smithi062.stdout:--> Running transaction check 2019-11-29T12:23:47.244 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package scipy.x86_64 0:0.12.1-6.el7 will be installed 2019-11-29T12:23:47.251 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: f2py for package: scipy-0.12.1-6.el7.x86_64 2019-11-29T12:23:47.252 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: libumfpack.so.5()(64bit) for package: scipy-0.12.1-6.el7.x86_64 2019-11-29T12:23:47.254 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: libamd.so.2()(64bit) for package: scipy-0.12.1-6.el7.x86_64 2019-11-29T12:23:47.255 INFO:teuthology.orchestra.run.smithi062.stdout:--> Running transaction check 2019-11-29T12:23:47.255 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package numpy-f2py.x86_64 1:1.7.1-13.el7 will be installed 2019-11-29T12:23:47.256 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package suitesparse.x86_64 0:4.0.2-10.el7 will be installed 2019-11-29T12:23:47.257 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: libtbbmalloc.so.2()(64bit) for package: suitesparse-4.0.2-10.el7.x86_64 2019-11-29T12:23:47.259 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: libtbb.so.2()(64bit) for package: suitesparse-4.0.2-10.el7.x86_64 2019-11-29T12:23:47.259 INFO:teuthology.orchestra.run.smithi062.stdout:--> Running transaction check 2019-11-29T12:23:47.259 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package tbb.x86_64 0:4.1-9.20130314.el7 will be installed 2019-11-29T12:23:47.315 INFO:teuthology.orchestra.run.smithi022:> sudo yum -y install ceph-mgr-diskprediction-local 2019-11-29T12:23:47.529 INFO:teuthology.orchestra.run.smithi022.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-29T12:23:47.568 INFO:teuthology.orchestra.run.smithi022.stdout:Loading mirror speeds from cached hostfile 2019-11-29T12:23:47.569 INFO:teuthology.orchestra.run.smithi022.stdout: * base: mirror.us-midwest-1.nexcess.net 2019-11-29T12:23:47.570 INFO:teuthology.orchestra.run.smithi022.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-29T12:23:47.570 INFO:teuthology.orchestra.run.smithi022.stdout: * extras: www.gtlib.gatech.edu 2019-11-29T12:23:47.570 INFO:teuthology.orchestra.run.smithi022.stdout: * updates: reflector.westga.edu 2019-11-29T12:23:47.641 INFO:teuthology.orchestra.run.smithi062.stdout:--> Finished Dependency Resolution 2019-11-29T12:23:47.871 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:23:47.872 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies Resolved 2019-11-29T12:23:47.872 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:23:47.873 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2019-11-29T12:23:47.873 INFO:teuthology.orchestra.run.smithi062.stdout: Package Arch Version Repository Size 2019-11-29T12:23:47.873 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2019-11-29T12:23:47.873 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2019-11-29T12:23:47.873 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-diskprediction-local 2019-11-29T12:23:47.873 INFO:teuthology.orchestra.run.smithi062.stdout: noarch 2:15.0.0-7809.g656c8e8.el7 ceph-noarch 8.6 M 2019-11-29T12:23:47.874 INFO:teuthology.orchestra.run.smithi062.stdout:Installing for dependencies: 2019-11-29T12:23:47.874 INFO:teuthology.orchestra.run.smithi062.stdout: numpy-f2py x86_64 1:1.7.1-13.el7 base 206 k 2019-11-29T12:23:47.874 INFO:teuthology.orchestra.run.smithi062.stdout: scipy x86_64 0.12.1-6.el7 base 9.3 M 2019-11-29T12:23:47.874 INFO:teuthology.orchestra.run.smithi062.stdout: suitesparse x86_64 4.0.2-10.el7 base 928 k 2019-11-29T12:23:47.874 INFO:teuthology.orchestra.run.smithi062.stdout: tbb x86_64 4.1-9.20130314.el7 base 124 k 2019-11-29T12:23:47.874 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:23:47.874 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2019-11-29T12:23:47.874 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2019-11-29T12:23:47.875 INFO:teuthology.orchestra.run.smithi062.stdout:Install 1 Package (+4 Dependent packages) 2019-11-29T12:23:47.875 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:23:47.875 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 19 M 2019-11-29T12:23:47.875 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 104 M 2019-11-29T12:23:47.876 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading packages: 2019-11-29T12:23:48.223 INFO:teuthology.orchestra.run.smithi022.stdout:7 packages excluded due to repository priority protections 2019-11-29T12:23:48.562 INFO:teuthology.orchestra.run.smithi022.stdout:Resolving Dependencies 2019-11-29T12:23:48.563 INFO:teuthology.orchestra.run.smithi022.stdout:--> Running transaction check 2019-11-29T12:23:48.563 INFO:teuthology.orchestra.run.smithi022.stdout:---> Package ceph-mgr-diskprediction-local.noarch 2:15.0.0-7809.g656c8e8.el7 will be installed 2019-11-29T12:23:48.565 INFO:teuthology.orchestra.run.smithi022.stdout:--> Processing Dependency: scipy for package: 2:ceph-mgr-diskprediction-local-15.0.0-7809.g656c8e8.el7.noarch 2019-11-29T12:23:48.596 INFO:teuthology.orchestra.run.smithi022.stdout:--> Running transaction check 2019-11-29T12:23:48.596 INFO:teuthology.orchestra.run.smithi022.stdout:---> Package scipy.x86_64 0:0.12.1-6.el7 will be installed 2019-11-29T12:23:48.603 INFO:teuthology.orchestra.run.smithi022.stdout:--> Processing Dependency: f2py for package: scipy-0.12.1-6.el7.x86_64 2019-11-29T12:23:48.604 INFO:teuthology.orchestra.run.smithi022.stdout:--> Processing Dependency: libumfpack.so.5()(64bit) for package: scipy-0.12.1-6.el7.x86_64 2019-11-29T12:23:48.607 INFO:teuthology.orchestra.run.smithi022.stdout:--> Processing Dependency: libamd.so.2()(64bit) for package: scipy-0.12.1-6.el7.x86_64 2019-11-29T12:23:48.607 INFO:teuthology.orchestra.run.smithi022.stdout:--> Running transaction check 2019-11-29T12:23:48.607 INFO:teuthology.orchestra.run.smithi022.stdout:---> Package numpy-f2py.x86_64 1:1.7.1-13.el7 will be installed 2019-11-29T12:23:48.608 INFO:teuthology.orchestra.run.smithi022.stdout:---> Package suitesparse.x86_64 0:4.0.2-10.el7 will be installed 2019-11-29T12:23:48.609 INFO:teuthology.orchestra.run.smithi022.stdout:--> Processing Dependency: libtbbmalloc.so.2()(64bit) for package: suitesparse-4.0.2-10.el7.x86_64 2019-11-29T12:23:48.613 INFO:teuthology.orchestra.run.smithi022.stdout:--> Processing Dependency: libtbb.so.2()(64bit) for package: suitesparse-4.0.2-10.el7.x86_64 2019-11-29T12:23:48.613 INFO:teuthology.orchestra.run.smithi022.stdout:--> Running transaction check 2019-11-29T12:23:48.613 INFO:teuthology.orchestra.run.smithi022.stdout:---> Package tbb.x86_64 0:4.1-9.20130314.el7 will be installed 2019-11-29T12:23:48.632 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2019-11-29T12:23:48.632 INFO:teuthology.orchestra.run.smithi062.stdout:Total 25 MB/s | 19 MB 00:00 2019-11-29T12:23:48.646 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2019-11-29T12:23:48.679 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2019-11-29T12:23:48.828 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded 2019-11-29T12:23:48.829 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2019-11-29T12:23:48.995 INFO:teuthology.orchestra.run.smithi022.stdout:--> Finished Dependency Resolution 2019-11-29T12:23:49.230 INFO:teuthology.orchestra.run.smithi022.stdout: 2019-11-29T12:23:49.231 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies Resolved 2019-11-29T12:23:49.232 INFO:teuthology.orchestra.run.smithi022.stdout: 2019-11-29T12:23:49.232 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2019-11-29T12:23:49.232 INFO:teuthology.orchestra.run.smithi022.stdout: Package Arch Version Repository Size 2019-11-29T12:23:49.232 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2019-11-29T12:23:49.232 INFO:teuthology.orchestra.run.smithi022.stdout:Installing: 2019-11-29T12:23:49.233 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-diskprediction-local 2019-11-29T12:23:49.233 INFO:teuthology.orchestra.run.smithi022.stdout: noarch 2:15.0.0-7809.g656c8e8.el7 ceph-noarch 8.6 M 2019-11-29T12:23:49.233 INFO:teuthology.orchestra.run.smithi022.stdout:Installing for dependencies: 2019-11-29T12:23:49.233 INFO:teuthology.orchestra.run.smithi022.stdout: numpy-f2py x86_64 1:1.7.1-13.el7 base 206 k 2019-11-29T12:23:49.233 INFO:teuthology.orchestra.run.smithi022.stdout: scipy x86_64 0.12.1-6.el7 base 9.3 M 2019-11-29T12:23:49.233 INFO:teuthology.orchestra.run.smithi022.stdout: suitesparse x86_64 4.0.2-10.el7 base 928 k 2019-11-29T12:23:49.233 INFO:teuthology.orchestra.run.smithi022.stdout: tbb x86_64 4.1-9.20130314.el7 base 124 k 2019-11-29T12:23:49.233 INFO:teuthology.orchestra.run.smithi022.stdout: 2019-11-29T12:23:49.234 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction Summary 2019-11-29T12:23:49.234 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2019-11-29T12:23:49.234 INFO:teuthology.orchestra.run.smithi022.stdout:Install 1 Package (+4 Dependent packages) 2019-11-29T12:23:49.234 INFO:teuthology.orchestra.run.smithi022.stdout: 2019-11-29T12:23:49.234 INFO:teuthology.orchestra.run.smithi022.stdout:Total download size: 19 M 2019-11-29T12:23:49.234 INFO:teuthology.orchestra.run.smithi022.stdout:Installed size: 104 M 2019-11-29T12:23:49.234 INFO:teuthology.orchestra.run.smithi022.stdout:Downloading packages: 2019-11-29T12:23:49.792 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : tbb-4.1-9.20130314.el7.x86_64 1/5 2019-11-29T12:23:49.932 INFO:teuthology.orchestra.run.smithi022.stdout:-------------------------------------------------------------------------------- 2019-11-29T12:23:49.932 INFO:teuthology.orchestra.run.smithi022.stdout:Total 27 MB/s | 19 MB 00:00 2019-11-29T12:23:49.945 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction check 2019-11-29T12:23:49.977 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction test 2019-11-29T12:23:50.122 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction test succeeded 2019-11-29T12:23:50.123 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction 2019-11-29T12:23:50.289 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : suitesparse-4.0.2-10.el7.x86_64 2/5 2019-11-29T12:23:51.002 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : tbb-4.1-9.20130314.el7.x86_64 1/5 2019-11-29T12:23:51.624 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : suitesparse-4.0.2-10.el7.x86_64 2/5 2019-11-29T12:23:52.092 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : 1:numpy-f2py-1.7.1-13.el7.x86_64 3/5 2019-11-29T12:23:53.417 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : 1:numpy-f2py-1.7.1-13.el7.x86_64 3/5 2019-11-29T12:23:53.817 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : scipy-0.12.1-6.el7.x86_64 4/5 2019-11-29T12:23:54.208 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : 2:ceph-mgr-diskprediction-local-15.0.0-7809.g656c8e8.el7.n 5/5 2019-11-29T12:23:54.312 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : suitesparse-4.0.2-10.el7.x86_64 1/5 2019-11-29T12:23:54.443 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : 2:ceph-mgr-diskprediction-local-15.0.0-7809.g656c8e8.el7.n 2/5 2019-11-29T12:23:54.554 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : 1:numpy-f2py-1.7.1-13.el7.x86_64 3/5 2019-11-29T12:23:54.671 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : scipy-0.12.1-6.el7.x86_64 4/5 2019-11-29T12:23:55.189 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : tbb-4.1-9.20130314.el7.x86_64 5/5 2019-11-29T12:23:55.189 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:23:55.189 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2019-11-29T12:23:55.189 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-diskprediction-local.noarch 2:15.0.0-7809.g656c8e8.el7 2019-11-29T12:23:55.189 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:23:55.190 INFO:teuthology.orchestra.run.smithi062.stdout:Dependency Installed: 2019-11-29T12:23:55.190 INFO:teuthology.orchestra.run.smithi062.stdout: numpy-f2py.x86_64 1:1.7.1-13.el7 scipy.x86_64 0:0.12.1-6.el7 2019-11-29T12:23:55.190 INFO:teuthology.orchestra.run.smithi062.stdout: suitesparse.x86_64 0:4.0.2-10.el7 tbb.x86_64 0:4.1-9.20130314.el7 2019-11-29T12:23:55.190 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:23:55.190 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2019-11-29T12:23:55.256 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : scipy-0.12.1-6.el7.x86_64 4/5 2019-11-29T12:23:55.308 INFO:teuthology.orchestra.run.smithi062:> sudo yum -y install ceph-mgr-rook 2019-11-29T12:23:55.561 INFO:teuthology.orchestra.run.smithi062.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-29T12:23:55.603 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : 2:ceph-mgr-diskprediction-local-15.0.0-7809.g656c8e8.el7.n 5/5 2019-11-29T12:23:55.607 INFO:teuthology.orchestra.run.smithi062.stdout:Loading mirror speeds from cached hostfile 2019-11-29T12:23:55.609 INFO:teuthology.orchestra.run.smithi062.stdout: * base: mirror.us-midwest-1.nexcess.net 2019-11-29T12:23:55.609 INFO:teuthology.orchestra.run.smithi062.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-29T12:23:55.609 INFO:teuthology.orchestra.run.smithi062.stdout: * extras: www.gtlib.gatech.edu 2019-11-29T12:23:55.610 INFO:teuthology.orchestra.run.smithi062.stdout: * updates: reflector.westga.edu 2019-11-29T12:23:55.833 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : suitesparse-4.0.2-10.el7.x86_64 1/5 2019-11-29T12:23:55.975 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : 2:ceph-mgr-diskprediction-local-15.0.0-7809.g656c8e8.el7.n 2/5 2019-11-29T12:23:56.075 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : 1:numpy-f2py-1.7.1-13.el7.x86_64 3/5 2019-11-29T12:23:56.184 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : scipy-0.12.1-6.el7.x86_64 4/5 2019-11-29T12:23:56.283 INFO:teuthology.orchestra.run.smithi062.stdout:7 packages excluded due to repository priority protections 2019-11-29T12:23:56.632 INFO:teuthology.orchestra.run.smithi062.stdout:Resolving Dependencies 2019-11-29T12:23:56.633 INFO:teuthology.orchestra.run.smithi062.stdout:--> Running transaction check 2019-11-29T12:23:56.633 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package ceph-mgr-rook.noarch 2:15.0.0-7809.g656c8e8.el7 will be installed 2019-11-29T12:23:56.634 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: python-kubernetes for package: 2:ceph-mgr-rook-15.0.0-7809.g656c8e8.el7.noarch 2019-11-29T12:23:56.644 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : tbb-4.1-9.20130314.el7.x86_64 5/5 2019-11-29T12:23:56.645 INFO:teuthology.orchestra.run.smithi022.stdout: 2019-11-29T12:23:56.645 INFO:teuthology.orchestra.run.smithi022.stdout:Installed: 2019-11-29T12:23:56.645 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-diskprediction-local.noarch 2:15.0.0-7809.g656c8e8.el7 2019-11-29T12:23:56.645 INFO:teuthology.orchestra.run.smithi022.stdout: 2019-11-29T12:23:56.645 INFO:teuthology.orchestra.run.smithi022.stdout:Dependency Installed: 2019-11-29T12:23:56.645 INFO:teuthology.orchestra.run.smithi022.stdout: numpy-f2py.x86_64 1:1.7.1-13.el7 scipy.x86_64 0:0.12.1-6.el7 2019-11-29T12:23:56.645 INFO:teuthology.orchestra.run.smithi022.stdout: suitesparse.x86_64 0:4.0.2-10.el7 tbb.x86_64 0:4.1-9.20130314.el7 2019-11-29T12:23:56.646 INFO:teuthology.orchestra.run.smithi022.stdout: 2019-11-29T12:23:56.646 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2019-11-29T12:23:56.665 INFO:teuthology.orchestra.run.smithi062.stdout:--> Running transaction check 2019-11-29T12:23:56.665 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package python2-kubernetes.noarch 0:10.0.1-1.el7 will be installed 2019-11-29T12:23:56.668 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: python-certifi for package: python2-kubernetes-10.0.1-1.el7.noarch 2019-11-29T12:23:56.669 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: python-google-auth for package: python2-kubernetes-10.0.1-1.el7.noarch 2019-11-29T12:23:56.670 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: python-requests-oauthlib for package: python2-kubernetes-10.0.1-1.el7.noarch 2019-11-29T12:23:56.671 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: python-websocket-client for package: python2-kubernetes-10.0.1-1.el7.noarch 2019-11-29T12:23:56.672 INFO:teuthology.orchestra.run.smithi062.stdout:--> Running transaction check 2019-11-29T12:23:56.672 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package python-websocket-client.noarch 0:0.56.0-3.git3c25814.el7 will be installed 2019-11-29T12:23:56.672 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package python2-certifi.noarch 0:2018.10.15-5.el7 will be installed 2019-11-29T12:23:56.672 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package python2-google-auth.noarch 1:1.1.1-5.el7 will be installed 2019-11-29T12:23:56.673 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: python-cachetools for package: 1:python2-google-auth-1.1.1-5.el7.noarch 2019-11-29T12:23:56.674 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: python2-pyasn1-modules for package: 1:python2-google-auth-1.1.1-5.el7.noarch 2019-11-29T12:23:56.675 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: python2-rsa for package: 1:python2-google-auth-1.1.1-5.el7.noarch 2019-11-29T12:23:56.676 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package python2-requests-oauthlib.noarch 0:0.8.0-5.el7 will be installed 2019-11-29T12:23:56.676 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: python2-oauthlib for package: python2-requests-oauthlib-0.8.0-5.el7.noarch 2019-11-29T12:23:56.677 INFO:teuthology.orchestra.run.smithi062.stdout:--> Running transaction check 2019-11-29T12:23:56.677 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package python-cachetools.noarch 0:1.0.3-1.el7 will be installed 2019-11-29T12:23:56.677 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package python2-oauthlib.noarch 0:2.0.1-8.el7 will be installed 2019-11-29T12:23:56.678 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: python-jwcrypto for package: python2-oauthlib-2.0.1-8.el7.noarch 2019-11-29T12:23:56.679 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package python2-pyasn1-modules.noarch 0:0.1.9-7.el7 will be installed 2019-11-29T12:23:56.679 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package python2-rsa.noarch 0:3.4.1-1.el7 will be installed 2019-11-29T12:23:56.679 INFO:teuthology.orchestra.run.smithi062.stdout:--> Running transaction check 2019-11-29T12:23:56.679 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package python-jwcrypto.noarch 0:0.4.2-1.el7 will be installed 2019-11-29T12:23:56.766 INFO:teuthology.orchestra.run.smithi022:> sudo yum -y install ceph-mgr-rook 2019-11-29T12:23:57.002 INFO:teuthology.orchestra.run.smithi022.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-29T12:23:57.042 INFO:teuthology.orchestra.run.smithi022.stdout:Loading mirror speeds from cached hostfile 2019-11-29T12:23:57.043 INFO:teuthology.orchestra.run.smithi022.stdout: * base: mirror.us-midwest-1.nexcess.net 2019-11-29T12:23:57.044 INFO:teuthology.orchestra.run.smithi022.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-29T12:23:57.044 INFO:teuthology.orchestra.run.smithi022.stdout: * extras: www.gtlib.gatech.edu 2019-11-29T12:23:57.044 INFO:teuthology.orchestra.run.smithi022.stdout: * updates: reflector.westga.edu 2019-11-29T12:23:57.063 INFO:teuthology.orchestra.run.smithi062.stdout:--> Finished Dependency Resolution 2019-11-29T12:23:57.297 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:23:57.297 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies Resolved 2019-11-29T12:23:57.299 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:23:57.299 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2019-11-29T12:23:57.299 INFO:teuthology.orchestra.run.smithi062.stdout: Package Arch Version Repository Size 2019-11-29T12:23:57.299 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2019-11-29T12:23:57.299 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2019-11-29T12:23:57.299 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-rook noarch 2:15.0.0-7809.g656c8e8.el7 ceph-noarch 23 k 2019-11-29T12:23:57.299 INFO:teuthology.orchestra.run.smithi062.stdout:Installing for dependencies: 2019-11-29T12:23:57.300 INFO:teuthology.orchestra.run.smithi062.stdout: python-cachetools noarch 1.0.3-1.el7 epel 22 k 2019-11-29T12:23:57.300 INFO:teuthology.orchestra.run.smithi062.stdout: python-jwcrypto noarch 0.4.2-1.el7 base 57 k 2019-11-29T12:23:57.300 INFO:teuthology.orchestra.run.smithi062.stdout: python-websocket-client noarch 0.56.0-3.git3c25814.el7 extras 66 k 2019-11-29T12:23:57.300 INFO:teuthology.orchestra.run.smithi062.stdout: python2-certifi noarch 2018.10.15-5.el7 epel 12 k 2019-11-29T12:23:57.300 INFO:teuthology.orchestra.run.smithi062.stdout: python2-google-auth noarch 1:1.1.1-5.el7 epel 76 k 2019-11-29T12:23:57.300 INFO:teuthology.orchestra.run.smithi062.stdout: python2-kubernetes noarch 10.0.1-1.el7 epel 1.1 M 2019-11-29T12:23:57.300 INFO:teuthology.orchestra.run.smithi062.stdout: python2-oauthlib noarch 2.0.1-8.el7 base 146 k 2019-11-29T12:23:57.301 INFO:teuthology.orchestra.run.smithi062.stdout: python2-pyasn1-modules noarch 0.1.9-7.el7 base 59 k 2019-11-29T12:23:57.301 INFO:teuthology.orchestra.run.smithi062.stdout: python2-requests-oauthlib noarch 0.8.0-5.el7 base 35 k 2019-11-29T12:23:57.301 INFO:teuthology.orchestra.run.smithi062.stdout: python2-rsa noarch 3.4.1-1.el7 epel 67 k 2019-11-29T12:23:57.301 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:23:57.301 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2019-11-29T12:23:57.301 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2019-11-29T12:23:57.301 INFO:teuthology.orchestra.run.smithi062.stdout:Install 1 Package (+10 Dependent packages) 2019-11-29T12:23:57.302 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:23:57.302 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 1.6 M 2019-11-29T12:23:57.302 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 24 M 2019-11-29T12:23:57.302 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading packages: 2019-11-29T12:23:57.677 INFO:teuthology.orchestra.run.smithi022.stdout:7 packages excluded due to repository priority protections 2019-11-29T12:23:58.016 INFO:teuthology.orchestra.run.smithi022.stdout:Resolving Dependencies 2019-11-29T12:23:58.017 INFO:teuthology.orchestra.run.smithi022.stdout:--> Running transaction check 2019-11-29T12:23:58.017 INFO:teuthology.orchestra.run.smithi022.stdout:---> Package ceph-mgr-rook.noarch 2:15.0.0-7809.g656c8e8.el7 will be installed 2019-11-29T12:23:58.018 INFO:teuthology.orchestra.run.smithi022.stdout:--> Processing Dependency: python-kubernetes for package: 2:ceph-mgr-rook-15.0.0-7809.g656c8e8.el7.noarch 2019-11-29T12:23:58.050 INFO:teuthology.orchestra.run.smithi022.stdout:--> Running transaction check 2019-11-29T12:23:58.050 INFO:teuthology.orchestra.run.smithi022.stdout:---> Package python2-kubernetes.noarch 0:10.0.1-1.el7 will be installed 2019-11-29T12:23:58.052 INFO:teuthology.orchestra.run.smithi022.stdout:--> Processing Dependency: python-certifi for package: python2-kubernetes-10.0.1-1.el7.noarch 2019-11-29T12:23:58.053 INFO:teuthology.orchestra.run.smithi022.stdout:--> Processing Dependency: python-google-auth for package: python2-kubernetes-10.0.1-1.el7.noarch 2019-11-29T12:23:58.054 INFO:teuthology.orchestra.run.smithi022.stdout:--> Processing Dependency: python-requests-oauthlib for package: python2-kubernetes-10.0.1-1.el7.noarch 2019-11-29T12:23:58.055 INFO:teuthology.orchestra.run.smithi022.stdout:--> Processing Dependency: python-websocket-client for package: python2-kubernetes-10.0.1-1.el7.noarch 2019-11-29T12:23:58.056 INFO:teuthology.orchestra.run.smithi022.stdout:--> Running transaction check 2019-11-29T12:23:58.057 INFO:teuthology.orchestra.run.smithi022.stdout:---> Package python-websocket-client.noarch 0:0.56.0-3.git3c25814.el7 will be installed 2019-11-29T12:23:58.057 INFO:teuthology.orchestra.run.smithi022.stdout:---> Package python2-certifi.noarch 0:2018.10.15-5.el7 will be installed 2019-11-29T12:23:58.057 INFO:teuthology.orchestra.run.smithi022.stdout:---> Package python2-google-auth.noarch 1:1.1.1-5.el7 will be installed 2019-11-29T12:23:58.057 INFO:teuthology.orchestra.run.smithi022.stdout:--> Processing Dependency: python-cachetools for package: 1:python2-google-auth-1.1.1-5.el7.noarch 2019-11-29T12:23:58.058 INFO:teuthology.orchestra.run.smithi022.stdout:--> Processing Dependency: python2-pyasn1-modules for package: 1:python2-google-auth-1.1.1-5.el7.noarch 2019-11-29T12:23:58.059 INFO:teuthology.orchestra.run.smithi022.stdout:--> Processing Dependency: python2-rsa for package: 1:python2-google-auth-1.1.1-5.el7.noarch 2019-11-29T12:23:58.060 INFO:teuthology.orchestra.run.smithi022.stdout:---> Package python2-requests-oauthlib.noarch 0:0.8.0-5.el7 will be installed 2019-11-29T12:23:58.061 INFO:teuthology.orchestra.run.smithi022.stdout:--> Processing Dependency: python2-oauthlib for package: python2-requests-oauthlib-0.8.0-5.el7.noarch 2019-11-29T12:23:58.062 INFO:teuthology.orchestra.run.smithi022.stdout:--> Running transaction check 2019-11-29T12:23:58.062 INFO:teuthology.orchestra.run.smithi022.stdout:---> Package python-cachetools.noarch 0:1.0.3-1.el7 will be installed 2019-11-29T12:23:58.062 INFO:teuthology.orchestra.run.smithi022.stdout:---> Package python2-oauthlib.noarch 0:2.0.1-8.el7 will be installed 2019-11-29T12:23:58.062 INFO:teuthology.orchestra.run.smithi022.stdout:--> Processing Dependency: python-jwcrypto for package: python2-oauthlib-2.0.1-8.el7.noarch 2019-11-29T12:23:58.063 INFO:teuthology.orchestra.run.smithi022.stdout:---> Package python2-pyasn1-modules.noarch 0:0.1.9-7.el7 will be installed 2019-11-29T12:23:58.063 INFO:teuthology.orchestra.run.smithi022.stdout:---> Package python2-rsa.noarch 0:3.4.1-1.el7 will be installed 2019-11-29T12:23:58.064 INFO:teuthology.orchestra.run.smithi022.stdout:--> Running transaction check 2019-11-29T12:23:58.064 INFO:teuthology.orchestra.run.smithi022.stdout:---> Package python-jwcrypto.noarch 0:0.4.2-1.el7 will be installed 2019-11-29T12:23:58.087 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2019-11-29T12:23:58.088 INFO:teuthology.orchestra.run.smithi062.stdout:Total 2.1 MB/s | 1.6 MB 00:00 2019-11-29T12:23:58.101 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2019-11-29T12:23:58.113 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2019-11-29T12:23:58.230 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded 2019-11-29T12:23:58.231 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2019-11-29T12:23:58.447 INFO:teuthology.orchestra.run.smithi022.stdout:--> Finished Dependency Resolution 2019-11-29T12:23:58.678 INFO:teuthology.orchestra.run.smithi022.stdout: 2019-11-29T12:23:58.678 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies Resolved 2019-11-29T12:23:58.680 INFO:teuthology.orchestra.run.smithi022.stdout: 2019-11-29T12:23:58.680 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2019-11-29T12:23:58.680 INFO:teuthology.orchestra.run.smithi022.stdout: Package Arch Version Repository Size 2019-11-29T12:23:58.680 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2019-11-29T12:23:58.680 INFO:teuthology.orchestra.run.smithi022.stdout:Installing: 2019-11-29T12:23:58.680 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-rook noarch 2:15.0.0-7809.g656c8e8.el7 ceph-noarch 23 k 2019-11-29T12:23:58.681 INFO:teuthology.orchestra.run.smithi022.stdout:Installing for dependencies: 2019-11-29T12:23:58.681 INFO:teuthology.orchestra.run.smithi022.stdout: python-cachetools noarch 1.0.3-1.el7 epel 22 k 2019-11-29T12:23:58.681 INFO:teuthology.orchestra.run.smithi022.stdout: python-jwcrypto noarch 0.4.2-1.el7 base 57 k 2019-11-29T12:23:58.681 INFO:teuthology.orchestra.run.smithi022.stdout: python-websocket-client noarch 0.56.0-3.git3c25814.el7 extras 66 k 2019-11-29T12:23:58.681 INFO:teuthology.orchestra.run.smithi022.stdout: python2-certifi noarch 2018.10.15-5.el7 epel 12 k 2019-11-29T12:23:58.681 INFO:teuthology.orchestra.run.smithi022.stdout: python2-google-auth noarch 1:1.1.1-5.el7 epel 76 k 2019-11-29T12:23:58.681 INFO:teuthology.orchestra.run.smithi022.stdout: python2-kubernetes noarch 10.0.1-1.el7 epel 1.1 M 2019-11-29T12:23:58.682 INFO:teuthology.orchestra.run.smithi022.stdout: python2-oauthlib noarch 2.0.1-8.el7 base 146 k 2019-11-29T12:23:58.682 INFO:teuthology.orchestra.run.smithi022.stdout: python2-pyasn1-modules noarch 0.1.9-7.el7 base 59 k 2019-11-29T12:23:58.682 INFO:teuthology.orchestra.run.smithi022.stdout: python2-requests-oauthlib noarch 0.8.0-5.el7 base 35 k 2019-11-29T12:23:58.682 INFO:teuthology.orchestra.run.smithi022.stdout: python2-rsa noarch 3.4.1-1.el7 epel 67 k 2019-11-29T12:23:58.682 INFO:teuthology.orchestra.run.smithi022.stdout: 2019-11-29T12:23:58.682 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction Summary 2019-11-29T12:23:58.682 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2019-11-29T12:23:58.683 INFO:teuthology.orchestra.run.smithi022.stdout:Install 1 Package (+10 Dependent packages) 2019-11-29T12:23:58.683 INFO:teuthology.orchestra.run.smithi022.stdout: 2019-11-29T12:23:58.683 INFO:teuthology.orchestra.run.smithi022.stdout:Total download size: 1.6 M 2019-11-29T12:23:58.683 INFO:teuthology.orchestra.run.smithi022.stdout:Installed size: 24 M 2019-11-29T12:23:58.684 INFO:teuthology.orchestra.run.smithi022.stdout:Downloading packages: 2019-11-29T12:23:59.029 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python-websocket-client-0.56.0-3.git3c25814.el7.noarch 1/11 2019-11-29T12:23:59.443 INFO:teuthology.orchestra.run.smithi022.stdout:-------------------------------------------------------------------------------- 2019-11-29T12:23:59.443 INFO:teuthology.orchestra.run.smithi022.stdout:Total 2.2 MB/s | 1.6 MB 00:00 2019-11-29T12:23:59.451 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python-jwcrypto-0.4.2-1.el7.noarch 2/11 2019-11-29T12:23:59.460 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction check 2019-11-29T12:23:59.474 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction test 2019-11-29T12:23:59.582 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction test succeeded 2019-11-29T12:23:59.582 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction 2019-11-29T12:23:59.845 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python2-oauthlib-2.0.1-8.el7.noarch 3/11 2019-11-29T12:24:00.155 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python2-requests-oauthlib-0.8.0-5.el7.noarch 4/11 2019-11-29T12:24:00.327 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python-websocket-client-0.56.0-3.git3c25814.el7.noarch 1/11 2019-11-29T12:24:00.537 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python2-certifi-2018.10.15-5.el7.noarch 5/11 2019-11-29T12:24:00.734 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python-jwcrypto-0.4.2-1.el7.noarch 2/11 2019-11-29T12:24:00.961 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python-cachetools-1.0.3-1.el7.noarch 6/11 2019-11-29T12:24:01.178 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python2-oauthlib-2.0.1-8.el7.noarch 3/11 2019-11-29T12:24:01.351 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python2-rsa-3.4.1-1.el7.noarch 7/11 2019-11-29T12:24:01.443 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python2-requests-oauthlib-0.8.0-5.el7.noarch 4/11 2019-11-29T12:24:01.710 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python2-pyasn1-modules-0.1.9-7.el7.noarch 8/11 2019-11-29T12:24:01.800 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python2-certifi-2018.10.15-5.el7.noarch 5/11 2019-11-29T12:24:02.181 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python-cachetools-1.0.3-1.el7.noarch 6/11 2019-11-29T12:24:02.574 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python2-rsa-3.4.1-1.el7.noarch 7/11 2019-11-29T12:24:03.048 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : 1:python2-google-auth-1.1.1-5.el7.noarch 9/11 2019-11-29T12:24:03.053 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python2-pyasn1-modules-0.1.9-7.el7.noarch 8/11 2019-11-29T12:24:03.473 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python2-kubernetes-10.0.1-1.el7.noarch 10/11 2019-11-29T12:24:03.801 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : 2:ceph-mgr-rook-15.0.0-7809.g656c8e8.el7.noarch 11/11 2019-11-29T12:24:03.916 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python2-requests-oauthlib-0.8.0-5.el7.noarch 1/11 2019-11-29T12:24:04.000 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python2-pyasn1-modules-0.1.9-7.el7.noarch 2/11 2019-11-29T12:24:04.125 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python2-rsa-3.4.1-1.el7.noarch 3/11 2019-11-29T12:24:04.225 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python2-oauthlib-2.0.1-8.el7.noarch 4/11 2019-11-29T12:24:04.343 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python-cachetools-1.0.3-1.el7.noarch 5/11 2019-11-29T12:24:04.385 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : 1:python2-google-auth-1.1.1-5.el7.noarch 9/11 2019-11-29T12:24:04.460 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : 1:python2-google-auth-1.1.1-5.el7.noarch 6/11 2019-11-29T12:24:04.569 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python2-certifi-2018.10.15-5.el7.noarch 7/11 2019-11-29T12:24:04.727 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python2-kubernetes-10.0.1-1.el7.noarch 8/11 2019-11-29T12:24:04.836 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python-jwcrypto-0.4.2-1.el7.noarch 9/11 2019-11-29T12:24:04.886 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python2-kubernetes-10.0.1-1.el7.noarch 10/11 2019-11-29T12:24:04.987 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python-websocket-client-0.56.0-3.git3c25814.el7.noarch 10/11 2019-11-29T12:24:05.206 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : 2:ceph-mgr-rook-15.0.0-7809.g656c8e8.el7.noarch 11/11 2019-11-29T12:24:05.313 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python2-requests-oauthlib-0.8.0-5.el7.noarch 1/11 2019-11-29T12:24:05.422 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python2-pyasn1-modules-0.1.9-7.el7.noarch 2/11 2019-11-29T12:24:05.498 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : 2:ceph-mgr-rook-15.0.0-7809.g656c8e8.el7.noarch 11/11 2019-11-29T12:24:05.499 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:24:05.499 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2019-11-29T12:24:05.499 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-rook.noarch 2:15.0.0-7809.g656c8e8.el7 2019-11-29T12:24:05.499 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:24:05.499 INFO:teuthology.orchestra.run.smithi062.stdout:Dependency Installed: 2019-11-29T12:24:05.499 INFO:teuthology.orchestra.run.smithi062.stdout: python-cachetools.noarch 0:1.0.3-1.el7 2019-11-29T12:24:05.499 INFO:teuthology.orchestra.run.smithi062.stdout: python-jwcrypto.noarch 0:0.4.2-1.el7 2019-11-29T12:24:05.500 INFO:teuthology.orchestra.run.smithi062.stdout: python-websocket-client.noarch 0:0.56.0-3.git3c25814.el7 2019-11-29T12:24:05.500 INFO:teuthology.orchestra.run.smithi062.stdout: python2-certifi.noarch 0:2018.10.15-5.el7 2019-11-29T12:24:05.500 INFO:teuthology.orchestra.run.smithi062.stdout: python2-google-auth.noarch 1:1.1.1-5.el7 2019-11-29T12:24:05.500 INFO:teuthology.orchestra.run.smithi062.stdout: python2-kubernetes.noarch 0:10.0.1-1.el7 2019-11-29T12:24:05.500 INFO:teuthology.orchestra.run.smithi062.stdout: python2-oauthlib.noarch 0:2.0.1-8.el7 2019-11-29T12:24:05.500 INFO:teuthology.orchestra.run.smithi062.stdout: python2-pyasn1-modules.noarch 0:0.1.9-7.el7 2019-11-29T12:24:05.500 INFO:teuthology.orchestra.run.smithi062.stdout: python2-requests-oauthlib.noarch 0:0.8.0-5.el7 2019-11-29T12:24:05.501 INFO:teuthology.orchestra.run.smithi062.stdout: python2-rsa.noarch 0:3.4.1-1.el7 2019-11-29T12:24:05.501 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:24:05.501 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2019-11-29T12:24:05.573 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python2-rsa-3.4.1-1.el7.noarch 3/11 2019-11-29T12:24:05.636 INFO:teuthology.orchestra.run.smithi062:> sudo yum -y install ceph-mgr-ssh 2019-11-29T12:24:05.690 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python2-oauthlib-2.0.1-8.el7.noarch 4/11 2019-11-29T12:24:05.800 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python-cachetools-1.0.3-1.el7.noarch 5/11 2019-11-29T12:24:05.874 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : 1:python2-google-auth-1.1.1-5.el7.noarch 6/11 2019-11-29T12:24:05.888 INFO:teuthology.orchestra.run.smithi062.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-29T12:24:05.933 INFO:teuthology.orchestra.run.smithi062.stdout:Loading mirror speeds from cached hostfile 2019-11-29T12:24:05.934 INFO:teuthology.orchestra.run.smithi062.stdout: * base: mirror.us-midwest-1.nexcess.net 2019-11-29T12:24:05.935 INFO:teuthology.orchestra.run.smithi062.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-29T12:24:05.935 INFO:teuthology.orchestra.run.smithi062.stdout: * extras: www.gtlib.gatech.edu 2019-11-29T12:24:05.935 INFO:teuthology.orchestra.run.smithi062.stdout: * updates: reflector.westga.edu 2019-11-29T12:24:05.958 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python2-certifi-2018.10.15-5.el7.noarch 7/11 2019-11-29T12:24:06.058 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python2-kubernetes-10.0.1-1.el7.noarch 8/11 2019-11-29T12:24:06.184 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python-jwcrypto-0.4.2-1.el7.noarch 9/11 2019-11-29T12:24:06.293 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python-websocket-client-0.56.0-3.git3c25814.el7.noarch 10/11 2019-11-29T12:24:06.597 INFO:teuthology.orchestra.run.smithi062.stdout:7 packages excluded due to repository priority protections 2019-11-29T12:24:06.787 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : 2:ceph-mgr-rook-15.0.0-7809.g656c8e8.el7.noarch 11/11 2019-11-29T12:24:06.787 INFO:teuthology.orchestra.run.smithi022.stdout: 2019-11-29T12:24:06.787 INFO:teuthology.orchestra.run.smithi022.stdout:Installed: 2019-11-29T12:24:06.787 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-rook.noarch 2:15.0.0-7809.g656c8e8.el7 2019-11-29T12:24:06.787 INFO:teuthology.orchestra.run.smithi022.stdout: 2019-11-29T12:24:06.788 INFO:teuthology.orchestra.run.smithi022.stdout:Dependency Installed: 2019-11-29T12:24:06.788 INFO:teuthology.orchestra.run.smithi022.stdout: python-cachetools.noarch 0:1.0.3-1.el7 2019-11-29T12:24:06.788 INFO:teuthology.orchestra.run.smithi022.stdout: python-jwcrypto.noarch 0:0.4.2-1.el7 2019-11-29T12:24:06.788 INFO:teuthology.orchestra.run.smithi022.stdout: python-websocket-client.noarch 0:0.56.0-3.git3c25814.el7 2019-11-29T12:24:06.788 INFO:teuthology.orchestra.run.smithi022.stdout: python2-certifi.noarch 0:2018.10.15-5.el7 2019-11-29T12:24:06.788 INFO:teuthology.orchestra.run.smithi022.stdout: python2-google-auth.noarch 1:1.1.1-5.el7 2019-11-29T12:24:06.788 INFO:teuthology.orchestra.run.smithi022.stdout: python2-kubernetes.noarch 0:10.0.1-1.el7 2019-11-29T12:24:06.789 INFO:teuthology.orchestra.run.smithi022.stdout: python2-oauthlib.noarch 0:2.0.1-8.el7 2019-11-29T12:24:06.789 INFO:teuthology.orchestra.run.smithi022.stdout: python2-pyasn1-modules.noarch 0:0.1.9-7.el7 2019-11-29T12:24:06.789 INFO:teuthology.orchestra.run.smithi022.stdout: python2-requests-oauthlib.noarch 0:0.8.0-5.el7 2019-11-29T12:24:06.789 INFO:teuthology.orchestra.run.smithi022.stdout: python2-rsa.noarch 0:3.4.1-1.el7 2019-11-29T12:24:06.789 INFO:teuthology.orchestra.run.smithi022.stdout: 2019-11-29T12:24:06.789 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2019-11-29T12:24:06.907 INFO:teuthology.orchestra.run.smithi022:> sudo yum -y install ceph-mgr-ssh 2019-11-29T12:24:06.943 INFO:teuthology.orchestra.run.smithi062.stdout:Resolving Dependencies 2019-11-29T12:24:06.944 INFO:teuthology.orchestra.run.smithi062.stdout:--> Running transaction check 2019-11-29T12:24:06.944 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package ceph-mgr-ssh.noarch 2:15.0.0-7809.g656c8e8.el7 will be installed 2019-11-29T12:24:06.946 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: python-remoto for package: 2:ceph-mgr-ssh-15.0.0-7809.g656c8e8.el7.noarch 2019-11-29T12:24:06.977 INFO:teuthology.orchestra.run.smithi062.stdout:--> Running transaction check 2019-11-29T12:24:06.977 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package python-remoto.noarch 0:0.0.25-1.el7 will be installed 2019-11-29T12:24:06.977 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: python-execnet >= 1.2.0 for package: python-remoto-0.0.25-1.el7.noarch 2019-11-29T12:24:06.978 INFO:teuthology.orchestra.run.smithi062.stdout:--> Running transaction check 2019-11-29T12:24:06.979 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package python-execnet.noarch 0:1.2.0-7.el7 will be installed 2019-11-29T12:24:07.178 INFO:teuthology.orchestra.run.smithi022.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-29T12:24:07.225 INFO:teuthology.orchestra.run.smithi022.stdout:Loading mirror speeds from cached hostfile 2019-11-29T12:24:07.226 INFO:teuthology.orchestra.run.smithi022.stdout: * base: mirror.us-midwest-1.nexcess.net 2019-11-29T12:24:07.226 INFO:teuthology.orchestra.run.smithi022.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-29T12:24:07.226 INFO:teuthology.orchestra.run.smithi022.stdout: * extras: www.gtlib.gatech.edu 2019-11-29T12:24:07.227 INFO:teuthology.orchestra.run.smithi022.stdout: * updates: reflector.westga.edu 2019-11-29T12:24:07.366 INFO:teuthology.orchestra.run.smithi062.stdout:--> Finished Dependency Resolution 2019-11-29T12:24:07.600 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:24:07.600 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies Resolved 2019-11-29T12:24:07.601 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:24:07.601 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2019-11-29T12:24:07.601 INFO:teuthology.orchestra.run.smithi062.stdout: Package Arch Version Repository Size 2019-11-29T12:24:07.601 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2019-11-29T12:24:07.601 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2019-11-29T12:24:07.602 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-ssh noarch 2:15.0.0-7809.g656c8e8.el7 ceph-noarch 33 k 2019-11-29T12:24:07.602 INFO:teuthology.orchestra.run.smithi062.stdout:Installing for dependencies: 2019-11-29T12:24:07.602 INFO:teuthology.orchestra.run.smithi062.stdout: python-execnet noarch 1.2.0-7.el7 epel 261 k 2019-11-29T12:24:07.602 INFO:teuthology.orchestra.run.smithi062.stdout: python-remoto noarch 0.0.25-1.el7 epel 22 k 2019-11-29T12:24:07.602 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:24:07.602 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2019-11-29T12:24:07.602 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2019-11-29T12:24:07.603 INFO:teuthology.orchestra.run.smithi062.stdout:Install 1 Package (+2 Dependent packages) 2019-11-29T12:24:07.603 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:24:07.603 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 316 k 2019-11-29T12:24:07.603 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 1.1 M 2019-11-29T12:24:07.603 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading packages: 2019-11-29T12:24:07.885 INFO:teuthology.orchestra.run.smithi022.stdout:7 packages excluded due to repository priority protections 2019-11-29T12:24:08.142 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2019-11-29T12:24:08.143 INFO:teuthology.orchestra.run.smithi062.stdout:Total 584 kB/s | 316 kB 00:00 2019-11-29T12:24:08.146 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2019-11-29T12:24:08.155 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2019-11-29T12:24:08.244 INFO:teuthology.orchestra.run.smithi022.stdout:Resolving Dependencies 2019-11-29T12:24:08.245 INFO:teuthology.orchestra.run.smithi022.stdout:--> Running transaction check 2019-11-29T12:24:08.245 INFO:teuthology.orchestra.run.smithi022.stdout:---> Package ceph-mgr-ssh.noarch 2:15.0.0-7809.g656c8e8.el7 will be installed 2019-11-29T12:24:08.247 INFO:teuthology.orchestra.run.smithi022.stdout:--> Processing Dependency: python-remoto for package: 2:ceph-mgr-ssh-15.0.0-7809.g656c8e8.el7.noarch 2019-11-29T12:24:08.250 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded 2019-11-29T12:24:08.250 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2019-11-29T12:24:08.278 INFO:teuthology.orchestra.run.smithi022.stdout:--> Running transaction check 2019-11-29T12:24:08.278 INFO:teuthology.orchestra.run.smithi022.stdout:---> Package python-remoto.noarch 0:0.0.25-1.el7 will be installed 2019-11-29T12:24:08.279 INFO:teuthology.orchestra.run.smithi022.stdout:--> Processing Dependency: python-execnet >= 1.2.0 for package: python-remoto-0.0.25-1.el7.noarch 2019-11-29T12:24:08.280 INFO:teuthology.orchestra.run.smithi022.stdout:--> Running transaction check 2019-11-29T12:24:08.280 INFO:teuthology.orchestra.run.smithi022.stdout:---> Package python-execnet.noarch 0:1.2.0-7.el7 will be installed 2019-11-29T12:24:08.668 INFO:teuthology.orchestra.run.smithi022.stdout:--> Finished Dependency Resolution 2019-11-29T12:24:08.902 INFO:teuthology.orchestra.run.smithi022.stdout: 2019-11-29T12:24:08.902 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies Resolved 2019-11-29T12:24:08.903 INFO:teuthology.orchestra.run.smithi022.stdout: 2019-11-29T12:24:08.903 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2019-11-29T12:24:08.903 INFO:teuthology.orchestra.run.smithi022.stdout: Package Arch Version Repository Size 2019-11-29T12:24:08.904 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2019-11-29T12:24:08.904 INFO:teuthology.orchestra.run.smithi022.stdout:Installing: 2019-11-29T12:24:08.904 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-ssh noarch 2:15.0.0-7809.g656c8e8.el7 ceph-noarch 33 k 2019-11-29T12:24:08.904 INFO:teuthology.orchestra.run.smithi022.stdout:Installing for dependencies: 2019-11-29T12:24:08.905 INFO:teuthology.orchestra.run.smithi022.stdout: python-execnet noarch 1.2.0-7.el7 epel 261 k 2019-11-29T12:24:08.905 INFO:teuthology.orchestra.run.smithi022.stdout: python-remoto noarch 0.0.25-1.el7 epel 22 k 2019-11-29T12:24:08.905 INFO:teuthology.orchestra.run.smithi022.stdout: 2019-11-29T12:24:08.905 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction Summary 2019-11-29T12:24:08.905 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2019-11-29T12:24:08.905 INFO:teuthology.orchestra.run.smithi022.stdout:Install 1 Package (+2 Dependent packages) 2019-11-29T12:24:08.905 INFO:teuthology.orchestra.run.smithi022.stdout: 2019-11-29T12:24:08.905 INFO:teuthology.orchestra.run.smithi022.stdout:Total download size: 316 k 2019-11-29T12:24:08.906 INFO:teuthology.orchestra.run.smithi022.stdout:Installed size: 1.1 M 2019-11-29T12:24:08.906 INFO:teuthology.orchestra.run.smithi022.stdout:Downloading packages: 2019-11-29T12:24:09.084 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python-execnet-1.2.0-7.el7.noarch 1/3 2019-11-29T12:24:09.382 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python-remoto-0.0.25-1.el7.noarch 2/3 2019-11-29T12:24:09.437 INFO:teuthology.orchestra.run.smithi022.stdout:-------------------------------------------------------------------------------- 2019-11-29T12:24:09.438 INFO:teuthology.orchestra.run.smithi022.stdout:Total 592 kB/s | 316 kB 00:00 2019-11-29T12:24:09.441 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction check 2019-11-29T12:24:09.451 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction test 2019-11-29T12:24:09.532 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction test succeeded 2019-11-29T12:24:09.532 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction 2019-11-29T12:24:09.684 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : 2:ceph-mgr-ssh-15.0.0-7809.g656c8e8.el7.noarch 3/3 2019-11-29T12:24:09.805 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python-remoto-0.0.25-1.el7.noarch 1/3 2019-11-29T12:24:09.938 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python-execnet-1.2.0-7.el7.noarch 2/3 2019-11-29T12:24:10.300 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python-execnet-1.2.0-7.el7.noarch 1/3 2019-11-29T12:24:10.498 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : 2:ceph-mgr-ssh-15.0.0-7809.g656c8e8.el7.noarch 3/3 2019-11-29T12:24:10.499 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:24:10.499 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2019-11-29T12:24:10.499 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-ssh.noarch 2:15.0.0-7809.g656c8e8.el7 2019-11-29T12:24:10.499 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:24:10.499 INFO:teuthology.orchestra.run.smithi062.stdout:Dependency Installed: 2019-11-29T12:24:10.499 INFO:teuthology.orchestra.run.smithi062.stdout: python-execnet.noarch 0:1.2.0-7.el7 python-remoto.noarch 0:0.0.25-1.el7 2019-11-29T12:24:10.499 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:24:10.500 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2019-11-29T12:24:10.592 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python-remoto-0.0.25-1.el7.noarch 2/3 2019-11-29T12:24:10.619 INFO:teuthology.orchestra.run.smithi062:> sudo yum -y install ceph-fuse 2019-11-29T12:24:10.882 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : 2:ceph-mgr-ssh-15.0.0-7809.g656c8e8.el7.noarch 3/3 2019-11-29T12:24:10.898 INFO:teuthology.orchestra.run.smithi062.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-29T12:24:10.945 INFO:teuthology.orchestra.run.smithi062.stdout:Loading mirror speeds from cached hostfile 2019-11-29T12:24:10.946 INFO:teuthology.orchestra.run.smithi062.stdout: * base: mirror.us-midwest-1.nexcess.net 2019-11-29T12:24:10.946 INFO:teuthology.orchestra.run.smithi062.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-29T12:24:10.947 INFO:teuthology.orchestra.run.smithi062.stdout: * extras: www.gtlib.gatech.edu 2019-11-29T12:24:10.947 INFO:teuthology.orchestra.run.smithi062.stdout: * updates: reflector.westga.edu 2019-11-29T12:24:10.977 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python-remoto-0.0.25-1.el7.noarch 1/3 2019-11-29T12:24:11.094 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python-execnet-1.2.0-7.el7.noarch 2/3 2019-11-29T12:24:11.578 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : 2:ceph-mgr-ssh-15.0.0-7809.g656c8e8.el7.noarch 3/3 2019-11-29T12:24:11.579 INFO:teuthology.orchestra.run.smithi022.stdout: 2019-11-29T12:24:11.579 INFO:teuthology.orchestra.run.smithi022.stdout:Installed: 2019-11-29T12:24:11.579 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-ssh.noarch 2:15.0.0-7809.g656c8e8.el7 2019-11-29T12:24:11.579 INFO:teuthology.orchestra.run.smithi022.stdout: 2019-11-29T12:24:11.579 INFO:teuthology.orchestra.run.smithi022.stdout:Dependency Installed: 2019-11-29T12:24:11.579 INFO:teuthology.orchestra.run.smithi022.stdout: python-execnet.noarch 0:1.2.0-7.el7 python-remoto.noarch 0:0.0.25-1.el7 2019-11-29T12:24:11.579 INFO:teuthology.orchestra.run.smithi022.stdout: 2019-11-29T12:24:11.580 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2019-11-29T12:24:11.603 INFO:teuthology.orchestra.run.smithi062.stdout:7 packages excluded due to repository priority protections 2019-11-29T12:24:11.705 INFO:teuthology.orchestra.run.smithi022:> sudo yum -y install ceph-fuse 2019-11-29T12:24:11.955 INFO:teuthology.orchestra.run.smithi022.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-29T12:24:11.958 INFO:teuthology.orchestra.run.smithi062.stdout:Resolving Dependencies 2019-11-29T12:24:11.959 INFO:teuthology.orchestra.run.smithi062.stdout:--> Running transaction check 2019-11-29T12:24:11.959 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package ceph-fuse.x86_64 2:15.0.0-7809.g656c8e8.el7 will be installed 2019-11-29T12:24:11.970 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: python36 for package: 2:ceph-fuse-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T12:24:11.999 INFO:teuthology.orchestra.run.smithi022.stdout:Loading mirror speeds from cached hostfile 2019-11-29T12:24:12.000 INFO:teuthology.orchestra.run.smithi022.stdout: * base: mirror.us-midwest-1.nexcess.net 2019-11-29T12:24:12.000 INFO:teuthology.orchestra.run.smithi022.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-29T12:24:12.001 INFO:teuthology.orchestra.run.smithi022.stdout: * extras: www.gtlib.gatech.edu 2019-11-29T12:24:12.001 INFO:teuthology.orchestra.run.smithi022.stdout: * updates: reflector.westga.edu 2019-11-29T12:24:12.003 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: /usr/bin/python3 for package: 2:ceph-fuse-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T12:24:12.004 INFO:teuthology.orchestra.run.smithi062.stdout:--> Running transaction check 2019-11-29T12:24:12.004 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package python3.x86_64 0:3.6.8-10.el7 will be installed 2019-11-29T12:24:12.005 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: python3-libs(x86-64) = 3.6.8-10.el7 for package: python3-3.6.8-10.el7.x86_64 2019-11-29T12:24:12.007 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: python3-setuptools for package: python3-3.6.8-10.el7.x86_64 2019-11-29T12:24:12.008 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: python3-pip for package: python3-3.6.8-10.el7.x86_64 2019-11-29T12:24:12.009 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: libpython3.6m.so.1.0()(64bit) for package: python3-3.6.8-10.el7.x86_64 2019-11-29T12:24:12.010 INFO:teuthology.orchestra.run.smithi062.stdout:--> Running transaction check 2019-11-29T12:24:12.010 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package python3-libs.x86_64 0:3.6.8-10.el7 will be installed 2019-11-29T12:24:12.016 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package python3-pip.noarch 0:9.0.3-5.el7 will be installed 2019-11-29T12:24:12.016 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package python3-setuptools.noarch 0:39.2.0-10.el7 will be installed 2019-11-29T12:24:12.400 INFO:teuthology.orchestra.run.smithi062.stdout:--> Finished Dependency Resolution 2019-11-29T12:24:12.633 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:24:12.633 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies Resolved 2019-11-29T12:24:12.634 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:24:12.634 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2019-11-29T12:24:12.634 INFO:teuthology.orchestra.run.smithi062.stdout: Package Arch Version Repository 2019-11-29T12:24:12.634 INFO:teuthology.orchestra.run.smithi062.stdout: Size 2019-11-29T12:24:12.635 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2019-11-29T12:24:12.635 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2019-11-29T12:24:12.635 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-fuse x86_64 2:15.0.0-7809.g656c8e8.el7 ceph 566 k 2019-11-29T12:24:12.635 INFO:teuthology.orchestra.run.smithi062.stdout:Installing for dependencies: 2019-11-29T12:24:12.635 INFO:teuthology.orchestra.run.smithi062.stdout: python3 x86_64 3.6.8-10.el7 base 69 k 2019-11-29T12:24:12.635 INFO:teuthology.orchestra.run.smithi062.stdout: python3-libs x86_64 3.6.8-10.el7 base 7.0 M 2019-11-29T12:24:12.635 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pip noarch 9.0.3-5.el7 base 1.8 M 2019-11-29T12:24:12.635 INFO:teuthology.orchestra.run.smithi062.stdout: python3-setuptools noarch 39.2.0-10.el7 base 629 k 2019-11-29T12:24:12.636 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:24:12.636 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2019-11-29T12:24:12.636 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2019-11-29T12:24:12.636 INFO:teuthology.orchestra.run.smithi062.stdout:Install 1 Package (+4 Dependent packages) 2019-11-29T12:24:12.636 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:24:12.637 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 10 M 2019-11-29T12:24:12.637 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 49 M 2019-11-29T12:24:12.637 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading packages: 2019-11-29T12:24:12.658 INFO:teuthology.orchestra.run.smithi022.stdout:7 packages excluded due to repository priority protections 2019-11-29T12:24:13.004 INFO:teuthology.orchestra.run.smithi022.stdout:Resolving Dependencies 2019-11-29T12:24:13.004 INFO:teuthology.orchestra.run.smithi022.stdout:--> Running transaction check 2019-11-29T12:24:13.004 INFO:teuthology.orchestra.run.smithi022.stdout:---> Package ceph-fuse.x86_64 2:15.0.0-7809.g656c8e8.el7 will be installed 2019-11-29T12:24:13.015 INFO:teuthology.orchestra.run.smithi022.stdout:--> Processing Dependency: python36 for package: 2:ceph-fuse-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T12:24:13.048 INFO:teuthology.orchestra.run.smithi022.stdout:--> Processing Dependency: /usr/bin/python3 for package: 2:ceph-fuse-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T12:24:13.049 INFO:teuthology.orchestra.run.smithi022.stdout:--> Running transaction check 2019-11-29T12:24:13.049 INFO:teuthology.orchestra.run.smithi022.stdout:---> Package python3.x86_64 0:3.6.8-10.el7 will be installed 2019-11-29T12:24:13.050 INFO:teuthology.orchestra.run.smithi022.stdout:--> Processing Dependency: python3-libs(x86-64) = 3.6.8-10.el7 for package: python3-3.6.8-10.el7.x86_64 2019-11-29T12:24:13.052 INFO:teuthology.orchestra.run.smithi022.stdout:--> Processing Dependency: python3-setuptools for package: python3-3.6.8-10.el7.x86_64 2019-11-29T12:24:13.053 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2019-11-29T12:24:13.053 INFO:teuthology.orchestra.run.smithi062.stdout:Total 24 MB/s | 10 MB 00:00 2019-11-29T12:24:13.054 INFO:teuthology.orchestra.run.smithi022.stdout:--> Processing Dependency: python3-pip for package: python3-3.6.8-10.el7.x86_64 2019-11-29T12:24:13.054 INFO:teuthology.orchestra.run.smithi022.stdout:--> Processing Dependency: libpython3.6m.so.1.0()(64bit) for package: python3-3.6.8-10.el7.x86_64 2019-11-29T12:24:13.055 INFO:teuthology.orchestra.run.smithi022.stdout:--> Running transaction check 2019-11-29T12:24:13.055 INFO:teuthology.orchestra.run.smithi022.stdout:---> Package python3-libs.x86_64 0:3.6.8-10.el7 will be installed 2019-11-29T12:24:13.061 INFO:teuthology.orchestra.run.smithi022.stdout:---> Package python3-pip.noarch 0:9.0.3-5.el7 will be installed 2019-11-29T12:24:13.061 INFO:teuthology.orchestra.run.smithi022.stdout:---> Package python3-setuptools.noarch 0:39.2.0-10.el7 will be installed 2019-11-29T12:24:13.069 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2019-11-29T12:24:13.092 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2019-11-29T12:24:13.225 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded 2019-11-29T12:24:13.225 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2019-11-29T12:24:13.444 INFO:teuthology.orchestra.run.smithi022.stdout:--> Finished Dependency Resolution 2019-11-29T12:24:13.676 INFO:teuthology.orchestra.run.smithi022.stdout: 2019-11-29T12:24:13.676 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies Resolved 2019-11-29T12:24:13.676 INFO:teuthology.orchestra.run.smithi022.stdout: 2019-11-29T12:24:13.677 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2019-11-29T12:24:13.677 INFO:teuthology.orchestra.run.smithi022.stdout: Package Arch Version Repository 2019-11-29T12:24:13.677 INFO:teuthology.orchestra.run.smithi022.stdout: Size 2019-11-29T12:24:13.677 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2019-11-29T12:24:13.677 INFO:teuthology.orchestra.run.smithi022.stdout:Installing: 2019-11-29T12:24:13.677 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-fuse x86_64 2:15.0.0-7809.g656c8e8.el7 ceph 566 k 2019-11-29T12:24:13.678 INFO:teuthology.orchestra.run.smithi022.stdout:Installing for dependencies: 2019-11-29T12:24:13.678 INFO:teuthology.orchestra.run.smithi022.stdout: python3 x86_64 3.6.8-10.el7 base 69 k 2019-11-29T12:24:13.678 INFO:teuthology.orchestra.run.smithi022.stdout: python3-libs x86_64 3.6.8-10.el7 base 7.0 M 2019-11-29T12:24:13.678 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pip noarch 9.0.3-5.el7 base 1.8 M 2019-11-29T12:24:13.678 INFO:teuthology.orchestra.run.smithi022.stdout: python3-setuptools noarch 39.2.0-10.el7 base 629 k 2019-11-29T12:24:13.678 INFO:teuthology.orchestra.run.smithi022.stdout: 2019-11-29T12:24:13.678 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction Summary 2019-11-29T12:24:13.678 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2019-11-29T12:24:13.679 INFO:teuthology.orchestra.run.smithi022.stdout:Install 1 Package (+4 Dependent packages) 2019-11-29T12:24:13.679 INFO:teuthology.orchestra.run.smithi022.stdout: 2019-11-29T12:24:13.679 INFO:teuthology.orchestra.run.smithi022.stdout:Total download size: 10 M 2019-11-29T12:24:13.679 INFO:teuthology.orchestra.run.smithi022.stdout:Installed size: 49 M 2019-11-29T12:24:13.680 INFO:teuthology.orchestra.run.smithi022.stdout:Downloading packages: 2019-11-29T12:24:14.087 INFO:teuthology.orchestra.run.smithi022.stdout:-------------------------------------------------------------------------------- 2019-11-29T12:24:14.087 INFO:teuthology.orchestra.run.smithi022.stdout:Total 24 MB/s | 10 MB 00:00 2019-11-29T12:24:14.103 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction check 2019-11-29T12:24:14.127 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction test 2019-11-29T12:24:14.260 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction test succeeded 2019-11-29T12:24:14.261 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction 2019-11-29T12:24:15.532 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-libs-3.6.8-10.el7.x86_64 1/5 2019-11-29T12:24:16.070 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-3.6.8-10.el7.x86_64 2/5 2019-11-29T12:24:16.545 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-libs-3.6.8-10.el7.x86_64 1/5 2019-11-29T12:24:16.969 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-setuptools-39.2.0-10.el7.noarch 3/5 2019-11-29T12:24:17.074 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-3.6.8-10.el7.x86_64 2/5 2019-11-29T12:24:17.468 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-pip-9.0.3-5.el7.noarch 4/5 2019-11-29T12:24:17.768 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : 2:ceph-fuse-15.0.0-7809.g656c8e8.el7.x86_64 5/5 2019-11-29T12:24:17.942 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : 2:ceph-fuse-15.0.0-7809.g656c8e8.el7.x86_64 1/5 2019-11-29T12:24:17.993 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-setuptools-39.2.0-10.el7.noarch 3/5 2019-11-29T12:24:18.060 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-setuptools-39.2.0-10.el7.noarch 2/5 2019-11-29T12:24:18.194 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-libs-3.6.8-10.el7.x86_64 3/5 2019-11-29T12:24:18.302 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-3.6.8-10.el7.x86_64 4/5 2019-11-29T12:24:18.463 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-pip-9.0.3-5.el7.noarch 4/5 2019-11-29T12:24:18.731 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : 2:ceph-fuse-15.0.0-7809.g656c8e8.el7.x86_64 5/5 2019-11-29T12:24:18.846 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-pip-9.0.3-5.el7.noarch 5/5 2019-11-29T12:24:18.846 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:24:18.846 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2019-11-29T12:24:18.846 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-fuse.x86_64 2:15.0.0-7809.g656c8e8.el7 2019-11-29T12:24:18.846 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:24:18.846 INFO:teuthology.orchestra.run.smithi062.stdout:Dependency Installed: 2019-11-29T12:24:18.847 INFO:teuthology.orchestra.run.smithi062.stdout: python3.x86_64 0:3.6.8-10.el7 python3-libs.x86_64 0:3.6.8-10.el7 2019-11-29T12:24:18.847 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pip.noarch 0:9.0.3-5.el7 python3-setuptools.noarch 0:39.2.0-10.el7 2019-11-29T12:24:18.847 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:24:18.847 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2019-11-29T12:24:18.847 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : 2:ceph-fuse-15.0.0-7809.g656c8e8.el7.x86_64 1/5 2019-11-29T12:24:18.965 INFO:teuthology.orchestra.run.smithi062:> sudo yum -y install libcephfs2 2019-11-29T12:24:18.989 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-setuptools-39.2.0-10.el7.noarch 2/5 2019-11-29T12:24:19.081 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-libs-3.6.8-10.el7.x86_64 3/5 2019-11-29T12:24:19.165 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-3.6.8-10.el7.x86_64 4/5 2019-11-29T12:24:19.225 INFO:teuthology.orchestra.run.smithi062.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-29T12:24:19.271 INFO:teuthology.orchestra.run.smithi062.stdout:Loading mirror speeds from cached hostfile 2019-11-29T12:24:19.272 INFO:teuthology.orchestra.run.smithi062.stdout: * base: mirror.us-midwest-1.nexcess.net 2019-11-29T12:24:19.273 INFO:teuthology.orchestra.run.smithi062.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-29T12:24:19.273 INFO:teuthology.orchestra.run.smithi062.stdout: * extras: www.gtlib.gatech.edu 2019-11-29T12:24:19.273 INFO:teuthology.orchestra.run.smithi062.stdout: * updates: reflector.westga.edu 2019-11-29T12:24:19.633 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-pip-9.0.3-5.el7.noarch 5/5 2019-11-29T12:24:19.633 INFO:teuthology.orchestra.run.smithi022.stdout: 2019-11-29T12:24:19.633 INFO:teuthology.orchestra.run.smithi022.stdout:Installed: 2019-11-29T12:24:19.634 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-fuse.x86_64 2:15.0.0-7809.g656c8e8.el7 2019-11-29T12:24:19.634 INFO:teuthology.orchestra.run.smithi022.stdout: 2019-11-29T12:24:19.634 INFO:teuthology.orchestra.run.smithi022.stdout:Dependency Installed: 2019-11-29T12:24:19.634 INFO:teuthology.orchestra.run.smithi022.stdout: python3.x86_64 0:3.6.8-10.el7 python3-libs.x86_64 0:3.6.8-10.el7 2019-11-29T12:24:19.634 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pip.noarch 0:9.0.3-5.el7 python3-setuptools.noarch 0:39.2.0-10.el7 2019-11-29T12:24:19.634 INFO:teuthology.orchestra.run.smithi022.stdout: 2019-11-29T12:24:19.634 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2019-11-29T12:24:19.764 INFO:teuthology.orchestra.run.smithi022:> sudo yum -y install libcephfs2 2019-11-29T12:24:19.943 INFO:teuthology.orchestra.run.smithi062.stdout:7 packages excluded due to repository priority protections 2019-11-29T12:24:19.991 INFO:teuthology.orchestra.run.smithi022.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-29T12:24:20.030 INFO:teuthology.orchestra.run.smithi022.stdout:Loading mirror speeds from cached hostfile 2019-11-29T12:24:20.031 INFO:teuthology.orchestra.run.smithi022.stdout: * base: mirror.us-midwest-1.nexcess.net 2019-11-29T12:24:20.032 INFO:teuthology.orchestra.run.smithi022.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-29T12:24:20.032 INFO:teuthology.orchestra.run.smithi022.stdout: * extras: www.gtlib.gatech.edu 2019-11-29T12:24:20.032 INFO:teuthology.orchestra.run.smithi022.stdout: * updates: reflector.westga.edu 2019-11-29T12:24:20.290 INFO:teuthology.orchestra.run.smithi062.stdout:Package 2:libcephfs2-15.0.0-7809.g656c8e8.el7.x86_64 already installed and latest version 2019-11-29T12:24:20.290 INFO:teuthology.orchestra.run.smithi062.stdout:Nothing to do 2019-11-29T12:24:20.351 INFO:teuthology.orchestra.run.smithi062:> sudo yum -y install libcephfs-devel 2019-11-29T12:24:20.617 INFO:teuthology.orchestra.run.smithi062.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-29T12:24:20.664 INFO:teuthology.orchestra.run.smithi062.stdout:Loading mirror speeds from cached hostfile 2019-11-29T12:24:20.665 INFO:teuthology.orchestra.run.smithi062.stdout: * base: mirror.us-midwest-1.nexcess.net 2019-11-29T12:24:20.665 INFO:teuthology.orchestra.run.smithi062.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-29T12:24:20.666 INFO:teuthology.orchestra.run.smithi062.stdout: * extras: www.gtlib.gatech.edu 2019-11-29T12:24:20.666 INFO:teuthology.orchestra.run.smithi062.stdout: * updates: reflector.westga.edu 2019-11-29T12:24:20.698 INFO:teuthology.orchestra.run.smithi022.stdout:7 packages excluded due to repository priority protections 2019-11-29T12:24:21.037 INFO:teuthology.orchestra.run.smithi022.stdout:Package 2:libcephfs2-15.0.0-7809.g656c8e8.el7.x86_64 already installed and latest version 2019-11-29T12:24:21.037 INFO:teuthology.orchestra.run.smithi022.stdout:Nothing to do 2019-11-29T12:24:21.098 INFO:teuthology.orchestra.run.smithi022:> sudo yum -y install libcephfs-devel 2019-11-29T12:24:21.327 INFO:teuthology.orchestra.run.smithi022.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-29T12:24:21.329 INFO:teuthology.orchestra.run.smithi062.stdout:7 packages excluded due to repository priority protections 2019-11-29T12:24:21.370 INFO:teuthology.orchestra.run.smithi022.stdout:Loading mirror speeds from cached hostfile 2019-11-29T12:24:21.371 INFO:teuthology.orchestra.run.smithi022.stdout: * base: mirror.us-midwest-1.nexcess.net 2019-11-29T12:24:21.371 INFO:teuthology.orchestra.run.smithi022.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-29T12:24:21.372 INFO:teuthology.orchestra.run.smithi022.stdout: * extras: www.gtlib.gatech.edu 2019-11-29T12:24:21.372 INFO:teuthology.orchestra.run.smithi022.stdout: * updates: reflector.westga.edu 2019-11-29T12:24:21.679 INFO:teuthology.orchestra.run.smithi062.stdout:Resolving Dependencies 2019-11-29T12:24:21.680 INFO:teuthology.orchestra.run.smithi062.stdout:--> Running transaction check 2019-11-29T12:24:21.680 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package libcephfs-devel.x86_64 2:15.0.0-7809.g656c8e8.el7 will be installed 2019-11-29T12:24:21.680 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: librados-devel = 2:15.0.0-7809.g656c8e8.el7 for package: 2:libcephfs-devel-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T12:24:21.711 INFO:teuthology.orchestra.run.smithi062.stdout:--> Running transaction check 2019-11-29T12:24:21.711 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package librados-devel.x86_64 2:15.0.0-7809.g656c8e8.el7 will be installed 2019-11-29T12:24:22.031 INFO:teuthology.orchestra.run.smithi022.stdout:7 packages excluded due to repository priority protections 2019-11-29T12:24:22.105 INFO:teuthology.orchestra.run.smithi062.stdout:--> Finished Dependency Resolution 2019-11-29T12:24:22.341 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:24:22.341 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies Resolved 2019-11-29T12:24:22.341 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:24:22.342 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2019-11-29T12:24:22.342 INFO:teuthology.orchestra.run.smithi062.stdout: Package Arch Version Repository 2019-11-29T12:24:22.342 INFO:teuthology.orchestra.run.smithi062.stdout: Size 2019-11-29T12:24:22.342 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2019-11-29T12:24:22.342 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2019-11-29T12:24:22.342 INFO:teuthology.orchestra.run.smithi062.stdout: libcephfs-devel x86_64 2:15.0.0-7809.g656c8e8.el7 ceph 17 k 2019-11-29T12:24:22.342 INFO:teuthology.orchestra.run.smithi062.stdout:Installing for dependencies: 2019-11-29T12:24:22.343 INFO:teuthology.orchestra.run.smithi062.stdout: librados-devel x86_64 2:15.0.0-7809.g656c8e8.el7 ceph 153 k 2019-11-29T12:24:22.343 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:24:22.343 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2019-11-29T12:24:22.343 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2019-11-29T12:24:22.343 INFO:teuthology.orchestra.run.smithi062.stdout:Install 1 Package (+1 Dependent package) 2019-11-29T12:24:22.343 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:24:22.343 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 170 k 2019-11-29T12:24:22.344 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 679 k 2019-11-29T12:24:22.344 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading packages: 2019-11-29T12:24:22.376 INFO:teuthology.orchestra.run.smithi022.stdout:Resolving Dependencies 2019-11-29T12:24:22.376 INFO:teuthology.orchestra.run.smithi022.stdout:--> Running transaction check 2019-11-29T12:24:22.377 INFO:teuthology.orchestra.run.smithi022.stdout:---> Package libcephfs-devel.x86_64 2:15.0.0-7809.g656c8e8.el7 will be installed 2019-11-29T12:24:22.377 INFO:teuthology.orchestra.run.smithi022.stdout:--> Processing Dependency: librados-devel = 2:15.0.0-7809.g656c8e8.el7 for package: 2:libcephfs-devel-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T12:24:22.408 INFO:teuthology.orchestra.run.smithi022.stdout:--> Running transaction check 2019-11-29T12:24:22.408 INFO:teuthology.orchestra.run.smithi022.stdout:---> Package librados-devel.x86_64 2:15.0.0-7809.g656c8e8.el7 will be installed 2019-11-29T12:24:22.741 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2019-11-29T12:24:22.741 INFO:teuthology.orchestra.run.smithi062.stdout:Total 425 kB/s | 170 kB 00:00 2019-11-29T12:24:22.744 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2019-11-29T12:24:22.756 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2019-11-29T12:24:22.758 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded 2019-11-29T12:24:22.759 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2019-11-29T12:24:22.798 INFO:teuthology.orchestra.run.smithi022.stdout:--> Finished Dependency Resolution 2019-11-29T12:24:23.033 INFO:teuthology.orchestra.run.smithi022.stdout: 2019-11-29T12:24:23.034 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies Resolved 2019-11-29T12:24:23.034 INFO:teuthology.orchestra.run.smithi022.stdout: 2019-11-29T12:24:23.034 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2019-11-29T12:24:23.035 INFO:teuthology.orchestra.run.smithi022.stdout: Package Arch Version Repository 2019-11-29T12:24:23.035 INFO:teuthology.orchestra.run.smithi022.stdout: Size 2019-11-29T12:24:23.035 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2019-11-29T12:24:23.035 INFO:teuthology.orchestra.run.smithi022.stdout:Installing: 2019-11-29T12:24:23.035 INFO:teuthology.orchestra.run.smithi022.stdout: libcephfs-devel x86_64 2:15.0.0-7809.g656c8e8.el7 ceph 17 k 2019-11-29T12:24:23.035 INFO:teuthology.orchestra.run.smithi022.stdout:Installing for dependencies: 2019-11-29T12:24:23.035 INFO:teuthology.orchestra.run.smithi022.stdout: librados-devel x86_64 2:15.0.0-7809.g656c8e8.el7 ceph 153 k 2019-11-29T12:24:23.036 INFO:teuthology.orchestra.run.smithi022.stdout: 2019-11-29T12:24:23.036 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction Summary 2019-11-29T12:24:23.036 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2019-11-29T12:24:23.036 INFO:teuthology.orchestra.run.smithi022.stdout:Install 1 Package (+1 Dependent package) 2019-11-29T12:24:23.036 INFO:teuthology.orchestra.run.smithi022.stdout: 2019-11-29T12:24:23.036 INFO:teuthology.orchestra.run.smithi022.stdout:Total download size: 170 k 2019-11-29T12:24:23.036 INFO:teuthology.orchestra.run.smithi022.stdout:Installed size: 679 k 2019-11-29T12:24:23.037 INFO:teuthology.orchestra.run.smithi022.stdout:Downloading packages: 2019-11-29T12:24:23.412 INFO:teuthology.orchestra.run.smithi022.stdout:-------------------------------------------------------------------------------- 2019-11-29T12:24:23.413 INFO:teuthology.orchestra.run.smithi022.stdout:Total 450 kB/s | 170 kB 00:00 2019-11-29T12:24:23.415 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction check 2019-11-29T12:24:23.428 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction test 2019-11-29T12:24:23.431 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction test succeeded 2019-11-29T12:24:23.431 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction 2019-11-29T12:24:23.884 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : 2:librados-devel-15.0.0-7809.g656c8e8.el7.x86_64 1/2 2019-11-29T12:24:24.020 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : 2:librados-devel-15.0.0-7809.g656c8e8.el7.x86_64 1/2 2019-11-29T12:24:24.163 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : 2:libcephfs-devel-15.0.0-7809.g656c8e8.el7.x86_64 2/2 2019-11-29T12:24:24.273 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : 2:libcephfs-devel-15.0.0-7809.g656c8e8.el7.x86_64 2/2 2019-11-29T12:24:24.294 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : 2:libcephfs-devel-15.0.0-7809.g656c8e8.el7.x86_64 1/2 2019-11-29T12:24:24.362 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : 2:libcephfs-devel-15.0.0-7809.g656c8e8.el7.x86_64 1/2 2019-11-29T12:24:24.812 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : 2:librados-devel-15.0.0-7809.g656c8e8.el7.x86_64 2/2 2019-11-29T12:24:24.813 INFO:teuthology.orchestra.run.smithi022.stdout: 2019-11-29T12:24:24.813 INFO:teuthology.orchestra.run.smithi022.stdout:Installed: 2019-11-29T12:24:24.813 INFO:teuthology.orchestra.run.smithi022.stdout: libcephfs-devel.x86_64 2:15.0.0-7809.g656c8e8.el7 2019-11-29T12:24:24.813 INFO:teuthology.orchestra.run.smithi022.stdout: 2019-11-29T12:24:24.813 INFO:teuthology.orchestra.run.smithi022.stdout:Dependency Installed: 2019-11-29T12:24:24.813 INFO:teuthology.orchestra.run.smithi022.stdout: librados-devel.x86_64 2:15.0.0-7809.g656c8e8.el7 2019-11-29T12:24:24.813 INFO:teuthology.orchestra.run.smithi022.stdout: 2019-11-29T12:24:24.814 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2019-11-29T12:24:24.886 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : 2:librados-devel-15.0.0-7809.g656c8e8.el7.x86_64 2/2 2019-11-29T12:24:24.886 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:24:24.886 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2019-11-29T12:24:24.886 INFO:teuthology.orchestra.run.smithi062.stdout: libcephfs-devel.x86_64 2:15.0.0-7809.g656c8e8.el7 2019-11-29T12:24:24.887 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:24:24.887 INFO:teuthology.orchestra.run.smithi062.stdout:Dependency Installed: 2019-11-29T12:24:24.887 INFO:teuthology.orchestra.run.smithi062.stdout: librados-devel.x86_64 2:15.0.0-7809.g656c8e8.el7 2019-11-29T12:24:24.887 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:24:24.887 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2019-11-29T12:24:24.941 INFO:teuthology.orchestra.run.smithi022:> sudo yum -y install librados2 2019-11-29T12:24:25.006 INFO:teuthology.orchestra.run.smithi062:> sudo yum -y install librados2 2019-11-29T12:24:25.200 INFO:teuthology.orchestra.run.smithi022.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-29T12:24:25.245 INFO:teuthology.orchestra.run.smithi022.stdout:Loading mirror speeds from cached hostfile 2019-11-29T12:24:25.246 INFO:teuthology.orchestra.run.smithi022.stdout: * base: mirror.us-midwest-1.nexcess.net 2019-11-29T12:24:25.247 INFO:teuthology.orchestra.run.smithi022.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-29T12:24:25.247 INFO:teuthology.orchestra.run.smithi022.stdout: * extras: www.gtlib.gatech.edu 2019-11-29T12:24:25.247 INFO:teuthology.orchestra.run.smithi022.stdout: * updates: reflector.westga.edu 2019-11-29T12:24:25.252 INFO:teuthology.orchestra.run.smithi062.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-29T12:24:25.296 INFO:teuthology.orchestra.run.smithi062.stdout:Loading mirror speeds from cached hostfile 2019-11-29T12:24:25.297 INFO:teuthology.orchestra.run.smithi062.stdout: * base: mirror.us-midwest-1.nexcess.net 2019-11-29T12:24:25.298 INFO:teuthology.orchestra.run.smithi062.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-29T12:24:25.298 INFO:teuthology.orchestra.run.smithi062.stdout: * extras: www.gtlib.gatech.edu 2019-11-29T12:24:25.298 INFO:teuthology.orchestra.run.smithi062.stdout: * updates: reflector.westga.edu 2019-11-29T12:24:25.912 INFO:teuthology.orchestra.run.smithi022.stdout:7 packages excluded due to repository priority protections 2019-11-29T12:24:25.967 INFO:teuthology.orchestra.run.smithi062.stdout:7 packages excluded due to repository priority protections 2019-11-29T12:24:26.262 INFO:teuthology.orchestra.run.smithi022.stdout:Package 2:librados2-15.0.0-7809.g656c8e8.el7.x86_64 already installed and latest version 2019-11-29T12:24:26.262 INFO:teuthology.orchestra.run.smithi022.stdout:Nothing to do 2019-11-29T12:24:26.311 INFO:teuthology.orchestra.run.smithi062.stdout:Package 2:librados2-15.0.0-7809.g656c8e8.el7.x86_64 already installed and latest version 2019-11-29T12:24:26.311 INFO:teuthology.orchestra.run.smithi062.stdout:Nothing to do 2019-11-29T12:24:26.323 INFO:teuthology.orchestra.run.smithi022:> sudo yum -y install librbd1 2019-11-29T12:24:26.372 INFO:teuthology.orchestra.run.smithi062:> sudo yum -y install librbd1 2019-11-29T12:24:26.573 INFO:teuthology.orchestra.run.smithi022.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-29T12:24:26.598 INFO:teuthology.orchestra.run.smithi062.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-29T12:24:26.618 INFO:teuthology.orchestra.run.smithi022.stdout:Loading mirror speeds from cached hostfile 2019-11-29T12:24:26.620 INFO:teuthology.orchestra.run.smithi022.stdout: * base: mirror.us-midwest-1.nexcess.net 2019-11-29T12:24:26.620 INFO:teuthology.orchestra.run.smithi022.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-29T12:24:26.620 INFO:teuthology.orchestra.run.smithi022.stdout: * extras: www.gtlib.gatech.edu 2019-11-29T12:24:26.621 INFO:teuthology.orchestra.run.smithi022.stdout: * updates: reflector.westga.edu 2019-11-29T12:24:26.640 INFO:teuthology.orchestra.run.smithi062.stdout:Loading mirror speeds from cached hostfile 2019-11-29T12:24:26.641 INFO:teuthology.orchestra.run.smithi062.stdout: * base: mirror.us-midwest-1.nexcess.net 2019-11-29T12:24:26.641 INFO:teuthology.orchestra.run.smithi062.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-29T12:24:26.641 INFO:teuthology.orchestra.run.smithi062.stdout: * extras: www.gtlib.gatech.edu 2019-11-29T12:24:26.642 INFO:teuthology.orchestra.run.smithi062.stdout: * updates: reflector.westga.edu 2019-11-29T12:24:27.279 INFO:teuthology.orchestra.run.smithi022.stdout:7 packages excluded due to repository priority protections 2019-11-29T12:24:27.280 INFO:teuthology.orchestra.run.smithi062.stdout:7 packages excluded due to repository priority protections 2019-11-29T12:24:27.619 INFO:teuthology.orchestra.run.smithi062.stdout:Package 2:librbd1-15.0.0-7809.g656c8e8.el7.x86_64 already installed and latest version 2019-11-29T12:24:27.620 INFO:teuthology.orchestra.run.smithi062.stdout:Nothing to do 2019-11-29T12:24:27.627 INFO:teuthology.orchestra.run.smithi022.stdout:Package 2:librbd1-15.0.0-7809.g656c8e8.el7.x86_64 already installed and latest version 2019-11-29T12:24:27.627 INFO:teuthology.orchestra.run.smithi022.stdout:Nothing to do 2019-11-29T12:24:27.681 INFO:teuthology.orchestra.run.smithi062:> sudo yum -y install python-ceph 2019-11-29T12:24:27.689 INFO:teuthology.orchestra.run.smithi022:> sudo yum -y install python-ceph 2019-11-29T12:24:27.859 INFO:teuthology.orchestra.run.smithi022.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-29T12:24:27.893 INFO:teuthology.orchestra.run.smithi062.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-29T12:24:27.896 INFO:teuthology.orchestra.run.smithi022.stdout:Loading mirror speeds from cached hostfile 2019-11-29T12:24:27.897 INFO:teuthology.orchestra.run.smithi022.stdout: * base: mirror.us-midwest-1.nexcess.net 2019-11-29T12:24:27.897 INFO:teuthology.orchestra.run.smithi022.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-29T12:24:27.898 INFO:teuthology.orchestra.run.smithi022.stdout: * extras: www.gtlib.gatech.edu 2019-11-29T12:24:27.898 INFO:teuthology.orchestra.run.smithi022.stdout: * updates: reflector.westga.edu 2019-11-29T12:24:27.933 INFO:teuthology.orchestra.run.smithi062.stdout:Loading mirror speeds from cached hostfile 2019-11-29T12:24:27.934 INFO:teuthology.orchestra.run.smithi062.stdout: * base: mirror.us-midwest-1.nexcess.net 2019-11-29T12:24:27.935 INFO:teuthology.orchestra.run.smithi062.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-29T12:24:27.935 INFO:teuthology.orchestra.run.smithi062.stdout: * extras: www.gtlib.gatech.edu 2019-11-29T12:24:27.935 INFO:teuthology.orchestra.run.smithi062.stdout: * updates: reflector.westga.edu 2019-11-29T12:24:28.512 INFO:teuthology.orchestra.run.smithi022.stdout:7 packages excluded due to repository priority protections 2019-11-29T12:24:28.597 INFO:teuthology.orchestra.run.smithi062.stdout:7 packages excluded due to repository priority protections 2019-11-29T12:24:28.852 INFO:teuthology.orchestra.run.smithi022.stdout:Resolving Dependencies 2019-11-29T12:24:28.852 INFO:teuthology.orchestra.run.smithi022.stdout:--> Running transaction check 2019-11-29T12:24:28.852 INFO:teuthology.orchestra.run.smithi022.stdout:---> Package python-ceph-compat.x86_64 2:15.0.0-7809.g656c8e8.el7 will be installed 2019-11-29T12:24:28.938 INFO:teuthology.orchestra.run.smithi062.stdout:Resolving Dependencies 2019-11-29T12:24:28.938 INFO:teuthology.orchestra.run.smithi062.stdout:--> Running transaction check 2019-11-29T12:24:28.938 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package python-ceph-compat.x86_64 2:15.0.0-7809.g656c8e8.el7 will be installed 2019-11-29T12:24:29.242 INFO:teuthology.orchestra.run.smithi022.stdout:--> Finished Dependency Resolution 2019-11-29T12:24:29.329 INFO:teuthology.orchestra.run.smithi062.stdout:--> Finished Dependency Resolution 2019-11-29T12:24:29.478 INFO:teuthology.orchestra.run.smithi022.stdout: 2019-11-29T12:24:29.478 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies Resolved 2019-11-29T12:24:29.479 INFO:teuthology.orchestra.run.smithi022.stdout: 2019-11-29T12:24:29.479 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2019-11-29T12:24:29.479 INFO:teuthology.orchestra.run.smithi022.stdout: Package Arch Version Repository 2019-11-29T12:24:29.479 INFO:teuthology.orchestra.run.smithi022.stdout: Size 2019-11-29T12:24:29.480 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2019-11-29T12:24:29.480 INFO:teuthology.orchestra.run.smithi022.stdout:Installing: 2019-11-29T12:24:29.480 INFO:teuthology.orchestra.run.smithi022.stdout: python-ceph-compat x86_64 2:15.0.0-7809.g656c8e8.el7 ceph 2.2 k 2019-11-29T12:24:29.480 INFO:teuthology.orchestra.run.smithi022.stdout: 2019-11-29T12:24:29.480 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction Summary 2019-11-29T12:24:29.480 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2019-11-29T12:24:29.480 INFO:teuthology.orchestra.run.smithi022.stdout:Install 1 Package 2019-11-29T12:24:29.480 INFO:teuthology.orchestra.run.smithi022.stdout: 2019-11-29T12:24:29.481 INFO:teuthology.orchestra.run.smithi022.stdout:Total download size: 2.2 k 2019-11-29T12:24:29.481 INFO:teuthology.orchestra.run.smithi022.stdout:Installed size: 0 2019-11-29T12:24:29.481 INFO:teuthology.orchestra.run.smithi022.stdout:Downloading packages: 2019-11-29T12:24:29.566 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:24:29.566 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies Resolved 2019-11-29T12:24:29.567 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:24:29.567 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2019-11-29T12:24:29.567 INFO:teuthology.orchestra.run.smithi062.stdout: Package Arch Version Repository 2019-11-29T12:24:29.567 INFO:teuthology.orchestra.run.smithi062.stdout: Size 2019-11-29T12:24:29.567 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2019-11-29T12:24:29.567 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2019-11-29T12:24:29.568 INFO:teuthology.orchestra.run.smithi062.stdout: python-ceph-compat x86_64 2:15.0.0-7809.g656c8e8.el7 ceph 2.2 k 2019-11-29T12:24:29.568 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:24:29.568 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2019-11-29T12:24:29.568 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2019-11-29T12:24:29.568 INFO:teuthology.orchestra.run.smithi062.stdout:Install 1 Package 2019-11-29T12:24:29.568 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:24:29.568 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 2.2 k 2019-11-29T12:24:29.569 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 0 2019-11-29T12:24:29.569 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading packages: 2019-11-29T12:24:29.761 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction check 2019-11-29T12:24:29.763 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction test 2019-11-29T12:24:29.765 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction test succeeded 2019-11-29T12:24:29.766 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction 2019-11-29T12:24:29.871 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2019-11-29T12:24:29.872 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2019-11-29T12:24:29.874 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded 2019-11-29T12:24:29.874 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2019-11-29T12:24:30.277 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : 2:python-ceph-compat-15.0.0-7809.g656c8e8.el7.x86_64 1/1 2019-11-29T12:24:30.375 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : 2:python-ceph-compat-15.0.0-7809.g656c8e8.el7.x86_64 1/1 2019-11-29T12:24:30.801 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : 2:python-ceph-compat-15.0.0-7809.g656c8e8.el7.x86_64 1/1 2019-11-29T12:24:30.802 INFO:teuthology.orchestra.run.smithi022.stdout: 2019-11-29T12:24:30.802 INFO:teuthology.orchestra.run.smithi022.stdout:Installed: 2019-11-29T12:24:30.802 INFO:teuthology.orchestra.run.smithi022.stdout: python-ceph-compat.x86_64 2:15.0.0-7809.g656c8e8.el7 2019-11-29T12:24:30.802 INFO:teuthology.orchestra.run.smithi022.stdout: 2019-11-29T12:24:30.802 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2019-11-29T12:24:30.866 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : 2:python-ceph-compat-15.0.0-7809.g656c8e8.el7.x86_64 1/1 2019-11-29T12:24:30.866 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:24:30.866 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2019-11-29T12:24:30.866 INFO:teuthology.orchestra.run.smithi062.stdout: python-ceph-compat.x86_64 2:15.0.0-7809.g656c8e8.el7 2019-11-29T12:24:30.866 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:24:30.867 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2019-11-29T12:24:30.927 INFO:teuthology.orchestra.run.smithi022:> sudo yum -y install rbd-fuse 2019-11-29T12:24:30.997 INFO:teuthology.orchestra.run.smithi062:> sudo yum -y install rbd-fuse 2019-11-29T12:24:31.188 INFO:teuthology.orchestra.run.smithi022.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-29T12:24:31.234 INFO:teuthology.orchestra.run.smithi022.stdout:Loading mirror speeds from cached hostfile 2019-11-29T12:24:31.235 INFO:teuthology.orchestra.run.smithi022.stdout: * base: mirror.us-midwest-1.nexcess.net 2019-11-29T12:24:31.236 INFO:teuthology.orchestra.run.smithi022.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-29T12:24:31.236 INFO:teuthology.orchestra.run.smithi022.stdout: * extras: www.gtlib.gatech.edu 2019-11-29T12:24:31.236 INFO:teuthology.orchestra.run.smithi022.stdout: * updates: reflector.westga.edu 2019-11-29T12:24:31.262 INFO:teuthology.orchestra.run.smithi062.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-29T12:24:31.308 INFO:teuthology.orchestra.run.smithi062.stdout:Loading mirror speeds from cached hostfile 2019-11-29T12:24:31.309 INFO:teuthology.orchestra.run.smithi062.stdout: * base: mirror.us-midwest-1.nexcess.net 2019-11-29T12:24:31.310 INFO:teuthology.orchestra.run.smithi062.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-29T12:24:31.310 INFO:teuthology.orchestra.run.smithi062.stdout: * extras: www.gtlib.gatech.edu 2019-11-29T12:24:31.310 INFO:teuthology.orchestra.run.smithi062.stdout: * updates: reflector.westga.edu 2019-11-29T12:24:31.896 INFO:teuthology.orchestra.run.smithi022.stdout:7 packages excluded due to repository priority protections 2019-11-29T12:24:31.977 INFO:teuthology.orchestra.run.smithi062.stdout:7 packages excluded due to repository priority protections 2019-11-29T12:24:32.243 INFO:teuthology.orchestra.run.smithi022.stdout:Resolving Dependencies 2019-11-29T12:24:32.243 INFO:teuthology.orchestra.run.smithi022.stdout:--> Running transaction check 2019-11-29T12:24:32.244 INFO:teuthology.orchestra.run.smithi022.stdout:---> Package rbd-fuse.x86_64 2:15.0.0-7809.g656c8e8.el7 will be installed 2019-11-29T12:24:32.324 INFO:teuthology.orchestra.run.smithi062.stdout:Resolving Dependencies 2019-11-29T12:24:32.325 INFO:teuthology.orchestra.run.smithi062.stdout:--> Running transaction check 2019-11-29T12:24:32.325 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package rbd-fuse.x86_64 2:15.0.0-7809.g656c8e8.el7 will be installed 2019-11-29T12:24:32.643 INFO:teuthology.orchestra.run.smithi022.stdout:--> Finished Dependency Resolution 2019-11-29T12:24:32.722 INFO:teuthology.orchestra.run.smithi062.stdout:--> Finished Dependency Resolution 2019-11-29T12:24:32.880 INFO:teuthology.orchestra.run.smithi022.stdout: 2019-11-29T12:24:32.880 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies Resolved 2019-11-29T12:24:32.881 INFO:teuthology.orchestra.run.smithi022.stdout: 2019-11-29T12:24:32.881 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2019-11-29T12:24:32.881 INFO:teuthology.orchestra.run.smithi022.stdout: Package Arch Version Repository Size 2019-11-29T12:24:32.881 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2019-11-29T12:24:32.881 INFO:teuthology.orchestra.run.smithi022.stdout:Installing: 2019-11-29T12:24:32.881 INFO:teuthology.orchestra.run.smithi022.stdout: rbd-fuse x86_64 2:15.0.0-7809.g656c8e8.el7 ceph 76 k 2019-11-29T12:24:32.881 INFO:teuthology.orchestra.run.smithi022.stdout: 2019-11-29T12:24:32.882 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction Summary 2019-11-29T12:24:32.882 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2019-11-29T12:24:32.882 INFO:teuthology.orchestra.run.smithi022.stdout:Install 1 Package 2019-11-29T12:24:32.882 INFO:teuthology.orchestra.run.smithi022.stdout: 2019-11-29T12:24:32.882 INFO:teuthology.orchestra.run.smithi022.stdout:Total download size: 76 k 2019-11-29T12:24:32.882 INFO:teuthology.orchestra.run.smithi022.stdout:Installed size: 200 k 2019-11-29T12:24:32.882 INFO:teuthology.orchestra.run.smithi022.stdout:Downloading packages: 2019-11-29T12:24:32.960 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:24:32.960 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies Resolved 2019-11-29T12:24:32.961 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:24:32.961 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2019-11-29T12:24:32.961 INFO:teuthology.orchestra.run.smithi062.stdout: Package Arch Version Repository Size 2019-11-29T12:24:32.962 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2019-11-29T12:24:32.962 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2019-11-29T12:24:32.962 INFO:teuthology.orchestra.run.smithi062.stdout: rbd-fuse x86_64 2:15.0.0-7809.g656c8e8.el7 ceph 76 k 2019-11-29T12:24:32.962 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:24:32.962 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2019-11-29T12:24:32.962 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2019-11-29T12:24:32.962 INFO:teuthology.orchestra.run.smithi062.stdout:Install 1 Package 2019-11-29T12:24:32.963 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:24:32.963 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 76 k 2019-11-29T12:24:32.963 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 200 k 2019-11-29T12:24:32.963 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading packages: 2019-11-29T12:24:33.214 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction check 2019-11-29T12:24:33.235 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction test 2019-11-29T12:24:33.237 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction test succeeded 2019-11-29T12:24:33.238 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction 2019-11-29T12:24:33.294 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2019-11-29T12:24:33.316 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2019-11-29T12:24:33.318 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded 2019-11-29T12:24:33.319 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2019-11-29T12:24:33.714 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : 2:rbd-fuse-15.0.0-7809.g656c8e8.el7.x86_64 1/1 2019-11-29T12:24:34.017 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : 2:rbd-fuse-15.0.0-7809.g656c8e8.el7.x86_64 1/1 2019-11-29T12:24:34.188 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : 2:rbd-fuse-15.0.0-7809.g656c8e8.el7.x86_64 1/1 2019-11-29T12:24:34.188 INFO:teuthology.orchestra.run.smithi022.stdout: 2019-11-29T12:24:34.188 INFO:teuthology.orchestra.run.smithi022.stdout:Installed: 2019-11-29T12:24:34.188 INFO:teuthology.orchestra.run.smithi022.stdout: rbd-fuse.x86_64 2:15.0.0-7809.g656c8e8.el7 2019-11-29T12:24:34.189 INFO:teuthology.orchestra.run.smithi022.stdout: 2019-11-29T12:24:34.189 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2019-11-29T12:24:34.304 DEBUG:teuthology.parallel:result is None 2019-11-29T12:24:34.438 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : 2:rbd-fuse-15.0.0-7809.g656c8e8.el7.x86_64 1/1 2019-11-29T12:24:34.439 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:24:34.439 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2019-11-29T12:24:34.439 INFO:teuthology.orchestra.run.smithi062.stdout: rbd-fuse.x86_64 2:15.0.0-7809.g656c8e8.el7 2019-11-29T12:24:34.439 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:24:34.439 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2019-11-29T12:24:34.556 DEBUG:teuthology.parallel:result is None 2019-11-29T12:24:34.557 INFO:teuthology.orchestra.run.smithi022:> sudo lsb_release -is 2019-11-29T12:24:34.715 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS 2019-11-29T12:24:34.717 DEBUG:teuthology.misc:System to be installed: CentOS 2019-11-29T12:24:34.718 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=notcmalloc&distros=centos%2F7%2Fx86_64&sha1=656c8e8049c2c1acd363143c842c2edf1fe09b64 2019-11-29T12:24:34.882 INFO:teuthology.orchestra.run.smithi022:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2019-11-29T12:24:35.025 INFO:teuthology.orchestra.run.smithi022.stdout:15.0.0-7809.g656c8e8.el7 2019-11-29T12:24:35.025 INFO:teuthology.packaging:The installed version of ceph is 15.0.0-7809.g656c8e8.el7 2019-11-29T12:24:35.026 INFO:teuthology.task.install:The correct ceph version 15.0.0-7809.g656c8e8 is installed. 2019-11-29T12:24:35.026 INFO:teuthology.orchestra.run.smithi062:> sudo lsb_release -is 2019-11-29T12:24:35.180 INFO:teuthology.orchestra.run.smithi062.stdout:CentOS 2019-11-29T12:24:35.182 DEBUG:teuthology.misc:System to be installed: CentOS 2019-11-29T12:24:35.182 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=notcmalloc&distros=centos%2F7%2Fx86_64&sha1=656c8e8049c2c1acd363143c842c2edf1fe09b64 2019-11-29T12:24:35.337 INFO:teuthology.orchestra.run.smithi062:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2019-11-29T12:24:35.471 INFO:teuthology.orchestra.run.smithi062.stdout:15.0.0-7809.g656c8e8.el7 2019-11-29T12:24:35.471 INFO:teuthology.packaging:The installed version of ceph is 15.0.0-7809.g656c8e8.el7 2019-11-29T12:24:35.472 INFO:teuthology.task.install:The correct ceph version 15.0.0-7809.g656c8e8 is installed. 2019-11-29T12:24:35.472 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2019-11-29T12:24:35.473 INFO:teuthology.orchestra.run.smithi022:> sudo sh -c 'cat > /home/ubuntu/cephtest/valgrind.supp' 2019-11-29T12:24:35.597 INFO:teuthology.orchestra.run.smithi062:> sudo sh -c 'cat > /home/ubuntu/cephtest/valgrind.supp' 2019-11-29T12:24:35.722 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2019-11-29T12:24:35.722 INFO:teuthology.orchestra.run.smithi022:> sudo sh -c 'cat > /usr/bin/daemon-helper' 2019-11-29T12:24:35.844 INFO:teuthology.orchestra.run.smithi022:> sudo chmod a=rx -- /usr/bin/daemon-helper 2019-11-29T12:24:35.957 INFO:teuthology.orchestra.run.smithi062:> sudo sh -c 'cat > /usr/bin/daemon-helper' 2019-11-29T12:24:36.082 INFO:teuthology.orchestra.run.smithi062:> sudo chmod a=rx -- /usr/bin/daemon-helper 2019-11-29T12:24:36.186 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2019-11-29T12:24:36.186 INFO:teuthology.orchestra.run.smithi022:> sudo sh -c 'cat > /usr/bin/adjust-ulimits' 2019-11-29T12:24:36.309 INFO:teuthology.orchestra.run.smithi022:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2019-11-29T12:24:36.417 INFO:teuthology.orchestra.run.smithi062:> sudo sh -c 'cat > /usr/bin/adjust-ulimits' 2019-11-29T12:24:36.537 INFO:teuthology.orchestra.run.smithi062:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2019-11-29T12:24:36.649 INFO:teuthology.run_tasks:Running task ceph... 2019-11-29T12:24:36.730 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2019-11-29T12:24:36.731 INFO:teuthology.orchestra.run.smithi022:> sudo chmod 777 /var/log/ceph 2019-11-29T12:24:36.736 INFO:teuthology.orchestra.run.smithi062:> sudo chmod 777 /var/log/ceph 2019-11-29T12:24:36.855 INFO:tasks.ceph:Disabling ceph logrotate... 2019-11-29T12:24:36.855 INFO:teuthology.orchestra.run.smithi022:> sudo rm -f -- /etc/logrotate.d/ceph 2019-11-29T12:24:36.860 INFO:teuthology.orchestra.run.smithi062:> sudo rm -f -- /etc/logrotate.d/ceph 2019-11-29T12:24:36.972 INFO:tasks.ceph:Creating extra log directories... 2019-11-29T12:24:36.972 INFO:teuthology.orchestra.run.smithi022:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2019-11-29T12:24:36.977 INFO:teuthology.orchestra.run.smithi062:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2019-11-29T12:24:37.092 INFO:tasks.ceph:Creating ceph cluster ceph... 2019-11-29T12:24:37.092 INFO:tasks.ceph:config {'mon_bind_addrvec': True, 'block_journal': None, 'fs': 'xfs', 'log_whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME'], 'skip_mgr_daemons': False, 'cpu_profile': set([]), 'mkfs_options': None, 'tmpfs_journal': None, 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mount_options': None, 'conf': {'global': {'osd heartbeat grace': 40, 'ms inject socket failures': 5000, 'osd_max_pg_log_entries': 10, 'mon client directed command retry': 5, 'osd_min_pg_log_entries': 10}, 'osd': {'mon osd full ratio': 0.9, 'debug ms': 1, 'bluestore fsck on mount': True, 'debug osd': 25, 'debug bluestore': 20, 'debug bluefs': 20, 'mon osd backfillfull_ratio': 0.85, 'debug rocksdb': 10, 'osd shutdown pgref assert': True, 'debug journal': 20, 'bluestore allocator': 'bitmap', 'mon osd nearfull ratio': 0.8, 'osd objectstore': 'bluestore', 'bdev async discard': True, 'osd fast shutdown': False, 'bluestore block size': 96636764160, 'debug filestore': 20, 'bdev enable discard': True, 'osd failsafe full ratio': 0.95}, 'mon': {'debug mon': 20, 'debug paxos': 20, 'mon osd crush smoke test': False, 'debug ms': 1}, 'client': {'debug rgw': 20, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt require ssl': False, 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw lc debug interval': 10}}} 2019-11-29T12:24:37.092 INFO:tasks.ceph:ctx.config {'kernel': {'sha1': 'distro', 'kdb': True}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.lock_machines': (2, 'smithi')}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'sha1': 'distro', 'kdb': True}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'flavor': 'notcmalloc', 'sha1': '656c8e8049c2c1acd363143c842c2edf1fe09b64'}}, {'ceph': None}, {'openssl_keys': None}, {'rgw': {'client.0': {'valgrind': ['--tool=memcheck', '--max-threads=1024']}}}, {'workunit': {'clients': {'client.0': ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'rgw/test_rgw_gc_log.sh']}}}, {'ragweed': {'client.0': {'rgw_server': 'client.0', 'stages': 'prepare,check', 'default-branch': 'ceph-master'}}}, {'s3tests-java': {'client.0': {'force-repo': 'https://github.com/ceph/java_s3tests.git', 'force-branch': 'master'}}}, {'s3tests': {'client.0': {'rgw_server': 'client.0', 'force-branch': 'ceph-master'}}}, {'swift': {'client.0': {'rgw_server': 'client.0'}}}], 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_wip-yuval-master/qa', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/worker.smithi.23608', 'owner': 'scheduled_yuvalif@teuthology', 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'targets': {'smithi062.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5+hf6FdqYFqh+AynmSxXQC5nbKMDF+q/g+G34IVXHpFRr4NAJrSWmKciu+zKJ47HLNjOJbcEnoZyXMHi1JXzMSG/VZYUt9bMfJSh+WxRjx2D+ZYr9cxdwpJ6+K7Jt8Ycc2Zx0zUo5HYmYUtCFGhLj/zojIaZg+eXpkm1jtxgXhRMnok1kzfpMbrhXCAiTf0olRJ7iIIcaJ2Cmacmsd+RVJ/TAgsqFJt7ATKajTul5XLKd++5t9CeIBNstKwn/aYaE68ZXBlLyD2oEGs7qe8ky8P8wK2mhEpm+2evuP+6bbHWXDknDdDrQ8zO+J7UpLtSRWQ/upR/hQpyCKM2NVvsj', 'smithi022.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDm/x8c1kfyNunZ3EzvTi8PfYoLmp/q7nUVTBR288AN7MyTC7lRycGMxw3ZKs1KwWDCOevNLGZwOCMM9W6o+0nbjw6aBhpbQeFgkqg9ebMNqcvQRdAWjqnlKdL0QTcJ6KSiFdJEo3/IML2KxJ8PDpKdXoZSyPjdE83+lYcu01iCS2rrEasHcnXGagRlsMCN68Xo9CdB967zqr6ttpkpLFq8H2i/7j/9IzCU2S+9I9fj1CPKerPgJMNZiDxVHNQFhy0CnBKBOaST1kIv38YP/xjSfWkiuHU/XbPtwlYy1AzpH9ItbxhMkDkYLcLPkOu7rC6UocnD/j2NyPQ4x2mNQfg9'}, 'job_id': '4552909', 'tube': 'smithi', 'suite_branch': 'wip-yuval-master', 'priority': 100, 'first_in_suite': False, 'branch': 'wip-yuval-master', 'suite': 'rgw:verify', 'email': 'yuvalif@yahoo.com', 'archive_path': '/home/teuthworker/archive/yuvalif-2019-11-29_09:46:32-rgw:verify-wip-yuval-master-distro-basic-smithi/4552909', 'description': 'rgw:verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/https.yaml rgw_pool_type/replicated.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml}', 'nuke-on-error': True, 'repo': 'https://github.com/ceph/ceph-ci.git', 'last_in_suite': False, 'machine_type': 'smithi', 'teuthology_branch': 'master', 'sha1': '656c8e8049c2c1acd363143c842c2edf1fe09b64', 'name': 'yuvalif-2019-11-29_09:46:32-rgw:verify-wip-yuval-master-distro-basic-smithi', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1']], 'suite_relpath': 'qa', 'suite_repo': 'git://git.ceph.com/ceph-ci.git', 'suite_sha1': '656c8e8049c2c1acd363143c842c2edf1fe09b64', 'os_type': 'centos', 'overrides': {'ceph-deploy': {'fs': 'xfs', 'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'mon osd full ratio': 0.9, 'mon osd backfillfull_ratio': 0.85, 'bluestore fsck on mount': True, 'mon osd nearfull ratio': 0.8, 'debug bluestore': 20, 'debug bluefs': 20, 'osd objectstore': 'bluestore', 'bluestore block size': 96636764160, 'debug rocksdb': 10, 'bdev enable discard': True, 'osd failsafe full ratio': 0.95, 'bdev async discard': True}}}, 'rgw': {'frontend': 'beast', 'ec-data-pool': False, 'client.1': {'ssl certificate': 'rgw.client.1'}, 'client.0': {'ssl certificate': 'rgw.client.0'}, 'storage classes': 'LUKEWARM, FROZEN', 'compression type': 'random'}, 'workunit': {'sha1': '656c8e8049c2c1acd363143c842c2edf1fe09b64', 'branch': 'wip-yuval-master'}, 'ceph': {'conf': {'global': {'osd heartbeat grace': 40, 'ms inject socket failures': 5000, 'osd_max_pg_log_entries': 10, 'mon client directed command retry': 5, 'osd_min_pg_log_entries': 10}, 'osd': {'mon osd full ratio': 0.9, 'debug ms': 1, 'bluestore fsck on mount': True, 'debug osd': 25, 'debug bluestore': 20, 'debug bluefs': 20, 'mon osd backfillfull_ratio': 0.85, 'debug rocksdb': 10, 'osd shutdown pgref assert': True, 'debug journal': 20, 'bluestore allocator': 'bitmap', 'mon osd nearfull ratio': 0.8, 'osd objectstore': 'bluestore', 'bdev async discard': True, 'osd fast shutdown': False, 'bluestore block size': 96636764160, 'debug filestore': 20, 'bdev enable discard': True, 'osd failsafe full ratio': 0.95}, 'mon': {'debug mon': 20, 'debug paxos': 20, 'mon osd crush smoke test': False, 'debug ms': 1}, 'client': {'debug rgw': 20, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt require ssl': False, 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw lc debug interval': 10}}, 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME'], 'valgrind': {'mds': ['--tool=memcheck'], 'mon': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes'], 'osd': ['--tool=memcheck']}, 'fs': 'xfs', 'sha1': '656c8e8049c2c1acd363143c842c2edf1fe09b64'}, 'openssl_keys': {'rgw.client.1': {'ca': 'root', 'client': 'client.1', 'embed-key': True}, 'root': {'key-type': 'rsa:4096', 'client': 'client.0', 'cn': 'teuthology', 'install': ['client.0', 'client.1']}, 'rgw.client.0': {'ca': 'root', 'client': 'client.0', 'embed-key': True}}, 'install': {'ceph': {'flavor': 'notcmalloc', 'sha1': '656c8e8049c2c1acd363143c842c2edf1fe09b64'}}, 'admin_socket': {'branch': 'wip-yuval-master'}, 'thrashosds': {'bdev_inject_crash_probability': 0.5, 'bdev_inject_crash': 2}}} 2019-11-29T12:24:37.093 INFO:teuthology.orchestra.run.smithi022:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2019-11-29T12:24:37.098 INFO:teuthology.orchestra.run.smithi062:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2019-11-29T12:24:37.187 INFO:teuthology.orchestra.run.smithi022:> sudo install -d -m0777 -- /var/run/ceph 2019-11-29T12:24:37.192 INFO:teuthology.orchestra.run.smithi062:> sudo install -d -m0777 -- /var/run/ceph 2019-11-29T12:24:37.390 DEBUG:teuthology.orchestra.remote:smithi022:/scratch_devs is 72B 2019-11-29T12:24:37.481 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_4', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_1'] 2019-11-29T12:24:37.481 INFO:teuthology.orchestra.run.smithi022:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2019-11-29T12:24:37.567 INFO:teuthology.orchestra.run.smithi022.stdout: File: ‘/dev/vg_nvme/lv_4’ -> ‘../dm-1’ 2019-11-29T12:24:37.567 INFO:teuthology.orchestra.run.smithi022.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-11-29T12:24:37.567 INFO:teuthology.orchestra.run.smithi022.stdout:Device: 5h/5d Inode: 108562 Links: 1 2019-11-29T12:24:37.567 INFO:teuthology.orchestra.run.smithi022.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-11-29T12:24:37.568 INFO:teuthology.orchestra.run.smithi022.stdout:Context: system_u:object_r:device_t:s0 2019-11-29T12:24:37.568 INFO:teuthology.orchestra.run.smithi022.stdout:Access: 2019-11-29 12:23:27.547725992 +0000 2019-11-29T12:24:37.568 INFO:teuthology.orchestra.run.smithi022.stdout:Modify: 2019-11-29 12:21:37.805334450 +0000 2019-11-29T12:24:37.568 INFO:teuthology.orchestra.run.smithi022.stdout:Change: 2019-11-29 12:21:37.805334450 +0000 2019-11-29T12:24:37.568 INFO:teuthology.orchestra.run.smithi022.stdout: Birth: - 2019-11-29T12:24:37.598 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2019-11-29T12:24:37.598 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2019-11-29T12:24:37.599 INFO:teuthology.orchestra.run.smithi022.stderr:512 bytes (512 B) copied, 0.000483448 s, 1.1 MB/s 2019-11-29T12:24:37.604 INFO:teuthology.orchestra.run.smithi022:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2019-11-29T12:24:37.690 INFO:teuthology.orchestra.run.smithi022.stdout: File: ‘/dev/vg_nvme/lv_3’ -> ‘../dm-2’ 2019-11-29T12:24:37.690 INFO:teuthology.orchestra.run.smithi022.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-11-29T12:24:37.690 INFO:teuthology.orchestra.run.smithi022.stdout:Device: 5h/5d Inode: 98952 Links: 1 2019-11-29T12:24:37.690 INFO:teuthology.orchestra.run.smithi022.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-11-29T12:24:37.691 INFO:teuthology.orchestra.run.smithi022.stdout:Context: system_u:object_r:device_t:s0 2019-11-29T12:24:37.691 INFO:teuthology.orchestra.run.smithi022.stdout:Access: 2019-11-29 12:23:27.547725992 +0000 2019-11-29T12:24:37.691 INFO:teuthology.orchestra.run.smithi022.stdout:Modify: 2019-11-29 12:21:38.307327916 +0000 2019-11-29T12:24:37.691 INFO:teuthology.orchestra.run.smithi022.stdout:Change: 2019-11-29 12:21:38.307327916 +0000 2019-11-29T12:24:37.691 INFO:teuthology.orchestra.run.smithi022.stdout: Birth: - 2019-11-29T12:24:37.715 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2019-11-29T12:24:37.715 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2019-11-29T12:24:37.715 INFO:teuthology.orchestra.run.smithi022.stderr:512 bytes (512 B) copied, 0.000407665 s, 1.3 MB/s 2019-11-29T12:24:37.719 INFO:teuthology.orchestra.run.smithi022:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2019-11-29T12:24:37.785 INFO:teuthology.orchestra.run.smithi022.stdout: File: ‘/dev/vg_nvme/lv_2’ -> ‘../dm-3’ 2019-11-29T12:24:37.786 INFO:teuthology.orchestra.run.smithi022.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-11-29T12:24:37.786 INFO:teuthology.orchestra.run.smithi022.stdout:Device: 5h/5d Inode: 89902 Links: 1 2019-11-29T12:24:37.786 INFO:teuthology.orchestra.run.smithi022.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-11-29T12:24:37.786 INFO:teuthology.orchestra.run.smithi022.stdout:Context: system_u:object_r:device_t:s0 2019-11-29T12:24:37.786 INFO:teuthology.orchestra.run.smithi022.stdout:Access: 2019-11-29 12:23:27.547725992 +0000 2019-11-29T12:24:37.786 INFO:teuthology.orchestra.run.smithi022.stdout:Modify: 2019-11-29 12:21:38.766321941 +0000 2019-11-29T12:24:37.787 INFO:teuthology.orchestra.run.smithi022.stdout:Change: 2019-11-29 12:21:38.766321941 +0000 2019-11-29T12:24:37.787 INFO:teuthology.orchestra.run.smithi022.stdout: Birth: - 2019-11-29T12:24:37.807 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2019-11-29T12:24:37.807 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2019-11-29T12:24:37.808 INFO:teuthology.orchestra.run.smithi022.stderr:512 bytes (512 B) copied, 0.000379665 s, 1.3 MB/s 2019-11-29T12:24:37.811 INFO:teuthology.orchestra.run.smithi022:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2019-11-29T12:24:37.877 INFO:teuthology.orchestra.run.smithi022.stdout: File: ‘/dev/vg_nvme/lv_1’ -> ‘../dm-4’ 2019-11-29T12:24:37.877 INFO:teuthology.orchestra.run.smithi022.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-11-29T12:24:37.877 INFO:teuthology.orchestra.run.smithi022.stdout:Device: 5h/5d Inode: 108656 Links: 1 2019-11-29T12:24:37.878 INFO:teuthology.orchestra.run.smithi022.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-11-29T12:24:37.878 INFO:teuthology.orchestra.run.smithi022.stdout:Context: system_u:object_r:device_t:s0 2019-11-29T12:24:37.878 INFO:teuthology.orchestra.run.smithi022.stdout:Access: 2019-11-29 12:23:27.547725992 +0000 2019-11-29T12:24:37.878 INFO:teuthology.orchestra.run.smithi022.stdout:Modify: 2019-11-29 12:21:39.261315498 +0000 2019-11-29T12:24:37.878 INFO:teuthology.orchestra.run.smithi022.stdout:Change: 2019-11-29 12:21:39.261315498 +0000 2019-11-29T12:24:37.878 INFO:teuthology.orchestra.run.smithi022.stdout: Birth: - 2019-11-29T12:24:37.895 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2019-11-29T12:24:37.895 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2019-11-29T12:24:37.895 INFO:teuthology.orchestra.run.smithi022.stderr:512 bytes (512 B) copied, 0.000353776 s, 1.4 MB/s 2019-11-29T12:24:37.899 INFO:tasks.ceph:fs option selected, checking for scratch devs 2019-11-29T12:24:37.899 INFO:tasks.ceph:found devs: ['/dev/vg_nvme/lv_4', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_1'] 2019-11-29T12:24:37.899 WARNING:teuthology.misc:Entering get_wwn_id_map, a deprecated function that will be removed 2019-11-29T12:24:37.899 INFO:tasks.ceph:dev map: {'osd.5': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.6': '/dev/vg_nvme/lv_2'} 2019-11-29T12:24:37.992 DEBUG:teuthology.orchestra.remote:smithi062:/scratch_devs is 72B 2019-11-29T12:24:38.078 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_4', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_1'] 2019-11-29T12:24:38.078 INFO:teuthology.orchestra.run.smithi062:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2019-11-29T12:24:38.155 INFO:teuthology.orchestra.run.smithi062.stdout: File: ‘/dev/vg_nvme/lv_4’ -> ‘../dm-1’ 2019-11-29T12:24:38.155 INFO:teuthology.orchestra.run.smithi062.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-11-29T12:24:38.155 INFO:teuthology.orchestra.run.smithi062.stdout:Device: 5h/5d Inode: 101222 Links: 1 2019-11-29T12:24:38.155 INFO:teuthology.orchestra.run.smithi062.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-11-29T12:24:38.156 INFO:teuthology.orchestra.run.smithi062.stdout:Context: system_u:object_r:device_t:s0 2019-11-29T12:24:38.156 INFO:teuthology.orchestra.run.smithi062.stdout:Access: 2019-11-29 12:23:25.901648435 +0000 2019-11-29T12:24:38.156 INFO:teuthology.orchestra.run.smithi062.stdout:Modify: 2019-11-29 12:21:37.786017755 +0000 2019-11-29T12:24:38.156 INFO:teuthology.orchestra.run.smithi062.stdout:Change: 2019-11-29 12:21:37.786017755 +0000 2019-11-29T12:24:38.156 INFO:teuthology.orchestra.run.smithi062.stdout: Birth: - 2019-11-29T12:24:38.185 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records in 2019-11-29T12:24:38.186 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records out 2019-11-29T12:24:38.186 INFO:teuthology.orchestra.run.smithi062.stderr:512 bytes (512 B) copied, 0.000453706 s, 1.1 MB/s 2019-11-29T12:24:38.191 INFO:teuthology.orchestra.run.smithi062:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2019-11-29T12:24:38.267 INFO:teuthology.orchestra.run.smithi062.stdout: File: ‘/dev/vg_nvme/lv_3’ -> ‘../dm-2’ 2019-11-29T12:24:38.268 INFO:teuthology.orchestra.run.smithi062.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-11-29T12:24:38.268 INFO:teuthology.orchestra.run.smithi062.stdout:Device: 5h/5d Inode: 106280 Links: 1 2019-11-29T12:24:38.268 INFO:teuthology.orchestra.run.smithi062.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-11-29T12:24:38.268 INFO:teuthology.orchestra.run.smithi062.stdout:Context: system_u:object_r:device_t:s0 2019-11-29T12:24:38.268 INFO:teuthology.orchestra.run.smithi062.stdout:Access: 2019-11-29 12:23:25.901648435 +0000 2019-11-29T12:24:38.268 INFO:teuthology.orchestra.run.smithi062.stdout:Modify: 2019-11-29 12:21:38.264011059 +0000 2019-11-29T12:24:38.269 INFO:teuthology.orchestra.run.smithi062.stdout:Change: 2019-11-29 12:21:38.264011059 +0000 2019-11-29T12:24:38.269 INFO:teuthology.orchestra.run.smithi062.stdout: Birth: - 2019-11-29T12:24:38.298 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records in 2019-11-29T12:24:38.298 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records out 2019-11-29T12:24:38.298 INFO:teuthology.orchestra.run.smithi062.stderr:512 bytes (512 B) copied, 0.000358113 s, 1.4 MB/s 2019-11-29T12:24:38.303 INFO:teuthology.orchestra.run.smithi062:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2019-11-29T12:24:38.375 INFO:teuthology.orchestra.run.smithi062.stdout: File: ‘/dev/vg_nvme/lv_2’ -> ‘../dm-3’ 2019-11-29T12:24:38.375 INFO:teuthology.orchestra.run.smithi062.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-11-29T12:24:38.375 INFO:teuthology.orchestra.run.smithi062.stdout:Device: 5h/5d Inode: 101274 Links: 1 2019-11-29T12:24:38.376 INFO:teuthology.orchestra.run.smithi062.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-11-29T12:24:38.376 INFO:teuthology.orchestra.run.smithi062.stdout:Context: system_u:object_r:device_t:s0 2019-11-29T12:24:38.376 INFO:teuthology.orchestra.run.smithi062.stdout:Access: 2019-11-29 12:23:25.901648435 +0000 2019-11-29T12:24:38.376 INFO:teuthology.orchestra.run.smithi062.stdout:Modify: 2019-11-29 12:21:38.798003579 +0000 2019-11-29T12:24:38.376 INFO:teuthology.orchestra.run.smithi062.stdout:Change: 2019-11-29 12:21:38.798003579 +0000 2019-11-29T12:24:38.376 INFO:teuthology.orchestra.run.smithi062.stdout: Birth: - 2019-11-29T12:24:38.401 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records in 2019-11-29T12:24:38.401 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records out 2019-11-29T12:24:38.401 INFO:teuthology.orchestra.run.smithi062.stderr:512 bytes (512 B) copied, 0.000391521 s, 1.3 MB/s 2019-11-29T12:24:38.406 INFO:teuthology.orchestra.run.smithi062:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2019-11-29T12:24:38.471 INFO:teuthology.orchestra.run.smithi062.stdout: File: ‘/dev/vg_nvme/lv_1’ -> ‘../dm-4’ 2019-11-29T12:24:38.471 INFO:teuthology.orchestra.run.smithi062.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-11-29T12:24:38.471 INFO:teuthology.orchestra.run.smithi062.stdout:Device: 5h/5d Inode: 107764 Links: 1 2019-11-29T12:24:38.471 INFO:teuthology.orchestra.run.smithi062.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-11-29T12:24:38.472 INFO:teuthology.orchestra.run.smithi062.stdout:Context: system_u:object_r:device_t:s0 2019-11-29T12:24:38.472 INFO:teuthology.orchestra.run.smithi062.stdout:Access: 2019-11-29 12:23:25.901648435 +0000 2019-11-29T12:24:38.472 INFO:teuthology.orchestra.run.smithi062.stdout:Modify: 2019-11-29 12:21:39.322996224 +0000 2019-11-29T12:24:38.472 INFO:teuthology.orchestra.run.smithi062.stdout:Change: 2019-11-29 12:21:39.322996224 +0000 2019-11-29T12:24:38.472 INFO:teuthology.orchestra.run.smithi062.stdout: Birth: - 2019-11-29T12:24:38.496 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records in 2019-11-29T12:24:38.496 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records out 2019-11-29T12:24:38.496 INFO:teuthology.orchestra.run.smithi062.stderr:512 bytes (512 B) copied, 0.000375762 s, 1.4 MB/s 2019-11-29T12:24:38.500 INFO:tasks.ceph:fs option selected, checking for scratch devs 2019-11-29T12:24:38.501 INFO:tasks.ceph:found devs: ['/dev/vg_nvme/lv_4', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_1'] 2019-11-29T12:24:38.501 WARNING:teuthology.misc:Entering get_wwn_id_map, a deprecated function that will be removed 2019-11-29T12:24:38.501 INFO:tasks.ceph:dev map: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_3', 'osd.2': '/dev/vg_nvme/lv_2'} 2019-11-29T12:24:38.501 INFO:tasks.ceph:Generating config... 2019-11-29T12:24:38.505 INFO:tasks.ceph:[global] osd heartbeat grace = 40 2019-11-29T12:24:38.505 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2019-11-29T12:24:38.505 INFO:tasks.ceph:[global] osd_max_pg_log_entries = 10 2019-11-29T12:24:38.505 INFO:tasks.ceph:[global] mon client directed command retry = 5 2019-11-29T12:24:38.506 INFO:tasks.ceph:[global] osd_min_pg_log_entries = 10 2019-11-29T12:24:38.506 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2019-11-29T12:24:38.506 INFO:tasks.ceph:[osd] debug ms = 1 2019-11-29T12:24:38.506 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2019-11-29T12:24:38.507 INFO:tasks.ceph:[osd] debug osd = 25 2019-11-29T12:24:38.507 INFO:tasks.ceph:[osd] debug bluestore = 20 2019-11-29T12:24:38.507 INFO:tasks.ceph:[osd] debug bluefs = 20 2019-11-29T12:24:38.507 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2019-11-29T12:24:38.508 INFO:tasks.ceph:[osd] debug rocksdb = 10 2019-11-29T12:24:38.508 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2019-11-29T12:24:38.508 INFO:tasks.ceph:[osd] debug journal = 20 2019-11-29T12:24:38.509 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2019-11-29T12:24:38.509 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2019-11-29T12:24:38.509 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2019-11-29T12:24:38.509 INFO:tasks.ceph:[osd] bdev async discard = True 2019-11-29T12:24:38.510 INFO:tasks.ceph:[osd] osd fast shutdown = False 2019-11-29T12:24:38.510 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2019-11-29T12:24:38.510 INFO:tasks.ceph:[osd] debug filestore = 20 2019-11-29T12:24:38.510 INFO:tasks.ceph:[osd] bdev enable discard = True 2019-11-29T12:24:38.511 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2019-11-29T12:24:38.511 INFO:tasks.ceph:[mon] debug mon = 20 2019-11-29T12:24:38.511 INFO:tasks.ceph:[mon] debug paxos = 20 2019-11-29T12:24:38.511 INFO:tasks.ceph:[mon] mon osd crush smoke test = False 2019-11-29T12:24:38.512 INFO:tasks.ceph:[mon] debug ms = 1 2019-11-29T12:24:38.512 INFO:tasks.ceph:[client] debug rgw = 20 2019-11-29T12:24:38.512 INFO:tasks.ceph:[client] rgw crypt s3 kms backend = testing 2019-11-29T12:24:38.513 INFO:tasks.ceph:[client] rgw crypt require ssl = False 2019-11-29T12:24:38.513 INFO:tasks.ceph:[client] rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2019-11-29T12:24:38.513 INFO:tasks.ceph:[client] rgw lc debug interval = 10 2019-11-29T12:24:38.514 INFO:tasks.ceph:Setting up mon.a... 2019-11-29T12:24:38.514 INFO:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2019-11-29T12:24:38.684 INFO:teuthology.orchestra.run.smithi062.stdout:creating /etc/ceph/ceph.keyring 2019-11-29T12:24:38.689 INFO:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2019-11-29T12:24:38.833 INFO:teuthology.orchestra.run.smithi062:> sudo chmod 0644 /etc/ceph/ceph.keyring 2019-11-29T12:24:38.954 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.62'), ('mon.c', '[v2:172.21.15.62:3301,v1:172.21.15.62:6790]'), ('mon.b', '172.21.15.22')] 2019-11-29T12:24:38.955 INFO:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool --create --clobber --enable-all-features --add a 172.21.15.62 --addv c '[v2:172.21.15.62:3301,v1:172.21.15.62:6790]' --add b 172.21.15.22 --print /home/ubuntu/cephtest/ceph.monmap 2019-11-29T12:24:39.093 INFO:teuthology.orchestra.run.smithi062.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2019-11-29T12:24:39.093 INFO:teuthology.orchestra.run.smithi062.stdout:monmaptool: generated fsid 787fcccf-49ed-4b7f-ac72-6914ee170c2a 2019-11-29T12:24:39.094 INFO:teuthology.orchestra.run.smithi062.stdout:epoch 0 2019-11-29T12:24:39.094 INFO:teuthology.orchestra.run.smithi062.stdout:fsid 787fcccf-49ed-4b7f-ac72-6914ee170c2a 2019-11-29T12:24:39.094 INFO:teuthology.orchestra.run.smithi062.stdout:last_changed 2019-11-29T12:24:39.094635+0000 2019-11-29T12:24:39.094 INFO:teuthology.orchestra.run.smithi062.stdout:created 2019-11-29T12:24:39.094635+0000 2019-11-29T12:24:39.094 INFO:teuthology.orchestra.run.smithi062.stdout:min_mon_release 0 (unknown) 2019-11-29T12:24:39.094 INFO:teuthology.orchestra.run.smithi062.stdout:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2019-11-29T12:24:39.094 INFO:teuthology.orchestra.run.smithi062.stdout:1: [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] mon.b 2019-11-29T12:24:39.095 INFO:teuthology.orchestra.run.smithi062.stdout:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2019-11-29T12:24:39.095 INFO:teuthology.orchestra.run.smithi062.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2019-11-29T12:24:39.096 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 787fcccf-49ed-4b7f-ac72-6914ee170c2a... 2019-11-29T12:24:39.097 INFO:teuthology.orchestra.run.smithi022:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo python -c 'import shutil, sys; shutil.copyfileobj(sys.stdin, file(sys.argv[1], "wb"))' /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf 2019-11-29T12:24:39.102 INFO:teuthology.orchestra.run.smithi062:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo python -c 'import shutil, sys; shutil.copyfileobj(sys.stdin, file(sys.argv[1], "wb"))' /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf 2019-11-29T12:24:39.327 INFO:tasks.ceph:Creating admin key on mon.a... 2019-11-29T12:24:39.328 INFO:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2019-11-29T12:24:39.467 INFO:tasks.ceph:Copying monmap to all nodes... 2019-11-29T12:24:39.558 DEBUG:teuthology.orchestra.remote:smithi062:/etc/ceph/ceph.keyring is 206B 2019-11-29T12:24:39.743 DEBUG:teuthology.orchestra.remote:smithi062:/home/ubuntu/cephtest/ceph.monmap is 379B 2019-11-29T12:24:39.831 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi022.front.sepia.ceph.com 2019-11-29T12:24:39.831 INFO:teuthology.orchestra.run.smithi022:> sudo sh -c 'cat > /etc/ceph/ceph.keyring' && sudo chmod 0644 /etc/ceph/ceph.keyring 2019-11-29T12:24:39.987 INFO:teuthology.orchestra.run.smithi022:> cat > /home/ubuntu/cephtest/ceph.monmap 2019-11-29T12:24:40.059 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi062.front.sepia.ceph.com 2019-11-29T12:24:40.059 INFO:teuthology.orchestra.run.smithi062:> sudo sh -c 'cat > /etc/ceph/ceph.keyring' && sudo chmod 0644 /etc/ceph/ceph.keyring 2019-11-29T12:24:40.218 INFO:teuthology.orchestra.run.smithi062:> cat > /home/ubuntu/cephtest/ceph.monmap 2019-11-29T12:24:40.293 INFO:tasks.ceph:Setting up mon nodes... 2019-11-29T12:24:40.293 INFO:tasks.ceph:Setting up mgr nodes... 2019-11-29T12:24:40.294 INFO:teuthology.orchestra.run.smithi022:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2019-11-29T12:24:40.499 INFO:teuthology.orchestra.run.smithi022.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2019-11-29T12:24:40.504 INFO:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2019-11-29T12:24:40.687 INFO:teuthology.orchestra.run.smithi062.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2019-11-29T12:24:40.691 INFO:tasks.ceph:Setting up mds nodes... 2019-11-29T12:24:40.691 INFO:tasks.ceph_client:Setting up client nodes... 2019-11-29T12:24:40.692 INFO:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2019-11-29T12:24:40.850 INFO:teuthology.orchestra.run.smithi022.stdout:creating /etc/ceph/ceph.client.1.keyring 2019-11-29T12:24:40.884 INFO:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2019-11-29T12:24:41.036 INFO:teuthology.orchestra.run.smithi062.stdout:creating /etc/ceph/ceph.client.0.keyring 2019-11-29T12:24:41.069 INFO:tasks.ceph:Running mkfs on osd nodes... 2019-11-29T12:24:41.069 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi022.front.sepia.ceph.com'): {'osd.5': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.6': '/dev/vg_nvme/lv_2'}, Remote(name='ubuntu@smithi062.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_3', 'osd.2': '/dev/vg_nvme/lv_2'}} 2019-11-29T12:24:41.069 INFO:teuthology.orchestra.run.smithi022:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2019-11-29T12:24:41.186 INFO:tasks.ceph:{'osd.5': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.6': '/dev/vg_nvme/lv_2'} 2019-11-29T12:24:41.186 INFO:tasks.ceph:{} 2019-11-29T12:24:41.186 INFO:tasks.ceph:osd.4 2019-11-29T12:24:41.186 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi022.front.sepia.ceph.com 2019-11-29T12:24:41.186 INFO:teuthology.orchestra.run.smithi022:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2019-11-29T12:24:41.778 INFO:teuthology.orchestra.run.smithi022.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2019-11-29T12:24:41.779 INFO:teuthology.orchestra.run.smithi022.stdout: = sectsz=512 attr=2, projid32bit=1 2019-11-29T12:24:41.779 INFO:teuthology.orchestra.run.smithi022.stdout: = crc=1 finobt=0, sparse=0 2019-11-29T12:24:41.779 INFO:teuthology.orchestra.run.smithi022.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2019-11-29T12:24:41.779 INFO:teuthology.orchestra.run.smithi022.stdout: = sunit=0 swidth=0 blks 2019-11-29T12:24:41.779 INFO:teuthology.orchestra.run.smithi022.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2019-11-29T12:24:41.779 INFO:teuthology.orchestra.run.smithi022.stdout:log =internal log bsize=4096 blocks=11443, version=2 2019-11-29T12:24:41.780 INFO:teuthology.orchestra.run.smithi022.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2019-11-29T12:24:41.780 INFO:teuthology.orchestra.run.smithi022.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2019-11-29T12:24:41.781 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi022.front.sepia.ceph.com -o noatime 2019-11-29T12:24:41.782 INFO:teuthology.orchestra.run.smithi022:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-4 2019-11-29T12:24:41.971 INFO:teuthology.orchestra.run.smithi022:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2019-11-29T12:24:42.103 INFO:teuthology.orchestra.run.smithi022:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2019-11-29T12:24:42.216 INFO:tasks.ceph:{'osd.5': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.6': '/dev/vg_nvme/lv_2'} 2019-11-29T12:24:42.216 INFO:tasks.ceph:{} 2019-11-29T12:24:42.216 INFO:tasks.ceph:osd.5 2019-11-29T12:24:42.216 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi022.front.sepia.ceph.com 2019-11-29T12:24:42.217 INFO:teuthology.orchestra.run.smithi022:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2019-11-29T12:24:42.811 INFO:teuthology.orchestra.run.smithi022.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2019-11-29T12:24:42.811 INFO:teuthology.orchestra.run.smithi022.stdout: = sectsz=512 attr=2, projid32bit=1 2019-11-29T12:24:42.811 INFO:teuthology.orchestra.run.smithi022.stdout: = crc=1 finobt=0, sparse=0 2019-11-29T12:24:42.811 INFO:teuthology.orchestra.run.smithi022.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2019-11-29T12:24:42.812 INFO:teuthology.orchestra.run.smithi022.stdout: = sunit=0 swidth=0 blks 2019-11-29T12:24:42.812 INFO:teuthology.orchestra.run.smithi022.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2019-11-29T12:24:42.812 INFO:teuthology.orchestra.run.smithi022.stdout:log =internal log bsize=4096 blocks=11443, version=2 2019-11-29T12:24:42.812 INFO:teuthology.orchestra.run.smithi022.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2019-11-29T12:24:42.812 INFO:teuthology.orchestra.run.smithi022.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2019-11-29T12:24:42.813 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi022.front.sepia.ceph.com -o noatime 2019-11-29T12:24:42.814 INFO:teuthology.orchestra.run.smithi022:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-5 2019-11-29T12:24:42.982 INFO:teuthology.orchestra.run.smithi022:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2019-11-29T12:24:43.092 INFO:teuthology.orchestra.run.smithi022:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2019-11-29T12:24:43.190 INFO:tasks.ceph:{'osd.5': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.6': '/dev/vg_nvme/lv_2'} 2019-11-29T12:24:43.191 INFO:tasks.ceph:{} 2019-11-29T12:24:43.191 INFO:tasks.ceph:osd.6 2019-11-29T12:24:43.191 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi022.front.sepia.ceph.com 2019-11-29T12:24:43.191 INFO:teuthology.orchestra.run.smithi022:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2019-11-29T12:24:43.806 INFO:teuthology.orchestra.run.smithi022.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2019-11-29T12:24:43.806 INFO:teuthology.orchestra.run.smithi022.stdout: = sectsz=512 attr=2, projid32bit=1 2019-11-29T12:24:43.806 INFO:teuthology.orchestra.run.smithi022.stdout: = crc=1 finobt=0, sparse=0 2019-11-29T12:24:43.806 INFO:teuthology.orchestra.run.smithi022.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2019-11-29T12:24:43.806 INFO:teuthology.orchestra.run.smithi022.stdout: = sunit=0 swidth=0 blks 2019-11-29T12:24:43.807 INFO:teuthology.orchestra.run.smithi022.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2019-11-29T12:24:43.807 INFO:teuthology.orchestra.run.smithi022.stdout:log =internal log bsize=4096 blocks=11443, version=2 2019-11-29T12:24:43.807 INFO:teuthology.orchestra.run.smithi022.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2019-11-29T12:24:43.807 INFO:teuthology.orchestra.run.smithi022.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2019-11-29T12:24:43.809 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi022.front.sepia.ceph.com -o noatime 2019-11-29T12:24:43.809 INFO:teuthology.orchestra.run.smithi022:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-6 2019-11-29T12:24:43.993 INFO:teuthology.orchestra.run.smithi022:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2019-11-29T12:24:44.111 INFO:teuthology.orchestra.run.smithi022:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2019-11-29T12:24:44.214 INFO:tasks.ceph:{'osd.5': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.6': '/dev/vg_nvme/lv_2'} 2019-11-29T12:24:44.214 INFO:tasks.ceph:{} 2019-11-29T12:24:44.214 INFO:tasks.ceph:osd.7 2019-11-29T12:24:44.214 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi022.front.sepia.ceph.com 2019-11-29T12:24:44.214 INFO:teuthology.orchestra.run.smithi022:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2019-11-29T12:24:44.810 INFO:teuthology.orchestra.run.smithi022.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2019-11-29T12:24:44.811 INFO:teuthology.orchestra.run.smithi022.stdout: = sectsz=512 attr=2, projid32bit=1 2019-11-29T12:24:44.811 INFO:teuthology.orchestra.run.smithi022.stdout: = crc=1 finobt=0, sparse=0 2019-11-29T12:24:44.811 INFO:teuthology.orchestra.run.smithi022.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2019-11-29T12:24:44.811 INFO:teuthology.orchestra.run.smithi022.stdout: = sunit=0 swidth=0 blks 2019-11-29T12:24:44.811 INFO:teuthology.orchestra.run.smithi022.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2019-11-29T12:24:44.811 INFO:teuthology.orchestra.run.smithi022.stdout:log =internal log bsize=4096 blocks=11443, version=2 2019-11-29T12:24:44.811 INFO:teuthology.orchestra.run.smithi022.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2019-11-29T12:24:44.812 INFO:teuthology.orchestra.run.smithi022.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2019-11-29T12:24:44.813 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi022.front.sepia.ceph.com -o noatime 2019-11-29T12:24:44.813 INFO:teuthology.orchestra.run.smithi022:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-7 2019-11-29T12:24:44.958 INFO:teuthology.orchestra.run.smithi022:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2019-11-29T12:24:45.076 INFO:teuthology.orchestra.run.smithi022:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2019-11-29T12:24:45.229 INFO:teuthology.orchestra.run.smithi022.stderr:2019-11-29T12:24:45.229+0000 7f6073145b40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2019-11-29T12:24:45.232 INFO:teuthology.orchestra.run.smithi022.stderr:2019-11-29T12:24:45.232+0000 7f6073145b40 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2019-11-29T12:24:45.233 INFO:teuthology.orchestra.run.smithi022.stderr:2019-11-29T12:24:45.232+0000 7f6073145b40 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2019-11-29T12:24:45.233 INFO:teuthology.orchestra.run.smithi022.stderr:2019-11-29T12:24:45.232+0000 7f6073145b40 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2019-11-29T12:24:45.233 INFO:teuthology.orchestra.run.smithi022.stderr:2019-11-29T12:24:45.232+0000 7f6073145b40 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2019-11-29T12:24:45.240 INFO:teuthology.orchestra.run.smithi022.stderr:2019-11-29T12:24:45.239+0000 7f6073145b40 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2019-11-29T12:24:47.549 INFO:teuthology.orchestra.run.smithi022:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2019-11-29T12:24:47.672 INFO:teuthology.orchestra.run.smithi022:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2019-11-29T12:24:47.822 INFO:teuthology.orchestra.run.smithi022.stderr:2019-11-29T12:24:47.821+0000 7fec31ca3b40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2019-11-29T12:24:47.823 INFO:teuthology.orchestra.run.smithi022.stderr:2019-11-29T12:24:47.822+0000 7fec31ca3b40 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2019-11-29T12:24:47.823 INFO:teuthology.orchestra.run.smithi022.stderr:2019-11-29T12:24:47.822+0000 7fec31ca3b40 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2019-11-29T12:24:47.823 INFO:teuthology.orchestra.run.smithi022.stderr:2019-11-29T12:24:47.822+0000 7fec31ca3b40 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2019-11-29T12:24:47.823 INFO:teuthology.orchestra.run.smithi022.stderr:2019-11-29T12:24:47.822+0000 7fec31ca3b40 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2019-11-29T12:24:47.824 INFO:teuthology.orchestra.run.smithi022.stderr:2019-11-29T12:24:47.823+0000 7fec31ca3b40 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2019-11-29T12:24:50.136 INFO:teuthology.orchestra.run.smithi022:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2019-11-29T12:24:50.252 INFO:teuthology.orchestra.run.smithi022:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2019-11-29T12:24:50.390 INFO:teuthology.orchestra.run.smithi022.stderr:2019-11-29T12:24:50.389+0000 7f9a96e87b40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2019-11-29T12:24:50.391 INFO:teuthology.orchestra.run.smithi022.stderr:2019-11-29T12:24:50.390+0000 7f9a96e87b40 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2019-11-29T12:24:50.391 INFO:teuthology.orchestra.run.smithi022.stderr:2019-11-29T12:24:50.390+0000 7f9a96e87b40 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2019-11-29T12:24:50.391 INFO:teuthology.orchestra.run.smithi022.stderr:2019-11-29T12:24:50.390+0000 7f9a96e87b40 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2019-11-29T12:24:50.391 INFO:teuthology.orchestra.run.smithi022.stderr:2019-11-29T12:24:50.390+0000 7f9a96e87b40 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2019-11-29T12:24:50.392 INFO:teuthology.orchestra.run.smithi022.stderr:2019-11-29T12:24:50.391+0000 7f9a96e87b40 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2019-11-29T12:24:52.700 INFO:teuthology.orchestra.run.smithi022:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2019-11-29T12:24:52.821 INFO:teuthology.orchestra.run.smithi022:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2019-11-29T12:24:52.976 INFO:teuthology.orchestra.run.smithi022.stderr:2019-11-29T12:24:52.975+0000 7ff4b9c4db40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2019-11-29T12:24:52.977 INFO:teuthology.orchestra.run.smithi022.stderr:2019-11-29T12:24:52.976+0000 7ff4b9c4db40 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2019-11-29T12:24:52.977 INFO:teuthology.orchestra.run.smithi022.stderr:2019-11-29T12:24:52.976+0000 7ff4b9c4db40 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2019-11-29T12:24:52.977 INFO:teuthology.orchestra.run.smithi022.stderr:2019-11-29T12:24:52.976+0000 7ff4b9c4db40 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2019-11-29T12:24:52.977 INFO:teuthology.orchestra.run.smithi022.stderr:2019-11-29T12:24:52.976+0000 7ff4b9c4db40 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2019-11-29T12:24:52.977 INFO:teuthology.orchestra.run.smithi022.stderr:2019-11-29T12:24:52.977+0000 7ff4b9c4db40 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2019-11-29T12:24:55.298 INFO:teuthology.orchestra.run.smithi022:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2019-11-29T12:24:55.420 INFO:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2019-11-29T12:24:55.543 INFO:tasks.ceph:{'osd.1': '/dev/vg_nvme/lv_1', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_3', 'osd.2': '/dev/vg_nvme/lv_2'} 2019-11-29T12:24:55.543 INFO:tasks.ceph:{} 2019-11-29T12:24:55.543 INFO:tasks.ceph:osd.0 2019-11-29T12:24:55.543 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi062.front.sepia.ceph.com 2019-11-29T12:24:55.543 INFO:teuthology.orchestra.run.smithi062:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2019-11-29T12:24:56.153 INFO:teuthology.orchestra.run.smithi062.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2019-11-29T12:24:56.153 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 attr=2, projid32bit=1 2019-11-29T12:24:56.153 INFO:teuthology.orchestra.run.smithi062.stdout: = crc=1 finobt=0, sparse=0 2019-11-29T12:24:56.153 INFO:teuthology.orchestra.run.smithi062.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2019-11-29T12:24:56.153 INFO:teuthology.orchestra.run.smithi062.stdout: = sunit=0 swidth=0 blks 2019-11-29T12:24:56.154 INFO:teuthology.orchestra.run.smithi062.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2019-11-29T12:24:56.154 INFO:teuthology.orchestra.run.smithi062.stdout:log =internal log bsize=4096 blocks=11443, version=2 2019-11-29T12:24:56.154 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2019-11-29T12:24:56.154 INFO:teuthology.orchestra.run.smithi062.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2019-11-29T12:24:56.156 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi062.front.sepia.ceph.com -o noatime 2019-11-29T12:24:56.156 INFO:teuthology.orchestra.run.smithi062:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-0 2019-11-29T12:24:56.329 INFO:teuthology.orchestra.run.smithi062:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2019-11-29T12:24:56.453 INFO:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2019-11-29T12:24:56.550 INFO:tasks.ceph:{'osd.1': '/dev/vg_nvme/lv_1', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_3', 'osd.2': '/dev/vg_nvme/lv_2'} 2019-11-29T12:24:56.550 INFO:tasks.ceph:{} 2019-11-29T12:24:56.551 INFO:tasks.ceph:osd.1 2019-11-29T12:24:56.551 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi062.front.sepia.ceph.com 2019-11-29T12:24:56.551 INFO:teuthology.orchestra.run.smithi062:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2019-11-29T12:24:57.124 INFO:teuthology.orchestra.run.smithi062.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2019-11-29T12:24:57.124 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 attr=2, projid32bit=1 2019-11-29T12:24:57.125 INFO:teuthology.orchestra.run.smithi062.stdout: = crc=1 finobt=0, sparse=0 2019-11-29T12:24:57.125 INFO:teuthology.orchestra.run.smithi062.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2019-11-29T12:24:57.125 INFO:teuthology.orchestra.run.smithi062.stdout: = sunit=0 swidth=0 blks 2019-11-29T12:24:57.125 INFO:teuthology.orchestra.run.smithi062.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2019-11-29T12:24:57.125 INFO:teuthology.orchestra.run.smithi062.stdout:log =internal log bsize=4096 blocks=11443, version=2 2019-11-29T12:24:57.125 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2019-11-29T12:24:57.125 INFO:teuthology.orchestra.run.smithi062.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2019-11-29T12:24:57.127 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi062.front.sepia.ceph.com -o noatime 2019-11-29T12:24:57.127 INFO:teuthology.orchestra.run.smithi062:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2019-11-29T12:24:57.293 INFO:teuthology.orchestra.run.smithi062:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2019-11-29T12:24:57.391 INFO:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2019-11-29T12:24:57.489 INFO:tasks.ceph:{'osd.1': '/dev/vg_nvme/lv_1', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_3', 'osd.2': '/dev/vg_nvme/lv_2'} 2019-11-29T12:24:57.489 INFO:tasks.ceph:{} 2019-11-29T12:24:57.489 INFO:tasks.ceph:osd.2 2019-11-29T12:24:57.489 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi062.front.sepia.ceph.com 2019-11-29T12:24:57.490 INFO:teuthology.orchestra.run.smithi062:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2019-11-29T12:24:58.079 INFO:teuthology.orchestra.run.smithi062.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2019-11-29T12:24:58.079 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 attr=2, projid32bit=1 2019-11-29T12:24:58.079 INFO:teuthology.orchestra.run.smithi062.stdout: = crc=1 finobt=0, sparse=0 2019-11-29T12:24:58.079 INFO:teuthology.orchestra.run.smithi062.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2019-11-29T12:24:58.079 INFO:teuthology.orchestra.run.smithi062.stdout: = sunit=0 swidth=0 blks 2019-11-29T12:24:58.080 INFO:teuthology.orchestra.run.smithi062.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2019-11-29T12:24:58.080 INFO:teuthology.orchestra.run.smithi062.stdout:log =internal log bsize=4096 blocks=11443, version=2 2019-11-29T12:24:58.080 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2019-11-29T12:24:58.080 INFO:teuthology.orchestra.run.smithi062.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2019-11-29T12:24:58.082 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi062.front.sepia.ceph.com -o noatime 2019-11-29T12:24:58.082 INFO:teuthology.orchestra.run.smithi062:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2 2019-11-29T12:24:58.252 INFO:teuthology.orchestra.run.smithi062:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2019-11-29T12:24:58.378 INFO:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2019-11-29T12:24:58.485 INFO:tasks.ceph:{'osd.1': '/dev/vg_nvme/lv_1', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_3', 'osd.2': '/dev/vg_nvme/lv_2'} 2019-11-29T12:24:58.485 INFO:tasks.ceph:{} 2019-11-29T12:24:58.485 INFO:tasks.ceph:osd.3 2019-11-29T12:24:58.485 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi062.front.sepia.ceph.com 2019-11-29T12:24:58.485 INFO:teuthology.orchestra.run.smithi062:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2019-11-29T12:24:59.042 INFO:teuthology.orchestra.run.smithi062.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2019-11-29T12:24:59.042 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 attr=2, projid32bit=1 2019-11-29T12:24:59.042 INFO:teuthology.orchestra.run.smithi062.stdout: = crc=1 finobt=0, sparse=0 2019-11-29T12:24:59.043 INFO:teuthology.orchestra.run.smithi062.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2019-11-29T12:24:59.043 INFO:teuthology.orchestra.run.smithi062.stdout: = sunit=0 swidth=0 blks 2019-11-29T12:24:59.043 INFO:teuthology.orchestra.run.smithi062.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2019-11-29T12:24:59.043 INFO:teuthology.orchestra.run.smithi062.stdout:log =internal log bsize=4096 blocks=11443, version=2 2019-11-29T12:24:59.043 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2019-11-29T12:24:59.043 INFO:teuthology.orchestra.run.smithi062.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2019-11-29T12:24:59.045 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi062.front.sepia.ceph.com -o noatime 2019-11-29T12:24:59.045 INFO:teuthology.orchestra.run.smithi062:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-3 2019-11-29T12:24:59.194 INFO:teuthology.orchestra.run.smithi062:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2019-11-29T12:24:59.314 INFO:teuthology.orchestra.run.smithi062:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2019-11-29T12:24:59.481 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:24:59.481+0000 7faf6ea53b40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2019-11-29T12:24:59.485 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:24:59.485+0000 7faf6ea53b40 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2019-11-29T12:24:59.485 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:24:59.485+0000 7faf6ea53b40 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2019-11-29T12:24:59.485 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:24:59.486+0000 7faf6ea53b40 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2019-11-29T12:24:59.485 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:24:59.486+0000 7faf6ea53b40 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2019-11-29T12:24:59.493 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:24:59.494+0000 7faf6ea53b40 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2019-11-29T12:25:01.801 INFO:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2019-11-29T12:25:01.923 INFO:teuthology.orchestra.run.smithi062:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2019-11-29T12:25:02.076 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:25:02.076+0000 7f09edbb1b40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2019-11-29T12:25:02.077 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:25:02.077+0000 7f09edbb1b40 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2019-11-29T12:25:02.077 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:25:02.077+0000 7f09edbb1b40 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2019-11-29T12:25:02.077 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:25:02.077+0000 7f09edbb1b40 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2019-11-29T12:25:02.077 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:25:02.077+0000 7f09edbb1b40 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2019-11-29T12:25:02.078 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:25:02.078+0000 7f09edbb1b40 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2019-11-29T12:25:04.390 INFO:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2019-11-29T12:25:04.511 INFO:teuthology.orchestra.run.smithi062:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2019-11-29T12:25:04.669 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:25:04.669+0000 7f4cb4395b40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2019-11-29T12:25:04.670 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:25:04.670+0000 7f4cb4395b40 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2019-11-29T12:25:04.670 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:25:04.670+0000 7f4cb4395b40 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2019-11-29T12:25:04.670 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:25:04.670+0000 7f4cb4395b40 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2019-11-29T12:25:04.670 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:25:04.670+0000 7f4cb4395b40 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2019-11-29T12:25:04.671 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:25:04.672+0000 7f4cb4395b40 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2019-11-29T12:25:06.986 INFO:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2019-11-29T12:25:07.099 INFO:teuthology.orchestra.run.smithi062:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2019-11-29T12:25:07.223 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:25:07.224+0000 7f60c7098b40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2019-11-29T12:25:07.224 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:25:07.225+0000 7f60c7098b40 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2019-11-29T12:25:07.224 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:25:07.225+0000 7f60c7098b40 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2019-11-29T12:25:07.225 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:25:07.225+0000 7f60c7098b40 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2019-11-29T12:25:07.225 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:25:07.225+0000 7f60c7098b40 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2019-11-29T12:25:07.225 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:25:07.226+0000 7f60c7098b40 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2019-11-29T12:25:09.533 INFO:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2019-11-29T12:25:09.652 INFO:tasks.ceph:Reading keys from all nodes... 2019-11-29T12:25:09.652 INFO:teuthology.orchestra.run.smithi022:> mktemp 2019-11-29T12:25:09.742 INFO:teuthology.orchestra.run.smithi022.stdout:/tmp/tmp.yrkn1wgrzX 2019-11-29T12:25:09.742 INFO:teuthology.orchestra.run.smithi022:> sudo cp /var/lib/ceph/mgr/ceph-x/keyring /tmp/tmp.yrkn1wgrzX 2019-11-29T12:25:09.860 INFO:teuthology.orchestra.run.smithi022:> sudo chmod 0666 /tmp/tmp.yrkn1wgrzX 2019-11-29T12:25:10.049 DEBUG:teuthology.orchestra.remote:smithi022:/tmp/tmp.yrkn1wgrzX is 56B 2019-11-29T12:25:10.122 INFO:teuthology.orchestra.run.smithi022:> rm -fr /tmp/tmp.yrkn1wgrzX 2019-11-29T12:25:10.196 INFO:teuthology.orchestra.run.smithi022:> mktemp 2019-11-29T12:25:10.263 INFO:teuthology.orchestra.run.smithi022.stdout:/tmp/tmp.98TIZfxMx0 2019-11-29T12:25:10.263 INFO:teuthology.orchestra.run.smithi022:> sudo cp /var/lib/ceph/osd/ceph-4/keyring /tmp/tmp.98TIZfxMx0 2019-11-29T12:25:10.369 INFO:teuthology.orchestra.run.smithi022:> sudo chmod 0666 /tmp/tmp.98TIZfxMx0 2019-11-29T12:25:10.545 DEBUG:teuthology.orchestra.remote:smithi022:/tmp/tmp.98TIZfxMx0 is 56B 2019-11-29T12:25:10.626 INFO:teuthology.orchestra.run.smithi022:> rm -fr /tmp/tmp.98TIZfxMx0 2019-11-29T12:25:10.762 INFO:teuthology.orchestra.run.smithi022:> mktemp 2019-11-29T12:25:10.845 INFO:teuthology.orchestra.run.smithi022.stdout:/tmp/tmp.4zwD3SK4ny 2019-11-29T12:25:10.845 INFO:teuthology.orchestra.run.smithi022:> sudo cp /var/lib/ceph/osd/ceph-5/keyring /tmp/tmp.4zwD3SK4ny 2019-11-29T12:25:10.966 INFO:teuthology.orchestra.run.smithi022:> sudo chmod 0666 /tmp/tmp.4zwD3SK4ny 2019-11-29T12:25:11.167 DEBUG:teuthology.orchestra.remote:smithi022:/tmp/tmp.4zwD3SK4ny is 56B 2019-11-29T12:25:11.257 INFO:teuthology.orchestra.run.smithi022:> rm -fr /tmp/tmp.4zwD3SK4ny 2019-11-29T12:25:11.331 INFO:teuthology.orchestra.run.smithi022:> mktemp 2019-11-29T12:25:11.399 INFO:teuthology.orchestra.run.smithi022.stdout:/tmp/tmp.Iokrya7dGl 2019-11-29T12:25:11.400 INFO:teuthology.orchestra.run.smithi022:> sudo cp /var/lib/ceph/osd/ceph-6/keyring /tmp/tmp.Iokrya7dGl 2019-11-29T12:25:11.501 INFO:teuthology.orchestra.run.smithi022:> sudo chmod 0666 /tmp/tmp.Iokrya7dGl 2019-11-29T12:25:11.703 DEBUG:teuthology.orchestra.remote:smithi022:/tmp/tmp.Iokrya7dGl is 56B 2019-11-29T12:25:11.790 INFO:teuthology.orchestra.run.smithi022:> rm -fr /tmp/tmp.Iokrya7dGl 2019-11-29T12:25:11.867 INFO:teuthology.orchestra.run.smithi022:> mktemp 2019-11-29T12:25:11.942 INFO:teuthology.orchestra.run.smithi022.stdout:/tmp/tmp.gDJguf2eEc 2019-11-29T12:25:11.942 INFO:teuthology.orchestra.run.smithi022:> sudo cp /var/lib/ceph/osd/ceph-7/keyring /tmp/tmp.gDJguf2eEc 2019-11-29T12:25:12.051 INFO:teuthology.orchestra.run.smithi022:> sudo chmod 0666 /tmp/tmp.gDJguf2eEc 2019-11-29T12:25:12.255 DEBUG:teuthology.orchestra.remote:smithi022:/tmp/tmp.gDJguf2eEc is 56B 2019-11-29T12:25:12.328 INFO:teuthology.orchestra.run.smithi022:> rm -fr /tmp/tmp.gDJguf2eEc 2019-11-29T12:25:12.390 INFO:teuthology.orchestra.run.smithi062:> mktemp 2019-11-29T12:25:12.483 INFO:teuthology.orchestra.run.smithi062.stdout:/tmp/tmp.YmaqB69Clv 2019-11-29T12:25:12.483 INFO:teuthology.orchestra.run.smithi062:> sudo cp /var/lib/ceph/mgr/ceph-y/keyring /tmp/tmp.YmaqB69Clv 2019-11-29T12:25:12.592 INFO:teuthology.orchestra.run.smithi062:> sudo chmod 0666 /tmp/tmp.YmaqB69Clv 2019-11-29T12:25:12.785 DEBUG:teuthology.orchestra.remote:smithi062:/tmp/tmp.YmaqB69Clv is 56B 2019-11-29T12:25:12.882 INFO:teuthology.orchestra.run.smithi062:> rm -fr /tmp/tmp.YmaqB69Clv 2019-11-29T12:25:12.962 INFO:teuthology.orchestra.run.smithi062:> mktemp 2019-11-29T12:25:13.046 INFO:teuthology.orchestra.run.smithi062.stdout:/tmp/tmp.3OU1q0aZ38 2019-11-29T12:25:13.046 INFO:teuthology.orchestra.run.smithi062:> sudo cp /var/lib/ceph/osd/ceph-0/keyring /tmp/tmp.3OU1q0aZ38 2019-11-29T12:25:13.157 INFO:teuthology.orchestra.run.smithi062:> sudo chmod 0666 /tmp/tmp.3OU1q0aZ38 2019-11-29T12:25:13.326 DEBUG:teuthology.orchestra.remote:smithi062:/tmp/tmp.3OU1q0aZ38 is 56B 2019-11-29T12:25:13.405 INFO:teuthology.orchestra.run.smithi062:> rm -fr /tmp/tmp.3OU1q0aZ38 2019-11-29T12:25:13.476 INFO:teuthology.orchestra.run.smithi062:> mktemp 2019-11-29T12:25:13.540 INFO:teuthology.orchestra.run.smithi062.stdout:/tmp/tmp.L2KVOqCd22 2019-11-29T12:25:13.540 INFO:teuthology.orchestra.run.smithi062:> sudo cp /var/lib/ceph/osd/ceph-1/keyring /tmp/tmp.L2KVOqCd22 2019-11-29T12:25:13.639 INFO:teuthology.orchestra.run.smithi062:> sudo chmod 0666 /tmp/tmp.L2KVOqCd22 2019-11-29T12:25:13.821 DEBUG:teuthology.orchestra.remote:smithi062:/tmp/tmp.L2KVOqCd22 is 56B 2019-11-29T12:25:13.898 INFO:teuthology.orchestra.run.smithi062:> rm -fr /tmp/tmp.L2KVOqCd22 2019-11-29T12:25:13.986 INFO:teuthology.orchestra.run.smithi062:> mktemp 2019-11-29T12:25:14.067 INFO:teuthology.orchestra.run.smithi062.stdout:/tmp/tmp.7tT1W2J3Ga 2019-11-29T12:25:14.067 INFO:teuthology.orchestra.run.smithi062:> sudo cp /var/lib/ceph/osd/ceph-2/keyring /tmp/tmp.7tT1W2J3Ga 2019-11-29T12:25:14.179 INFO:teuthology.orchestra.run.smithi062:> sudo chmod 0666 /tmp/tmp.7tT1W2J3Ga 2019-11-29T12:25:14.364 DEBUG:teuthology.orchestra.remote:smithi062:/tmp/tmp.7tT1W2J3Ga is 56B 2019-11-29T12:25:14.459 INFO:teuthology.orchestra.run.smithi062:> rm -fr /tmp/tmp.7tT1W2J3Ga 2019-11-29T12:25:14.530 INFO:teuthology.orchestra.run.smithi062:> mktemp 2019-11-29T12:25:14.615 INFO:teuthology.orchestra.run.smithi062.stdout:/tmp/tmp.PWaTFaLzWy 2019-11-29T12:25:14.616 INFO:teuthology.orchestra.run.smithi062:> sudo cp /var/lib/ceph/osd/ceph-3/keyring /tmp/tmp.PWaTFaLzWy 2019-11-29T12:25:14.734 INFO:teuthology.orchestra.run.smithi062:> sudo chmod 0666 /tmp/tmp.PWaTFaLzWy 2019-11-29T12:25:14.943 DEBUG:teuthology.orchestra.remote:smithi062:/tmp/tmp.PWaTFaLzWy is 56B 2019-11-29T12:25:15.028 INFO:teuthology.orchestra.run.smithi062:> rm -fr /tmp/tmp.PWaTFaLzWy 2019-11-29T12:25:15.204 DEBUG:teuthology.orchestra.remote:smithi022:/etc/ceph/ceph.client.1.keyring is 59B 2019-11-29T12:25:15.389 DEBUG:teuthology.orchestra.remote:smithi062:/etc/ceph/ceph.client.0.keyring is 59B 2019-11-29T12:25:15.478 INFO:tasks.ceph:Adding keys to all mons... 2019-11-29T12:25:15.479 INFO:teuthology.orchestra.run.smithi022:> sudo tee -a /etc/ceph/ceph.keyring 2019-11-29T12:25:15.483 INFO:teuthology.orchestra.run.smithi062:> sudo tee -a /etc/ceph/ceph.keyring 2019-11-29T12:25:15.593 INFO:teuthology.orchestra.run.smithi062.stdout:[mgr.x] 2019-11-29T12:25:15.593 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQAIDuFdZG/ZHRAAeZCtcqQSXSaclDSBfKHsXg== 2019-11-29T12:25:15.593 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.4] 2019-11-29T12:25:15.593 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQANDuFdhwTBDRAAp2AJpNn8FVvn8rpWfq3JNQ== 2019-11-29T12:25:15.594 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.5] 2019-11-29T12:25:15.594 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQAPDuFdUSwWMRAAPj4tjH54HRvIBdyXuAckDw== 2019-11-29T12:25:15.594 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.6] 2019-11-29T12:25:15.594 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQASDuFdQ59TFxAAloRvtE6S/2lStTxuMPXkyQ== 2019-11-29T12:25:15.594 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.7] 2019-11-29T12:25:15.594 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQAUDuFdVck+OhAAPaBk3dBDEtCjZl4tsunJ0w== 2019-11-29T12:25:15.595 INFO:teuthology.orchestra.run.smithi062.stdout:[mgr.y] 2019-11-29T12:25:15.595 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQAIDuFdpMgGKRAAv8hKbIWpnI4AqwKfJTSh7w== 2019-11-29T12:25:15.595 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.0] 2019-11-29T12:25:15.595 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQAbDuFdu//FHBAA+Odgx5s1+XPalBVAoIsI5Q== 2019-11-29T12:25:15.595 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.1] 2019-11-29T12:25:15.595 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQAeDuFdRvmlBBAAL/OqF/KPYvrPguny8zVCug== 2019-11-29T12:25:15.595 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.2] 2019-11-29T12:25:15.596 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQAgDuFdI5P+JxAAalmUZBHllCrmPfdngr520Q== 2019-11-29T12:25:15.596 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.3] 2019-11-29T12:25:15.596 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQAjDuFdkAB0DRAAGg9anzDjEmk+JfEjwp52Cg== 2019-11-29T12:25:15.596 INFO:teuthology.orchestra.run.smithi062.stdout:[client.1] 2019-11-29T12:25:15.596 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQAIDuFdIxO7MhAAFNL5BXdss46hWkCnSEt9FA== 2019-11-29T12:25:15.596 INFO:teuthology.orchestra.run.smithi062.stdout:[client.0] 2019-11-29T12:25:15.596 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQAJDuFd2xVFAhAAhq8IfjyWltJNgEW0bdq05g== 2019-11-29T12:25:15.597 INFO:teuthology.orchestra.run.smithi022.stdout:[mgr.x] 2019-11-29T12:25:15.598 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQAIDuFdZG/ZHRAAeZCtcqQSXSaclDSBfKHsXg== 2019-11-29T12:25:15.598 INFO:teuthology.orchestra.run.smithi022.stdout:[osd.4] 2019-11-29T12:25:15.598 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQANDuFdhwTBDRAAp2AJpNn8FVvn8rpWfq3JNQ== 2019-11-29T12:25:15.598 INFO:teuthology.orchestra.run.smithi022.stdout:[osd.5] 2019-11-29T12:25:15.598 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQAPDuFdUSwWMRAAPj4tjH54HRvIBdyXuAckDw== 2019-11-29T12:25:15.598 INFO:teuthology.orchestra.run.smithi022.stdout:[osd.6] 2019-11-29T12:25:15.598 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQASDuFdQ59TFxAAloRvtE6S/2lStTxuMPXkyQ== 2019-11-29T12:25:15.599 INFO:teuthology.orchestra.run.smithi022.stdout:[osd.7] 2019-11-29T12:25:15.599 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQAUDuFdVck+OhAAPaBk3dBDEtCjZl4tsunJ0w== 2019-11-29T12:25:15.599 INFO:teuthology.orchestra.run.smithi022.stdout:[mgr.y] 2019-11-29T12:25:15.599 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQAIDuFdpMgGKRAAv8hKbIWpnI4AqwKfJTSh7w== 2019-11-29T12:25:15.599 INFO:teuthology.orchestra.run.smithi022.stdout:[osd.0] 2019-11-29T12:25:15.599 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQAbDuFdu//FHBAA+Odgx5s1+XPalBVAoIsI5Q== 2019-11-29T12:25:15.599 INFO:teuthology.orchestra.run.smithi022.stdout:[osd.1] 2019-11-29T12:25:15.599 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQAeDuFdRvmlBBAAL/OqF/KPYvrPguny8zVCug== 2019-11-29T12:25:15.600 INFO:teuthology.orchestra.run.smithi022.stdout:[osd.2] 2019-11-29T12:25:15.600 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQAgDuFdI5P+JxAAalmUZBHllCrmPfdngr520Q== 2019-11-29T12:25:15.600 INFO:teuthology.orchestra.run.smithi022.stdout:[osd.3] 2019-11-29T12:25:15.600 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQAjDuFdkAB0DRAAGg9anzDjEmk+JfEjwp52Cg== 2019-11-29T12:25:15.600 INFO:teuthology.orchestra.run.smithi022.stdout:[client.1] 2019-11-29T12:25:15.600 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQAIDuFdIxO7MhAAFNL5BXdss46hWkCnSEt9FA== 2019-11-29T12:25:15.600 INFO:teuthology.orchestra.run.smithi022.stdout:[client.0] 2019-11-29T12:25:15.601 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQAJDuFd2xVFAhAAhq8IfjyWltJNgEW0bdq05g== 2019-11-29T12:25:15.602 INFO:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mds 'allow *' --cap osd 'allow *' --cap mon 'allow profile mgr' 2019-11-29T12:25:15.606 INFO:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mds 'allow *' --cap osd 'allow *' --cap mon 'allow profile mgr' 2019-11-29T12:25:15.778 INFO:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-11-29T12:25:15.787 INFO:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-11-29T12:25:15.961 INFO:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-11-29T12:25:15.966 INFO:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-11-29T12:25:16.135 INFO:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-11-29T12:25:16.139 INFO:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-11-29T12:25:16.312 INFO:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-11-29T12:25:16.317 INFO:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-11-29T12:25:16.489 INFO:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mds 'allow *' --cap osd 'allow *' --cap mon 'allow profile mgr' 2019-11-29T12:25:16.494 INFO:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mds 'allow *' --cap osd 'allow *' --cap mon 'allow profile mgr' 2019-11-29T12:25:16.659 INFO:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-11-29T12:25:16.664 INFO:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-11-29T12:25:16.839 INFO:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-11-29T12:25:16.844 INFO:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-11-29T12:25:17.008 INFO:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-11-29T12:25:17.013 INFO:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-11-29T12:25:17.180 INFO:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-11-29T12:25:17.184 INFO:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-11-29T12:25:17.360 INFO:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mds allow --cap osd 'allow rwx' --cap mgr 'allow r' --cap mon 'allow rw' 2019-11-29T12:25:17.364 INFO:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mds allow --cap osd 'allow rwx' --cap mgr 'allow r' --cap mon 'allow rw' 2019-11-29T12:25:17.544 INFO:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mds allow --cap osd 'allow rwx' --cap mgr 'allow r' --cap mon 'allow rw' 2019-11-29T12:25:17.549 INFO:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mds allow --cap osd 'allow rwx' --cap mgr 'allow r' --cap mon 'allow rw' 2019-11-29T12:25:17.718 INFO:tasks.ceph:Running mkfs on mon nodes... 2019-11-29T12:25:17.718 INFO:teuthology.orchestra.run.smithi022:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2019-11-29T12:25:17.840 INFO:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2019-11-29T12:25:18.021 INFO:teuthology.orchestra.run.smithi022:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2019-11-29T12:25:18.134 INFO:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2019-11-29T12:25:18.256 INFO:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2019-11-29T12:25:18.450 INFO:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2019-11-29T12:25:18.566 INFO:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2019-11-29T12:25:18.676 INFO:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2019-11-29T12:25:18.865 INFO:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2019-11-29T12:25:18.982 INFO:teuthology.orchestra.run.smithi022:> rm -- /home/ubuntu/cephtest/ceph.monmap 2019-11-29T12:25:18.987 INFO:teuthology.orchestra.run.smithi062:> rm -- /home/ubuntu/cephtest/ceph.monmap 2019-11-29T12:25:19.078 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2019-11-29T12:25:19.078 DEBUG:teuthology.misc:running mon.b under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.b.log', '--time-stamp=yes', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2019-11-29T12:25:19.078 INFO:tasks.ceph.mon.b:Restarting daemon 2019-11-29T12:25:19.078 INFO:teuthology.orchestra.run.smithi022:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b 2019-11-29T12:25:19.083 INFO:tasks.ceph.mon.b:Started 2019-11-29T12:25:19.083 DEBUG:teuthology.misc:running mon.a under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.a.log', '--time-stamp=yes', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2019-11-29T12:25:19.084 INFO:tasks.ceph.mon.a:Restarting daemon 2019-11-29T12:25:19.084 INFO:teuthology.orchestra.run.smithi062:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a 2019-11-29T12:25:19.089 INFO:tasks.ceph.mon.a:Started 2019-11-29T12:25:19.089 DEBUG:teuthology.misc:running mon.c under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.c.log', '--time-stamp=yes', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2019-11-29T12:25:19.089 INFO:tasks.ceph.mon.c:Restarting daemon 2019-11-29T12:25:19.089 INFO:teuthology.orchestra.run.smithi062:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c 2019-11-29T12:25:19.093 INFO:tasks.ceph.mon.c:Started 2019-11-29T12:25:19.093 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2019-11-29T12:25:19.093 INFO:tasks.ceph.mgr.x:Restarting daemon 2019-11-29T12:25:19.094 INFO:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i x 2019-11-29T12:25:19.098 INFO:tasks.ceph.mgr.x:Started 2019-11-29T12:25:19.098 INFO:tasks.ceph.mgr.y:Restarting daemon 2019-11-29T12:25:19.098 INFO:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i y 2019-11-29T12:25:19.102 INFO:tasks.ceph.mgr.y:Started 2019-11-29T12:25:19.103 INFO:tasks.ceph:Setting crush tunables to default 2019-11-29T12:25:19.103 INFO:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph osd crush tunables default 2019-11-29T12:25:23.458 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:00:04.069 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T12:25:23.512 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:00:04.123 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T12:25:23.572 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:00:00:04.234 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T12:25:36.510 INFO:teuthology.orchestra.run.smithi062.stderr:adjusted tunables profile to default 2019-11-29T12:25:36.522 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2019-11-29T12:25:36.522 INFO:teuthology.orchestra.run.smithi022:> mktemp 2019-11-29T12:25:36.587 INFO:teuthology.orchestra.run.smithi022.stdout:/tmp/tmp.7r01Q0YQlo 2019-11-29T12:25:36.587 INFO:teuthology.orchestra.run.smithi022:> sudo cp /var/lib/ceph/osd/ceph-4/fsid /tmp/tmp.7r01Q0YQlo 2019-11-29T12:25:36.659 INFO:teuthology.orchestra.run.smithi022:> sudo chmod 0666 /tmp/tmp.7r01Q0YQlo 2019-11-29T12:25:36.767 DEBUG:teuthology.orchestra.remote:smithi022:/tmp/tmp.7r01Q0YQlo is 37B 2019-11-29T12:25:36.815 INFO:teuthology.orchestra.run.smithi022:> rm -fr /tmp/tmp.7r01Q0YQlo 2019-11-29T12:25:36.859 INFO:teuthology.orchestra.run.smithi022:> mktemp 2019-11-29T12:25:36.980 INFO:teuthology.orchestra.run.smithi022.stdout:/tmp/tmp.bVgUa41sJe 2019-11-29T12:25:36.981 INFO:teuthology.orchestra.run.smithi022:> sudo cp /var/lib/ceph/osd/ceph-5/fsid /tmp/tmp.bVgUa41sJe 2019-11-29T12:25:37.054 INFO:teuthology.orchestra.run.smithi022:> sudo chmod 0666 /tmp/tmp.bVgUa41sJe 2019-11-29T12:25:37.180 DEBUG:teuthology.orchestra.remote:smithi022:/tmp/tmp.bVgUa41sJe is 37B 2019-11-29T12:25:37.229 INFO:teuthology.orchestra.run.smithi022:> rm -fr /tmp/tmp.bVgUa41sJe 2019-11-29T12:25:37.275 INFO:teuthology.orchestra.run.smithi022:> mktemp 2019-11-29T12:25:37.413 INFO:teuthology.orchestra.run.smithi022.stdout:/tmp/tmp.ylZqXT5h5N 2019-11-29T12:25:37.414 INFO:teuthology.orchestra.run.smithi022:> sudo cp /var/lib/ceph/osd/ceph-6/fsid /tmp/tmp.ylZqXT5h5N 2019-11-29T12:25:37.483 INFO:teuthology.orchestra.run.smithi022:> sudo chmod 0666 /tmp/tmp.ylZqXT5h5N 2019-11-29T12:25:37.588 DEBUG:teuthology.orchestra.remote:smithi022:/tmp/tmp.ylZqXT5h5N is 37B 2019-11-29T12:25:37.636 INFO:teuthology.orchestra.run.smithi022:> rm -fr /tmp/tmp.ylZqXT5h5N 2019-11-29T12:25:37.679 INFO:teuthology.orchestra.run.smithi022:> mktemp 2019-11-29T12:25:37.810 INFO:teuthology.orchestra.run.smithi022.stdout:/tmp/tmp.RO8eagS8Vc 2019-11-29T12:25:37.810 INFO:teuthology.orchestra.run.smithi022:> sudo cp /var/lib/ceph/osd/ceph-7/fsid /tmp/tmp.RO8eagS8Vc 2019-11-29T12:25:37.873 INFO:teuthology.orchestra.run.smithi022:> sudo chmod 0666 /tmp/tmp.RO8eagS8Vc 2019-11-29T12:25:37.972 DEBUG:teuthology.orchestra.remote:smithi022:/tmp/tmp.RO8eagS8Vc is 37B 2019-11-29T12:25:38.018 INFO:teuthology.orchestra.run.smithi022:> rm -fr /tmp/tmp.RO8eagS8Vc 2019-11-29T12:25:38.059 INFO:teuthology.orchestra.run.smithi062:> mktemp 2019-11-29T12:25:38.143 INFO:teuthology.orchestra.run.smithi062.stdout:/tmp/tmp.yRxMbpSNqB 2019-11-29T12:25:38.144 INFO:teuthology.orchestra.run.smithi062:> sudo cp /var/lib/ceph/osd/ceph-0/fsid /tmp/tmp.yRxMbpSNqB 2019-11-29T12:25:38.213 INFO:teuthology.orchestra.run.smithi062:> sudo chmod 0666 /tmp/tmp.yRxMbpSNqB 2019-11-29T12:25:38.318 DEBUG:teuthology.orchestra.remote:smithi062:/tmp/tmp.yRxMbpSNqB is 37B 2019-11-29T12:25:38.366 INFO:teuthology.orchestra.run.smithi062:> rm -fr /tmp/tmp.yRxMbpSNqB 2019-11-29T12:25:38.408 INFO:teuthology.orchestra.run.smithi062:> mktemp 2019-11-29T12:25:38.544 INFO:teuthology.orchestra.run.smithi062.stdout:/tmp/tmp.Y8hXjytxde 2019-11-29T12:25:38.544 INFO:teuthology.orchestra.run.smithi062:> sudo cp /var/lib/ceph/osd/ceph-1/fsid /tmp/tmp.Y8hXjytxde 2019-11-29T12:25:38.646 INFO:teuthology.orchestra.run.smithi062:> sudo chmod 0666 /tmp/tmp.Y8hXjytxde 2019-11-29T12:25:38.837 DEBUG:teuthology.orchestra.remote:smithi062:/tmp/tmp.Y8hXjytxde is 37B 2019-11-29T12:25:38.910 INFO:teuthology.orchestra.run.smithi062:> rm -fr /tmp/tmp.Y8hXjytxde 2019-11-29T12:25:38.959 INFO:teuthology.orchestra.run.smithi062:> mktemp 2019-11-29T12:25:39.004 INFO:teuthology.orchestra.run.smithi062.stdout:/tmp/tmp.oTw06ht5mA 2019-11-29T12:25:39.004 INFO:teuthology.orchestra.run.smithi062:> sudo cp /var/lib/ceph/osd/ceph-2/fsid /tmp/tmp.oTw06ht5mA 2019-11-29T12:25:39.061 INFO:teuthology.orchestra.run.smithi062:> sudo chmod 0666 /tmp/tmp.oTw06ht5mA 2019-11-29T12:25:39.162 DEBUG:teuthology.orchestra.remote:smithi062:/tmp/tmp.oTw06ht5mA is 37B 2019-11-29T12:25:39.213 INFO:teuthology.orchestra.run.smithi062:> rm -fr /tmp/tmp.oTw06ht5mA 2019-11-29T12:25:39.264 INFO:teuthology.orchestra.run.smithi062:> mktemp 2019-11-29T12:25:39.318 INFO:teuthology.orchestra.run.smithi062.stdout:/tmp/tmp.FBTRbHP9XY 2019-11-29T12:25:39.319 INFO:teuthology.orchestra.run.smithi062:> sudo cp /var/lib/ceph/osd/ceph-3/fsid /tmp/tmp.FBTRbHP9XY 2019-11-29T12:25:39.386 INFO:teuthology.orchestra.run.smithi062:> sudo chmod 0666 /tmp/tmp.FBTRbHP9XY 2019-11-29T12:25:39.490 DEBUG:teuthology.orchestra.remote:smithi062:/tmp/tmp.FBTRbHP9XY is 37B 2019-11-29T12:25:39.540 INFO:teuthology.orchestra.run.smithi062:> rm -fr /tmp/tmp.FBTRbHP9XY 2019-11-29T12:25:39.593 INFO:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph osd new 1d2f040a-cabb-44e4-8527-8164d3b9c71e 0 2019-11-29T12:25:41.249 INFO:teuthology.orchestra.run.smithi062.stdout:0 2019-11-29T12:25:41.271 INFO:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph osd new 705d011c-fb4e-4205-87e1-f6c8201438a2 1 2019-11-29T12:25:42.627 INFO:teuthology.orchestra.run.smithi062.stdout:1 2019-11-29T12:25:42.650 INFO:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph osd new 294db287-c871-4469-81bc-ac07519a731a 2 2019-11-29T12:25:43.796 INFO:teuthology.orchestra.run.smithi062.stdout:2 2019-11-29T12:25:43.815 INFO:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph osd new 6dd90165-5705-4605-84ed-b9f88111d325 3 2019-11-29T12:25:44.985 INFO:teuthology.orchestra.run.smithi062.stdout:3 2019-11-29T12:25:45.011 INFO:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph osd new 51d162f7-af55-4534-b122-effe88c2e073 4 2019-11-29T12:25:46.051 INFO:teuthology.orchestra.run.smithi062.stdout:4 2019-11-29T12:25:46.070 INFO:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph osd new b9cafea9-e874-4f21-bba3-28629266318a 5 2019-11-29T12:25:47.177 INFO:teuthology.orchestra.run.smithi062.stdout:5 2019-11-29T12:25:47.204 INFO:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph osd new 7348c077-a357-47b8-9f1e-a0a6f31e06a3 6 2019-11-29T12:25:48.285 INFO:teuthology.orchestra.run.smithi062.stdout:6 2019-11-29T12:25:48.307 INFO:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph osd new ae9ea222-bca6-4fdc-b3cf-83e08cd89804 7 2019-11-29T12:25:49.299 INFO:teuthology.orchestra.run.smithi062.stdout:7 2019-11-29T12:25:49.319 DEBUG:teuthology.misc:running osd.4 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.4.log', '--time-stamp=yes', '--tool=memcheck'] 2019-11-29T12:25:49.320 INFO:tasks.ceph.osd.4:Restarting daemon 2019-11-29T12:25:49.320 INFO:teuthology.orchestra.run.smithi022:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.4.log --time-stamp=yes --tool=memcheck ceph-osd -f --cluster ceph -i 4 2019-11-29T12:25:49.325 INFO:tasks.ceph.osd.4:Started 2019-11-29T12:25:49.325 DEBUG:teuthology.misc:running osd.5 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.5.log', '--time-stamp=yes', '--tool=memcheck'] 2019-11-29T12:25:49.325 INFO:tasks.ceph.osd.5:Restarting daemon 2019-11-29T12:25:49.325 INFO:teuthology.orchestra.run.smithi022:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.5.log --time-stamp=yes --tool=memcheck ceph-osd -f --cluster ceph -i 5 2019-11-29T12:25:49.330 INFO:tasks.ceph.osd.5:Started 2019-11-29T12:25:49.330 DEBUG:teuthology.misc:running osd.6 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.6.log', '--time-stamp=yes', '--tool=memcheck'] 2019-11-29T12:25:49.330 INFO:tasks.ceph.osd.6:Restarting daemon 2019-11-29T12:25:49.330 INFO:teuthology.orchestra.run.smithi022:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.6.log --time-stamp=yes --tool=memcheck ceph-osd -f --cluster ceph -i 6 2019-11-29T12:25:49.334 INFO:tasks.ceph.osd.6:Started 2019-11-29T12:25:49.335 DEBUG:teuthology.misc:running osd.7 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.7.log', '--time-stamp=yes', '--tool=memcheck'] 2019-11-29T12:25:49.335 INFO:tasks.ceph.osd.7:Restarting daemon 2019-11-29T12:25:49.335 INFO:teuthology.orchestra.run.smithi022:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.7.log --time-stamp=yes --tool=memcheck ceph-osd -f --cluster ceph -i 7 2019-11-29T12:25:49.339 INFO:tasks.ceph.osd.7:Started 2019-11-29T12:25:49.340 DEBUG:teuthology.misc:running osd.0 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.0.log', '--time-stamp=yes', '--tool=memcheck'] 2019-11-29T12:25:49.340 INFO:tasks.ceph.osd.0:Restarting daemon 2019-11-29T12:25:49.340 INFO:teuthology.orchestra.run.smithi062:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.0.log --time-stamp=yes --tool=memcheck ceph-osd -f --cluster ceph -i 0 2019-11-29T12:25:49.344 INFO:tasks.ceph.osd.0:Started 2019-11-29T12:25:49.344 DEBUG:teuthology.misc:running osd.1 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.1.log', '--time-stamp=yes', '--tool=memcheck'] 2019-11-29T12:25:49.345 INFO:tasks.ceph.osd.1:Restarting daemon 2019-11-29T12:25:49.345 INFO:teuthology.orchestra.run.smithi062:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.1.log --time-stamp=yes --tool=memcheck ceph-osd -f --cluster ceph -i 1 2019-11-29T12:25:49.349 INFO:tasks.ceph.osd.1:Started 2019-11-29T12:25:49.349 DEBUG:teuthology.misc:running osd.2 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.2.log', '--time-stamp=yes', '--tool=memcheck'] 2019-11-29T12:25:49.350 INFO:tasks.ceph.osd.2:Restarting daemon 2019-11-29T12:25:49.350 INFO:teuthology.orchestra.run.smithi062:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.2.log --time-stamp=yes --tool=memcheck ceph-osd -f --cluster ceph -i 2 2019-11-29T12:25:49.355 INFO:tasks.ceph.osd.2:Started 2019-11-29T12:25:49.355 DEBUG:teuthology.misc:running osd.3 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.3.log', '--time-stamp=yes', '--tool=memcheck'] 2019-11-29T12:25:49.355 INFO:tasks.ceph.osd.3:Restarting daemon 2019-11-29T12:25:49.355 INFO:teuthology.orchestra.run.smithi062:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.3.log --time-stamp=yes --tool=memcheck ceph-osd -f --cluster ceph -i 3 2019-11-29T12:25:49.359 INFO:tasks.ceph.osd.3:Started 2019-11-29T12:25:49.359 INFO:tasks.ceph:Waiting for OSDs to come up 2019-11-29T12:25:50.167 INFO:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2019-11-29T12:25:51.263 INFO:teuthology.misc.health.smithi062.stdout: 2019-11-29T12:25:51.263 INFO:teuthology.misc.health.smithi062.stdout:{"epoch":10,"fsid":"787fcccf-49ed-4b7f-ac72-6914ee170c2a","created":"2019-11-29T12:25:33.524089+0000","modified":"2019-11-29T12:25:49.163778+0000","last_up_change":"0.000000","last_in_change":"0.000000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"1d2f040a-cabb-44e4-8527-8164d3b9c71e","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"705d011c-fb4e-4205-87e1-f6c8201438a2","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"294db287-c871-4469-81bc-ac07519a731a","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"6dd90165-5705-4605-84ed-b9f88111d325","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"51d162f7-af55-4534-b122-effe88c2e073","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"b9cafea9-e874-4f21-bba3-28629266318a","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"7348c077-a357-47b8-9f1e-a0a6f31e06a3","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"ae9ea222-bca6-4fdc-b3cf-83e08cd89804","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-29T12:25:51.277 DEBUG:teuthology.misc:0 of 8 OSDs are up 2019-11-29T12:25:53.172 INFO:tasks.ceph.osd.6.smithi022.stderr:==00:00:00:03.725 9262== Warning: unimplemented fcntl command: 1038 2019-11-29T12:25:53.182 INFO:tasks.ceph.osd.7.smithi022.stderr:==00:00:00:03.729 9263== Warning: unimplemented fcntl command: 1038 2019-11-29T12:25:53.229 INFO:tasks.ceph.osd.6.smithi022.stderr:==00:00:00:03.783 9262== Warning: unimplemented fcntl command: 1038 2019-11-29T12:25:53.239 INFO:tasks.ceph.osd.7.smithi022.stderr:==00:00:00:03.786 9263== Warning: unimplemented fcntl command: 1038 2019-11-29T12:25:53.258 INFO:tasks.ceph.osd.4.smithi022.stderr:==00:00:00:03.800 9265== Warning: unimplemented fcntl command: 1038 2019-11-29T12:25:53.260 INFO:tasks.ceph.osd.5.smithi022.stderr:==00:00:00:03.805 9264== Warning: unimplemented fcntl command: 1038 2019-11-29T12:25:53.333 INFO:tasks.ceph.osd.4.smithi022.stderr:==00:00:00:03.876 9265== Warning: unimplemented fcntl command: 1038 2019-11-29T12:25:53.345 INFO:tasks.ceph.osd.1.smithi062.stderr:==00:00:00:03.850 10370== Warning: unimplemented fcntl command: 1038 2019-11-29T12:25:53.350 INFO:tasks.ceph.osd.5.smithi022.stderr:==00:00:00:03.894 9264== Warning: unimplemented fcntl command: 1038 2019-11-29T12:25:53.426 INFO:tasks.ceph.osd.1.smithi062.stderr:==00:00:00:03.931 10370== Warning: unimplemented fcntl command: 1038 2019-11-29T12:25:53.461 INFO:tasks.ceph.osd.2.smithi062.stderr:==00:00:00:04.008 10361== Warning: unimplemented fcntl command: 1038 2019-11-29T12:25:53.519 INFO:tasks.ceph.osd.2.smithi062.stderr:==00:00:00:04.065 10361== Warning: unimplemented fcntl command: 1038 2019-11-29T12:25:53.581 INFO:tasks.ceph.osd.0.smithi062.stderr:==00:00:00:04.085 10371== Warning: unimplemented fcntl command: 1038 2019-11-29T12:25:53.614 INFO:tasks.ceph.osd.3.smithi062.stderr:==00:00:00:04.119 10369== Warning: unimplemented fcntl command: 1038 2019-11-29T12:25:53.639 INFO:tasks.ceph.osd.0.smithi062.stderr:==00:00:00:04.144 10371== Warning: unimplemented fcntl command: 1038 2019-11-29T12:25:53.674 INFO:tasks.ceph.osd.3.smithi062.stderr:==00:00:00:04.179 10369== Warning: unimplemented fcntl command: 1038 2019-11-29T12:25:53.848 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T12:25:53.832+0000 9b10800 -1 Falling back to public interface 2019-11-29T12:25:53.849 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T12:25:53.823+0000 9b10800 -1 Falling back to public interface 2019-11-29T12:25:53.928 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T12:25:53.917+0000 9b10800 -1 Falling back to public interface 2019-11-29T12:25:53.944 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T12:25:53.925+0000 9b10800 -1 Falling back to public interface 2019-11-29T12:25:54.028 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T12:25:54.004+0000 9b10800 -1 Falling back to public interface 2019-11-29T12:25:54.053 INFO:tasks.ceph.osd.6.smithi022.stderr:==00:00:00:04.607 9262== Warning: unimplemented fcntl command: 1038 2019-11-29T12:25:54.086 INFO:tasks.ceph.osd.7.smithi022.stderr:==00:00:00:04.633 9263== Warning: unimplemented fcntl command: 1038 2019-11-29T12:25:54.132 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T12:25:54.114+0000 9b10800 -1 Falling back to public interface 2019-11-29T12:25:54.153 INFO:tasks.ceph.osd.5.smithi022.stderr:==00:00:00:04.697 9264== Warning: unimplemented fcntl command: 1038 2019-11-29T12:25:54.169 INFO:tasks.ceph.osd.4.smithi022.stderr:==00:00:00:04.711 9265== Warning: unimplemented fcntl command: 1038 2019-11-29T12:25:54.255 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T12:25:54.243+0000 9b10800 -1 Falling back to public interface 2019-11-29T12:25:54.268 INFO:tasks.ceph.osd.4.smithi022.stderr:==00:00:00:04.810 9265== Warning: unimplemented fcntl command: 1038 2019-11-29T12:25:54.282 INFO:tasks.ceph.osd.5.smithi022.stderr:==00:00:00:04.826 9264== Warning: unimplemented fcntl command: 1038 2019-11-29T12:25:54.286 INFO:tasks.ceph.osd.4.smithi022.stderr:==00:00:00:04.828 9265== Warning: unimplemented fcntl command: 1038 2019-11-29T12:25:54.286 INFO:tasks.ceph.osd.1.smithi062.stderr:==00:00:00:04.791 10370== Warning: unimplemented fcntl command: 1038 2019-11-29T12:25:54.296 INFO:tasks.ceph.osd.5.smithi022.stderr:==00:00:00:04.840 9264== Warning: unimplemented fcntl command: 1038 2019-11-29T12:25:54.303 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T12:25:54.287+0000 9b10800 -1 Falling back to public interface 2019-11-29T12:25:54.395 INFO:tasks.ceph.osd.2.smithi062.stderr:==00:00:00:04.941 10361== Warning: unimplemented fcntl command: 1038 2019-11-29T12:25:54.405 INFO:tasks.ceph.osd.6.smithi022.stderr:==00:00:00:04.959 9262== Warning: unimplemented fcntl command: 1038 2019-11-29T12:25:54.425 INFO:tasks.ceph.osd.6.smithi022.stderr:==00:00:00:04.979 9262== Warning: unimplemented fcntl command: 1038 2019-11-29T12:25:54.482 INFO:tasks.ceph.osd.7.smithi022.stderr:==00:00:00:05.028 9263== Warning: unimplemented fcntl command: 1038 2019-11-29T12:25:54.486 INFO:tasks.ceph.osd.0.smithi062.stderr:==00:00:00:04.990 10371== Warning: unimplemented fcntl command: 1038 2019-11-29T12:25:54.500 INFO:tasks.ceph.osd.7.smithi022.stderr:==00:00:00:05.046 9263== Warning: unimplemented fcntl command: 1038 2019-11-29T12:25:54.525 INFO:tasks.ceph.osd.3.smithi062.stderr:==00:00:00:05.030 10369== Warning: unimplemented fcntl command: 1038 2019-11-29T12:25:54.672 INFO:tasks.ceph.osd.1.smithi062.stderr:==00:00:00:05.176 10370== Warning: unimplemented fcntl command: 1038 2019-11-29T12:25:54.672 INFO:tasks.ceph.osd.3.smithi062.stderr:==00:00:00:05.178 10369== Warning: unimplemented fcntl command: 1038 2019-11-29T12:25:54.683 INFO:tasks.ceph.osd.1.smithi062.stderr:==00:00:00:05.188 10370== Warning: unimplemented fcntl command: 1038 2019-11-29T12:25:54.696 INFO:tasks.ceph.osd.3.smithi062.stderr:==00:00:00:05.201 10369== Warning: unimplemented fcntl command: 1038 2019-11-29T12:25:54.796 INFO:tasks.ceph.osd.2.smithi062.stderr:==00:00:00:05.342 10361== Warning: unimplemented fcntl command: 1038 2019-11-29T12:25:54.807 INFO:tasks.ceph.osd.2.smithi062.stderr:==00:00:00:05.354 10361== Warning: unimplemented fcntl command: 1038 2019-11-29T12:25:54.847 INFO:tasks.ceph.osd.0.smithi062.stderr:==00:00:00:05.352 10371== Warning: unimplemented fcntl command: 1038 2019-11-29T12:25:54.859 INFO:tasks.ceph.osd.0.smithi062.stderr:==00:00:00:05.364 10371== Warning: unimplemented fcntl command: 1038 2019-11-29T12:25:57.276 INFO:tasks.ceph.osd.7.smithi022.stderr:==00:00:00:07.822 9263== Warning: unimplemented fcntl command: 1038 2019-11-29T12:25:57.283 INFO:tasks.ceph.osd.7.smithi022.stderr:==00:00:00:07.830 9263== Warning: unimplemented fcntl command: 1038 2019-11-29T12:25:57.427 INFO:tasks.ceph.osd.4.smithi022.stderr:==00:00:00:07.969 9265== Warning: unimplemented fcntl command: 1038 2019-11-29T12:25:57.433 INFO:tasks.ceph.osd.4.smithi022.stderr:==00:00:00:07.975 9265== Warning: unimplemented fcntl command: 1038 2019-11-29T12:25:57.544 INFO:tasks.ceph.osd.7.smithi022.stderr:==00:00:00:08.091 9263== Warning: unimplemented fcntl command: 1038 2019-11-29T12:25:57.697 INFO:tasks.ceph.osd.4.smithi022.stderr:==00:00:00:08.239 9265== Warning: unimplemented fcntl command: 1038 2019-11-29T12:25:58.062 INFO:tasks.ceph.osd.5.smithi022.stderr:==00:00:00:08.606 9264== Warning: unimplemented fcntl command: 1038 2019-11-29T12:25:58.067 INFO:tasks.ceph.osd.5.smithi022.stderr:==00:00:00:08.612 9264== Warning: unimplemented fcntl command: 1038 2019-11-29T12:25:58.083 INFO:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2019-11-29T12:25:58.298 INFO:tasks.ceph.osd.6.smithi022.stderr:==00:00:00:08.851 9262== Warning: unimplemented fcntl command: 1038 2019-11-29T12:25:58.304 INFO:tasks.ceph.osd.6.smithi022.stderr:==00:00:00:08.858 9262== Warning: unimplemented fcntl command: 1038 2019-11-29T12:25:58.332 INFO:tasks.ceph.osd.5.smithi022.stderr:==00:00:00:08.876 9264== Warning: unimplemented fcntl command: 1038 2019-11-29T12:25:58.368 INFO:tasks.ceph.osd.2.smithi062.stderr:==00:00:00:08.914 10361== Warning: unimplemented fcntl command: 1038 2019-11-29T12:25:58.373 INFO:tasks.ceph.osd.2.smithi062.stderr:==00:00:00:08.919 10361== Warning: unimplemented fcntl command: 1038 2019-11-29T12:25:58.566 INFO:tasks.ceph.osd.6.smithi022.stderr:==00:00:00:09.119 9262== Warning: unimplemented fcntl command: 1038 2019-11-29T12:25:58.583 INFO:tasks.ceph.osd.0.smithi062.stderr:==00:00:00:09.088 10371== Warning: unimplemented fcntl command: 1038 2019-11-29T12:25:58.594 INFO:tasks.ceph.osd.0.smithi062.stderr:==00:00:00:09.099 10371== Warning: unimplemented fcntl command: 1038 2019-11-29T12:25:58.636 INFO:tasks.ceph.osd.2.smithi062.stderr:==00:00:00:09.182 10361== Warning: unimplemented fcntl command: 1038 2019-11-29T12:25:58.785 INFO:tasks.ceph.osd.3.smithi062.stderr:==00:00:00:09.291 10369== Warning: unimplemented fcntl command: 1038 2019-11-29T12:25:58.792 INFO:tasks.ceph.osd.3.smithi062.stderr:==00:00:00:09.297 10369== Warning: unimplemented fcntl command: 1038 2019-11-29T12:25:58.810 INFO:tasks.ceph.osd.1.smithi062.stderr:==00:00:00:09.314 10370== Warning: unimplemented fcntl command: 1038 2019-11-29T12:25:58.810 INFO:teuthology.misc.health.smithi062.stdout: 2019-11-29T12:25:58.811 INFO:teuthology.misc.health.smithi062.stdout:{"epoch":10,"fsid":"787fcccf-49ed-4b7f-ac72-6914ee170c2a","created":"2019-11-29T12:25:33.524089+0000","modified":"2019-11-29T12:25:49.163778+0000","last_up_change":"0.000000","last_in_change":"0.000000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"1d2f040a-cabb-44e4-8527-8164d3b9c71e","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"705d011c-fb4e-4205-87e1-f6c8201438a2","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"294db287-c871-4469-81bc-ac07519a731a","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"6dd90165-5705-4605-84ed-b9f88111d325","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"51d162f7-af55-4534-b122-effe88c2e073","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"b9cafea9-e874-4f21-bba3-28629266318a","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"7348c077-a357-47b8-9f1e-a0a6f31e06a3","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"ae9ea222-bca6-4fdc-b3cf-83e08cd89804","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-29T12:25:58.815 INFO:tasks.ceph.osd.1.smithi062.stderr:==00:00:00:09.320 10370== Warning: unimplemented fcntl command: 1038 2019-11-29T12:25:58.823 DEBUG:teuthology.misc:0 of 8 OSDs are up 2019-11-29T12:25:58.861 INFO:tasks.ceph.osd.0.smithi062.stderr:==00:00:00:09.366 10371== Warning: unimplemented fcntl command: 1038 2019-11-29T12:25:58.914 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T12:25:58.904+0000 9b10800 -1 osd.7 0 log_to_monitors {default=true} 2019-11-29T12:25:59.052 INFO:tasks.ceph.osd.3.smithi062.stderr:==00:00:00:09.557 10369== Warning: unimplemented fcntl command: 1038 2019-11-29T12:25:59.073 INFO:tasks.ceph.osd.1.smithi062.stderr:==00:00:00:09.578 10370== Warning: unimplemented fcntl command: 1038 2019-11-29T12:25:59.171 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T12:25:59.170+0000 9b10800 -1 osd.4 0 log_to_monitors {default=true} 2019-11-29T12:25:59.645 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T12:25:59.643+0000 9b10800 -1 osd.5 0 log_to_monitors {default=true} 2019-11-29T12:25:59.950 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T12:25:59.947+0000 9b10800 -1 osd.6 0 log_to_monitors {default=true} 2019-11-29T12:26:00.155 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T12:26:00.152+0000 9b10800 -1 osd.2 0 log_to_monitors {default=true} 2019-11-29T12:26:00.324 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T12:26:00.323+0000 9b10800 -1 osd.0 0 log_to_monitors {default=true} 2019-11-29T12:26:00.568 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T12:26:00.564+0000 9b10800 -1 osd.1 0 log_to_monitors {default=true} 2019-11-29T12:26:00.581 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T12:26:00.573+0000 9b10800 -1 osd.3 0 log_to_monitors {default=true} 2019-11-29T12:26:01.543 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T12:26:01.540+0000 27b6f700 -1 osd.7 0 waiting for initial osdmap 2019-11-29T12:26:01.553 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T12:26:01.549+0000 2776f700 -1 osd.4 0 waiting for initial osdmap 2019-11-29T12:26:01.592 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T12:26:01.589+0000 2776f700 -1 osd.5 0 waiting for initial osdmap 2019-11-29T12:26:02.984 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T12:26:02.980+0000 27b6f700 -1 osd.6 0 waiting for initial osdmap 2019-11-29T12:26:02.999 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T12:26:02.997+0000 2476b700 -1 osd.2 0 waiting for initial osdmap 2019-11-29T12:26:03.009 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T12:26:03.002+0000 2776f700 -1 osd.1 0 waiting for initial osdmap 2019-11-29T12:26:03.017 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T12:26:03.014+0000 2776f700 -1 osd.3 0 waiting for initial osdmap 2019-11-29T12:26:03.043 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T12:26:03.038+0000 24966700 -1 osd.0 0 waiting for initial osdmap 2019-11-29T12:26:05.633 INFO:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2019-11-29T12:26:06.482 INFO:teuthology.misc.health.smithi062.stdout: 2019-11-29T12:26:06.483 INFO:teuthology.misc.health.smithi062.stdout:{"epoch":16,"fsid":"787fcccf-49ed-4b7f-ac72-6914ee170c2a","created":"2019-11-29T12:25:33.524089+0000","modified":"2019-11-29T12:26:06.136148+0000","last_up_change":"2019-11-29T12:26:04.643954+0000","last_in_change":"2019-11-29T12:26:04.643954+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"1d2f040a-cabb-44e4-8527-8164d3b9c71e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":10371},{"type":"v1","addr":"172.21.15.62:6817","nonce":10371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":10371},{"type":"v1","addr":"172.21.15.62:6819","nonce":10371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":10371},{"type":"v1","addr":"172.21.15.62:6824","nonce":10371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":10371},{"type":"v1","addr":"172.21.15.62:6821","nonce":10371}]},"public_addr":"172.21.15.62:6817/10371","cluster_addr":"172.21.15.62:6819/10371","heartbeat_back_addr":"172.21.15.62:6824/10371","heartbeat_front_addr":"172.21.15.62:6821/10371","state":["exists","up"]},{"osd":1,"uuid":"705d011c-fb4e-4205-87e1-f6c8201438a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":10370},{"type":"v1","addr":"172.21.15.62:6801","nonce":10370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":10370},{"type":"v1","addr":"172.21.15.62:6803","nonce":10370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":10370},{"type":"v1","addr":"172.21.15.62:6807","nonce":10370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":10370},{"type":"v1","addr":"172.21.15.62:6805","nonce":10370}]},"public_addr":"172.21.15.62:6801/10370","cluster_addr":"172.21.15.62:6803/10370","heartbeat_back_addr":"172.21.15.62:6807/10370","heartbeat_front_addr":"172.21.15.62:6805/10370","state":["exists","up"]},{"osd":2,"uuid":"294db287-c871-4469-81bc-ac07519a731a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":10361},{"type":"v1","addr":"172.21.15.62:6809","nonce":10361}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":10361},{"type":"v1","addr":"172.21.15.62:6811","nonce":10361}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":10361},{"type":"v1","addr":"172.21.15.62:6815","nonce":10361}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":10361},{"type":"v1","addr":"172.21.15.62:6813","nonce":10361}]},"public_addr":"172.21.15.62:6809/10361","cluster_addr":"172.21.15.62:6811/10361","heartbeat_back_addr":"172.21.15.62:6815/10361","heartbeat_front_addr":"172.21.15.62:6813/10361","state":["exists","up"]},{"osd":3,"uuid":"6dd90165-5705-4605-84ed-b9f88111d325","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6823","nonce":10369},{"type":"v1","addr":"172.21.15.62:6825","nonce":10369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":10369},{"type":"v1","addr":"172.21.15.62:6827","nonce":10369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":10369},{"type":"v1","addr":"172.21.15.62:6831","nonce":10369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":10369},{"type":"v1","addr":"172.21.15.62:6829","nonce":10369}]},"public_addr":"172.21.15.62:6825/10369","cluster_addr":"172.21.15.62:6827/10369","heartbeat_back_addr":"172.21.15.62:6831/10369","heartbeat_front_addr":"172.21.15.62:6829/10369","state":["exists","up"]},{"osd":4,"uuid":"51d162f7-af55-4534-b122-effe88c2e073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6821","nonce":9265},{"type":"v1","addr":"172.21.15.22:6823","nonce":9265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6825","nonce":9265},{"type":"v1","addr":"172.21.15.22:6827","nonce":9265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":9265},{"type":"v1","addr":"172.21.15.22:6833","nonce":9265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6829","nonce":9265},{"type":"v1","addr":"172.21.15.22:6831","nonce":9265}]},"public_addr":"172.21.15.22:6823/9265","cluster_addr":"172.21.15.22:6827/9265","heartbeat_back_addr":"172.21.15.22:6833/9265","heartbeat_front_addr":"172.21.15.22:6831/9265","state":["exists","up"]},{"osd":5,"uuid":"b9cafea9-e874-4f21-bba3-28629266318a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":9264},{"type":"v1","addr":"172.21.15.22:6819","nonce":9264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":9264},{"type":"v1","addr":"172.21.15.22:6822","nonce":9264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":9264},{"type":"v1","addr":"172.21.15.22:6830","nonce":9264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":9264},{"type":"v1","addr":"172.21.15.22:6826","nonce":9264}]},"public_addr":"172.21.15.22:6819/9264","cluster_addr":"172.21.15.22:6822/9264","heartbeat_back_addr":"172.21.15.22:6830/9264","heartbeat_front_addr":"172.21.15.22:6826/9264","state":["exists","up"]},{"osd":6,"uuid":"7348c077-a357-47b8-9f1e-a0a6f31e06a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6803","nonce":9262},{"type":"v1","addr":"172.21.15.22:6805","nonce":9262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":9262},{"type":"v1","addr":"172.21.15.22:6808","nonce":9262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6813","nonce":9262},{"type":"v1","addr":"172.21.15.22:6814","nonce":9262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":9262},{"type":"v1","addr":"172.21.15.22:6811","nonce":9262}]},"public_addr":"172.21.15.22:6805/9262","cluster_addr":"172.21.15.22:6808/9262","heartbeat_back_addr":"172.21.15.22:6814/9262","heartbeat_front_addr":"172.21.15.22:6811/9262","state":["exists","up"]},{"osd":7,"uuid":"ae9ea222-bca6-4fdc-b3cf-83e08cd89804","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":9263},{"type":"v1","addr":"172.21.15.22:6804","nonce":9263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6807","nonce":9263},{"type":"v1","addr":"172.21.15.22:6809","nonce":9263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":9263},{"type":"v1","addr":"172.21.15.22:6817","nonce":9263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":9263},{"type":"v1","addr":"172.21.15.22:6815","nonce":9263}]},"public_addr":"172.21.15.22:6804/9263","cluster_addr":"172.21.15.22:6809/9263","heartbeat_back_addr":"172.21.15.22:6817/9263","heartbeat_front_addr":"172.21.15.22:6815/9263","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-29T12:26:01.382649+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-29T12:26:01.719134+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-29T12:26:01.270373+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-29T12:26:01.690627+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-29T12:26:00.212545+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-29T12:26:00.765470+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-29T12:26:01.066245+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-29T12:26:00.009065+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-29T12:26:06.502 DEBUG:teuthology.misc:8 of 8 OSDs are up 2019-11-29T12:26:06.502 INFO:tasks.ceph:Creating RBD pool 2019-11-29T12:26:06.503 INFO:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph osd pool create rbd 8 2019-11-29T12:26:08.920 INFO:teuthology.orchestra.run.smithi062.stderr:pool 'rbd' created 2019-11-29T12:26:08.936 INFO:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2019-11-29T12:26:10.814 INFO:teuthology.orchestra.run.smithi062.stderr:enabled application 'rbd' on pool 'rbd' 2019-11-29T12:26:10.831 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2019-11-29T12:26:10.832 INFO:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-29T12:26:10.832 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2019-11-29T12:26:11.667 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:26:11.667 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":19,"fsid":"787fcccf-49ed-4b7f-ac72-6914ee170c2a","created":"2019-11-29T12:25:33.524089+0000","modified":"2019-11-29T12:26:10.666033+0000","last_up_change":"2019-11-29T12:26:04.643954+0000","last_in_change":"2019-11-29T12:26:04.643954+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-29T12:26:07.407224+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"1d2f040a-cabb-44e4-8527-8164d3b9c71e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":10371},{"type":"v1","addr":"172.21.15.62:6817","nonce":10371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":10371},{"type":"v1","addr":"172.21.15.62:6819","nonce":10371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":10371},{"type":"v1","addr":"172.21.15.62:6824","nonce":10371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":10371},{"type":"v1","addr":"172.21.15.62:6821","nonce":10371}]},"public_addr":"172.21.15.62:6817/10371","cluster_addr":"172.21.15.62:6819/10371","heartbeat_back_addr":"172.21.15.62:6824/10371","heartbeat_front_addr":"172.21.15.62:6821/10371","state":["exists","up"]},{"osd":1,"uuid":"705d011c-fb4e-4205-87e1-f6c8201438a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":10370},{"type":"v1","addr":"172.21.15.62:6801","nonce":10370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":10370},{"type":"v1","addr":"172.21.15.62:6803","nonce":10370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":10370},{"type":"v1","addr":"172.21.15.62:6807","nonce":10370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":10370},{"type":"v1","addr":"172.21.15.62:6805","nonce":10370}]},"public_addr":"172.21.15.62:6801/10370","cluster_addr":"172.21.15.62:6803/10370","heartbeat_back_addr":"172.21.15.62:6807/10370","heartbeat_front_addr":"172.21.15.62:6805/10370","state":["exists","up"]},{"osd":2,"uuid":"294db287-c871-4469-81bc-ac07519a731a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":10361},{"type":"v1","addr":"172.21.15.62:6809","nonce":10361}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":10361},{"type":"v1","addr":"172.21.15.62:6811","nonce":10361}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":10361},{"type":"v1","addr":"172.21.15.62:6815","nonce":10361}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":10361},{"type":"v1","addr":"172.21.15.62:6813","nonce":10361}]},"public_addr":"172.21.15.62:6809/10361","cluster_addr":"172.21.15.62:6811/10361","heartbeat_back_addr":"172.21.15.62:6815/10361","heartbeat_front_addr":"172.21.15.62:6813/10361","state":["exists","up"]},{"osd":3,"uuid":"6dd90165-5705-4605-84ed-b9f88111d325","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6823","nonce":10369},{"type":"v1","addr":"172.21.15.62:6825","nonce":10369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":10369},{"type":"v1","addr":"172.21.15.62:6827","nonce":10369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":10369},{"type":"v1","addr":"172.21.15.62:6831","nonce":10369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":10369},{"type":"v1","addr":"172.21.15.62:6829","nonce":10369}]},"public_addr":"172.21.15.62:6825/10369","cluster_addr":"172.21.15.62:6827/10369","heartbeat_back_addr":"172.21.15.62:6831/10369","heartbeat_front_addr":"172.21.15.62:6829/10369","state":["exists","up"]},{"osd":4,"uuid":"51d162f7-af55-4534-b122-effe88c2e073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6821","nonce":9265},{"type":"v1","addr":"172.21.15.22:6823","nonce":9265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6825","nonce":9265},{"type":"v1","addr":"172.21.15.22:6827","nonce":9265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":9265},{"type":"v1","addr":"172.21.15.22:6833","nonce":9265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6829","nonce":9265},{"type":"v1","addr":"172.21.15.22:6831","nonce":9265}]},"public_addr":"172.21.15.22:6823/9265","cluster_addr":"172.21.15.22:6827/9265","heartbeat_back_addr":"172.21.15.22:6833/9265","heartbeat_front_addr":"172.21.15.22:6831/9265","state":["exists","up"]},{"osd":5,"uuid":"b9cafea9-e874-4f21-bba3-28629266318a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":9264},{"type":"v1","addr":"172.21.15.22:6819","nonce":9264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":9264},{"type":"v1","addr":"172.21.15.22:6822","nonce":9264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":9264},{"type":"v1","addr":"172.21.15.22:6830","nonce":9264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":9264},{"type":"v1","addr":"172.21.15.22:6826","nonce":9264}]},"public_addr":"172.21.15.22:6819/9264","cluster_addr":"172.21.15.22:6822/9264","heartbeat_back_addr":"172.21.15.22:6830/9264","heartbeat_front_addr":"172.21.15.22:6826/9264","state":["exists","up"]},{"osd":6,"uuid":"7348c077-a357-47b8-9f1e-a0a6f31e06a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6803","nonce":9262},{"type":"v1","addr":"172.21.15.22:6805","nonce":9262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":9262},{"type":"v1","addr":"172.21.15.22:6808","nonce":9262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6813","nonce":9262},{"type":"v1","addr":"172.21.15.22:6814","nonce":9262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":9262},{"type":"v1","addr":"172.21.15.22:6811","nonce":9262}]},"public_addr":"172.21.15.22:6805/9262","cluster_addr":"172.21.15.22:6808/9262","heartbeat_back_addr":"172.21.15.22:6814/9262","heartbeat_front_addr":"172.21.15.22:6811/9262","state":["exists","up"]},{"osd":7,"uuid":"ae9ea222-bca6-4fdc-b3cf-83e08cd89804","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":9263},{"type":"v1","addr":"172.21.15.22:6804","nonce":9263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6807","nonce":9263},{"type":"v1","addr":"172.21.15.22:6809","nonce":9263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":9263},{"type":"v1","addr":"172.21.15.22:6817","nonce":9263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":9263},{"type":"v1","addr":"172.21.15.22:6815","nonce":9263}]},"public_addr":"172.21.15.22:6804/9263","cluster_addr":"172.21.15.22:6809/9263","heartbeat_back_addr":"172.21.15.22:6817/9263","heartbeat_front_addr":"172.21.15.22:6815/9263","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-29T12:26:01.382649+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-29T12:26:01.719134+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-29T12:26:01.270373+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-29T12:26:01.690627+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-29T12:26:00.212545+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-29T12:26:00.765470+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-29T12:26:01.066245+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-29T12:26:00.009065+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-29T12:26:11.690 INFO:tasks.ceph.ceph_manager.ceph:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool,creating', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-29T12:26:07.407224+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 32769, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'19', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2019-11-29T12:26:11.690 INFO:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2019-11-29T12:26:12.611 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2019-11-29T12:26:12.628 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2019-11-29T12:26:12.629 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2019-11-29T12:26:12.629 INFO:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2019-11-29T12:26:13.785 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:26:13.811 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":3,"active_gid":4104,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":8367},{"type":"v1","addr":"172.21.15.22:6801","nonce":8367}]},"active_addr":"172.21.15.22:6801/8367","active_change":"2019-11-29T12:25:37.601749+0000","active_mgr_features":4540138292836696063,"available":true,"standbys":[{"gid":4103,"name":"y","mgr_features":4540138292836696063,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"str","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"ansible","can_run":true,"error_string":"","module_options":{"ca_bundle":{"name":"ca_bundle","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_location":{"name":"server_location","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_server":{"name":"verify_server","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"float","level":"advanced","flags":1,"default_value":"0.01","min":"0","max":"1","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the ratio between the fullest and least-full OSD is below this value then we stop trying to optimize placement.","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"str","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"str","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"str","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"str","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"deepsea","can_run":true,"error_string":"","module_options":{"salt_api_eauth":{"name":"salt_api_eauth","type":"str","level":"advanced","flags":0,"default_value":"sharedsecret","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_password":{"name":"salt_api_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_url":{"name":"salt_api_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_username":{"name":"salt_api_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_cloud","can_run":true,"error_string":"","module_options":{"diskprediction_cert_context":{"name":"diskprediction_cert_context","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_default_authority":{"name":"diskprediction_default_authority","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_password":{"name":"diskprediction_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_port":{"name":"diskprediction_port","type":"str","level":"advanced","flags":0,"default_value":"31400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_retrieve_prediction_interval":{"name":"diskprediction_retrieve_prediction_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_server":{"name":"diskprediction_server","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_ssl_target_name_override":{"name":"diskprediction_ssl_target_name_override","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_metrics_interval":{"name":"diskprediction_upload_metrics_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_smart_interval":{"name":"diskprediction_upload_smart_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_user":{"name":"diskprediction_user","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{}},{"name":"iostat","can_run":true,"error_string":"","module_options":{}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator_cli","can_run":true,"error_string":"","module_options":{"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"ssh","can_run":true,"error_string":"","module_options":{"inventory_cache_timeout":{"name":"inventory_cache_timeout","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["ceph-daemon-package","root"],"desc":"mode for remote execution of ceph-daemon","long_desc":"","tags":[],"see_also":[]},"service_cache_timeout":{"name":"service_cache_timeout","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{}},{"name":"volumes","can_run":true,"error_string":"","module_options":{}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"str","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"ansible","can_run":true,"error_string":"","module_options":{"ca_bundle":{"name":"ca_bundle","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_location":{"name":"server_location","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_server":{"name":"verify_server","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"float","level":"advanced","flags":1,"default_value":"0.01","min":"0","max":"1","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the ratio between the fullest and least-full OSD is below this value then we stop trying to optimize placement.","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"str","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"str","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"str","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"str","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"deepsea","can_run":true,"error_string":"","module_options":{"salt_api_eauth":{"name":"salt_api_eauth","type":"str","level":"advanced","flags":0,"default_value":"sharedsecret","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_password":{"name":"salt_api_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_url":{"name":"salt_api_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_username":{"name":"salt_api_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_cloud","can_run":true,"error_string":"","module_options":{"diskprediction_cert_context":{"name":"diskprediction_cert_context","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_default_authority":{"name":"diskprediction_default_authority","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_password":{"name":"diskprediction_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_port":{"name":"diskprediction_port","type":"str","level":"advanced","flags":0,"default_value":"31400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_retrieve_prediction_interval":{"name":"diskprediction_retrieve_prediction_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_server":{"name":"diskprediction_server","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_ssl_target_name_override":{"name":"diskprediction_ssl_target_name_override","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_metrics_interval":{"name":"diskprediction_upload_metrics_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_smart_interval":{"name":"diskprediction_upload_smart_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_user":{"name":"diskprediction_user","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{}},{"name":"iostat","can_run":true,"error_string":"","module_options":{}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator_cli","can_run":true,"error_string":"","module_options":{"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"ssh","can_run":true,"error_string":"","module_options":{"inventory_cache_timeout":{"name":"inventory_cache_timeout","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["ceph-daemon-package","root"],"desc":"mode for remote execution of ceph-daemon","long_desc":"","tags":[],"see_also":[]},"service_cache_timeout":{"name":"service_cache_timeout","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{}},{"name":"volumes","can_run":true,"error_string":"","module_options":{}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator_cli","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]}} 2019-11-29T12:26:13.815 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2019-11-29T12:26:13.816 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2019-11-29T12:26:13.816 INFO:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-29T12:26:14.871 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:26:14.872 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":20,"fsid":"787fcccf-49ed-4b7f-ac72-6914ee170c2a","created":"2019-11-29T12:25:33.524089+0000","modified":"2019-11-29T12:26:11.835867+0000","last_up_change":"2019-11-29T12:26:04.643954+0000","last_in_change":"2019-11-29T12:26:04.643954+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-29T12:26:07.407224+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"1d2f040a-cabb-44e4-8527-8164d3b9c71e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":10371},{"type":"v1","addr":"172.21.15.62:6817","nonce":10371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":10371},{"type":"v1","addr":"172.21.15.62:6819","nonce":10371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":10371},{"type":"v1","addr":"172.21.15.62:6824","nonce":10371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":10371},{"type":"v1","addr":"172.21.15.62:6821","nonce":10371}]},"public_addr":"172.21.15.62:6817/10371","cluster_addr":"172.21.15.62:6819/10371","heartbeat_back_addr":"172.21.15.62:6824/10371","heartbeat_front_addr":"172.21.15.62:6821/10371","state":["exists","up"]},{"osd":1,"uuid":"705d011c-fb4e-4205-87e1-f6c8201438a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":10370},{"type":"v1","addr":"172.21.15.62:6801","nonce":10370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":10370},{"type":"v1","addr":"172.21.15.62:6803","nonce":10370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":10370},{"type":"v1","addr":"172.21.15.62:6807","nonce":10370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":10370},{"type":"v1","addr":"172.21.15.62:6805","nonce":10370}]},"public_addr":"172.21.15.62:6801/10370","cluster_addr":"172.21.15.62:6803/10370","heartbeat_back_addr":"172.21.15.62:6807/10370","heartbeat_front_addr":"172.21.15.62:6805/10370","state":["exists","up"]},{"osd":2,"uuid":"294db287-c871-4469-81bc-ac07519a731a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":10361},{"type":"v1","addr":"172.21.15.62:6809","nonce":10361}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":10361},{"type":"v1","addr":"172.21.15.62:6811","nonce":10361}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":10361},{"type":"v1","addr":"172.21.15.62:6815","nonce":10361}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":10361},{"type":"v1","addr":"172.21.15.62:6813","nonce":10361}]},"public_addr":"172.21.15.62:6809/10361","cluster_addr":"172.21.15.62:6811/10361","heartbeat_back_addr":"172.21.15.62:6815/10361","heartbeat_front_addr":"172.21.15.62:6813/10361","state":["exists","up"]},{"osd":3,"uuid":"6dd90165-5705-4605-84ed-b9f88111d325","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6823","nonce":10369},{"type":"v1","addr":"172.21.15.62:6825","nonce":10369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":10369},{"type":"v1","addr":"172.21.15.62:6827","nonce":10369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":10369},{"type":"v1","addr":"172.21.15.62:6831","nonce":10369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":10369},{"type":"v1","addr":"172.21.15.62:6829","nonce":10369}]},"public_addr":"172.21.15.62:6825/10369","cluster_addr":"172.21.15.62:6827/10369","heartbeat_back_addr":"172.21.15.62:6831/10369","heartbeat_front_addr":"172.21.15.62:6829/10369","state":["exists","up"]},{"osd":4,"uuid":"51d162f7-af55-4534-b122-effe88c2e073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6821","nonce":9265},{"type":"v1","addr":"172.21.15.22:6823","nonce":9265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6825","nonce":9265},{"type":"v1","addr":"172.21.15.22:6827","nonce":9265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":9265},{"type":"v1","addr":"172.21.15.22:6833","nonce":9265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6829","nonce":9265},{"type":"v1","addr":"172.21.15.22:6831","nonce":9265}]},"public_addr":"172.21.15.22:6823/9265","cluster_addr":"172.21.15.22:6827/9265","heartbeat_back_addr":"172.21.15.22:6833/9265","heartbeat_front_addr":"172.21.15.22:6831/9265","state":["exists","up"]},{"osd":5,"uuid":"b9cafea9-e874-4f21-bba3-28629266318a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":9264},{"type":"v1","addr":"172.21.15.22:6819","nonce":9264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":9264},{"type":"v1","addr":"172.21.15.22:6822","nonce":9264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":9264},{"type":"v1","addr":"172.21.15.22:6830","nonce":9264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":9264},{"type":"v1","addr":"172.21.15.22:6826","nonce":9264}]},"public_addr":"172.21.15.22:6819/9264","cluster_addr":"172.21.15.22:6822/9264","heartbeat_back_addr":"172.21.15.22:6830/9264","heartbeat_front_addr":"172.21.15.22:6826/9264","state":["exists","up"]},{"osd":6,"uuid":"7348c077-a357-47b8-9f1e-a0a6f31e06a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6803","nonce":9262},{"type":"v1","addr":"172.21.15.22:6805","nonce":9262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":9262},{"type":"v1","addr":"172.21.15.22:6808","nonce":9262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6813","nonce":9262},{"type":"v1","addr":"172.21.15.22:6814","nonce":9262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":9262},{"type":"v1","addr":"172.21.15.22:6811","nonce":9262}]},"public_addr":"172.21.15.22:6805/9262","cluster_addr":"172.21.15.22:6808/9262","heartbeat_back_addr":"172.21.15.22:6814/9262","heartbeat_front_addr":"172.21.15.22:6811/9262","state":["exists","up"]},{"osd":7,"uuid":"ae9ea222-bca6-4fdc-b3cf-83e08cd89804","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":9263},{"type":"v1","addr":"172.21.15.22:6804","nonce":9263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6807","nonce":9263},{"type":"v1","addr":"172.21.15.22:6809","nonce":9263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":9263},{"type":"v1","addr":"172.21.15.22:6817","nonce":9263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":9263},{"type":"v1","addr":"172.21.15.22:6815","nonce":9263}]},"public_addr":"172.21.15.22:6804/9263","cluster_addr":"172.21.15.22:6809/9263","heartbeat_back_addr":"172.21.15.22:6817/9263","heartbeat_front_addr":"172.21.15.22:6815/9263","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-29T12:26:01.382649+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-29T12:26:01.719134+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-29T12:26:01.270373+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-29T12:26:01.690627+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-29T12:26:00.212545+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-29T12:26:00.765470+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-29T12:26:01.066245+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-29T12:26:00.009065+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-29T12:26:14.892 INFO:tasks.ceph.ceph_manager.ceph:all up! 2019-11-29T12:26:14.892 INFO:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-29T12:26:15.859 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:26:15.860 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":20,"fsid":"787fcccf-49ed-4b7f-ac72-6914ee170c2a","created":"2019-11-29T12:25:33.524089+0000","modified":"2019-11-29T12:26:11.835867+0000","last_up_change":"2019-11-29T12:26:04.643954+0000","last_in_change":"2019-11-29T12:26:04.643954+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-29T12:26:07.407224+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"1d2f040a-cabb-44e4-8527-8164d3b9c71e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":10371},{"type":"v1","addr":"172.21.15.62:6817","nonce":10371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":10371},{"type":"v1","addr":"172.21.15.62:6819","nonce":10371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":10371},{"type":"v1","addr":"172.21.15.62:6824","nonce":10371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":10371},{"type":"v1","addr":"172.21.15.62:6821","nonce":10371}]},"public_addr":"172.21.15.62:6817/10371","cluster_addr":"172.21.15.62:6819/10371","heartbeat_back_addr":"172.21.15.62:6824/10371","heartbeat_front_addr":"172.21.15.62:6821/10371","state":["exists","up"]},{"osd":1,"uuid":"705d011c-fb4e-4205-87e1-f6c8201438a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":10370},{"type":"v1","addr":"172.21.15.62:6801","nonce":10370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":10370},{"type":"v1","addr":"172.21.15.62:6803","nonce":10370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":10370},{"type":"v1","addr":"172.21.15.62:6807","nonce":10370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":10370},{"type":"v1","addr":"172.21.15.62:6805","nonce":10370}]},"public_addr":"172.21.15.62:6801/10370","cluster_addr":"172.21.15.62:6803/10370","heartbeat_back_addr":"172.21.15.62:6807/10370","heartbeat_front_addr":"172.21.15.62:6805/10370","state":["exists","up"]},{"osd":2,"uuid":"294db287-c871-4469-81bc-ac07519a731a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":10361},{"type":"v1","addr":"172.21.15.62:6809","nonce":10361}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":10361},{"type":"v1","addr":"172.21.15.62:6811","nonce":10361}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":10361},{"type":"v1","addr":"172.21.15.62:6815","nonce":10361}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":10361},{"type":"v1","addr":"172.21.15.62:6813","nonce":10361}]},"public_addr":"172.21.15.62:6809/10361","cluster_addr":"172.21.15.62:6811/10361","heartbeat_back_addr":"172.21.15.62:6815/10361","heartbeat_front_addr":"172.21.15.62:6813/10361","state":["exists","up"]},{"osd":3,"uuid":"6dd90165-5705-4605-84ed-b9f88111d325","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6823","nonce":10369},{"type":"v1","addr":"172.21.15.62:6825","nonce":10369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":10369},{"type":"v1","addr":"172.21.15.62:6827","nonce":10369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":10369},{"type":"v1","addr":"172.21.15.62:6831","nonce":10369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":10369},{"type":"v1","addr":"172.21.15.62:6829","nonce":10369}]},"public_addr":"172.21.15.62:6825/10369","cluster_addr":"172.21.15.62:6827/10369","heartbeat_back_addr":"172.21.15.62:6831/10369","heartbeat_front_addr":"172.21.15.62:6829/10369","state":["exists","up"]},{"osd":4,"uuid":"51d162f7-af55-4534-b122-effe88c2e073","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6821","nonce":9265},{"type":"v1","addr":"172.21.15.22:6823","nonce":9265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6825","nonce":9265},{"type":"v1","addr":"172.21.15.22:6827","nonce":9265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":9265},{"type":"v1","addr":"172.21.15.22:6833","nonce":9265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6829","nonce":9265},{"type":"v1","addr":"172.21.15.22:6831","nonce":9265}]},"public_addr":"172.21.15.22:6823/9265","cluster_addr":"172.21.15.22:6827/9265","heartbeat_back_addr":"172.21.15.22:6833/9265","heartbeat_front_addr":"172.21.15.22:6831/9265","state":["exists","up"]},{"osd":5,"uuid":"b9cafea9-e874-4f21-bba3-28629266318a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":9264},{"type":"v1","addr":"172.21.15.22:6819","nonce":9264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":9264},{"type":"v1","addr":"172.21.15.22:6822","nonce":9264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":9264},{"type":"v1","addr":"172.21.15.22:6830","nonce":9264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":9264},{"type":"v1","addr":"172.21.15.22:6826","nonce":9264}]},"public_addr":"172.21.15.22:6819/9264","cluster_addr":"172.21.15.22:6822/9264","heartbeat_back_addr":"172.21.15.22:6830/9264","heartbeat_front_addr":"172.21.15.22:6826/9264","state":["exists","up"]},{"osd":6,"uuid":"7348c077-a357-47b8-9f1e-a0a6f31e06a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6803","nonce":9262},{"type":"v1","addr":"172.21.15.22:6805","nonce":9262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":9262},{"type":"v1","addr":"172.21.15.22:6808","nonce":9262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6813","nonce":9262},{"type":"v1","addr":"172.21.15.22:6814","nonce":9262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":9262},{"type":"v1","addr":"172.21.15.22:6811","nonce":9262}]},"public_addr":"172.21.15.22:6805/9262","cluster_addr":"172.21.15.22:6808/9262","heartbeat_back_addr":"172.21.15.22:6814/9262","heartbeat_front_addr":"172.21.15.22:6811/9262","state":["exists","up"]},{"osd":7,"uuid":"ae9ea222-bca6-4fdc-b3cf-83e08cd89804","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":9263},{"type":"v1","addr":"172.21.15.22:6804","nonce":9263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6807","nonce":9263},{"type":"v1","addr":"172.21.15.22:6809","nonce":9263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":9263},{"type":"v1","addr":"172.21.15.22:6817","nonce":9263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":9263},{"type":"v1","addr":"172.21.15.22:6815","nonce":9263}]},"public_addr":"172.21.15.22:6804/9263","cluster_addr":"172.21.15.22:6809/9263","heartbeat_back_addr":"172.21.15.22:6817/9263","heartbeat_front_addr":"172.21.15.22:6815/9263","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-29T12:26:01.382649+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-29T12:26:01.719134+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-29T12:26:01.270373+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-29T12:26:01.690627+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-29T12:26:00.212545+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-29T12:26:00.765470+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-29T12:26:01.066245+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-29T12:26:00.009065+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-29T12:26:15.882 INFO:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2019-11-29T12:26:16.570 INFO:teuthology.orchestra.run.smithi062.stdout:64424509446 2019-11-29T12:26:16.571 INFO:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2019-11-29T12:26:17.114 INFO:teuthology.orchestra.run.smithi062.stdout:64424509445 2019-11-29T12:26:17.115 INFO:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2019-11-29T12:26:17.667 INFO:teuthology.orchestra.run.smithi062.stdout:64424509446 2019-11-29T12:26:17.668 INFO:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2019-11-29T12:26:18.224 INFO:teuthology.orchestra.run.smithi062.stdout:64424509445 2019-11-29T12:26:18.224 INFO:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2019-11-29T12:26:18.857 INFO:teuthology.orchestra.run.smithi062.stdout:55834574855 2019-11-29T12:26:18.858 INFO:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2019-11-29T12:26:19.440 INFO:teuthology.orchestra.run.smithi062.stdout:60129542151 2019-11-29T12:26:19.440 INFO:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2019-11-29T12:26:20.023 INFO:teuthology.orchestra.run.smithi062.stdout:64424509444 2019-11-29T12:26:20.023 INFO:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2019-11-29T12:26:20.642 INFO:teuthology.orchestra.run.smithi062.stdout:55834574854 2019-11-29T12:26:20.643 INFO:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2019-11-29T12:26:21.502 INFO:teuthology.orchestra.run.smithi062.stdout:64424509446 2019-11-29T12:26:21.515 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.0 2019-11-29T12:26:21.515 INFO:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2019-11-29T12:26:22.363 INFO:teuthology.orchestra.run.smithi062.stdout:64424509445 2019-11-29T12:26:22.385 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509445 for osd.1 2019-11-29T12:26:22.385 INFO:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2019-11-29T12:26:23.388 INFO:teuthology.orchestra.run.smithi062.stdout:64424509447 2019-11-29T12:26:23.402 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509447 for osd.2 2019-11-29T12:26:23.402 INFO:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2019-11-29T12:26:24.235 INFO:teuthology.orchestra.run.smithi062.stdout:64424509446 2019-11-29T12:26:24.250 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509446 for osd.3 2019-11-29T12:26:24.250 INFO:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2019-11-29T12:26:25.074 INFO:teuthology.orchestra.run.smithi062.stdout:55834574856 2019-11-29T12:26:25.094 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574856 for osd.4 2019-11-29T12:26:25.095 INFO:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2019-11-29T12:26:25.813 INFO:teuthology.orchestra.run.smithi062.stdout:60129542152 2019-11-29T12:26:25.833 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542152 for osd.5 2019-11-29T12:26:25.833 INFO:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2019-11-29T12:26:26.551 INFO:teuthology.orchestra.run.smithi062.stdout:64424509446 2019-11-29T12:26:26.565 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509444 got 64424509446 for osd.6 2019-11-29T12:26:26.565 INFO:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2019-11-29T12:26:27.337 INFO:teuthology.orchestra.run.smithi062.stdout:55834574855 2019-11-29T12:26:27.354 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574855 for osd.7 2019-11-29T12:26:27.354 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2019-11-29T12:26:27.354 INFO:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2019-11-29T12:26:28.114 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2019-11-29T12:26:28.115 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:26:28.127 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2019-11-29T12:26:27.786405+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8390204,"kb_used_data":1532,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":746584516,"statfs":{"total":773094113280,"available":764502544384,"internally_reserved":8589934592,"allocated":1568768,"data_stored":497422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"10","reported_epoch":"19","state":"active+clean","last_fresh":"2019-11-29T12:26:10.866713+0000","last_change":"2019-11-29T12:26:10.815302+0000","last_active":"2019-11-29T12:26:10.866713+0000","last_peered":"2019-11-29T12:26:10.866713+0000","last_clean":"2019-11-29T12:26:10.866713+0000","last_became_active":"2019-11-29T12:26:10.790281+0000","last_became_peered":"2019-11-29T12:26:10.790281+0000","last_unstale":"2019-11-29T12:26:10.866713+0000","last_undegraded":"2019-11-29T12:26:10.866713+0000","last_fullsized":"2019-11-29T12:26:10.866713+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-29T12:26:08.330333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-29T12:26:08.330333+0000","last_clean_scrub_stamp":"2019-11-29T12:26:08.330333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"10","reported_epoch":"19","state":"active+clean","last_fresh":"2019-11-29T12:26:11.476179+0000","last_change":"2019-11-29T12:26:11.449995+0000","last_active":"2019-11-29T12:26:11.476179+0000","last_peered":"2019-11-29T12:26:11.476179+0000","last_clean":"2019-11-29T12:26:11.476179+0000","last_became_active":"2019-11-29T12:26:11.389219+0000","last_became_peered":"2019-11-29T12:26:11.389219+0000","last_unstale":"2019-11-29T12:26:11.476179+0000","last_undegraded":"2019-11-29T12:26:11.476179+0000","last_fullsized":"2019-11-29T12:26:11.476179+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-29T12:26:08.330333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-29T12:26:08.330333+0000","last_clean_scrub_stamp":"2019-11-29T12:26:08.330333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"10","reported_epoch":"19","state":"active+clean","last_fresh":"2019-11-29T12:26:11.432599+0000","last_change":"2019-11-29T12:26:11.411503+0000","last_active":"2019-11-29T12:26:11.432599+0000","last_peered":"2019-11-29T12:26:11.432599+0000","last_clean":"2019-11-29T12:26:11.432599+0000","last_became_active":"2019-11-29T12:26:11.382841+0000","last_became_peered":"2019-11-29T12:26:11.382841+0000","last_unstale":"2019-11-29T12:26:11.432599+0000","last_undegraded":"2019-11-29T12:26:11.432599+0000","last_fullsized":"2019-11-29T12:26:11.432599+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-29T12:26:08.330333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-29T12:26:08.330333+0000","last_clean_scrub_stamp":"2019-11-29T12:26:08.330333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"10","reported_epoch":"19","state":"active+clean","last_fresh":"2019-11-29T12:26:11.084326+0000","last_change":"2019-11-29T12:26:11.060410+0000","last_active":"2019-11-29T12:26:11.084326+0000","last_peered":"2019-11-29T12:26:11.084326+0000","last_clean":"2019-11-29T12:26:11.084326+0000","last_became_active":"2019-11-29T12:26:11.033343+0000","last_became_peered":"2019-11-29T12:26:11.033343+0000","last_unstale":"2019-11-29T12:26:11.084326+0000","last_undegraded":"2019-11-29T12:26:11.084326+0000","last_fullsized":"2019-11-29T12:26:11.084326+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-29T12:26:08.330333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-29T12:26:08.330333+0000","last_clean_scrub_stamp":"2019-11-29T12:26:08.330333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"10","reported_epoch":"19","state":"active+clean","last_fresh":"2019-11-29T12:26:10.871289+0000","last_change":"2019-11-29T12:26:10.491112+0000","last_active":"2019-11-29T12:26:10.871289+0000","last_peered":"2019-11-29T12:26:10.871289+0000","last_clean":"2019-11-29T12:26:10.871289+0000","last_became_active":"2019-11-29T12:26:10.430180+0000","last_became_peered":"2019-11-29T12:26:10.430180+0000","last_unstale":"2019-11-29T12:26:10.871289+0000","last_undegraded":"2019-11-29T12:26:10.871289+0000","last_fullsized":"2019-11-29T12:26:10.871289+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-29T12:26:08.330333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-29T12:26:08.330333+0000","last_clean_scrub_stamp":"2019-11-29T12:26:08.330333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"10","reported_epoch":"19","state":"active+clean","last_fresh":"2019-11-29T12:26:11.479488+0000","last_change":"2019-11-29T12:26:11.461195+0000","last_active":"2019-11-29T12:26:11.479488+0000","last_peered":"2019-11-29T12:26:11.479488+0000","last_clean":"2019-11-29T12:26:11.479488+0000","last_became_active":"2019-11-29T12:26:11.424130+0000","last_became_peered":"2019-11-29T12:26:11.424130+0000","last_unstale":"2019-11-29T12:26:11.479488+0000","last_undegraded":"2019-11-29T12:26:11.479488+0000","last_fullsized":"2019-11-29T12:26:11.479488+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-29T12:26:08.330333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-29T12:26:08.330333+0000","last_clean_scrub_stamp":"2019-11-29T12:26:08.330333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"10","reported_epoch":"19","state":"active+clean","last_fresh":"2019-11-29T12:26:11.371987+0000","last_change":"2019-11-29T12:26:11.350851+0000","last_active":"2019-11-29T12:26:11.371987+0000","last_peered":"2019-11-29T12:26:11.371987+0000","last_clean":"2019-11-29T12:26:11.371987+0000","last_became_active":"2019-11-29T12:26:11.322084+0000","last_became_peered":"2019-11-29T12:26:11.322084+0000","last_unstale":"2019-11-29T12:26:11.371987+0000","last_undegraded":"2019-11-29T12:26:11.371987+0000","last_fullsized":"2019-11-29T12:26:11.371987+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-29T12:26:08.330333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-29T12:26:08.330333+0000","last_clean_scrub_stamp":"2019-11-29T12:26:08.330333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"10","reported_epoch":"19","state":"active+clean","last_fresh":"2019-11-29T12:26:11.301005+0000","last_change":"2019-11-29T12:26:11.233796+0000","last_active":"2019-11-29T12:26:11.301005+0000","last_peered":"2019-11-29T12:26:11.301005+0000","last_clean":"2019-11-29T12:26:11.301005+0000","last_became_active":"2019-11-29T12:26:11.095710+0000","last_became_peered":"2019-11-29T12:26:11.095710+0000","last_unstale":"2019-11-29T12:26:11.301005+0000","last_undegraded":"2019-11-29T12:26:11.301005+0000","last_fullsized":"2019-11-29T12:26:11.301005+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-29T12:26:08.330333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-29T12:26:08.330333+0000","last_clean_scrub_stamp":"2019-11-29T12:26:08.330333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509446,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048776,"kb_used_data":192,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323064,"statfs":{"total":96636764160,"available":95562817536,"internally_reserved":1073741824,"allocated":196608,"data_stored":62250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":38.359}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":21.413}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":19.793}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":28.741}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":33.260}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":34.771}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":30.366}]}]},{"osd":3,"up_from":15,"seq":64424509447,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048776,"kb_used_data":192,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323064,"statfs":{"total":96636764160,"available":95562817536,"internally_reserved":1073741824,"allocated":196608,"data_stored":62250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":16.929}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":15.792}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":17.933}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":20.537}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":30.473}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":22.949}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":27.321}]}]},{"osd":2,"up_from":15,"seq":64424509448,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048776,"kb_used_data":192,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323064,"statfs":{"total":96636764160,"available":95562817536,"internally_reserved":1073741824,"allocated":196608,"data_stored":62250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":32.089}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":35.169}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":20.064}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":34.112}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":41.590}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":24.738}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":39.961}]}]},{"osd":1,"up_from":15,"seq":64424509447,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048776,"kb_used_data":192,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323064,"statfs":{"total":96636764160,"available":95562817536,"internally_reserved":1073741824,"allocated":196608,"data_stored":62250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":22.774}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":17.365}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":19.939}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":14.715}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":22.452}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":23.550}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":28.865}]}]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048776,"kb_used_data":192,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323064,"statfs":{"total":96636764160,"available":95562817536,"internally_reserved":1073741824,"allocated":196608,"data_stored":62250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":24.777}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":20.517}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":29.054}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":31.502}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":26.355}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":22.751}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":43.675}]}]},{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048776,"kb_used_data":192,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323064,"statfs":{"total":96636764160,"available":95562817536,"internally_reserved":1073741824,"allocated":196608,"data_stored":62250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":13.053}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":19.230}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":15.965}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":20.789}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":23.717}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":25.837}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":30.774}]}]},{"osd":5,"up_from":14,"seq":60129542153,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048772,"kb_used_data":188,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323068,"statfs":{"total":96636764160,"available":95562821632,"internally_reserved":1073741824,"allocated":192512,"data_stored":61672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":21.066}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":22.158}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":26.512}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":22.846}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":29.741}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":37.463}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":40.051}]}]},{"osd":0,"up_from":15,"seq":64424509448,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048776,"kb_used_data":192,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323064,"statfs":{"total":96636764160,"available":95562817536,"internally_reserved":1073741824,"allocated":196608,"data_stored":62250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":39.172}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":30.346}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":34.167}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":19.740}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":22.188}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":40.797}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":29.022}]}]}]}} 2019-11-29T12:26:28.129 INFO:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2019-11-29T12:26:29.099 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:26:29.099 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2019-11-29T12:26:29.112 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2019-11-29T12:26:27.786405+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8390204,"kb_used_data":1532,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":746584516,"statfs":{"total":773094113280,"available":764502544384,"internally_reserved":8589934592,"allocated":1568768,"data_stored":497422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"10","reported_epoch":"19","state":"active+clean","last_fresh":"2019-11-29T12:26:10.866713+0000","last_change":"2019-11-29T12:26:10.815302+0000","last_active":"2019-11-29T12:26:10.866713+0000","last_peered":"2019-11-29T12:26:10.866713+0000","last_clean":"2019-11-29T12:26:10.866713+0000","last_became_active":"2019-11-29T12:26:10.790281+0000","last_became_peered":"2019-11-29T12:26:10.790281+0000","last_unstale":"2019-11-29T12:26:10.866713+0000","last_undegraded":"2019-11-29T12:26:10.866713+0000","last_fullsized":"2019-11-29T12:26:10.866713+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-29T12:26:08.330333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-29T12:26:08.330333+0000","last_clean_scrub_stamp":"2019-11-29T12:26:08.330333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"10","reported_epoch":"19","state":"active+clean","last_fresh":"2019-11-29T12:26:11.476179+0000","last_change":"2019-11-29T12:26:11.449995+0000","last_active":"2019-11-29T12:26:11.476179+0000","last_peered":"2019-11-29T12:26:11.476179+0000","last_clean":"2019-11-29T12:26:11.476179+0000","last_became_active":"2019-11-29T12:26:11.389219+0000","last_became_peered":"2019-11-29T12:26:11.389219+0000","last_unstale":"2019-11-29T12:26:11.476179+0000","last_undegraded":"2019-11-29T12:26:11.476179+0000","last_fullsized":"2019-11-29T12:26:11.476179+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-29T12:26:08.330333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-29T12:26:08.330333+0000","last_clean_scrub_stamp":"2019-11-29T12:26:08.330333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"10","reported_epoch":"19","state":"active+clean","last_fresh":"2019-11-29T12:26:11.432599+0000","last_change":"2019-11-29T12:26:11.411503+0000","last_active":"2019-11-29T12:26:11.432599+0000","last_peered":"2019-11-29T12:26:11.432599+0000","last_clean":"2019-11-29T12:26:11.432599+0000","last_became_active":"2019-11-29T12:26:11.382841+0000","last_became_peered":"2019-11-29T12:26:11.382841+0000","last_unstale":"2019-11-29T12:26:11.432599+0000","last_undegraded":"2019-11-29T12:26:11.432599+0000","last_fullsized":"2019-11-29T12:26:11.432599+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-29T12:26:08.330333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-29T12:26:08.330333+0000","last_clean_scrub_stamp":"2019-11-29T12:26:08.330333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"10","reported_epoch":"19","state":"active+clean","last_fresh":"2019-11-29T12:26:11.084326+0000","last_change":"2019-11-29T12:26:11.060410+0000","last_active":"2019-11-29T12:26:11.084326+0000","last_peered":"2019-11-29T12:26:11.084326+0000","last_clean":"2019-11-29T12:26:11.084326+0000","last_became_active":"2019-11-29T12:26:11.033343+0000","last_became_peered":"2019-11-29T12:26:11.033343+0000","last_unstale":"2019-11-29T12:26:11.084326+0000","last_undegraded":"2019-11-29T12:26:11.084326+0000","last_fullsized":"2019-11-29T12:26:11.084326+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-29T12:26:08.330333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-29T12:26:08.330333+0000","last_clean_scrub_stamp":"2019-11-29T12:26:08.330333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"10","reported_epoch":"19","state":"active+clean","last_fresh":"2019-11-29T12:26:10.871289+0000","last_change":"2019-11-29T12:26:10.491112+0000","last_active":"2019-11-29T12:26:10.871289+0000","last_peered":"2019-11-29T12:26:10.871289+0000","last_clean":"2019-11-29T12:26:10.871289+0000","last_became_active":"2019-11-29T12:26:10.430180+0000","last_became_peered":"2019-11-29T12:26:10.430180+0000","last_unstale":"2019-11-29T12:26:10.871289+0000","last_undegraded":"2019-11-29T12:26:10.871289+0000","last_fullsized":"2019-11-29T12:26:10.871289+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-29T12:26:08.330333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-29T12:26:08.330333+0000","last_clean_scrub_stamp":"2019-11-29T12:26:08.330333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"10","reported_epoch":"19","state":"active+clean","last_fresh":"2019-11-29T12:26:11.479488+0000","last_change":"2019-11-29T12:26:11.461195+0000","last_active":"2019-11-29T12:26:11.479488+0000","last_peered":"2019-11-29T12:26:11.479488+0000","last_clean":"2019-11-29T12:26:11.479488+0000","last_became_active":"2019-11-29T12:26:11.424130+0000","last_became_peered":"2019-11-29T12:26:11.424130+0000","last_unstale":"2019-11-29T12:26:11.479488+0000","last_undegraded":"2019-11-29T12:26:11.479488+0000","last_fullsized":"2019-11-29T12:26:11.479488+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-29T12:26:08.330333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-29T12:26:08.330333+0000","last_clean_scrub_stamp":"2019-11-29T12:26:08.330333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"10","reported_epoch":"19","state":"active+clean","last_fresh":"2019-11-29T12:26:11.371987+0000","last_change":"2019-11-29T12:26:11.350851+0000","last_active":"2019-11-29T12:26:11.371987+0000","last_peered":"2019-11-29T12:26:11.371987+0000","last_clean":"2019-11-29T12:26:11.371987+0000","last_became_active":"2019-11-29T12:26:11.322084+0000","last_became_peered":"2019-11-29T12:26:11.322084+0000","last_unstale":"2019-11-29T12:26:11.371987+0000","last_undegraded":"2019-11-29T12:26:11.371987+0000","last_fullsized":"2019-11-29T12:26:11.371987+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-29T12:26:08.330333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-29T12:26:08.330333+0000","last_clean_scrub_stamp":"2019-11-29T12:26:08.330333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"10","reported_epoch":"19","state":"active+clean","last_fresh":"2019-11-29T12:26:11.301005+0000","last_change":"2019-11-29T12:26:11.233796+0000","last_active":"2019-11-29T12:26:11.301005+0000","last_peered":"2019-11-29T12:26:11.301005+0000","last_clean":"2019-11-29T12:26:11.301005+0000","last_became_active":"2019-11-29T12:26:11.095710+0000","last_became_peered":"2019-11-29T12:26:11.095710+0000","last_unstale":"2019-11-29T12:26:11.301005+0000","last_undegraded":"2019-11-29T12:26:11.301005+0000","last_fullsized":"2019-11-29T12:26:11.301005+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-29T12:26:08.330333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-29T12:26:08.330333+0000","last_clean_scrub_stamp":"2019-11-29T12:26:08.330333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509446,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048776,"kb_used_data":192,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323064,"statfs":{"total":96636764160,"available":95562817536,"internally_reserved":1073741824,"allocated":196608,"data_stored":62250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":38.359}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":21.413}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":19.793}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":28.741}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":33.260}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":34.771}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":30.366}]}]},{"osd":3,"up_from":15,"seq":64424509447,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048776,"kb_used_data":192,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323064,"statfs":{"total":96636764160,"available":95562817536,"internally_reserved":1073741824,"allocated":196608,"data_stored":62250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":16.929}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":15.792}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":17.933}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":20.537}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":30.473}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":22.949}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":27.321}]}]},{"osd":2,"up_from":15,"seq":64424509448,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048776,"kb_used_data":192,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323064,"statfs":{"total":96636764160,"available":95562817536,"internally_reserved":1073741824,"allocated":196608,"data_stored":62250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":32.089}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":35.169}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":20.064}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":34.112}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":41.590}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":24.738}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":39.961}]}]},{"osd":1,"up_from":15,"seq":64424509447,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048776,"kb_used_data":192,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323064,"statfs":{"total":96636764160,"available":95562817536,"internally_reserved":1073741824,"allocated":196608,"data_stored":62250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":22.774}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":17.365}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":19.939}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":14.715}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":22.452}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":23.550}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":28.865}]}]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048776,"kb_used_data":192,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323064,"statfs":{"total":96636764160,"available":95562817536,"internally_reserved":1073741824,"allocated":196608,"data_stored":62250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":24.777}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":20.517}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":29.054}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":31.502}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":26.355}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":22.751}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":43.675}]}]},{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048776,"kb_used_data":192,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323064,"statfs":{"total":96636764160,"available":95562817536,"internally_reserved":1073741824,"allocated":196608,"data_stored":62250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":13.053}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":19.230}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":15.965}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":20.789}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":23.717}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":25.837}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":30.774}]}]},{"osd":5,"up_from":14,"seq":60129542153,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048772,"kb_used_data":188,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323068,"statfs":{"total":96636764160,"available":95562821632,"internally_reserved":1073741824,"allocated":192512,"data_stored":61672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":21.066}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":22.158}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":26.512}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":22.846}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":29.741}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":37.463}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":40.051}]}]},{"osd":0,"up_from":15,"seq":64424509448,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048776,"kb_used_data":192,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323064,"statfs":{"total":96636764160,"available":95562817536,"internally_reserved":1073741824,"allocated":196608,"data_stored":62250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":39.172}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":30.346}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":34.167}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":19.740}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":22.188}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":40.797}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":29.022}]}]}]}} 2019-11-29T12:26:29.114 INFO:tasks.ceph.ceph_manager.ceph:clean! 2019-11-29T12:26:29.114 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2019-11-29T12:26:29.114 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2019-11-29T12:26:29.114 INFO:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2019-11-29T12:26:29.884 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:26:29.899 INFO:teuthology.orchestra.run.smithi062.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2019-11-29T12:26:29.899 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2019-11-29T12:26:29.899 INFO:teuthology.run_tasks:Running task openssl_keys... 2019-11-29T12:26:29.911 DEBUG:teuthology.task:Applying overrides for task openssl_keys: {'rgw.client.1': {'ca': 'root', 'client': 'client.1', 'embed-key': True}, 'root': {'key-type': 'rsa:4096', 'client': 'client.0', 'cn': 'teuthology', 'install': ['client.0', 'client.1']}, 'rgw.client.0': {'ca': 'root', 'client': 'client.0', 'embed-key': True}} 2019-11-29T12:26:29.912 INFO:teuthology.orchestra.run.smithi062:> mkdir -p /home/ubuntu/cephtest/ca 2019-11-29T12:26:29.974 INFO:teuthology.orchestra.run.smithi062:> openssl req -x509 -nodes -newkey rsa:4096 -keyout /home/ubuntu/cephtest/ca/root.key -days 365 -out /home/ubuntu/cephtest/ca/root.crt -subj /CN=teuthology 2019-11-29T12:26:30.060 INFO:teuthology.orchestra.run.smithi062.stderr:Generating a 4096 bit RSA private key 2019-11-29T12:26:31.009 INFO:teuthology.orchestra.run.smithi062.stderr:....................................................................................................................................................................................................................++ 2019-11-29T12:26:31.058 INFO:teuthology.orchestra.run.smithi062.stderr:...........++ 2019-11-29T12:26:31.059 INFO:teuthology.orchestra.run.smithi062.stderr:writing new private key to '/home/ubuntu/cephtest/ca/root.key' 2019-11-29T12:26:31.059 INFO:teuthology.orchestra.run.smithi062.stderr:----- 2019-11-29T12:26:31.068 INFO:teuthology.orchestra.run.smithi062:> sudo cp /home/ubuntu/cephtest/ca/root.crt /usr/share/pki/ca-trust-source/anchors/root.crt 2019-11-29T12:26:31.196 INFO:teuthology.orchestra.run.smithi062:> sudo update-ca-trust 2019-11-29T12:26:32.112 INFO:teuthology.orchestra.run.smithi022:> mkdir -p /home/ubuntu/cephtest/ca 2019-11-29T12:26:32.201 INFO:tasks.openssl_keys:copying from ubuntu@smithi062.front.sepia.ceph.com:/home/ubuntu/cephtest/ca/root.crt to ubuntu@smithi022.front.sepia.ceph.com:/home/ubuntu/cephtest/ca/root.crt... 2019-11-29T12:26:32.293 DEBUG:teuthology.orchestra.remote:smithi062:/home/ubuntu/cephtest/ca/root.crt is 2KB 2019-11-29T12:26:32.477 INFO:teuthology.orchestra.run.smithi022:> sudo mv /home/ubuntu/cephtest/ca/root.crt /usr/share/pki/ca-trust-source/anchors/root.crt 2019-11-29T12:26:32.595 INFO:teuthology.orchestra.run.smithi022:> sudo update-ca-trust 2019-11-29T12:26:33.380 INFO:teuthology.orchestra.run.smithi022:> mkdir -p /home/ubuntu/cephtest/ca 2019-11-29T12:26:33.436 INFO:teuthology.orchestra.run.smithi062:> openssl req -nodes -newkey rsa:2048 -keyout /home/ubuntu/cephtest/ca/rgw.client.1.key -out /home/ubuntu/cephtest/ca/rgw.client.1.csr -subj /CN=smithi022.front.sepia.ceph.com 2019-11-29T12:26:33.535 INFO:teuthology.orchestra.run.smithi062.stderr:Generating a 2048 bit RSA private key 2019-11-29T12:26:33.651 INFO:teuthology.orchestra.run.smithi062.stderr:...........................................................+++ 2019-11-29T12:26:33.698 INFO:teuthology.orchestra.run.smithi062.stderr:.........................................+++ 2019-11-29T12:26:33.699 INFO:teuthology.orchestra.run.smithi062.stderr:writing new private key to '/home/ubuntu/cephtest/ca/rgw.client.1.key' 2019-11-29T12:26:33.699 INFO:teuthology.orchestra.run.smithi062.stderr:----- 2019-11-29T12:26:33.701 INFO:teuthology.orchestra.run.smithi062:> openssl x509 -req -in /home/ubuntu/cephtest/ca/rgw.client.1.csr -CA /home/ubuntu/cephtest/ca/root.crt -CAkey /home/ubuntu/cephtest/ca/root.key -CAcreateserial -out /home/ubuntu/cephtest/ca/rgw.client.1.crt -days 365 -sha256 2019-11-29T12:26:33.792 INFO:teuthology.orchestra.run.smithi062.stderr:Signature ok 2019-11-29T12:26:33.793 INFO:teuthology.orchestra.run.smithi062.stderr:subject=/CN=smithi022.front.sepia.ceph.com 2019-11-29T12:26:33.793 INFO:teuthology.orchestra.run.smithi062.stderr:Getting CA Private Key 2019-11-29T12:26:33.809 INFO:teuthology.orchestra.run.smithi062:> rm /home/ubuntu/cephtest/ca/rgw.client.1.csr /home/ubuntu/cephtest/ca/root.srl 2019-11-29T12:26:33.872 INFO:teuthology.orchestra.run.smithi062:> openssl verify -CAfile /home/ubuntu/cephtest/ca/root.crt /home/ubuntu/cephtest/ca/rgw.client.1.crt 2019-11-29T12:26:33.947 INFO:teuthology.orchestra.run.smithi062.stdout:/home/ubuntu/cephtest/ca/rgw.client.1.crt: OK 2019-11-29T12:26:33.948 INFO:tasks.openssl_keys:copying from ubuntu@smithi062.front.sepia.ceph.com:/home/ubuntu/cephtest/ca/rgw.client.1.crt to ubuntu@smithi022.front.sepia.ceph.com:/home/ubuntu/cephtest/ca/rgw.client.1.crt... 2019-11-29T12:26:34.006 DEBUG:teuthology.orchestra.remote:smithi062:/home/ubuntu/cephtest/ca/rgw.client.1.crt is 1KB 2019-11-29T12:26:34.155 INFO:tasks.openssl_keys:copying from ubuntu@smithi062.front.sepia.ceph.com:/home/ubuntu/cephtest/ca/rgw.client.1.key to ubuntu@smithi022.front.sepia.ceph.com:/home/ubuntu/cephtest/ca/rgw.client.1.key... 2019-11-29T12:26:34.242 DEBUG:teuthology.orchestra.remote:smithi062:/home/ubuntu/cephtest/ca/rgw.client.1.key is 2KB 2019-11-29T12:26:34.425 INFO:teuthology.orchestra.run.smithi062:> rm /home/ubuntu/cephtest/ca/rgw.client.1.crt /home/ubuntu/cephtest/ca/rgw.client.1.key 2019-11-29T12:26:34.520 INFO:teuthology.orchestra.run.smithi022:> openssl verify /home/ubuntu/cephtest/ca/rgw.client.1.crt 2019-11-29T12:26:34.621 INFO:teuthology.orchestra.run.smithi022.stdout:/home/ubuntu/cephtest/ca/rgw.client.1.crt: OK 2019-11-29T12:26:34.622 INFO:teuthology.orchestra.run.smithi022:> cat /home/ubuntu/cephtest/ca/rgw.client.1.key >> /home/ubuntu/cephtest/ca/rgw.client.1.crt 2019-11-29T12:26:34.707 INFO:teuthology.orchestra.run.smithi062:> mkdir -p /home/ubuntu/cephtest/ca 2019-11-29T12:26:34.795 INFO:teuthology.orchestra.run.smithi062:> openssl req -nodes -newkey rsa:2048 -keyout /home/ubuntu/cephtest/ca/rgw.client.0.key -out /home/ubuntu/cephtest/ca/rgw.client.0.csr -subj /CN=smithi062.front.sepia.ceph.com 2019-11-29T12:26:34.879 INFO:teuthology.orchestra.run.smithi062.stderr:Generating a 2048 bit RSA private key 2019-11-29T12:26:35.054 INFO:teuthology.orchestra.run.smithi062.stderr:...........................................................................................................+++ 2019-11-29T12:26:35.130 INFO:teuthology.orchestra.run.smithi062.stderr:.................................................................+++ 2019-11-29T12:26:35.130 INFO:teuthology.orchestra.run.smithi062.stderr:writing new private key to '/home/ubuntu/cephtest/ca/rgw.client.0.key' 2019-11-29T12:26:35.130 INFO:teuthology.orchestra.run.smithi062.stderr:----- 2019-11-29T12:26:35.132 INFO:teuthology.orchestra.run.smithi062:> openssl x509 -req -in /home/ubuntu/cephtest/ca/rgw.client.0.csr -CA /home/ubuntu/cephtest/ca/root.crt -CAkey /home/ubuntu/cephtest/ca/root.key -CAcreateserial -out /home/ubuntu/cephtest/ca/rgw.client.0.crt -days 365 -sha256 2019-11-29T12:26:35.226 INFO:teuthology.orchestra.run.smithi062.stderr:Signature ok 2019-11-29T12:26:35.226 INFO:teuthology.orchestra.run.smithi062.stderr:subject=/CN=smithi062.front.sepia.ceph.com 2019-11-29T12:26:35.227 INFO:teuthology.orchestra.run.smithi062.stderr:Getting CA Private Key 2019-11-29T12:26:35.242 INFO:teuthology.orchestra.run.smithi062:> rm /home/ubuntu/cephtest/ca/rgw.client.0.csr /home/ubuntu/cephtest/ca/root.srl 2019-11-29T12:26:35.303 INFO:teuthology.orchestra.run.smithi062:> openssl verify -CAfile /home/ubuntu/cephtest/ca/root.crt /home/ubuntu/cephtest/ca/rgw.client.0.crt 2019-11-29T12:26:35.357 INFO:teuthology.orchestra.run.smithi062.stdout:/home/ubuntu/cephtest/ca/rgw.client.0.crt: OK 2019-11-29T12:26:35.357 INFO:teuthology.orchestra.run.smithi062:> cat /home/ubuntu/cephtest/ca/rgw.client.0.key >> /home/ubuntu/cephtest/ca/rgw.client.0.crt 2019-11-29T12:26:35.404 INFO:teuthology.run_tasks:Running task rgw... 2019-11-29T12:26:35.420 DEBUG:tasks.rgw:config is {'client.1': {'ssl certificate': 'rgw.client.1'}, 'client.0': {'ssl certificate': 'rgw.client.0', 'valgrind': ['--tool=memcheck', '--max-threads=1024']}} 2019-11-29T12:26:35.420 DEBUG:tasks.rgw:client list is ['client.0'] 2019-11-29T12:26:35.420 INFO:tasks.rgw:Creating data pools 2019-11-29T12:26:35.420 DEBUG:tasks.rgw:Obtaining remote for client client.0 2019-11-29T12:26:35.421 INFO:teuthology.orchestra.run.smithi062:> sudo ceph osd pool create default.rgw.buckets.data 64 64 --cluster ceph 2019-11-29T12:26:36.637 INFO:teuthology.orchestra.run.smithi062.stderr:pool 'default.rgw.buckets.data' created 2019-11-29T12:26:36.651 INFO:teuthology.orchestra.run.smithi062:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2019-11-29T12:26:37.628 INFO:teuthology.orchestra.run.smithi062.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2019-11-29T12:26:37.652 INFO:teuthology.orchestra.run.smithi062:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2019-11-29T12:26:39.022 INFO:teuthology.orchestra.run.smithi062.stderr:pool 'default.rgw.buckets.index' created 2019-11-29T12:26:39.034 INFO:teuthology.orchestra.run.smithi062:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2019-11-29T12:26:40.163 INFO:teuthology.orchestra.run.smithi062.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2019-11-29T12:26:40.176 DEBUG:tasks.rgw:Pools created 2019-11-29T12:26:40.176 INFO:tasks.rgw:Configuring compression type = random 2019-11-29T12:26:40.176 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2019-11-29T12:26:40.176 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2019-11-29T12:26:40.177 INFO:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2019-11-29T12:26:40.359 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:26:40.361+0000 7f812eab8ec0 20 rados->read ofs=0 len=0 2019-11-29T12:26:43.208 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:26:43.209+0000 7f812eab8ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T12:26:43.208 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:26:43.209+0000 7f812eab8ec0 20 rados->read ofs=0 len=0 2019-11-29T12:26:43.229 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:26:43.230+0000 7f812eab8ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T12:26:43.229 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:26:43.230+0000 7f812eab8ec0 20 rados->read ofs=0 len=0 2019-11-29T12:26:43.238 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:26:43.239+0000 7f812eab8ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T12:26:43.238 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:26:43.239+0000 7f812eab8ec0 20 rados->read ofs=0 len=0 2019-11-29T12:26:43.383 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:26:43.384+0000 7f812eab8ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T12:26:44.957 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:26:44.959+0000 7f812eab8ec0 20 rados->read ofs=0 len=0 2019-11-29T12:26:44.971 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:26:44.972+0000 7f812eab8ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T12:26:44.971 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:26:44.972+0000 7f812eab8ec0 20 rados->read ofs=0 len=0 2019-11-29T12:26:44.976 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:26:44.978+0000 7f812eab8ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T12:26:44.977 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:26:44.978+0000 7f812eab8ec0 20 rados->read ofs=0 len=0 2019-11-29T12:26:44.981 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:26:44.983+0000 7f812eab8ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T12:26:44.982 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:26:44.983+0000 7f812eab8ec0 10 cannot find current period zonegroup using local zonegroup 2019-11-29T12:26:44.982 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:26:44.983+0000 7f812eab8ec0 20 rados->read ofs=0 len=0 2019-11-29T12:26:44.989 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:26:44.991+0000 7f812eab8ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T12:26:44.989 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:26:44.991+0000 7f812eab8ec0 20 rados->read ofs=0 len=0 2019-11-29T12:26:44.995 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:26:44.996+0000 7f812eab8ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T12:26:44.995 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:26:44.996+0000 7f812eab8ec0 10 Creating default zonegroup 2019-11-29T12:26:44.995 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:26:44.996+0000 7f812eab8ec0 20 get_system_obj_state: rctx=0x7ffc3787c8b0 obj=:.pools.avail state=0x55803dc9c8a0 s->prefetch_data=0 2019-11-29T12:26:44.999 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:26:45.001+0000 7f812eab8ec0 10 couldn't find old data placement pools config, setting up new ones for the zone 2019-11-29T12:26:45.196 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:26:45.198+0000 7f812eab8ec0 10 WARNING: store->list_zones() returned r=-2 2019-11-29T12:26:45.196 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:26:45.198+0000 7f812eab8ec0 20 rados->read ofs=0 len=0 2019-11-29T12:26:45.206 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:26:45.207+0000 7f812eab8ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T12:26:46.136 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:26:46.138+0000 7f812eab8ec0 20 rados->read ofs=0 len=0 2019-11-29T12:26:46.144 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:26:46.145+0000 7f812eab8ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T12:26:46.144 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:26:46.145+0000 7f812eab8ec0 10 could not read realm id: (2) No such file or directory 2019-11-29T12:26:46.144 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:26:46.145+0000 7f812eab8ec0 10 WARNING: failed to set zone as default, r=-22 2019-11-29T12:26:46.144 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:26:46.145+0000 7f812eab8ec0 20 rados->read ofs=0 len=0 2019-11-29T12:26:46.157 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:26:46.158+0000 7f811bce5700 0 -- 172.21.15.62:0/2560641544 >> [v2:172.21.15.22:6802/9263,v1:172.21.15.22:6804/9263] conn(0x55803dc958d0 msgr2=0x55803dc97cf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-29T12:26:46.157 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:26:46.159+0000 7f812eab8ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T12:26:46.329 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:26:46.330+0000 7f812eab8ec0 20 rados->read ofs=0 len=0 2019-11-29T12:26:46.376 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:26:46.377+0000 7f812eab8ec0 20 rados_obj.operate() r=0 bl.length=805 2019-11-29T12:26:46.376 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:26:46.377+0000 7f812eab8ec0 20 rados->read ofs=0 len=0 2019-11-29T12:26:46.412 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:26:46.413+0000 7f812eab8ec0 20 rados_obj.operate() r=0 bl.length=348 2019-11-29T12:26:46.412 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:26:46.414+0000 7f812eab8ec0 20 zonegroup default 2019-11-29T12:26:46.413 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:26:46.414+0000 7f812eab8ec0 20 rados->read ofs=0 len=0 2019-11-29T12:26:46.422 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:26:46.423+0000 7f812eab8ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T12:26:46.422 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:26:46.423+0000 7f812eab8ec0 10 Cannot find current period zone using local zone 2019-11-29T12:26:46.422 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:26:46.423+0000 7f812eab8ec0 10 Using default name default 2019-11-29T12:26:46.422 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:26:46.423+0000 7f812eab8ec0 20 rados->read ofs=0 len=0 2019-11-29T12:26:46.434 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:26:46.435+0000 7f812eab8ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T12:26:46.434 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:26:46.435+0000 7f812eab8ec0 20 rados->read ofs=0 len=0 2019-11-29T12:26:46.447 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:26:46.448+0000 7f812eab8ec0 20 rados_obj.operate() r=0 bl.length=805 2019-11-29T12:26:46.447 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:26:46.448+0000 7f812eab8ec0 20 zone default found 2019-11-29T12:26:46.447 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:26:46.448+0000 7f812eab8ec0 20 started sync module instance, tier type = 2019-11-29T12:26:46.447 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:26:46.448+0000 7f812eab8ec0 20 started zone id=7f922895-c6d7-4b1b-a19c-be3df5b5a899 (name=default) with tier type = 2019-11-29T12:26:50.464 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:26:50.465+0000 7f811bce5700 0 -- 172.21.15.62:0/2560641544 >> [v2:172.21.15.22:6802/9263,v1:172.21.15.22:6804/9263] conn(0x7f8108022090 msgr2=0x7f81080244b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2019-11-29T12:26:51.459 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:26:51.460+0000 7f812eab8ec0 20 add_watcher() i=0 2019-11-29T12:26:51.459 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:26:51.460+0000 7f812eab8ec0 20 add_watcher() i=1 2019-11-29T12:26:51.459 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:26:51.460+0000 7f812eab8ec0 20 add_watcher() i=2 2019-11-29T12:26:51.459 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:26:51.460+0000 7f812eab8ec0 20 add_watcher() i=3 2019-11-29T12:26:51.459 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:26:51.460+0000 7f812eab8ec0 20 add_watcher() i=4 2019-11-29T12:26:51.459 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:26:51.460+0000 7f812eab8ec0 20 add_watcher() i=5 2019-11-29T12:26:51.519 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:26:51.520+0000 7f812eab8ec0 20 add_watcher() i=6 2019-11-29T12:26:51.560 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:26:51.562+0000 7f812eab8ec0 20 add_watcher() i=7 2019-11-29T12:26:51.561 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:26:51.562+0000 7f812eab8ec0 2 all 8 watchers are set, enabling cache 2019-11-29T12:26:51.561 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:26:51.562+0000 7f8067fff700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-29T12:26:55.903 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:26:55.905+0000 7f812eab8ec0 10 rgw_init_ioctx warning: failed to set recovery_priority on default.rgw.meta 2019-11-29T12:27:00.411 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:00.413+0000 7f812eab8ec0 10 rgw_init_ioctx warning: failed to set recovery_priority on default.rgw.log 2019-11-29T12:27:05.548 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:05.550+0000 7f80527fc700 20 reqs_thread_entry: start 2019-11-29T12:27:05.549 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:05.550+0000 7f8043fff700 20 reqs_thread_entry: start 2019-11-29T12:27:05.549 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:05.550+0000 7f812eab8ec0 20 init_complete bucket index max shards: 0 2019-11-29T12:27:05.549 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:05.551+0000 7f80427fc700 20 reqs_thread_entry: start 2019-11-29T12:27:05.863 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:05.864+0000 7f812eab8ec0 20 remove_watcher() i=0 2019-11-29T12:27:05.863 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:05.864+0000 7f812eab8ec0 2 removed watcher, disabling cache 2019-11-29T12:27:05.954 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:05.955+0000 7f812eab8ec0 20 remove_watcher() i=1 2019-11-29T12:27:06.055 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:06.057+0000 7f812eab8ec0 20 remove_watcher() i=2 2019-11-29T12:27:06.145 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:06.147+0000 7f812eab8ec0 20 remove_watcher() i=3 2019-11-29T12:27:06.213 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:06.214+0000 7f812eab8ec0 20 remove_watcher() i=4 2019-11-29T12:27:06.286 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:06.288+0000 7f812eab8ec0 20 remove_watcher() i=5 2019-11-29T12:27:06.392 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:06.393+0000 7f812eab8ec0 20 remove_watcher() i=6 2019-11-29T12:27:06.461 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:06.462+0000 7f812eab8ec0 20 remove_watcher() i=7 2019-11-29T12:27:06.473 INFO:teuthology.orchestra.run.smithi062.stdout:[] 2019-11-29T12:27:06.474 DEBUG:tasks.util.rgw: json result: [] 2019-11-29T12:27:06.474 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2019-11-29T12:27:06.474 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2019-11-29T12:27:06.474 INFO:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement modify --rgw-zone default --placement-id default-placement --compression random 2019-11-29T12:27:06.654 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:06.656+0000 7fd03d7fa700 20 reqs_thread_entry: start 2019-11-29T12:27:06.655 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:06.656+0000 7fd0f8094ec0 20 rados->read ofs=0 len=0 2019-11-29T12:27:06.670 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:06.672+0000 7fd0f8094ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T12:27:06.670 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:06.672+0000 7fd0f8094ec0 20 rados->read ofs=0 len=0 2019-11-29T12:27:06.685 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:06.687+0000 7fd0f8094ec0 20 rados_obj.operate() r=0 bl.length=805 2019-11-29T12:27:06.685 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:06.687+0000 7fd0f8094ec0 20 rados->read ofs=0 len=0 2019-11-29T12:27:06.694 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:06.696+0000 7fd0f8094ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T12:27:06.695 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:06.696+0000 7fd0f8094ec0 20 rados->read ofs=0 len=0 2019-11-29T12:27:06.708 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:06.709+0000 7fd0f8094ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T12:27:06.708 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:06.709+0000 7fd0f8094ec0 20 rados->read ofs=0 len=0 2019-11-29T12:27:06.715 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:06.717+0000 7fd0f8094ec0 20 rados_obj.operate() r=0 bl.length=348 2019-11-29T12:27:06.872 INFO:teuthology.orchestra.run.smithi062.stdout:{"id":"7f922895-c6d7-4b1b-a19c-be3df5b5a899","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0}}],"realm_id":""} 2019-11-29T12:27:06.873 DEBUG:tasks.util.rgw: json result: {u'control_pool': u'default.rgw.control', u'otp_pool': u'default.rgw.otp', u'usage_log_pool': u'default.rgw.log:usage', u'name': u'default', u'user_uid_pool': u'default.rgw.meta:users.uid', u'gc_pool': u'default.rgw.log:gc', u'intent_log_pool': u'default.rgw.log:intent', u'roles_pool': u'default.rgw.meta:roles', u'lc_pool': u'default.rgw.log:lc', u'user_keys_pool': u'default.rgw.meta:users.keys', u'domain_root': u'default.rgw.meta:root', u'system_key': {u'access_key': u'', u'secret_key': u''}, u'reshard_pool': u'default.rgw.log:reshard', u'log_pool': u'default.rgw.log', u'user_email_pool': u'default.rgw.meta:users.email', u'realm_id': u'', u'placement_pools': [{u'val': {u'storage_classes': {u'STANDARD': {u'data_pool': u'default.rgw.buckets.data', u'compression_type': u'random'}}, u'data_extra_pool': u'default.rgw.buckets.non-ec', u'index_type': 0, u'index_pool': u'default.rgw.buckets.index'}, u'key': u'default-placement'}], u'id': u'7f922895-c6d7-4b1b-a19c-be3df5b5a899', u'user_swift_pool': u'default.rgw.meta:users.swift'} 2019-11-29T12:27:06.873 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2019-11-29T12:27:06.873 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2019-11-29T12:27:06.873 INFO:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2019-11-29T12:27:07.095 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:07.097+0000 7fb0e4728ec0 20 rados->read ofs=0 len=0 2019-11-29T12:27:07.174 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:07.176+0000 7fb0e4728ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T12:27:07.175 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:07.176+0000 7fb0e4728ec0 20 rados->read ofs=0 len=0 2019-11-29T12:27:07.183 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:07.185+0000 7fb0e4728ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T12:27:07.183 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:07.185+0000 7fb0e4728ec0 20 rados->read ofs=0 len=0 2019-11-29T12:27:07.194 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:07.195+0000 7fb0e4728ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T12:27:07.194 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:07.195+0000 7fb0e4728ec0 20 rados->read ofs=0 len=0 2019-11-29T12:27:07.213 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:07.215+0000 7fb0e4728ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T12:27:07.504 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:07.506+0000 7fb0e4728ec0 20 RGWRados::pool_iterate: got zone_info.7f922895-c6d7-4b1b-a19c-be3df5b5a899 2019-11-29T12:27:07.505 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:07.506+0000 7fb0e4728ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-29T12:27:07.505 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:07.506+0000 7fb0e4728ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-29T12:27:07.505 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:07.506+0000 7fb0e4728ec0 20 RGWRados::pool_iterate: got zonegroup_info.76ba47ff-1c23-4409-aae0-24fe26589cae 2019-11-29T12:27:07.505 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:07.506+0000 7fb0e4728ec0 20 rados->read ofs=0 len=0 2019-11-29T12:27:07.528 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:07.530+0000 7fb0e4728ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T12:27:07.528 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:07.530+0000 7fb0e4728ec0 20 rados->read ofs=0 len=0 2019-11-29T12:27:07.549 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:07.551+0000 7fb0e4728ec0 20 rados_obj.operate() r=0 bl.length=821 2019-11-29T12:27:07.549 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:07.551+0000 7fb0e4728ec0 20 rados->read ofs=0 len=0 2019-11-29T12:27:07.564 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:07.566+0000 7fb0e4728ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T12:27:07.564 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:07.566+0000 7fb0e4728ec0 20 rados->read ofs=0 len=0 2019-11-29T12:27:07.583 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:07.585+0000 7fb0e4728ec0 20 rados_obj.operate() r=0 bl.length=348 2019-11-29T12:27:07.584 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:07.585+0000 7fb0e4728ec0 20 rados->read ofs=0 len=0 2019-11-29T12:27:07.594 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:07.596+0000 7fb0e4728ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T12:27:07.594 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:07.596+0000 7fb0e4728ec0 10 cannot find current period zonegroup using local zonegroup 2019-11-29T12:27:07.594 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:07.596+0000 7fb0e4728ec0 20 rados->read ofs=0 len=0 2019-11-29T12:27:07.610 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:07.612+0000 7fb0e4728ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T12:27:07.610 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:07.612+0000 7fb0e4728ec0 20 rados->read ofs=0 len=0 2019-11-29T12:27:07.645 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:07.647+0000 7fb0e4728ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T12:27:07.645 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:07.647+0000 7fb0e4728ec0 20 rados->read ofs=0 len=0 2019-11-29T12:27:07.659 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:07.660+0000 7fb0e4728ec0 20 rados_obj.operate() r=0 bl.length=348 2019-11-29T12:27:07.659 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:07.660+0000 7fb0e4728ec0 20 zonegroup default 2019-11-29T12:27:07.659 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:07.660+0000 7fb0e4728ec0 20 rados->read ofs=0 len=0 2019-11-29T12:27:07.667 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:07.668+0000 7fb0e4728ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T12:27:07.667 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:07.668+0000 7fb0e4728ec0 10 Cannot find current period zone using local zone 2019-11-29T12:27:07.667 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:07.668+0000 7fb0e4728ec0 20 rados->read ofs=0 len=0 2019-11-29T12:27:07.676 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:07.678+0000 7fb0e4728ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T12:27:07.677 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:07.678+0000 7fb0e4728ec0 20 rados->read ofs=0 len=0 2019-11-29T12:27:07.687 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:07.689+0000 7fb0e4728ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T12:27:07.687 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:07.689+0000 7fb0e4728ec0 20 rados->read ofs=0 len=0 2019-11-29T12:27:07.701 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:07.703+0000 7fb0e4728ec0 20 rados_obj.operate() r=0 bl.length=821 2019-11-29T12:27:07.701 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:07.703+0000 7fb0e4728ec0 20 zone default found 2019-11-29T12:27:07.702 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:07.703+0000 7fb0e4728ec0 20 started sync module instance, tier type = 2019-11-29T12:27:07.702 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:07.703+0000 7fb0e4728ec0 20 started zone id=7f922895-c6d7-4b1b-a19c-be3df5b5a899 (name=default) with tier type = 2019-11-29T12:27:08.189 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:08.190+0000 7fb0e4728ec0 20 add_watcher() i=0 2019-11-29T12:27:08.189 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:08.190+0000 7fb0e4728ec0 20 add_watcher() i=1 2019-11-29T12:27:08.189 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:08.190+0000 7fb0e4728ec0 20 add_watcher() i=2 2019-11-29T12:27:08.189 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:08.190+0000 7fb0e4728ec0 20 add_watcher() i=3 2019-11-29T12:27:08.190 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:08.190+0000 7fb0e4728ec0 20 add_watcher() i=4 2019-11-29T12:27:08.190 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:08.190+0000 7fb0e4728ec0 20 add_watcher() i=5 2019-11-29T12:27:08.195 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:08.196+0000 7fb0e4728ec0 20 add_watcher() i=6 2019-11-29T12:27:08.229 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:08.230+0000 7fb0e4728ec0 20 add_watcher() i=7 2019-11-29T12:27:08.229 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:08.230+0000 7fb0e4728ec0 2 all 8 watchers are set, enabling cache 2019-11-29T12:27:08.229 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:08.231+0000 7fb0a27dc700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-29T12:27:08.233 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:08.235+0000 7fb0d1154700 0 -- 172.21.15.62:0/956264222 >> v2:172.21.15.22:3300/0 conn(0x55dc629d75d0 msgr2=0x55dc629d9ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0)._try_send injecting socket failure 2019-11-29T12:27:08.273 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:08.274+0000 7fb0d1154700 0 -- 172.21.15.62:0/2279911731 >> [v2:172.21.15.22:6818/9264,v1:172.21.15.22:6819/9264] conn(0x55dc629e8800 msgr2=0x55dc629eac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-29T12:27:10.831 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:10.832+0000 7fb018ff9700 20 reqs_thread_entry: start 2019-11-29T12:27:10.831 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:10.833+0000 7fb0127fc700 20 reqs_thread_entry: start 2019-11-29T12:27:10.831 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:10.833+0000 7fb0e4728ec0 20 init_complete bucket index max shards: 0 2019-11-29T12:27:10.832 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:10.834+0000 7fb010ff9700 20 reqs_thread_entry: start 2019-11-29T12:27:11.125 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:11.127+0000 7fb0e4728ec0 20 remove_watcher() i=0 2019-11-29T12:27:11.126 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:11.127+0000 7fb0e4728ec0 2 removed watcher, disabling cache 2019-11-29T12:27:11.192 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:11.194+0000 7fb0e4728ec0 20 remove_watcher() i=1 2019-11-29T12:27:11.259 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:11.260+0000 7fb0e4728ec0 20 remove_watcher() i=2 2019-11-29T12:27:11.315 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:11.317+0000 7fb0e4728ec0 20 remove_watcher() i=3 2019-11-29T12:27:11.372 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:11.374+0000 7fb0e4728ec0 20 remove_watcher() i=4 2019-11-29T12:27:11.436 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:11.438+0000 7fb0e4728ec0 20 remove_watcher() i=5 2019-11-29T12:27:11.514 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:11.515+0000 7fb0e4728ec0 20 remove_watcher() i=6 2019-11-29T12:27:11.586 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:11.588+0000 7fb0e4728ec0 20 remove_watcher() i=7 2019-11-29T12:27:11.594 INFO:teuthology.orchestra.run.smithi062.stdout:[] 2019-11-29T12:27:11.595 DEBUG:tasks.util.rgw: json result: [] 2019-11-29T12:27:11.595 INFO:tasks.rgw:Configuring storage class type = LUKEWARM 2019-11-29T12:27:11.595 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2019-11-29T12:27:11.595 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2019-11-29T12:27:11.595 INFO:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM 2019-11-29T12:27:11.786 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:11.788+0000 7ff7db7fe700 20 reqs_thread_entry: start 2019-11-29T12:27:11.787 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:11.788+0000 7ff8a626fec0 20 rados->read ofs=0 len=0 2019-11-29T12:27:11.805 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:11.806+0000 7ff8a626fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T12:27:11.805 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:11.806+0000 7ff8a626fec0 20 rados->read ofs=0 len=0 2019-11-29T12:27:11.826 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:11.828+0000 7ff8a626fec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T12:27:11.827 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:11.828+0000 7ff8a626fec0 20 rados->read ofs=0 len=0 2019-11-29T12:27:11.840 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:11.841+0000 7ff8a626fec0 20 rados_obj.operate() r=0 bl.length=348 2019-11-29T12:27:11.840 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:11.841+0000 7ff8a626fec0 20 rados->read ofs=0 len=0 2019-11-29T12:27:11.862 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:11.864+0000 7ff8a626fec0 20 rados_obj.operate() r=0 bl.length=821 2019-11-29T12:27:12.000 INFO:teuthology.orchestra.run.smithi062.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["LUKEWARM","STANDARD"]}}] 2019-11-29T12:27:12.001 DEBUG:tasks.util.rgw: json result: [{u'val': {u'storage_classes': [u'LUKEWARM', u'STANDARD'], u'name': u'default-placement', u'tags': []}, u'key': u'default-placement'}] 2019-11-29T12:27:12.001 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2019-11-29T12:27:12.001 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2019-11-29T12:27:12.001 INFO:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM --data-pool default.rgw.buckets.data.lukewarm 2019-11-29T12:27:12.204 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:12.205+0000 7f038b7fe700 20 reqs_thread_entry: start 2019-11-29T12:27:12.204 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:12.205+0000 7f0456b77ec0 20 rados->read ofs=0 len=0 2019-11-29T12:27:12.222 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:12.224+0000 7f0456b77ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T12:27:12.223 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:12.224+0000 7f0456b77ec0 20 rados->read ofs=0 len=0 2019-11-29T12:27:12.261 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:12.263+0000 7f0456b77ec0 20 rados_obj.operate() r=0 bl.length=821 2019-11-29T12:27:12.261 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:12.263+0000 7f0456b77ec0 20 rados->read ofs=0 len=0 2019-11-29T12:27:12.271 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:12.273+0000 7f0456b77ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T12:27:12.271 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:12.273+0000 7f0456b77ec0 20 rados->read ofs=0 len=0 2019-11-29T12:27:12.283 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:12.285+0000 7f0456b77ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T12:27:12.284 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:12.285+0000 7f0456b77ec0 20 rados->read ofs=0 len=0 2019-11-29T12:27:12.298 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:12.300+0000 7f0456b77ec0 20 rados_obj.operate() r=0 bl.length=372 2019-11-29T12:27:12.347 INFO:teuthology.orchestra.run.smithi062.stdout:{"id":"7f922895-c6d7-4b1b-a19c-be3df5b5a899","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0}}],"realm_id":""} 2019-11-29T12:27:12.348 DEBUG:tasks.util.rgw: json result: {u'control_pool': u'default.rgw.control', u'otp_pool': u'default.rgw.otp', u'usage_log_pool': u'default.rgw.log:usage', u'name': u'default', u'user_uid_pool': u'default.rgw.meta:users.uid', u'gc_pool': u'default.rgw.log:gc', u'intent_log_pool': u'default.rgw.log:intent', u'roles_pool': u'default.rgw.meta:roles', u'lc_pool': u'default.rgw.log:lc', u'user_keys_pool': u'default.rgw.meta:users.keys', u'domain_root': u'default.rgw.meta:root', u'system_key': {u'access_key': u'', u'secret_key': u''}, u'reshard_pool': u'default.rgw.log:reshard', u'log_pool': u'default.rgw.log', u'user_email_pool': u'default.rgw.meta:users.email', u'realm_id': u'', u'placement_pools': [{u'val': {u'storage_classes': {u'LUKEWARM': {u'data_pool': u'default.rgw.buckets.data.lukewarm'}, u'STANDARD': {u'data_pool': u'default.rgw.buckets.data', u'compression_type': u'random'}}, u'data_extra_pool': u'default.rgw.buckets.non-ec', u'index_type': 0, u'index_pool': u'default.rgw.buckets.index'}, u'key': u'default-placement'}], u'id': u'7f922895-c6d7-4b1b-a19c-be3df5b5a899', u'user_swift_pool': u'default.rgw.meta:users.swift'} 2019-11-29T12:27:12.348 INFO:tasks.rgw:Configuring storage class type = FROZEN 2019-11-29T12:27:12.348 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2019-11-29T12:27:12.348 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2019-11-29T12:27:12.348 INFO:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN 2019-11-29T12:27:12.507 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:12.508+0000 7f65c67fc700 20 reqs_thread_entry: start 2019-11-29T12:27:12.507 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:12.508+0000 7f6690f07ec0 20 rados->read ofs=0 len=0 2019-11-29T12:27:12.516 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:12.518+0000 7f6690f07ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T12:27:12.516 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:12.518+0000 7f6690f07ec0 20 rados->read ofs=0 len=0 2019-11-29T12:27:12.531 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:12.533+0000 7f6690f07ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T12:27:12.532 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:12.533+0000 7f6690f07ec0 20 rados->read ofs=0 len=0 2019-11-29T12:27:12.538 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:12.540+0000 7f6690f07ec0 20 rados_obj.operate() r=0 bl.length=372 2019-11-29T12:27:12.538 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:12.540+0000 7f6690f07ec0 20 rados->read ofs=0 len=0 2019-11-29T12:27:12.554 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:12.556+0000 7f6690f07ec0 20 rados_obj.operate() r=0 bl.length=888 2019-11-29T12:27:12.607 INFO:teuthology.orchestra.run.smithi062.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["FROZEN","LUKEWARM","STANDARD"]}}] 2019-11-29T12:27:12.608 DEBUG:tasks.util.rgw: json result: [{u'val': {u'storage_classes': [u'FROZEN', u'LUKEWARM', u'STANDARD'], u'name': u'default-placement', u'tags': []}, u'key': u'default-placement'}] 2019-11-29T12:27:12.608 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2019-11-29T12:27:12.608 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2019-11-29T12:27:12.608 INFO:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN --data-pool default.rgw.buckets.data.frozen 2019-11-29T12:27:12.873 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:12.875+0000 7f86c0ff9700 20 reqs_thread_entry: start 2019-11-29T12:27:12.874 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:12.875+0000 7f874b709ec0 20 rados->read ofs=0 len=0 2019-11-29T12:27:12.900 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:12.902+0000 7f874b709ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T12:27:12.901 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:12.902+0000 7f874b709ec0 20 rados->read ofs=0 len=0 2019-11-29T12:27:12.922 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:12.924+0000 7f874b709ec0 20 rados_obj.operate() r=0 bl.length=888 2019-11-29T12:27:12.922 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:12.924+0000 7f874b709ec0 20 rados->read ofs=0 len=0 2019-11-29T12:27:12.935 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:12.937+0000 7f874b709ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T12:27:12.935 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:12.937+0000 7f874b709ec0 20 rados->read ofs=0 len=0 2019-11-29T12:27:12.949 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:12.951+0000 7f874b709ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T12:27:12.950 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:12.951+0000 7f874b709ec0 20 rados->read ofs=0 len=0 2019-11-29T12:27:12.965 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:27:12.967+0000 7f874b709ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-29T12:27:13.033 INFO:teuthology.orchestra.run.smithi062.stdout:{"id":"7f922895-c6d7-4b1b-a19c-be3df5b5a899","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"FROZEN":{"data_pool":"default.rgw.buckets.data.frozen"},"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0}}],"realm_id":""} 2019-11-29T12:27:13.033 DEBUG:tasks.util.rgw: json result: {u'control_pool': u'default.rgw.control', u'otp_pool': u'default.rgw.otp', u'usage_log_pool': u'default.rgw.log:usage', u'name': u'default', u'user_uid_pool': u'default.rgw.meta:users.uid', u'gc_pool': u'default.rgw.log:gc', u'intent_log_pool': u'default.rgw.log:intent', u'roles_pool': u'default.rgw.meta:roles', u'lc_pool': u'default.rgw.log:lc', u'user_keys_pool': u'default.rgw.meta:users.keys', u'domain_root': u'default.rgw.meta:root', u'system_key': {u'access_key': u'', u'secret_key': u''}, u'reshard_pool': u'default.rgw.log:reshard', u'log_pool': u'default.rgw.log', u'user_email_pool': u'default.rgw.meta:users.email', u'realm_id': u'', u'placement_pools': [{u'val': {u'storage_classes': {u'FROZEN': {u'data_pool': u'default.rgw.buckets.data.frozen'}, u'LUKEWARM': {u'data_pool': u'default.rgw.buckets.data.lukewarm'}, u'STANDARD': {u'data_pool': u'default.rgw.buckets.data', u'compression_type': u'random'}}, u'data_extra_pool': u'default.rgw.buckets.non-ec', u'index_type': 0, u'index_pool': u'default.rgw.buckets.index'}, u'key': u'default-placement'}], u'id': u'7f922895-c6d7-4b1b-a19c-be3df5b5a899', u'user_swift_pool': u'default.rgw.meta:users.swift'} 2019-11-29T12:27:13.033 INFO:tasks.rgw:Starting rgw... 2019-11-29T12:27:13.034 INFO:tasks.rgw:rgw client.0 config is {'ssl certificate': 'rgw.client.0', 'valgrind': ['--tool=memcheck', '--max-threads=1024']} 2019-11-29T12:27:13.034 INFO:tasks.rgw:Using beast as radosgw frontend 2019-11-29T12:27:13.034 DEBUG:teuthology.misc:running ceph.client.0 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/ceph.client.0.log', '--time-stamp=yes', '--tool=memcheck', '--max-threads=1024'] 2019-11-29T12:27:13.034 INFO:tasks.rgw.client.0:Restarting daemon 2019-11-29T12:27:13.034 INFO:teuthology.orchestra.run.smithi062:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/ceph.client.0.log --time-stamp=yes --tool=memcheck --max-threads=1024 radosgw --rgw-frontends 'beast ssl_certificate=/home/ubuntu/cephtest/ca/rgw.client.0.crt ssl_port=443' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2019-11-29T12:27:13.039 INFO:tasks.rgw.client.0:Started 2019-11-29T12:27:13.039 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on https://smithi062.front.sepia.ceph.com:443/ 2019-11-29T12:27:13.039 INFO:teuthology.orchestra.run.smithi062:> curl https://smithi062.front.sepia.ceph.com:443/ 2019-11-29T12:27:13.146 INFO:teuthology.orchestra.run.smithi062.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2019-11-29T12:27:13.146 INFO:teuthology.orchestra.run.smithi062.stderr: Dload Upload Total Spent Left Speed 2019-11-29T12:27:13.148 INFO:teuthology.orchestra.run.smithi062.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0curl: (7) Failed connect to smithi062.front.sepia.ceph.com:443; Connection refused 2019-11-29T12:27:13.148 DEBUG:teuthology.orchestra.run:got remote process result: 7 2019-11-29T12:27:14.149 INFO:teuthology.orchestra.run.smithi062:> curl https://smithi062.front.sepia.ceph.com:443/ 2019-11-29T12:27:14.206 INFO:teuthology.orchestra.run.smithi062.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2019-11-29T12:27:14.206 INFO:teuthology.orchestra.run.smithi062.stderr: Dload Upload Total Spent Left Speed 2019-11-29T12:27:14.209 INFO:teuthology.orchestra.run.smithi062.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0curl: (7) Failed connect to smithi062.front.sepia.ceph.com:443; Connection refused 2019-11-29T12:27:14.209 DEBUG:teuthology.orchestra.run:got remote process result: 7 2019-11-29T12:27:16.210 INFO:teuthology.orchestra.run.smithi062:> curl https://smithi062.front.sepia.ceph.com:443/ 2019-11-29T12:27:16.298 INFO:teuthology.orchestra.run.smithi062.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2019-11-29T12:27:16.298 INFO:teuthology.orchestra.run.smithi062.stderr: Dload Upload Total Spent Left Speed 2019-11-29T12:27:16.302 INFO:teuthology.orchestra.run.smithi062.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0curl: (7) Failed connect to smithi062.front.sepia.ceph.com:443; Connection refused 2019-11-29T12:27:16.302 DEBUG:teuthology.orchestra.run:got remote process result: 7 2019-11-29T12:27:20.303 INFO:teuthology.orchestra.run.smithi062:> curl https://smithi062.front.sepia.ceph.com:443/ 2019-11-29T12:27:20.382 INFO:teuthology.orchestra.run.smithi062.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2019-11-29T12:27:20.382 INFO:teuthology.orchestra.run.smithi062.stderr: Dload Upload Total Spent Left Speed 2019-11-29T12:27:20.385 INFO:teuthology.orchestra.run.smithi062.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0curl: (7) Failed connect to smithi062.front.sepia.ceph.com:443; Connection refused 2019-11-29T12:27:20.386 DEBUG:teuthology.orchestra.run:got remote process result: 7 2019-11-29T12:27:28.388 INFO:teuthology.orchestra.run.smithi062:> curl https://smithi062.front.sepia.ceph.com:443/ 2019-11-29T12:27:28.437 INFO:teuthology.orchestra.run.smithi062.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2019-11-29T12:27:28.437 INFO:teuthology.orchestra.run.smithi062.stderr: Dload Upload Total Spent Left Speed 2019-11-29T12:27:30.100 INFO:teuthology.orchestra.run.smithi062.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- 0:00:01 --:--:-- 0 100 214 0 214 0 0 128 0 --:--:-- 0:00:01 --:--:-- 128 2019-11-29T12:27:30.102 INFO:teuthology.orchestra.run.smithi062.stdout:anonymous 2019-11-29T12:27:30.102 INFO:teuthology.run_tasks:Running task workunit... 2019-11-29T12:27:30.119 INFO:tasks.workunit:Pulling workunits from ref 656c8e8049c2c1acd363143c842c2edf1fe09b64 2019-11-29T12:27:30.119 INFO:tasks.workunit:Making a separate scratch dir for every client... 2019-11-29T12:27:30.119 INFO:teuthology.orchestra.run.smithi062:> stat -- /home/ubuntu/cephtest/mnt.0 2019-11-29T12:27:30.166 INFO:teuthology.orchestra.run.smithi062.stderr:stat: cannot stat ‘/home/ubuntu/cephtest/mnt.0’: No such file or directory 2019-11-29T12:27:30.166 DEBUG:teuthology.orchestra.run:got remote process result: 1 2019-11-29T12:27:30.166 INFO:teuthology.orchestra.run.smithi062:> mkdir -- /home/ubuntu/cephtest/mnt.0 2019-11-29T12:27:30.211 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2019-11-29T12:27:30.211 INFO:teuthology.orchestra.run.smithi062:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2019-11-29T12:27:30.259 INFO:tasks.workunit:timeout=3h 2019-11-29T12:27:30.259 INFO:tasks.workunit:cleanup=True 2019-11-29T12:27:30.259 INFO:teuthology.orchestra.run.smithi062:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 656c8e8049c2c1acd363143c842c2edf1fe09b64 2019-11-29T12:27:30.610 INFO:tasks.workunit.client.0.smithi062.stdout:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2019-11-29T12:28:33.591 INFO:tasks.workunit.client.0.smithi062.stderr:Note: checking out '656c8e8049c2c1acd363143c842c2edf1fe09b64'. 2019-11-29T12:28:33.591 INFO:tasks.workunit.client.0.smithi062.stderr: 2019-11-29T12:28:33.591 INFO:tasks.workunit.client.0.smithi062.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2019-11-29T12:28:33.591 INFO:tasks.workunit.client.0.smithi062.stderr:changes and commit them, and you can discard any commits you make in this 2019-11-29T12:28:33.591 INFO:tasks.workunit.client.0.smithi062.stderr:state without impacting any branches by performing another checkout. 2019-11-29T12:28:33.591 INFO:tasks.workunit.client.0.smithi062.stderr: 2019-11-29T12:28:33.592 INFO:tasks.workunit.client.0.smithi062.stderr:If you want to create a new branch to retain commits you create, you may 2019-11-29T12:28:33.592 INFO:tasks.workunit.client.0.smithi062.stderr:do so (now or later) by using -b with the checkout command again. Example: 2019-11-29T12:28:33.592 INFO:tasks.workunit.client.0.smithi062.stderr: 2019-11-29T12:28:33.592 INFO:tasks.workunit.client.0.smithi062.stderr: git checkout -b new_branch_name 2019-11-29T12:28:33.592 INFO:tasks.workunit.client.0.smithi062.stderr: 2019-11-29T12:28:33.593 INFO:tasks.workunit.client.0.smithi062.stderr:HEAD is now at 656c8e8... Merge pull request #31856 from rzarzynski/wip-crimson-errorator-handle_error 2019-11-29T12:28:33.594 INFO:teuthology.orchestra.run.smithi062:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2019-11-29T12:28:33.647 INFO:tasks.workunit.client.0.smithi062.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2019-11-29T12:28:33.649 INFO:tasks.workunit.client.0.smithi062.stdout:make[1]: Entering directory `/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2019-11-29T12:28:33.649 INFO:tasks.workunit.client.0.smithi062.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2019-11-29T12:28:34.114 INFO:tasks.workunit.client.0.smithi062.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2019-11-29T12:28:34.183 INFO:tasks.workunit.client.0.smithi062.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2019-11-29T12:28:34.216 INFO:tasks.workunit.client.0.smithi062.stdout:make[1]: Leaving directory `/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2019-11-29T12:28:34.217 INFO:tasks.workunit.client.0.smithi062.stdout:make[1]: Entering directory `/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2019-11-29T12:28:34.218 INFO:tasks.workunit.client.0.smithi062.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2019-11-29T12:28:34.250 INFO:tasks.workunit.client.0.smithi062.stdout:make[1]: Leaving directory `/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2019-11-29T12:28:34.298 DEBUG:teuthology.orchestra.remote:smithi062:/home/ubuntu/cephtest/workunits.list.client.0 is 4KB 2019-11-29T12:28:34.346 INFO:tasks.workunit:Running workunits matching cls/test_cls_lock.sh on client.0... 2019-11-29T12:28:34.346 INFO:tasks.workunit:Running workunit cls/test_cls_lock.sh... 2019-11-29T12:28:34.347 INFO:teuthology.orchestra.run.smithi062:workunit test cls/test_cls_lock.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=656c8e8049c2c1acd363143c842c2edf1fe09b64 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_lock.sh 2019-11-29T12:28:34.400 INFO:tasks.workunit.client.0.smithi062.stdout:Running main() from gmock_main.cc 2019-11-29T12:28:34.400 INFO:tasks.workunit.client.0.smithi062.stdout:[==========] Running 11 tests from 1 test suite. 2019-11-29T12:28:34.400 INFO:tasks.workunit.client.0.smithi062.stdout:[----------] Global test environment set-up. 2019-11-29T12:28:34.400 INFO:tasks.workunit.client.0.smithi062.stdout:[----------] 11 tests from ClsLock 2019-11-29T12:28:34.400 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] ClsLock.TestMultiLocking 2019-11-29T12:28:37.225 INFO:tasks.workunit.client.0.smithi062.stdout:lock: mylock 2019-11-29T12:28:37.226 INFO:tasks.workunit.client.0.smithi062.stdout: lock_type: exclusive 2019-11-29T12:28:37.226 INFO:tasks.workunit.client.0.smithi062.stdout: tag: 2019-11-29T12:28:37.226 INFO:tasks.workunit.client.0.smithi062.stdout: lockers: 2019-11-29T12:28:37.226 INFO:tasks.workunit.client.0.smithi062.stdout: client.4516 expiration=2019-11-29T12:30:36.815761+0000 addr=v1:172.21.15.62:0/2551795326 cookie= 2019-11-29T12:28:37.438 INFO:tasks.workunit.client.0.smithi062.stdout:lock: mylock 2019-11-29T12:28:37.439 INFO:tasks.workunit.client.0.smithi062.stdout: lock_type: shared 2019-11-29T12:28:37.439 INFO:tasks.workunit.client.0.smithi062.stdout: tag: 2019-11-29T12:28:37.439 INFO:tasks.workunit.client.0.smithi062.stdout: lockers: 2019-11-29T12:28:37.439 INFO:tasks.workunit.client.0.smithi062.stdout: client.4340 expiration=0.000000 addr=v1:172.21.15.62:0/661250812 cookie= 2019-11-29T12:28:37.439 INFO:tasks.workunit.client.0.smithi062.stdout: client.4516 expiration=2019-11-29T12:30:37.363268+0000 addr=v1:172.21.15.62:0/2551795326 cookie= 2019-11-29T12:28:37.621 INFO:tasks.workunit.client.0.smithi062.stdout:lock: mylock 2019-11-29T12:28:37.621 INFO:tasks.workunit.client.0.smithi062.stdout: lock_type: shared 2019-11-29T12:28:37.621 INFO:tasks.workunit.client.0.smithi062.stdout: tag: 2019-11-29T12:28:37.622 INFO:tasks.workunit.client.0.smithi062.stdout: lockers: 2019-11-29T12:28:37.622 INFO:tasks.workunit.client.0.smithi062.stdout: client.4340 expiration=0.000000 addr=v1:172.21.15.62:0/661250812 cookie= 2019-11-29T12:28:38.587 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] ClsLock.TestMultiLocking (4187 ms) 2019-11-29T12:28:38.587 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] ClsLock.TestMeta 2019-11-29T12:28:41.613 INFO:tasks.workunit.client.0.smithi062.stdout:lock: mylock 2019-11-29T12:28:41.613 INFO:tasks.workunit.client.0.smithi062.stdout: lock_type: shared 2019-11-29T12:28:41.613 INFO:tasks.workunit.client.0.smithi062.stdout: tag: 2019-11-29T12:28:41.613 INFO:tasks.workunit.client.0.smithi062.stdout: lockers: 2019-11-29T12:28:41.614 INFO:tasks.workunit.client.0.smithi062.stdout: client.4531 expiration=0.000000 addr=v1:172.21.15.62:0/594021269 cookie= 2019-11-29T12:28:41.695 INFO:tasks.workunit.client.0.smithi062.stdout:lock: mylock 2019-11-29T12:28:41.695 INFO:tasks.workunit.client.0.smithi062.stdout: lock_type: exclusive 2019-11-29T12:28:41.695 INFO:tasks.workunit.client.0.smithi062.stdout: tag: new_tag 2019-11-29T12:28:41.695 INFO:tasks.workunit.client.0.smithi062.stdout: lockers: 2019-11-29T12:28:41.696 INFO:tasks.workunit.client.0.smithi062.stdout: client.4525 expiration=0.000000 addr=v1:172.21.15.62:0/1149655072 cookie= 2019-11-29T12:28:42.216 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] ClsLock.TestMeta (3629 ms) 2019-11-29T12:28:42.216 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] ClsLock.TestCookie 2019-11-29T12:28:45.115 INFO:tasks.workunit.client.0.smithi062.stdout:lock: mylock 2019-11-29T12:28:45.115 INFO:tasks.workunit.client.0.smithi062.stdout: lock_type: exclusive 2019-11-29T12:28:45.115 INFO:tasks.workunit.client.0.smithi062.stdout: tag: 2019-11-29T12:28:45.115 INFO:tasks.workunit.client.0.smithi062.stdout: lockers: 2019-11-29T12:28:45.187 INFO:tasks.workunit.client.0.smithi062.stdout:lock: mylock 2019-11-29T12:28:45.188 INFO:tasks.workunit.client.0.smithi062.stdout: lock_type: shared 2019-11-29T12:28:45.188 INFO:tasks.workunit.client.0.smithi062.stdout: tag: 2019-11-29T12:28:45.188 INFO:tasks.workunit.client.0.smithi062.stdout: lockers: 2019-11-29T12:28:45.188 INFO:tasks.workunit.client.0.smithi062.stdout: client.4551 expiration=0.000000 addr=v1:172.21.15.62:0/4027284015 cookie= 2019-11-29T12:28:45.188 INFO:tasks.workunit.client.0.smithi062.stdout: client.4551 expiration=0.000000 addr=v1:172.21.15.62:0/4027284015 cookie=new cookie 2019-11-29T12:28:45.920 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] ClsLock.TestCookie (3705 ms) 2019-11-29T12:28:45.921 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] ClsLock.TestMultipleLocks 2019-11-29T12:28:49.385 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] ClsLock.TestMultipleLocks (3464 ms) 2019-11-29T12:28:49.385 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] ClsLock.TestLockDuration 2019-11-29T12:28:57.938 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] ClsLock.TestLockDuration (8550 ms) 2019-11-29T12:28:57.938 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] ClsLock.TestAssertLocked 2019-11-29T12:29:01.437 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] ClsLock.TestAssertLocked (3503 ms) 2019-11-29T12:29:01.438 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] ClsLock.TestSetCookie 2019-11-29T12:29:04.887 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] ClsLock.TestSetCookie (3447 ms) 2019-11-29T12:29:04.887 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] ClsLock.TestRenew 2019-11-29T12:29:27.133 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] ClsLock.TestRenew (22248 ms) 2019-11-29T12:29:27.133 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralBasic 2019-11-29T12:29:35.165 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] ClsLock.TestExclusiveEphemeralBasic (8033 ms) 2019-11-29T12:29:35.165 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealEphemeral 2019-11-29T12:29:43.378 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealEphemeral (8213 ms) 2019-11-29T12:29:43.378 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealExclusive 2019-11-29T12:29:51.923 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealExclusive (8545 ms) 2019-11-29T12:29:51.923 INFO:tasks.workunit.client.0.smithi062.stdout:[----------] 11 tests from ClsLock (77524 ms total) 2019-11-29T12:29:51.923 INFO:tasks.workunit.client.0.smithi062.stdout: 2019-11-29T12:29:51.923 INFO:tasks.workunit.client.0.smithi062.stdout:[----------] Global test environment tear-down 2019-11-29T12:29:51.923 INFO:tasks.workunit.client.0.smithi062.stdout:[==========] 11 tests from 1 test suite ran. (77524 ms total) 2019-11-29T12:29:51.924 INFO:tasks.workunit.client.0.smithi062.stdout:[ PASSED ] 11 tests. 2019-11-29T12:29:51.925 INFO:teuthology.orchestra.run:Running command with timeout 3600 2019-11-29T12:29:51.926 INFO:teuthology.orchestra.run.smithi062:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2019-11-29T12:29:52.108 INFO:tasks.workunit:Running workunits matching cls/test_cls_log.sh on client.0... 2019-11-29T12:29:52.109 INFO:tasks.workunit:Running workunit cls/test_cls_log.sh... 2019-11-29T12:29:52.109 INFO:teuthology.orchestra.run.smithi062:workunit test cls/test_cls_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=656c8e8049c2c1acd363143c842c2edf1fe09b64 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_log.sh 2019-11-29T12:29:52.169 INFO:tasks.workunit.client.0.smithi062.stdout:Running main() from gmock_main.cc 2019-11-29T12:29:52.169 INFO:tasks.workunit.client.0.smithi062.stdout:[==========] Running 4 tests from 1 test suite. 2019-11-29T12:29:52.169 INFO:tasks.workunit.client.0.smithi062.stdout:[----------] Global test environment set-up. 2019-11-29T12:29:52.170 INFO:tasks.workunit.client.0.smithi062.stdout:[----------] 4 tests from cls_log 2019-11-29T12:29:52.170 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] cls_log.test_log_add_same_time 2019-11-29T12:29:55.443 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] cls_log.test_log_add_same_time (3274 ms) 2019-11-29T12:29:55.443 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] cls_log.test_log_add_different_time 2019-11-29T12:29:59.569 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] cls_log.test_log_add_different_time (4126 ms) 2019-11-29T12:29:59.569 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] cls_log.trim_by_time 2019-11-29T12:30:04.361 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] cls_log.trim_by_time (4793 ms) 2019-11-29T12:30:04.362 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] cls_log.trim_by_marker 2019-11-29T12:30:09.106 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] cls_log.trim_by_marker (4744 ms) 2019-11-29T12:30:09.106 INFO:tasks.workunit.client.0.smithi062.stdout:[----------] 4 tests from cls_log (16937 ms total) 2019-11-29T12:30:09.106 INFO:tasks.workunit.client.0.smithi062.stdout: 2019-11-29T12:30:09.106 INFO:tasks.workunit.client.0.smithi062.stdout:[----------] Global test environment tear-down 2019-11-29T12:30:09.106 INFO:tasks.workunit.client.0.smithi062.stdout:[==========] 4 tests from 1 test suite ran. (16937 ms total) 2019-11-29T12:30:09.107 INFO:tasks.workunit.client.0.smithi062.stdout:[ PASSED ] 4 tests. 2019-11-29T12:30:09.108 INFO:teuthology.orchestra.run:Running command with timeout 3600 2019-11-29T12:30:09.108 INFO:teuthology.orchestra.run.smithi062:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2019-11-29T12:30:09.228 INFO:tasks.workunit:Running workunits matching cls/test_cls_refcount.sh on client.0... 2019-11-29T12:30:09.228 INFO:tasks.workunit:Running workunit cls/test_cls_refcount.sh... 2019-11-29T12:30:09.229 INFO:teuthology.orchestra.run.smithi062:workunit test cls/test_cls_refcount.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=656c8e8049c2c1acd363143c842c2edf1fe09b64 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_refcount.sh 2019-11-29T12:30:09.310 INFO:tasks.workunit.client.0.smithi062.stdout:Running main() from gmock_main.cc 2019-11-29T12:30:09.310 INFO:tasks.workunit.client.0.smithi062.stdout:[==========] Running 5 tests from 1 test suite. 2019-11-29T12:30:09.310 INFO:tasks.workunit.client.0.smithi062.stdout:[----------] Global test environment set-up. 2019-11-29T12:30:09.310 INFO:tasks.workunit.client.0.smithi062.stdout:[----------] 5 tests from cls_rgw 2019-11-29T12:30:09.311 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] cls_rgw.test_implicit 2019-11-29T12:30:12.522 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] cls_rgw.test_implicit (3212 ms) 2019-11-29T12:30:12.523 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] cls_rgw.test_implicit_idempotent 2019-11-29T12:30:17.118 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] cls_rgw.test_implicit_idempotent (4588 ms) 2019-11-29T12:30:17.119 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] cls_rgw.test_put_snap 2019-11-29T12:30:25.687 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T12:30:25.639+0000 38791700 -1 osd.5 pg_epoch: 104 pg[25.6( v 103'4 (0'0,103'4] local-lis/les=100/101 n=2 ec=100/100 lis/c=100/100 les/c/f=101/101/0 sis=100) [5,1] r=0 lpr=100 crt=102'3 lcod 102'3 mlcod 102'3 active+clean+snaptrim trimq=[1~1]] removing snap head 2019-11-29T12:30:27.044 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] cls_rgw.test_put_snap (9935 ms) 2019-11-29T12:30:27.044 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] cls_rgw.test_explicit 2019-11-29T12:30:30.758 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] cls_rgw.test_explicit (3713 ms) 2019-11-29T12:30:30.758 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] cls_rgw.set 2019-11-29T12:30:34.282 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] cls_rgw.set (3524 ms) 2019-11-29T12:30:34.282 INFO:tasks.workunit.client.0.smithi062.stdout:[----------] 5 tests from cls_rgw (24972 ms total) 2019-11-29T12:30:34.282 INFO:tasks.workunit.client.0.smithi062.stdout: 2019-11-29T12:30:34.282 INFO:tasks.workunit.client.0.smithi062.stdout:[----------] Global test environment tear-down 2019-11-29T12:30:34.282 INFO:tasks.workunit.client.0.smithi062.stdout:[==========] 5 tests from 1 test suite ran. (24972 ms total) 2019-11-29T12:30:34.282 INFO:tasks.workunit.client.0.smithi062.stdout:[ PASSED ] 5 tests. 2019-11-29T12:30:34.284 INFO:teuthology.orchestra.run:Running command with timeout 3600 2019-11-29T12:30:34.284 INFO:teuthology.orchestra.run.smithi062:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2019-11-29T12:30:34.403 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw.sh on client.0... 2019-11-29T12:30:34.403 INFO:tasks.workunit:Running workunit cls/test_cls_rgw.sh... 2019-11-29T12:30:34.403 INFO:teuthology.orchestra.run.smithi062:workunit test cls/test_cls_rgw.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=656c8e8049c2c1acd363143c842c2edf1fe09b64 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw.sh 2019-11-29T12:30:34.465 INFO:tasks.workunit.client.0.smithi062.stdout:Running main() from gmock_main.cc 2019-11-29T12:30:34.465 INFO:tasks.workunit.client.0.smithi062.stdout:[==========] Running 13 tests from 1 test suite. 2019-11-29T12:30:34.465 INFO:tasks.workunit.client.0.smithi062.stdout:[----------] Global test environment set-up. 2019-11-29T12:30:34.466 INFO:tasks.workunit.client.0.smithi062.stdout:[----------] 13 tests from cls_rgw 2019-11-29T12:30:36.723 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] cls_rgw.index_basic 2019-11-29T12:30:38.133 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] cls_rgw.index_basic (1411 ms) 2019-11-29T12:30:38.134 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] cls_rgw.index_multiple_obj_writers 2019-11-29T12:30:39.942 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] cls_rgw.index_multiple_obj_writers (1808 ms) 2019-11-29T12:30:39.942 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] cls_rgw.index_remove_object 2019-11-29T12:30:42.223 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] cls_rgw.index_remove_object (2282 ms) 2019-11-29T12:30:42.224 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] cls_rgw.index_suggest 2019-11-29T12:31:12.816 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] cls_rgw.index_suggest (30593 ms) 2019-11-29T12:31:12.816 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] cls_rgw.index_list 2019-11-29T12:31:14.439 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] cls_rgw.index_list (1623 ms) 2019-11-29T12:31:14.439 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] cls_rgw.bi_list 2019-11-29T12:31:17.689 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] cls_rgw.bi_list (3250 ms) 2019-11-29T12:31:17.689 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] cls_rgw.gc_set 2019-11-29T12:31:18.453 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] cls_rgw.gc_set (764 ms) 2019-11-29T12:31:18.454 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] cls_rgw.gc_list 2019-11-29T12:31:19.228 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] cls_rgw.gc_list (775 ms) 2019-11-29T12:31:19.229 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] cls_rgw.gc_defer 2019-11-29T12:31:27.238 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] cls_rgw.gc_defer (8011 ms) 2019-11-29T12:31:27.239 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] cls_rgw.usage_basic 2019-11-29T12:31:35.459 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] cls_rgw.usage_basic (8220 ms) 2019-11-29T12:31:35.459 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] cls_rgw.usage_clear_no_obj 2019-11-29T12:31:35.496 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] cls_rgw.usage_clear_no_obj (37 ms) 2019-11-29T12:31:35.496 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] cls_rgw.usage_clear 2019-11-29T12:31:47.613 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] cls_rgw.usage_clear (12118 ms) 2019-11-29T12:31:47.614 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] cls_rgw.bi_log_trim 2019-11-29T12:31:50.161 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] cls_rgw.bi_log_trim (2547 ms) 2019-11-29T12:31:51.283 INFO:tasks.workunit.client.0.smithi062.stdout:[----------] 13 tests from cls_rgw (73439 ms total) 2019-11-29T12:31:51.283 INFO:tasks.workunit.client.0.smithi062.stdout: 2019-11-29T12:31:51.284 INFO:tasks.workunit.client.0.smithi062.stdout:[----------] Global test environment tear-down 2019-11-29T12:31:51.284 INFO:tasks.workunit.client.0.smithi062.stdout:[==========] 13 tests from 1 test suite ran. (76818 ms total) 2019-11-29T12:31:51.284 INFO:tasks.workunit.client.0.smithi062.stdout:[ PASSED ] 13 tests. 2019-11-29T12:31:51.286 INFO:teuthology.orchestra.run:Running command with timeout 3600 2019-11-29T12:31:51.286 INFO:teuthology.orchestra.run.smithi062:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2019-11-29T12:31:51.405 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_gc_log.sh on client.0... 2019-11-29T12:31:51.406 INFO:tasks.workunit:Running workunit rgw/test_rgw_gc_log.sh... 2019-11-29T12:31:51.406 INFO:teuthology.orchestra.run.smithi062:workunit test rgw/test_rgw_gc_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=656c8e8049c2c1acd363143c842c2edf1fe09b64 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_gc_log.sh 2019-11-29T12:31:51.480 INFO:tasks.workunit.client.0.smithi062.stdout:[==========] Running 6 tests from 1 test suite. 2019-11-29T12:31:51.480 INFO:tasks.workunit.client.0.smithi062.stdout:[----------] Global test environment set-up. 2019-11-29T12:31:53.634 INFO:tasks.workunit.client.0.smithi062.stdout:[----------] 6 tests from rgw_gc_log 2019-11-29T12:31:53.634 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] rgw_gc_log.init_existing_queue 2019-11-29T12:31:54.010 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] rgw_gc_log.init_existing_queue (376 ms) 2019-11-29T12:31:54.010 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] rgw_gc_log.init_existing_omap 2019-11-29T12:31:54.194 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] rgw_gc_log.init_existing_omap (185 ms) 2019-11-29T12:31:54.195 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] rgw_gc_log.enqueue1_after_init 2019-11-29T12:31:54.300 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] rgw_gc_log.enqueue1_after_init (105 ms) 2019-11-29T12:31:54.300 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] rgw_gc_log.enqueue2_before_init 2019-11-29T12:31:54.351 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] rgw_gc_log.enqueue2_before_init (52 ms) 2019-11-29T12:31:54.352 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] rgw_gc_log.defer1_after_init 2019-11-29T12:31:54.442 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] rgw_gc_log.defer1_after_init (90 ms) 2019-11-29T12:31:54.442 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] rgw_gc_log.defer2_before_init 2019-11-29T12:31:54.507 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] rgw_gc_log.defer2_before_init (65 ms) 2019-11-29T12:31:54.507 INFO:tasks.workunit.client.0.smithi062.stdout:[----------] 6 tests from rgw_gc_log (873 ms total) 2019-11-29T12:31:54.507 INFO:tasks.workunit.client.0.smithi062.stdout: 2019-11-29T12:31:54.508 INFO:tasks.workunit.client.0.smithi062.stdout:[----------] Global test environment tear-down 2019-11-29T12:31:54.685 INFO:tasks.workunit.client.0.smithi062.stdout:[==========] 6 tests from 1 test suite ran. (3206 ms total) 2019-11-29T12:31:54.685 INFO:tasks.workunit.client.0.smithi062.stdout:[ PASSED ] 6 tests. 2019-11-29T12:31:54.688 INFO:teuthology.orchestra.run:Running command with timeout 3600 2019-11-29T12:31:54.688 INFO:teuthology.orchestra.run.smithi062:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2019-11-29T12:31:54.757 INFO:tasks.workunit:Stopping ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'rgw/test_rgw_gc_log.sh'] on client.0... 2019-11-29T12:31:54.757 INFO:teuthology.orchestra.run.smithi062:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2019-11-29T12:31:55.008 DEBUG:teuthology.parallel:result is None 2019-11-29T12:31:55.008 INFO:teuthology.orchestra.run.smithi062:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2019-11-29T12:31:55.063 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2019-11-29T12:31:55.063 INFO:teuthology.orchestra.run.smithi062:> rmdir -- /home/ubuntu/cephtest/mnt.0 2019-11-29T12:31:55.127 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2019-11-29T12:31:55.127 INFO:teuthology.run_tasks:Running task ragweed... 2019-11-29T12:31:55.149 DEBUG:tasks.ragweed:ragweed config is {'client.0': {'rgw_server': 'client.0', 'stages': 'prepare,check', 'default-branch': 'ceph-master'}} 2019-11-29T12:31:55.149 INFO:tasks.ragweed:Downloading ragweed... 2019-11-29T12:31:55.149 INFO:tasks.ragweed:Using branch 'wip-yuval-master' for ragweed 2019-11-29T12:31:55.150 INFO:teuthology.orchestra.run.smithi062:> git clone -b wip-yuval-master git://git.ceph.com/git/ragweed.git /home/ubuntu/cephtest/ragweed 2019-11-29T12:31:55.218 INFO:teuthology.orchestra.run.smithi062.stderr:fatal: Remote branch wip-yuval-master not found in upstream origin 2019-11-29T12:31:55.218 INFO:teuthology.orchestra.run.smithi062.stdout:Cloning into '/home/ubuntu/cephtest/ragweed'... 2019-11-29T12:31:55.218 DEBUG:teuthology.orchestra.run:got remote process result: 128 2019-11-29T12:31:55.218 INFO:teuthology.orchestra.run.smithi062:> git clone -b ceph-master git://git.ceph.com/git/ragweed.git /home/ubuntu/cephtest/ragweed 2019-11-29T12:31:55.315 INFO:teuthology.orchestra.run.smithi062.stdout:Cloning into '/home/ubuntu/cephtest/ragweed'... 2019-11-29T12:31:55.430 INFO:tasks.ragweed:Creating rgw users... 2019-11-29T12:31:55.430 DEBUG:tasks.ragweed:Creating user sysuser.client.0 on client.0 2019-11-29T12:31:55.430 INFO:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid sysuser.client.0 --display-name 'Mr. sysuser.client.0' --access-key JAXGYKNYMQMBDWLJMPFG --secret cDdFfhJsioC731qM8Dtx2koS2dLAHZDzfeqVviTNhcR7/+HoBnJIng== --email sysuser.client.0+test@test.test --system true 2019-11-29T12:31:55.566 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:31:55.570+0000 7faf64b3eec0 20 rados->read ofs=0 len=0 2019-11-29T12:31:55.770 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:31:55.774+0000 7faf64b3eec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T12:31:55.770 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:31:55.774+0000 7faf64b3eec0 20 rados->read ofs=0 len=0 2019-11-29T12:31:55.805 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:31:55.809+0000 7faf64b3eec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T12:31:55.805 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:31:55.809+0000 7faf64b3eec0 20 rados->read ofs=0 len=0 2019-11-29T12:31:55.817 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:31:55.822+0000 7faf64b3eec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T12:31:55.818 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:31:55.822+0000 7faf64b3eec0 20 rados->read ofs=0 len=0 2019-11-29T12:31:55.853 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:31:55.858+0000 7faf64b3eec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T12:31:56.096 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:31:56.100+0000 7faf64b3eec0 20 RGWRados::pool_iterate: got zone_info.7f922895-c6d7-4b1b-a19c-be3df5b5a899 2019-11-29T12:31:56.096 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:31:56.100+0000 7faf64b3eec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-29T12:31:56.097 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:31:56.100+0000 7faf64b3eec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-29T12:31:56.097 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:31:56.100+0000 7faf64b3eec0 20 RGWRados::pool_iterate: got zonegroup_info.76ba47ff-1c23-4409-aae0-24fe26589cae 2019-11-29T12:31:56.097 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:31:56.100+0000 7faf64b3eec0 20 rados->read ofs=0 len=0 2019-11-29T12:31:56.115 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:31:56.119+0000 7faf64b3eec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T12:31:56.115 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:31:56.120+0000 7faf64b3eec0 20 rados->read ofs=0 len=0 2019-11-29T12:31:56.132 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:31:56.137+0000 7faf64b3eec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-29T12:31:56.133 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:31:56.137+0000 7faf64b3eec0 20 rados->read ofs=0 len=0 2019-11-29T12:31:56.149 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:31:56.154+0000 7faf64b3eec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T12:31:56.150 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:31:56.154+0000 7faf64b3eec0 20 rados->read ofs=0 len=0 2019-11-29T12:31:56.166 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:31:56.171+0000 7faf64b3eec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-29T12:31:56.167 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:31:56.171+0000 7faf64b3eec0 20 rados->read ofs=0 len=0 2019-11-29T12:31:56.180 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:31:56.184+0000 7faf64b3eec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T12:31:56.180 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:31:56.184+0000 7faf64b3eec0 10 cannot find current period zonegroup using local zonegroup 2019-11-29T12:31:56.180 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:31:56.184+0000 7faf64b3eec0 20 rados->read ofs=0 len=0 2019-11-29T12:31:56.190 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:31:56.195+0000 7faf64b3eec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T12:31:56.190 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:31:56.195+0000 7faf64b3eec0 20 rados->read ofs=0 len=0 2019-11-29T12:31:56.203 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:31:56.207+0000 7faf64b3eec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T12:31:56.203 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:31:56.207+0000 7faf64b3eec0 20 rados->read ofs=0 len=0 2019-11-29T12:31:56.220 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:31:56.225+0000 7faf64b3eec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-29T12:31:56.221 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:31:56.225+0000 7faf64b3eec0 20 zonegroup default 2019-11-29T12:31:56.221 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:31:56.225+0000 7faf64b3eec0 20 rados->read ofs=0 len=0 2019-11-29T12:31:56.231 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:31:56.235+0000 7faf64b3eec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T12:31:56.231 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:31:56.235+0000 7faf64b3eec0 10 Cannot find current period zone using local zone 2019-11-29T12:31:56.231 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:31:56.235+0000 7faf64b3eec0 20 rados->read ofs=0 len=0 2019-11-29T12:31:56.239 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:31:56.243+0000 7faf64b3eec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T12:31:56.239 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:31:56.243+0000 7faf64b3eec0 20 rados->read ofs=0 len=0 2019-11-29T12:31:56.256 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:31:56.256+0000 7faf64b3eec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T12:31:56.256 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:31:56.256+0000 7faf64b3eec0 20 rados->read ofs=0 len=0 2019-11-29T12:31:56.265 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:31:56.269+0000 7faf64b3eec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-29T12:31:56.265 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:31:56.269+0000 7faf64b3eec0 20 zone default found 2019-11-29T12:31:56.265 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:31:56.269+0000 7faf64b3eec0 20 started sync module instance, tier type = 2019-11-29T12:31:56.265 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:31:56.269+0000 7faf64b3eec0 20 started zone id=7f922895-c6d7-4b1b-a19c-be3df5b5a899 (name=default) with tier type = 2019-11-29T12:31:56.647 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:31:56.651+0000 7faf64b3eec0 20 add_watcher() i=0 2019-11-29T12:31:56.647 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:31:56.651+0000 7faf64b3eec0 20 add_watcher() i=1 2019-11-29T12:31:56.647 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:31:56.651+0000 7faf64b3eec0 20 add_watcher() i=2 2019-11-29T12:31:56.647 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:31:56.651+0000 7faf64b3eec0 20 add_watcher() i=3 2019-11-29T12:31:56.647 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:31:56.651+0000 7faf64b3eec0 20 add_watcher() i=4 2019-11-29T12:31:56.647 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:31:56.651+0000 7faf64b3eec0 20 add_watcher() i=5 2019-11-29T12:31:56.648 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:31:56.651+0000 7faf64b3eec0 20 add_watcher() i=6 2019-11-29T12:31:56.680 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:31:56.685+0000 7faf64b3eec0 20 add_watcher() i=7 2019-11-29T12:31:56.681 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:31:56.685+0000 7faf64b3eec0 2 all 8 watchers are set, enabling cache 2019-11-29T12:31:56.681 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:31:56.685+0000 7faf227dc700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-29T12:31:56.687 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:31:56.692+0000 7faf51d6b700 0 -- 172.21.15.62:0/471558947 >> v2:172.21.15.62:3300/0 conn(0x557ced75cd00 msgr2=0x557ced7633c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2019-11-29T12:31:56.714 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:31:56.718+0000 7faf4bfff700 0 -- 172.21.15.62:0/2172051294 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fae94007e90 msgr2=0x7fae9400a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-29T12:31:56.916 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:31:56.920+0000 7faf4bfff700 0 --2- 172.21.15.62:0/2172051294 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fae94007e90 0x7fae9400a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2019-11-29T12:31:58.473 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:31:58.477+0000 7fae98ff9700 20 reqs_thread_entry: start 2019-11-29T12:31:58.474 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:31:58.478+0000 7fae927fc700 20 reqs_thread_entry: start 2019-11-29T12:31:58.474 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:31:58.478+0000 7faf64b3eec0 20 init_complete bucket index max shards: 0 2019-11-29T12:31:58.474 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:31:58.478+0000 7fae90ff9700 20 reqs_thread_entry: start 2019-11-29T12:31:58.474 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:31:58.478+0000 7faf64b3eec0 20 get_system_obj_state: rctx=0x7fff0568fe18 obj=default.rgw.meta:users.uid:sysuser.client.0 state=0x557ced7d5060 s->prefetch_data=0 2019-11-29T12:31:58.475 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:31:58.478+0000 7faf64b3eec0 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2019-11-29T12:31:58.500 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:31:58.505+0000 7faf64b3eec0 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x0 2019-11-29T12:31:58.501 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:31:58.505+0000 7faf64b3eec0 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2019-11-29T12:31:58.501 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:31:58.505+0000 7faf64b3eec0 20 get_system_obj_state: rctx=0x7fff0568fe28 obj=default.rgw.meta:users.email:sysuser.client.0+test@test.test state=0x557ced7d6df0 s->prefetch_data=0 2019-11-29T12:31:58.501 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:31:58.505+0000 7faf64b3eec0 10 cache get: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test : miss 2019-11-29T12:31:58.508 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:31:58.512+0000 7faf64b3eec0 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x0 2019-11-29T12:31:58.508 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:31:58.512+0000 7faf64b3eec0 10 adding default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2019-11-29T12:31:58.508 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:31:58.512+0000 7faf64b3eec0 20 get_system_obj_state: rctx=0x7fff0568fe28 obj=default.rgw.meta:users.keys:JAXGYKNYMQMBDWLJMPFG state=0x557ced7d6df0 s->prefetch_data=0 2019-11-29T12:31:58.508 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:31:58.512+0000 7faf64b3eec0 10 cache get: name=default.rgw.meta+users.keys+JAXGYKNYMQMBDWLJMPFG : miss 2019-11-29T12:31:58.517 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:31:58.522+0000 7faf64b3eec0 10 cache put: name=default.rgw.meta+users.keys+JAXGYKNYMQMBDWLJMPFG info.flags=0x0 2019-11-29T12:31:58.518 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:31:58.522+0000 7faf64b3eec0 10 adding default.rgw.meta+users.keys+JAXGYKNYMQMBDWLJMPFG to cache LRU end 2019-11-29T12:31:58.518 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:31:58.522+0000 7faf64b3eec0 20 get_system_obj_state: rctx=0x7fff0568fa38 obj=default.rgw.meta:users.keys:JAXGYKNYMQMBDWLJMPFG state=0x557ced7d6df0 s->prefetch_data=0 2019-11-29T12:31:58.518 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:31:58.522+0000 7faf64b3eec0 10 cache get: name=default.rgw.meta+users.keys+JAXGYKNYMQMBDWLJMPFG : type miss (requested=0x6, cached=0x0) 2019-11-29T12:31:58.524 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:31:58.529+0000 7faf64b3eec0 10 cache put: name=default.rgw.meta+users.keys+JAXGYKNYMQMBDWLJMPFG info.flags=0x0 2019-11-29T12:31:58.524 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:31:58.529+0000 7faf64b3eec0 10 moving default.rgw.meta+users.keys+JAXGYKNYMQMBDWLJMPFG to cache LRU end 2019-11-29T12:31:58.524 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:31:58.529+0000 7faf64b3eec0 20 get_system_obj_state: rctx=0x7fff0568fbb8 obj=default.rgw.meta:users.keys:JAXGYKNYMQMBDWLJMPFG state=0x557ced7d6df0 s->prefetch_data=0 2019-11-29T12:31:58.525 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:31:58.529+0000 7faf64b3eec0 10 cache get: name=default.rgw.meta+users.keys+JAXGYKNYMQMBDWLJMPFG : type miss (requested=0x6, cached=0x0) 2019-11-29T12:31:58.534 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:31:58.538+0000 7faf64b3eec0 10 cache put: name=default.rgw.meta+users.keys+JAXGYKNYMQMBDWLJMPFG info.flags=0x0 2019-11-29T12:31:58.534 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:31:58.538+0000 7faf64b3eec0 10 moving default.rgw.meta+users.keys+JAXGYKNYMQMBDWLJMPFG to cache LRU end 2019-11-29T12:31:58.635 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:31:58.640+0000 7faf64b3eec0 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2019-11-29T12:31:58.636 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:31:58.640+0000 7faf64b3eec0 10 moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2019-11-29T12:31:58.636 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:31:58.640+0000 7faf64b3eec0 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=637 2019-11-29T12:31:58.688 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:31:58.693+0000 7faf32ffd700 10 RGWWatcher::handle_notify() notify_id 528280977408 cookie 93995048164240 notifier 4430 bl.length()=637 2019-11-29T12:31:58.689 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:31:58.693+0000 7faf32ffd700 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2019-11-29T12:31:58.689 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:31:58.693+0000 7faf32ffd700 10 moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2019-11-29T12:31:59.098 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:31:59.103+0000 7faf64b3eec0 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2019-11-29T12:31:59.099 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:31:59.103+0000 7faf64b3eec0 10 moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2019-11-29T12:31:59.099 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:31:59.103+0000 7faf64b3eec0 10 distributing notification oid=default.rgw.control:notify.4 bl.length()=202 2019-11-29T12:31:59.119 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:31:59.123+0000 7faf32ffd700 10 RGWWatcher::handle_notify() notify_id 528280977409 cookie 93995048167056 notifier 4430 bl.length()=202 2019-11-29T12:31:59.119 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:31:59.123+0000 7faf32ffd700 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2019-11-29T12:31:59.119 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:31:59.123+0000 7faf32ffd700 10 moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2019-11-29T12:31:59.582 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:31:59.587+0000 7faf64b3eec0 10 cache put: name=default.rgw.meta+users.keys+JAXGYKNYMQMBDWLJMPFG info.flags=0x7 2019-11-29T12:31:59.583 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:31:59.587+0000 7faf64b3eec0 10 moving default.rgw.meta+users.keys+JAXGYKNYMQMBDWLJMPFG to cache LRU end 2019-11-29T12:31:59.583 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:31:59.587+0000 7faf64b3eec0 10 distributing notification oid=default.rgw.control:notify.3 bl.length()=190 2019-11-29T12:31:59.611 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:31:59.615+0000 7faf32ffd700 10 RGWWatcher::handle_notify() notify_id 528280977408 cookie 93995048165088 notifier 4430 bl.length()=190 2019-11-29T12:31:59.611 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:31:59.615+0000 7faf32ffd700 10 cache put: name=default.rgw.meta+users.keys+JAXGYKNYMQMBDWLJMPFG info.flags=0x7 2019-11-29T12:31:59.611 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:31:59.615+0000 7faf32ffd700 10 moving default.rgw.meta+users.keys+JAXGYKNYMQMBDWLJMPFG to cache LRU end 2019-11-29T12:31:59.664 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2019-11-29T12:31:59.665 INFO:teuthology.orchestra.run.smithi062.stdout: "user_id": "sysuser.client.0", 2019-11-29T12:31:59.665 INFO:teuthology.orchestra.run.smithi062.stdout: "display_name": "Mr. sysuser.client.0", 2019-11-29T12:31:59.665 INFO:teuthology.orchestra.run.smithi062.stdout: "email": "sysuser.client.0+test@test.test", 2019-11-29T12:31:59.665 INFO:teuthology.orchestra.run.smithi062.stdout: "suspended": 0, 2019-11-29T12:31:59.665 INFO:teuthology.orchestra.run.smithi062.stdout: "max_buckets": 1000, 2019-11-29T12:31:59.666 INFO:teuthology.orchestra.run.smithi062.stdout: "subusers": [], 2019-11-29T12:31:59.666 INFO:teuthology.orchestra.run.smithi062.stdout: "keys": [ 2019-11-29T12:31:59.666 INFO:teuthology.orchestra.run.smithi062.stdout: { 2019-11-29T12:31:59.666 INFO:teuthology.orchestra.run.smithi062.stdout: "user": "sysuser.client.0", 2019-11-29T12:31:59.666 INFO:teuthology.orchestra.run.smithi062.stdout: "access_key": "JAXGYKNYMQMBDWLJMPFG", 2019-11-29T12:31:59.666 INFO:teuthology.orchestra.run.smithi062.stdout: "secret_key": "cDdFfhJsioC731qM8Dtx2koS2dLAHZDzfeqVviTNhcR7/+HoBnJIng==" 2019-11-29T12:31:59.666 INFO:teuthology.orchestra.run.smithi062.stdout: } 2019-11-29T12:31:59.667 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2019-11-29T12:31:59.667 INFO:teuthology.orchestra.run.smithi062.stdout: "swift_keys": [], 2019-11-29T12:31:59.667 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": [], 2019-11-29T12:31:59.667 INFO:teuthology.orchestra.run.smithi062.stdout: "op_mask": "read, write, delete", 2019-11-29T12:31:59.667 INFO:teuthology.orchestra.run.smithi062.stdout: "system": "true", 2019-11-29T12:31:59.667 INFO:teuthology.orchestra.run.smithi062.stdout: "default_placement": "", 2019-11-29T12:31:59.667 INFO:teuthology.orchestra.run.smithi062.stdout: "default_storage_class": "", 2019-11-29T12:31:59.668 INFO:teuthology.orchestra.run.smithi062.stdout: "placement_tags": [], 2019-11-29T12:31:59.668 INFO:teuthology.orchestra.run.smithi062.stdout: "bucket_quota": { 2019-11-29T12:31:59.668 INFO:teuthology.orchestra.run.smithi062.stdout: "enabled": false, 2019-11-29T12:31:59.668 INFO:teuthology.orchestra.run.smithi062.stdout: "check_on_raw": false, 2019-11-29T12:31:59.668 INFO:teuthology.orchestra.run.smithi062.stdout: "max_size": -1, 2019-11-29T12:31:59.668 INFO:teuthology.orchestra.run.smithi062.stdout: "max_size_kb": 0, 2019-11-29T12:31:59.668 INFO:teuthology.orchestra.run.smithi062.stdout: "max_objects": -1 2019-11-29T12:31:59.669 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2019-11-29T12:31:59.669 INFO:teuthology.orchestra.run.smithi062.stdout: "user_quota": { 2019-11-29T12:31:59.669 INFO:teuthology.orchestra.run.smithi062.stdout: "enabled": false, 2019-11-29T12:31:59.669 INFO:teuthology.orchestra.run.smithi062.stdout: "check_on_raw": false, 2019-11-29T12:31:59.669 INFO:teuthology.orchestra.run.smithi062.stdout: "max_size": -1, 2019-11-29T12:31:59.669 INFO:teuthology.orchestra.run.smithi062.stdout: "max_size_kb": 0, 2019-11-29T12:31:59.669 INFO:teuthology.orchestra.run.smithi062.stdout: "max_objects": -1 2019-11-29T12:31:59.669 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2019-11-29T12:31:59.670 INFO:teuthology.orchestra.run.smithi062.stdout: "temp_url_keys": [], 2019-11-29T12:31:59.670 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "rgw", 2019-11-29T12:31:59.670 INFO:teuthology.orchestra.run.smithi062.stdout: "mfa_ids": [] 2019-11-29T12:31:59.670 INFO:teuthology.orchestra.run.smithi062.stdout:} 2019-11-29T12:31:59.670 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:31:59.712 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:31:59.716+0000 7faf64b3eec0 20 remove_watcher() i=0 2019-11-29T12:31:59.713 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:31:59.716+0000 7faf64b3eec0 2 removed watcher, disabling cache 2019-11-29T12:31:59.773 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:31:59.777+0000 7faf64b3eec0 20 remove_watcher() i=1 2019-11-29T12:31:59.845 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:31:59.850+0000 7faf64b3eec0 20 remove_watcher() i=2 2019-11-29T12:31:59.911 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:31:59.915+0000 7faf64b3eec0 20 remove_watcher() i=3 2019-11-29T12:31:59.968 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:31:59.972+0000 7faf64b3eec0 20 remove_watcher() i=4 2019-11-29T12:32:00.016 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:32:00.020+0000 7faf64b3eec0 20 remove_watcher() i=5 2019-11-29T12:32:00.070 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:32:00.074+0000 7faf64b3eec0 20 remove_watcher() i=6 2019-11-29T12:32:00.113 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:32:00.117+0000 7faf64b3eec0 20 remove_watcher() i=7 2019-11-29T12:32:00.120 DEBUG:tasks.ragweed:Creating user ragweed.client.0 on client.0 2019-11-29T12:32:00.121 INFO:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid ragweed.client.0 --display-name 'Mr. ragweed.client.0' --access-key INJMFBCBSYLUQCKOTIHA --secret NsTn2fndpTEHNvz1E8dE0FmJU7FRhNkDyLwrTp2jffvYxN/R869m/g== --email ragweed.client.0+test@test.test --system false 2019-11-29T12:32:00.248 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:32:00.253+0000 7f8685e51ec0 20 rados->read ofs=0 len=0 2019-11-29T12:32:00.284 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:32:00.288+0000 7f8685e51ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T12:32:00.284 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:32:00.288+0000 7f8685e51ec0 20 rados->read ofs=0 len=0 2019-11-29T12:32:00.291 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:32:00.296+0000 7f8685e51ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T12:32:00.292 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:32:00.296+0000 7f8685e51ec0 20 rados->read ofs=0 len=0 2019-11-29T12:32:00.299 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:32:00.303+0000 7f8685e51ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T12:32:00.299 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:32:00.303+0000 7f8685e51ec0 20 rados->read ofs=0 len=0 2019-11-29T12:32:00.315 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:32:00.320+0000 7f8685e51ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T12:32:00.515 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:32:00.519+0000 7f8685e51ec0 20 RGWRados::pool_iterate: got zone_info.7f922895-c6d7-4b1b-a19c-be3df5b5a899 2019-11-29T12:32:00.515 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:32:00.519+0000 7f8685e51ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-29T12:32:00.515 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:32:00.519+0000 7f8685e51ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-29T12:32:00.515 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:32:00.519+0000 7f8685e51ec0 20 RGWRados::pool_iterate: got zonegroup_info.76ba47ff-1c23-4409-aae0-24fe26589cae 2019-11-29T12:32:00.515 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:32:00.519+0000 7f8685e51ec0 20 rados->read ofs=0 len=0 2019-11-29T12:32:00.524 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:32:00.529+0000 7f8685e51ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T12:32:00.524 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:32:00.529+0000 7f8685e51ec0 20 rados->read ofs=0 len=0 2019-11-29T12:32:00.537 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:32:00.542+0000 7f8685e51ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-29T12:32:00.538 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:32:00.542+0000 7f8685e51ec0 20 rados->read ofs=0 len=0 2019-11-29T12:32:00.547 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:32:00.552+0000 7f8685e51ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T12:32:00.547 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:32:00.552+0000 7f8685e51ec0 20 rados->read ofs=0 len=0 2019-11-29T12:32:00.557 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:32:00.561+0000 7f8685e51ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-29T12:32:00.557 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:32:00.561+0000 7f8685e51ec0 20 rados->read ofs=0 len=0 2019-11-29T12:32:00.563 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:32:00.567+0000 7f8685e51ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T12:32:00.563 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:32:00.567+0000 7f8685e51ec0 10 cannot find current period zonegroup using local zonegroup 2019-11-29T12:32:00.563 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:32:00.567+0000 7f8685e51ec0 20 rados->read ofs=0 len=0 2019-11-29T12:32:00.569 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:32:00.573+0000 7f8685e51ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T12:32:00.569 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:32:00.573+0000 7f8685e51ec0 20 rados->read ofs=0 len=0 2019-11-29T12:32:00.577 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:32:00.581+0000 7f8685e51ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T12:32:00.577 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:32:00.581+0000 7f8685e51ec0 20 rados->read ofs=0 len=0 2019-11-29T12:32:00.584 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:32:00.589+0000 7f8685e51ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-29T12:32:00.585 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:32:00.589+0000 7f8685e51ec0 20 zonegroup default 2019-11-29T12:32:00.585 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:32:00.589+0000 7f8685e51ec0 20 rados->read ofs=0 len=0 2019-11-29T12:32:00.591 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:32:00.595+0000 7f8685e51ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T12:32:00.591 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:32:00.595+0000 7f8685e51ec0 10 Cannot find current period zone using local zone 2019-11-29T12:32:00.591 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:32:00.595+0000 7f8685e51ec0 20 rados->read ofs=0 len=0 2019-11-29T12:32:00.598 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:32:00.603+0000 7f8685e51ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T12:32:00.598 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:32:00.603+0000 7f8685e51ec0 20 rados->read ofs=0 len=0 2019-11-29T12:32:00.607 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:32:00.611+0000 7f8685e51ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T12:32:00.607 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:32:00.611+0000 7f8685e51ec0 20 rados->read ofs=0 len=0 2019-11-29T12:32:00.615 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:32:00.620+0000 7f8685e51ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-29T12:32:00.616 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:32:00.620+0000 7f8685e51ec0 20 zone default found 2019-11-29T12:32:00.616 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:32:00.620+0000 7f8685e51ec0 20 started sync module instance, tier type = 2019-11-29T12:32:00.616 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:32:00.620+0000 7f8685e51ec0 20 started zone id=7f922895-c6d7-4b1b-a19c-be3df5b5a899 (name=default) with tier type = 2019-11-29T12:32:00.940 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:32:00.944+0000 7f8685e51ec0 20 add_watcher() i=0 2019-11-29T12:32:00.940 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:32:00.944+0000 7f8685e51ec0 20 add_watcher() i=1 2019-11-29T12:32:00.940 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:32:00.944+0000 7f8685e51ec0 20 add_watcher() i=2 2019-11-29T12:32:00.940 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:32:00.944+0000 7f8685e51ec0 20 add_watcher() i=3 2019-11-29T12:32:00.940 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:32:00.944+0000 7f8685e51ec0 20 add_watcher() i=4 2019-11-29T12:32:00.941 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:32:00.944+0000 7f8685e51ec0 20 add_watcher() i=5 2019-11-29T12:32:00.941 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:32:00.944+0000 7f8685e51ec0 20 add_watcher() i=6 2019-11-29T12:32:00.974 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:32:00.978+0000 7f8685e51ec0 20 add_watcher() i=7 2019-11-29T12:32:00.974 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:32:00.978+0000 7f8685e51ec0 2 all 8 watchers are set, enabling cache 2019-11-29T12:32:00.974 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:32:00.978+0000 7f8643fdf700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-29T12:32:00.986 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:32:00.990+0000 7f867307e700 0 -- 172.21.15.62:0/3127064364 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x557ce733fb50 msgr2=0x557ce7341f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-29T12:32:01.011 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:32:01.015+0000 7f867387f700 0 -- 172.21.15.62:0/2041713280 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x557ce7342620 msgr2=0x557ce7342a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-29T12:32:02.507 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:32:02.512+0000 7f85b27fc700 20 reqs_thread_entry: start 2019-11-29T12:32:02.508 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:32:02.512+0000 7f85abfff700 20 reqs_thread_entry: start 2019-11-29T12:32:02.508 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:32:02.512+0000 7f8685e51ec0 20 init_complete bucket index max shards: 0 2019-11-29T12:32:02.509 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:32:02.513+0000 7f85aa7fc700 20 reqs_thread_entry: start 2019-11-29T12:32:02.509 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:32:02.513+0000 7f8685e51ec0 20 get_system_obj_state: rctx=0x7ffc86fab658 obj=default.rgw.meta:users.uid:ragweed.client.0 state=0x557ce73bcb70 s->prefetch_data=0 2019-11-29T12:32:02.509 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:32:02.513+0000 7f8685e51ec0 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2019-11-29T12:32:02.523 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:32:02.528+0000 7f8685e51ec0 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x0 2019-11-29T12:32:02.524 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:32:02.528+0000 7f8685e51ec0 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2019-11-29T12:32:02.524 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:32:02.528+0000 7f8685e51ec0 20 get_system_obj_state: rctx=0x7ffc86fab668 obj=default.rgw.meta:users.email:ragweed.client.0+test@test.test state=0x557ce73be900 s->prefetch_data=0 2019-11-29T12:32:02.524 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:32:02.528+0000 7f8685e51ec0 10 cache get: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test : miss 2019-11-29T12:32:02.537 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:32:02.541+0000 7f8685e51ec0 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x0 2019-11-29T12:32:02.537 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:32:02.541+0000 7f8685e51ec0 10 adding default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2019-11-29T12:32:02.537 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:32:02.541+0000 7f8685e51ec0 20 get_system_obj_state: rctx=0x7ffc86fab668 obj=default.rgw.meta:users.keys:INJMFBCBSYLUQCKOTIHA state=0x557ce73be900 s->prefetch_data=0 2019-11-29T12:32:02.537 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:32:02.541+0000 7f8685e51ec0 10 cache get: name=default.rgw.meta+users.keys+INJMFBCBSYLUQCKOTIHA : miss 2019-11-29T12:32:02.551 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:32:02.555+0000 7f8685e51ec0 10 cache put: name=default.rgw.meta+users.keys+INJMFBCBSYLUQCKOTIHA info.flags=0x0 2019-11-29T12:32:02.551 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:32:02.555+0000 7f8685e51ec0 10 adding default.rgw.meta+users.keys+INJMFBCBSYLUQCKOTIHA to cache LRU end 2019-11-29T12:32:02.551 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:32:02.555+0000 7f8685e51ec0 20 get_system_obj_state: rctx=0x7ffc86fab278 obj=default.rgw.meta:users.keys:INJMFBCBSYLUQCKOTIHA state=0x557ce73be900 s->prefetch_data=0 2019-11-29T12:32:02.551 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:32:02.555+0000 7f8685e51ec0 10 cache get: name=default.rgw.meta+users.keys+INJMFBCBSYLUQCKOTIHA : type miss (requested=0x6, cached=0x0) 2019-11-29T12:32:02.558 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:32:02.563+0000 7f8685e51ec0 10 cache put: name=default.rgw.meta+users.keys+INJMFBCBSYLUQCKOTIHA info.flags=0x0 2019-11-29T12:32:02.558 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:32:02.563+0000 7f8685e51ec0 10 moving default.rgw.meta+users.keys+INJMFBCBSYLUQCKOTIHA to cache LRU end 2019-11-29T12:32:02.559 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:32:02.563+0000 7f8685e51ec0 20 get_system_obj_state: rctx=0x7ffc86fab3f8 obj=default.rgw.meta:users.keys:INJMFBCBSYLUQCKOTIHA state=0x557ce73be900 s->prefetch_data=0 2019-11-29T12:32:02.559 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:32:02.563+0000 7f8685e51ec0 10 cache get: name=default.rgw.meta+users.keys+INJMFBCBSYLUQCKOTIHA : type miss (requested=0x6, cached=0x0) 2019-11-29T12:32:02.569 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:32:02.574+0000 7f8685e51ec0 10 cache put: name=default.rgw.meta+users.keys+INJMFBCBSYLUQCKOTIHA info.flags=0x0 2019-11-29T12:32:02.570 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:32:02.574+0000 7f8685e51ec0 10 moving default.rgw.meta+users.keys+INJMFBCBSYLUQCKOTIHA to cache LRU end 2019-11-29T12:32:02.658 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:32:02.663+0000 7f8685e51ec0 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2019-11-29T12:32:02.659 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:32:02.663+0000 7f8685e51ec0 10 moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2019-11-29T12:32:02.659 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:32:02.663+0000 7f8685e51ec0 10 distributing notification oid=default.rgw.control:notify.4 bl.length()=637 2019-11-29T12:32:02.672 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:32:02.676+0000 7f8668ff9700 10 RGWWatcher::handle_notify() notify_id 528280977410 cookie 93994943180272 notifier 4678 bl.length()=637 2019-11-29T12:32:02.672 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:32:02.676+0000 7f8668ff9700 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2019-11-29T12:32:02.672 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:32:02.676+0000 7f8668ff9700 10 moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2019-11-29T12:32:02.969 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:32:02.973+0000 7f8685e51ec0 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2019-11-29T12:32:02.969 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:32:02.973+0000 7f8685e51ec0 10 moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2019-11-29T12:32:02.969 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:32:02.973+0000 7f8685e51ec0 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=202 2019-11-29T12:32:02.984 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:32:02.988+0000 7f8668ff9700 10 RGWWatcher::handle_notify() notify_id 528280977411 cookie 93994943174992 notifier 4678 bl.length()=202 2019-11-29T12:32:02.984 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:32:02.988+0000 7f8668ff9700 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2019-11-29T12:32:02.984 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:32:02.988+0000 7f8668ff9700 10 moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2019-11-29T12:32:03.183 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:32:03.187+0000 7f8685e51ec0 10 cache put: name=default.rgw.meta+users.keys+INJMFBCBSYLUQCKOTIHA info.flags=0x7 2019-11-29T12:32:03.183 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:32:03.187+0000 7f8685e51ec0 10 moving default.rgw.meta+users.keys+INJMFBCBSYLUQCKOTIHA to cache LRU end 2019-11-29T12:32:03.183 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:32:03.187+0000 7f8685e51ec0 10 distributing notification oid=default.rgw.control:notify.6 bl.length()=190 2019-11-29T12:32:03.231 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:32:03.235+0000 7f8668ff9700 10 RGWWatcher::handle_notify() notify_id 528280977408 cookie 93994943183760 notifier 4678 bl.length()=190 2019-11-29T12:32:03.231 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:32:03.235+0000 7f8668ff9700 10 cache put: name=default.rgw.meta+users.keys+INJMFBCBSYLUQCKOTIHA info.flags=0x7 2019-11-29T12:32:03.231 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:32:03.235+0000 7f8668ff9700 10 moving default.rgw.meta+users.keys+INJMFBCBSYLUQCKOTIHA to cache LRU end 2019-11-29T12:32:03.301 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2019-11-29T12:32:03.301 INFO:teuthology.orchestra.run.smithi062.stdout: "user_id": "ragweed.client.0", 2019-11-29T12:32:03.301 INFO:teuthology.orchestra.run.smithi062.stdout: "display_name": "Mr. ragweed.client.0", 2019-11-29T12:32:03.301 INFO:teuthology.orchestra.run.smithi062.stdout: "email": "ragweed.client.0+test@test.test", 2019-11-29T12:32:03.301 INFO:teuthology.orchestra.run.smithi062.stdout: "suspended": 0, 2019-11-29T12:32:03.301 INFO:teuthology.orchestra.run.smithi062.stdout: "max_buckets": 1000, 2019-11-29T12:32:03.302 INFO:teuthology.orchestra.run.smithi062.stdout: "subusers": [], 2019-11-29T12:32:03.302 INFO:teuthology.orchestra.run.smithi062.stdout: "keys": [ 2019-11-29T12:32:03.302 INFO:teuthology.orchestra.run.smithi062.stdout: { 2019-11-29T12:32:03.302 INFO:teuthology.orchestra.run.smithi062.stdout: "user": "ragweed.client.0", 2019-11-29T12:32:03.302 INFO:teuthology.orchestra.run.smithi062.stdout: "access_key": "INJMFBCBSYLUQCKOTIHA", 2019-11-29T12:32:03.302 INFO:teuthology.orchestra.run.smithi062.stdout: "secret_key": "NsTn2fndpTEHNvz1E8dE0FmJU7FRhNkDyLwrTp2jffvYxN/R869m/g==" 2019-11-29T12:32:03.302 INFO:teuthology.orchestra.run.smithi062.stdout: } 2019-11-29T12:32:03.303 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2019-11-29T12:32:03.303 INFO:teuthology.orchestra.run.smithi062.stdout: "swift_keys": [], 2019-11-29T12:32:03.303 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": [], 2019-11-29T12:32:03.303 INFO:teuthology.orchestra.run.smithi062.stdout: "op_mask": "read, write, delete", 2019-11-29T12:32:03.303 INFO:teuthology.orchestra.run.smithi062.stdout: "system": "true", 2019-11-29T12:32:03.303 INFO:teuthology.orchestra.run.smithi062.stdout: "default_placement": "", 2019-11-29T12:32:03.303 INFO:teuthology.orchestra.run.smithi062.stdout: "default_storage_class": "", 2019-11-29T12:32:03.304 INFO:teuthology.orchestra.run.smithi062.stdout: "placement_tags": [], 2019-11-29T12:32:03.304 INFO:teuthology.orchestra.run.smithi062.stdout: "bucket_quota": { 2019-11-29T12:32:03.304 INFO:teuthology.orchestra.run.smithi062.stdout: "enabled": false, 2019-11-29T12:32:03.304 INFO:teuthology.orchestra.run.smithi062.stdout: "check_on_raw": false, 2019-11-29T12:32:03.304 INFO:teuthology.orchestra.run.smithi062.stdout: "max_size": -1, 2019-11-29T12:32:03.305 INFO:teuthology.orchestra.run.smithi062.stdout: "max_size_kb": 0, 2019-11-29T12:32:03.305 INFO:teuthology.orchestra.run.smithi062.stdout: "max_objects": -1 2019-11-29T12:32:03.305 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2019-11-29T12:32:03.305 INFO:teuthology.orchestra.run.smithi062.stdout: "user_quota": { 2019-11-29T12:32:03.305 INFO:teuthology.orchestra.run.smithi062.stdout: "enabled": false, 2019-11-29T12:32:03.305 INFO:teuthology.orchestra.run.smithi062.stdout: "check_on_raw": false, 2019-11-29T12:32:03.305 INFO:teuthology.orchestra.run.smithi062.stdout: "max_size": -1, 2019-11-29T12:32:03.306 INFO:teuthology.orchestra.run.smithi062.stdout: "max_size_kb": 0, 2019-11-29T12:32:03.306 INFO:teuthology.orchestra.run.smithi062.stdout: "max_objects": -1 2019-11-29T12:32:03.306 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2019-11-29T12:32:03.306 INFO:teuthology.orchestra.run.smithi062.stdout: "temp_url_keys": [], 2019-11-29T12:32:03.307 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "rgw", 2019-11-29T12:32:03.307 INFO:teuthology.orchestra.run.smithi062.stdout: "mfa_ids": [] 2019-11-29T12:32:03.307 INFO:teuthology.orchestra.run.smithi062.stdout:} 2019-11-29T12:32:03.307 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:32:03.339 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:32:03.343+0000 7f8685e51ec0 20 remove_watcher() i=0 2019-11-29T12:32:03.339 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:32:03.343+0000 7f8685e51ec0 2 removed watcher, disabling cache 2019-11-29T12:32:03.414 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:32:03.419+0000 7f8685e51ec0 20 remove_watcher() i=1 2019-11-29T12:32:03.480 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:32:03.484+0000 7f8685e51ec0 20 remove_watcher() i=2 2019-11-29T12:32:03.533 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:32:03.537+0000 7f8685e51ec0 20 remove_watcher() i=3 2019-11-29T12:32:03.579 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:32:03.583+0000 7f8685e51ec0 20 remove_watcher() i=4 2019-11-29T12:32:03.634 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:32:03.639+0000 7f8685e51ec0 20 remove_watcher() i=5 2019-11-29T12:32:03.690 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:32:03.694+0000 7f8685e51ec0 20 remove_watcher() i=6 2019-11-29T12:32:03.725 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:32:03.730+0000 7f8685e51ec0 20 remove_watcher() i=7 2019-11-29T12:32:03.733 INFO:tasks.ragweed:Configuring ragweed... 2019-11-29T12:32:03.734 INFO:teuthology.orchestra.run.smithi062:> cd /home/ubuntu/cephtest/ragweed && ./bootstrap 2019-11-29T12:32:09.791 INFO:teuthology.orchestra.run.smithi062.stderr:./bootstrap: missing required RPM packages. Installing via sudo. 2019-11-29T12:32:09.958 INFO:teuthology.orchestra.run.smithi062.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-29T12:32:10.002 INFO:teuthology.orchestra.run.smithi062.stdout:Loading mirror speeds from cached hostfile 2019-11-29T12:32:10.003 INFO:teuthology.orchestra.run.smithi062.stdout: * base: mirror.us-midwest-1.nexcess.net 2019-11-29T12:32:10.003 INFO:teuthology.orchestra.run.smithi062.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-29T12:32:10.003 INFO:teuthology.orchestra.run.smithi062.stdout: * extras: www.gtlib.gatech.edu 2019-11-29T12:32:10.004 INFO:teuthology.orchestra.run.smithi062.stdout: * updates: reflector.westga.edu 2019-11-29T12:32:10.656 INFO:teuthology.orchestra.run.smithi062.stdout:7 packages excluded due to repository priority protections 2019-11-29T12:32:11.001 INFO:teuthology.orchestra.run.smithi062.stdout:Package python2-pip-8.1.2-10.el7.noarch already installed and latest version 2019-11-29T12:32:11.876 INFO:teuthology.orchestra.run.smithi062.stdout:Resolving Dependencies 2019-11-29T12:32:11.877 INFO:teuthology.orchestra.run.smithi062.stdout:--> Running transaction check 2019-11-29T12:32:11.877 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package libevent-devel.x86_64 0:2.0.21-4.el7 will be installed 2019-11-29T12:32:11.879 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package libxml2-devel.x86_64 0:2.9.1-6.el7_2.3 will be installed 2019-11-29T12:32:11.881 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: xz-devel for package: libxml2-devel-2.9.1-6.el7_2.3.x86_64 2019-11-29T12:32:11.914 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package libxslt-devel.x86_64 0:1.1.28-5.el7 will be installed 2019-11-29T12:32:11.915 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: libgcrypt-devel for package: libxslt-devel-1.1.28-5.el7.x86_64 2019-11-29T12:32:11.918 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package zlib-devel.x86_64 0:1.2.7-18.el7 will be installed 2019-11-29T12:32:11.919 INFO:teuthology.orchestra.run.smithi062.stdout:--> Running transaction check 2019-11-29T12:32:11.919 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package libgcrypt-devel.x86_64 0:1.5.3-14.el7 will be installed 2019-11-29T12:32:11.921 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: libgpg-error-devel for package: libgcrypt-devel-1.5.3-14.el7.x86_64 2019-11-29T12:32:11.924 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package xz-devel.x86_64 0:5.2.2-1.el7 will be installed 2019-11-29T12:32:11.924 INFO:teuthology.orchestra.run.smithi062.stdout:--> Running transaction check 2019-11-29T12:32:11.925 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package libgpg-error-devel.x86_64 0:1.12-3.el7 will be installed 2019-11-29T12:32:12.516 INFO:teuthology.orchestra.run.smithi062.stdout:--> Finished Dependency Resolution 2019-11-29T12:32:12.710 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:32:12.711 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies Resolved 2019-11-29T12:32:12.712 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:32:12.712 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2019-11-29T12:32:12.712 INFO:teuthology.orchestra.run.smithi062.stdout: Package Arch Version Repository Size 2019-11-29T12:32:12.712 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2019-11-29T12:32:12.713 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2019-11-29T12:32:12.713 INFO:teuthology.orchestra.run.smithi062.stdout: libevent-devel x86_64 2.0.21-4.el7 base 85 k 2019-11-29T12:32:12.713 INFO:teuthology.orchestra.run.smithi062.stdout: libxml2-devel x86_64 2.9.1-6.el7_2.3 base 1.0 M 2019-11-29T12:32:12.713 INFO:teuthology.orchestra.run.smithi062.stdout: libxslt-devel x86_64 1.1.28-5.el7 base 309 k 2019-11-29T12:32:12.713 INFO:teuthology.orchestra.run.smithi062.stdout: zlib-devel x86_64 1.2.7-18.el7 base 50 k 2019-11-29T12:32:12.713 INFO:teuthology.orchestra.run.smithi062.stdout:Installing for dependencies: 2019-11-29T12:32:12.713 INFO:teuthology.orchestra.run.smithi062.stdout: libgcrypt-devel x86_64 1.5.3-14.el7 base 129 k 2019-11-29T12:32:12.714 INFO:teuthology.orchestra.run.smithi062.stdout: libgpg-error-devel x86_64 1.12-3.el7 base 16 k 2019-11-29T12:32:12.714 INFO:teuthology.orchestra.run.smithi062.stdout: xz-devel x86_64 5.2.2-1.el7 base 46 k 2019-11-29T12:32:12.714 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:32:12.714 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2019-11-29T12:32:12.714 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2019-11-29T12:32:12.714 INFO:teuthology.orchestra.run.smithi062.stdout:Install 4 Packages (+3 Dependent packages) 2019-11-29T12:32:12.714 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:32:12.715 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 1.7 M 2019-11-29T12:32:12.715 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 12 M 2019-11-29T12:32:12.715 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading packages: 2019-11-29T12:32:13.060 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2019-11-29T12:32:13.061 INFO:teuthology.orchestra.run.smithi062.stdout:Total 4.8 MB/s | 1.7 MB 00:00 2019-11-29T12:32:13.066 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2019-11-29T12:32:13.076 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2019-11-29T12:32:13.124 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded 2019-11-29T12:32:13.125 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2019-11-29T12:32:13.807 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libgpg-error-devel-1.12-3.el7.x86_64 1/7 2019-11-29T12:32:14.122 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libgcrypt-devel-1.5.3-14.el7.x86_64 2/7 2019-11-29T12:32:14.419 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : zlib-devel-1.2.7-18.el7.x86_64 3/7 2019-11-29T12:32:14.967 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : xz-devel-5.2.2-1.el7.x86_64 4/7 2019-11-29T12:32:15.396 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libxml2-devel-2.9.1-6.el7_2.3.x86_64 5/7 2019-11-29T12:32:16.056 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libxslt-devel-1.1.28-5.el7.x86_64 6/7 2019-11-29T12:32:16.333 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libevent-devel-2.0.21-4.el7.x86_64 7/7 2019-11-29T12:32:16.473 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : xz-devel-5.2.2-1.el7.x86_64 1/7 2019-11-29T12:32:16.606 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libxml2-devel-2.9.1-6.el7_2.3.x86_64 2/7 2019-11-29T12:32:16.773 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : zlib-devel-1.2.7-18.el7.x86_64 3/7 2019-11-29T12:32:16.899 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libxslt-devel-1.1.28-5.el7.x86_64 4/7 2019-11-29T12:32:17.007 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libgpg-error-devel-1.12-3.el7.x86_64 5/7 2019-11-29T12:32:17.092 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libevent-devel-2.0.21-4.el7.x86_64 6/7 2019-11-29T12:32:17.495 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libgcrypt-devel-1.5.3-14.el7.x86_64 7/7 2019-11-29T12:32:17.496 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:32:17.496 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2019-11-29T12:32:17.496 INFO:teuthology.orchestra.run.smithi062.stdout: libevent-devel.x86_64 0:2.0.21-4.el7 libxml2-devel.x86_64 0:2.9.1-6.el7_2.3 2019-11-29T12:32:17.496 INFO:teuthology.orchestra.run.smithi062.stdout: libxslt-devel.x86_64 0:1.1.28-5.el7 zlib-devel.x86_64 0:1.2.7-18.el7 2019-11-29T12:32:17.496 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:32:17.497 INFO:teuthology.orchestra.run.smithi062.stdout:Dependency Installed: 2019-11-29T12:32:17.497 INFO:teuthology.orchestra.run.smithi062.stdout: libgcrypt-devel.x86_64 0:1.5.3-14.el7 libgpg-error-devel.x86_64 0:1.12-3.el7 2019-11-29T12:32:17.497 INFO:teuthology.orchestra.run.smithi062.stdout: xz-devel.x86_64 0:5.2.2-1.el7 2019-11-29T12:32:17.497 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:32:17.497 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2019-11-29T12:32:17.715 INFO:teuthology.orchestra.run.smithi062.stdout:New python executable in /home/ubuntu/cephtest/ragweed/virtualenv/bin/python 2019-11-29T12:32:19.201 INFO:teuthology.orchestra.run.smithi062.stdout:Installing setuptools, pip, wheel...done. 2019-11-29T12:32:19.750 INFO:teuthology.orchestra.run.smithi062.stdout:Collecting pip 2019-11-29T12:32:19.874 INFO:teuthology.orchestra.run.smithi062.stdout: Downloading https://files.pythonhosted.org/packages/00/b6/9cfa56b4081ad13874b0c6f96af8ce16cfbc1cb06bedf8e9164ce5551ec1/pip-19.3.1-py2.py3-none-any.whl (1.4MB) 2019-11-29T12:32:20.074 INFO:teuthology.orchestra.run.smithi062.stdout:Installing collected packages: pip 2019-11-29T12:32:20.074 INFO:teuthology.orchestra.run.smithi062.stdout: Found existing installation: pip 9.0.1 2019-11-29T12:32:20.135 INFO:teuthology.orchestra.run.smithi062.stdout: Uninstalling pip-9.0.1: 2019-11-29T12:32:20.196 INFO:teuthology.orchestra.run.smithi062.stdout: Successfully uninstalled pip-9.0.1 2019-11-29T12:32:20.802 INFO:teuthology.orchestra.run.smithi062.stdout:Successfully installed pip-19.3.1 2019-11-29T12:32:21.484 INFO:teuthology.orchestra.run.smithi062.stderr:DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support 2019-11-29T12:32:21.552 INFO:teuthology.orchestra.run.smithi062.stdout:Requirement already satisfied: six in /usr/lib/python2.7/site-packages (1.9.0) 2019-11-29T12:32:22.470 INFO:teuthology.orchestra.run.smithi062.stderr:DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support 2019-11-29T12:32:22.669 INFO:teuthology.orchestra.run.smithi062.stdout:Collecting nose 2019-11-29T12:32:22.709 INFO:teuthology.orchestra.run.smithi062.stdout: Downloading https://files.pythonhosted.org/packages/99/4f/13fb671119e65c4dce97c60e67d3fd9e6f7f809f2b307e2611f4701205cb/nose-1.3.7-py2-none-any.whl (154kB) 2019-11-29T12:32:22.818 INFO:teuthology.orchestra.run.smithi062.stdout:Installing collected packages: nose 2019-11-29T12:32:22.892 INFO:teuthology.orchestra.run.smithi062.stdout:Successfully installed nose-1.3.7 2019-11-29T12:32:23.388 INFO:teuthology.orchestra.run.smithi062.stderr:DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support 2019-11-29T12:32:23.936 INFO:teuthology.orchestra.run.smithi062.stdout:Collecting setuptools==32.3.1 2019-11-29T12:32:23.989 INFO:teuthology.orchestra.run.smithi062.stdout: Downloading https://files.pythonhosted.org/packages/69/19/b1dff551058ce79d88b1e3688f1c735590d7ddf44d10681512133b35019f/setuptools-32.3.1-py2.py3-none-any.whl (479kB) 2019-11-29T12:32:24.145 INFO:teuthology.orchestra.run.smithi062.stderr:ERROR: kubernetes 10.0.1 has requirement ipaddress>=1.0.17, but you'll have ipaddress 1.0.16 which is incompatible. 2019-11-29T12:32:24.146 INFO:teuthology.orchestra.run.smithi062.stdout:Installing collected packages: setuptools 2019-11-29T12:32:24.146 INFO:teuthology.orchestra.run.smithi062.stdout: Found existing installation: setuptools 28.8.0 2019-11-29T12:32:24.163 INFO:teuthology.orchestra.run.smithi062.stdout: Uninstalling setuptools-28.8.0: 2019-11-29T12:32:24.172 INFO:teuthology.orchestra.run.smithi062.stdout: Successfully uninstalled setuptools-28.8.0 2019-11-29T12:32:24.303 INFO:teuthology.orchestra.run.smithi062.stdout:Successfully installed setuptools-32.3.1 2019-11-29T12:32:24.867 INFO:teuthology.orchestra.run.smithi062.stderr:DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support 2019-11-29T12:32:25.181 INFO:teuthology.orchestra.run.smithi062.stdout:Collecting PyYAML 2019-11-29T12:32:25.222 INFO:teuthology.orchestra.run.smithi062.stdout: Downloading https://files.pythonhosted.org/packages/e3/e8/b3212641ee2718d556df0f23f78de8303f068fe29cdaa7a91018849582fe/PyYAML-5.1.2.tar.gz (265kB) 2019-11-29T12:32:25.961 INFO:teuthology.orchestra.run.smithi062.stdout:Requirement already up-to-date: nose>=1.0.0 in ./virtualenv/lib/python2.7/site-packages (from -r requirements.txt (line 2)) (1.3.7) 2019-11-29T12:32:26.166 INFO:teuthology.orchestra.run.smithi062.stdout:Collecting boto!=2.46.0,>=2.6.0 2019-11-29T12:32:26.179 INFO:teuthology.orchestra.run.smithi062.stdout: Downloading https://files.pythonhosted.org/packages/23/10/c0b78c27298029e4454a472a1919bde20cb182dab1662cec7f2ca1dcc523/boto-2.49.0-py2.py3-none-any.whl (1.4MB) 2019-11-29T12:32:26.525 INFO:teuthology.orchestra.run.smithi062.stdout:Collecting bunch>=1.0.0 2019-11-29T12:32:26.535 INFO:teuthology.orchestra.run.smithi062.stdout: Downloading https://files.pythonhosted.org/packages/ef/bf/a4cf1779a4ffb4f610903fa08e15d1f4a8a2f4e3353a02afbe097c5bf4a8/bunch-1.0.1.tar.gz 2019-11-29T12:32:27.318 INFO:teuthology.orchestra.run.smithi062.stdout:Collecting gevent>=1.0 2019-11-29T12:32:27.336 INFO:teuthology.orchestra.run.smithi062.stdout: Downloading https://files.pythonhosted.org/packages/e6/e9/3a693414f706e12abe60554cd73c5ae8f848b182ae58018f93d86c9eb418/gevent-1.4.0-cp27-cp27mu-manylinux1_x86_64.whl (5.0MB) 2019-11-29T12:32:27.852 INFO:teuthology.orchestra.run.smithi062.stdout:Collecting httplib2 2019-11-29T12:32:27.861 INFO:teuthology.orchestra.run.smithi062.stdout: Downloading https://files.pythonhosted.org/packages/ce/2e/87461bfbb7e561203b759b3f7f639e2144226604372830d00a8279960ae1/httplib2-0.14.0.tar.gz (219kB) 2019-11-29T12:32:29.502 INFO:teuthology.orchestra.run.smithi062.stdout:Collecting lxml 2019-11-29T12:32:29.520 INFO:teuthology.orchestra.run.smithi062.stdout: Downloading https://files.pythonhosted.org/packages/25/73/730ad7249847f741c7e622f52b971daa5540f6fb87589bc92c717f5aafba/lxml-4.4.2-cp27-cp27mu-manylinux1_x86_64.whl (5.7MB) 2019-11-29T12:32:29.964 INFO:teuthology.orchestra.run.smithi062.stdout:Collecting greenlet>=0.4.14; platform_python_implementation == "CPython" 2019-11-29T12:32:29.973 INFO:teuthology.orchestra.run.smithi062.stdout: Downloading https://files.pythonhosted.org/packages/8b/6e/f2d25875713ad0885c8d3c69269697406652e6f64e1a6bd8264f7a609327/greenlet-0.4.15-cp27-cp27mu-manylinux1_x86_64.whl 2019-11-29T12:32:30.081 INFO:teuthology.orchestra.run.smithi062.stdout:Building wheels for collected packages: PyYAML, bunch, httplib2 2019-11-29T12:32:30.081 INFO:teuthology.orchestra.run.smithi062.stdout: Building wheel for PyYAML (setup.py): started 2019-11-29T12:32:30.675 INFO:teuthology.orchestra.run.smithi062.stdout: Building wheel for PyYAML (setup.py): finished with status 'done' 2019-11-29T12:32:30.675 INFO:teuthology.orchestra.run.smithi062.stdout: Created wheel for PyYAML: filename=PyYAML-5.1.2-cp27-cp27mu-linux_x86_64.whl size=46204 sha256=897d8833b6082b2391fba3c5367e0cd5c00678bb43db866ecd5f1dcd161464fe 2019-11-29T12:32:30.676 INFO:teuthology.orchestra.run.smithi062.stdout: Stored in directory: /home/ubuntu/.cache/pip/wheels/d9/45/dd/65f0b38450c47cf7e5312883deb97d065e030c5cca0a365030 2019-11-29T12:32:30.691 INFO:teuthology.orchestra.run.smithi062.stdout: Building wheel for bunch (setup.py): started 2019-11-29T12:32:31.040 INFO:teuthology.orchestra.run.smithi062.stdout: Building wheel for bunch (setup.py): finished with status 'done' 2019-11-29T12:32:31.040 INFO:teuthology.orchestra.run.smithi062.stdout: Created wheel for bunch: filename=bunch-1.0.1-cp27-none-any.whl size=8347 sha256=d311e008a9a950ed6f076f005b9ffa5ffa31d2111363dba9b9962d2206138bac 2019-11-29T12:32:31.041 INFO:teuthology.orchestra.run.smithi062.stdout: Stored in directory: /home/ubuntu/.cache/pip/wheels/56/0f/19/fbbf81e5764e6d8b74501c4357a88c14c94466ec777c03734c 2019-11-29T12:32:31.043 INFO:teuthology.orchestra.run.smithi062.stdout: Building wheel for httplib2 (setup.py): started 2019-11-29T12:32:31.364 INFO:teuthology.orchestra.run.smithi062.stdout: Building wheel for httplib2 (setup.py): finished with status 'done' 2019-11-29T12:32:31.364 INFO:teuthology.orchestra.run.smithi062.stdout: Created wheel for httplib2: filename=httplib2-0.14.0-cp27-none-any.whl size=96742 sha256=e829feb234eaba546e266f90b07cb396144bc7a3b712593ae30b1020be1e3780 2019-11-29T12:32:31.364 INFO:teuthology.orchestra.run.smithi062.stdout: Stored in directory: /home/ubuntu/.cache/pip/wheels/51/ab/65/f318b4271019823cf7d7c178ac76a8ea4d6e6271fe9f5ba488 2019-11-29T12:32:31.369 INFO:teuthology.orchestra.run.smithi062.stdout:Successfully built PyYAML bunch httplib2 2019-11-29T12:32:31.481 INFO:teuthology.orchestra.run.smithi062.stderr:ERROR: kubernetes 10.0.1 has requirement ipaddress>=1.0.17, but you'll have ipaddress 1.0.16 which is incompatible. 2019-11-29T12:32:31.481 INFO:teuthology.orchestra.run.smithi062.stdout:Installing collected packages: PyYAML, boto, bunch, greenlet, gevent, httplib2, lxml 2019-11-29T12:32:31.481 INFO:teuthology.orchestra.run.smithi062.stdout: Found existing installation: PyYAML 3.10 2019-11-29T12:32:31.482 INFO:teuthology.orchestra.run.smithi062.stdout: Not uninstalling pyyaml at /usr/lib64/python2.7/site-packages, outside environment /home/ubuntu/cephtest/ragweed/virtualenv 2019-11-29T12:32:31.482 INFO:teuthology.orchestra.run.smithi062.stdout: Can't uninstall 'PyYAML'. No files were found to uninstall. 2019-11-29T12:32:32.554 INFO:teuthology.orchestra.run.smithi062.stdout: Found existing installation: lxml 3.2.1 2019-11-29T12:32:32.555 INFO:teuthology.orchestra.run.smithi062.stdout: Not uninstalling lxml at /usr/lib64/python2.7/site-packages, outside environment /home/ubuntu/cephtest/ragweed/virtualenv 2019-11-29T12:32:32.555 INFO:teuthology.orchestra.run.smithi062.stdout: Can't uninstall 'lxml'. No files were found to uninstall. 2019-11-29T12:32:32.623 INFO:teuthology.orchestra.run.smithi062.stdout:Successfully installed PyYAML-5.1.2 boto-2.49.0 bunch-1.0.1 gevent-1.4.0 greenlet-0.4.15 httplib2-0.14.0 lxml-4.4.2 2019-11-29T12:32:33.077 INFO:teuthology.orchestra.run.smithi062.stdout:running develop 2019-11-29T12:32:33.152 INFO:teuthology.orchestra.run.smithi062.stdout:running egg_info 2019-11-29T12:32:33.153 INFO:teuthology.orchestra.run.smithi062.stdout:creating ragweed.egg-info 2019-11-29T12:32:33.153 INFO:teuthology.orchestra.run.smithi062.stdout:writing requirements to ragweed.egg-info/requires.txt 2019-11-29T12:32:33.153 INFO:teuthology.orchestra.run.smithi062.stdout:writing ragweed.egg-info/PKG-INFO 2019-11-29T12:32:33.153 INFO:teuthology.orchestra.run.smithi062.stdout:writing top-level names to ragweed.egg-info/top_level.txt 2019-11-29T12:32:33.153 INFO:teuthology.orchestra.run.smithi062.stdout:writing dependency_links to ragweed.egg-info/dependency_links.txt 2019-11-29T12:32:33.154 INFO:teuthology.orchestra.run.smithi062.stdout:writing manifest file 'ragweed.egg-info/SOURCES.txt' 2019-11-29T12:32:33.154 INFO:teuthology.orchestra.run.smithi062.stdout:reading manifest file 'ragweed.egg-info/SOURCES.txt' 2019-11-29T12:32:33.154 INFO:teuthology.orchestra.run.smithi062.stdout:writing manifest file 'ragweed.egg-info/SOURCES.txt' 2019-11-29T12:32:33.155 INFO:teuthology.orchestra.run.smithi062.stdout:running build_ext 2019-11-29T12:32:33.156 INFO:teuthology.orchestra.run.smithi062.stdout:Creating /home/ubuntu/cephtest/ragweed/virtualenv/lib/python2.7/site-packages/ragweed.egg-link (link to .) 2019-11-29T12:32:33.156 INFO:teuthology.orchestra.run.smithi062.stdout:Adding ragweed 0.0.1 to easy-install.pth file 2019-11-29T12:32:33.156 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:32:33.156 INFO:teuthology.orchestra.run.smithi062.stdout:Installed /home/ubuntu/cephtest/ragweed 2019-11-29T12:32:33.157 INFO:teuthology.orchestra.run.smithi062.stdout:Processing dependencies for ragweed==0.0.1 2019-11-29T12:32:33.160 INFO:teuthology.orchestra.run.smithi062.stdout:Searching for isodate>=0.4.4 2019-11-29T12:32:33.161 INFO:teuthology.orchestra.run.smithi062.stdout:Reading https://pypi.python.org/simple/isodate/ 2019-11-29T12:32:33.270 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading https://files.pythonhosted.org/packages/b1/80/fb8c13a4cd38eb5021dc3741a9e588e4d1de88d895c1910c6fc8a08b7a70/isodate-0.6.0.tar.gz#sha256=2e364a3d5759479cdb2d37cce6b9376ea504db2ff90252a2e5b7cc89cc9ff2d8 2019-11-29T12:32:33.328 INFO:teuthology.orchestra.run.smithi062.stdout:Best match: isodate 0.6.0 2019-11-29T12:32:33.328 INFO:teuthology.orchestra.run.smithi062.stdout:Processing isodate-0.6.0.tar.gz 2019-11-29T12:32:33.338 INFO:teuthology.orchestra.run.smithi062.stdout:Writing /tmp/easy_install-_ax3JX/isodate-0.6.0/setup.cfg 2019-11-29T12:32:33.338 INFO:teuthology.orchestra.run.smithi062.stdout:Running isodate-0.6.0/setup.py -q bdist_egg --dist-dir /tmp/easy_install-_ax3JX/isodate-0.6.0/egg-dist-tmp-h8Kwj2 2019-11-29T12:32:33.806 INFO:teuthology.orchestra.run.smithi062.stderr:zip_safe flag not set; analyzing archive contents... 2019-11-29T12:32:33.827 INFO:teuthology.orchestra.run.smithi062.stdout:Moving isodate-0.6.0-py2.7.egg to /home/ubuntu/cephtest/ragweed/virtualenv/lib/python2.7/site-packages 2019-11-29T12:32:33.829 INFO:teuthology.orchestra.run.smithi062.stdout:Adding isodate 0.6.0 to easy-install.pth file 2019-11-29T12:32:33.831 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:32:33.831 INFO:teuthology.orchestra.run.smithi062.stdout:Installed /home/ubuntu/cephtest/ragweed/virtualenv/lib/python2.7/site-packages/isodate-0.6.0-py2.7.egg 2019-11-29T12:32:33.869 INFO:teuthology.orchestra.run.smithi062.stdout:Searching for gevent==1.4.0 2019-11-29T12:32:33.870 INFO:teuthology.orchestra.run.smithi062.stdout:Best match: gevent 1.4.0 2019-11-29T12:32:33.870 INFO:teuthology.orchestra.run.smithi062.stdout:Adding gevent 1.4.0 to easy-install.pth file 2019-11-29T12:32:33.870 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:32:33.870 INFO:teuthology.orchestra.run.smithi062.stdout:Using /home/ubuntu/cephtest/ragweed/virtualenv/lib/python2.7/site-packages 2019-11-29T12:32:33.871 INFO:teuthology.orchestra.run.smithi062.stdout:Searching for bunch==1.0.1 2019-11-29T12:32:33.871 INFO:teuthology.orchestra.run.smithi062.stdout:Best match: bunch 1.0.1 2019-11-29T12:32:33.871 INFO:teuthology.orchestra.run.smithi062.stdout:Adding bunch 1.0.1 to easy-install.pth file 2019-11-29T12:32:33.872 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:32:33.872 INFO:teuthology.orchestra.run.smithi062.stdout:Using /home/ubuntu/cephtest/ragweed/virtualenv/lib/python2.7/site-packages 2019-11-29T12:32:33.873 INFO:teuthology.orchestra.run.smithi062.stdout:Searching for PyYAML==5.1.2 2019-11-29T12:32:33.873 INFO:teuthology.orchestra.run.smithi062.stdout:Best match: PyYAML 5.1.2 2019-11-29T12:32:33.873 INFO:teuthology.orchestra.run.smithi062.stdout:Adding PyYAML 5.1.2 to easy-install.pth file 2019-11-29T12:32:33.873 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:32:33.874 INFO:teuthology.orchestra.run.smithi062.stdout:Using /home/ubuntu/cephtest/ragweed/virtualenv/lib/python2.7/site-packages 2019-11-29T12:32:33.874 INFO:teuthology.orchestra.run.smithi062.stdout:Searching for boto==2.49.0 2019-11-29T12:32:33.875 INFO:teuthology.orchestra.run.smithi062.stdout:Best match: boto 2.49.0 2019-11-29T12:32:33.875 INFO:teuthology.orchestra.run.smithi062.stdout:Adding boto 2.49.0 to easy-install.pth file 2019-11-29T12:32:33.875 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:32:33.875 INFO:teuthology.orchestra.run.smithi062.stdout:Using /home/ubuntu/cephtest/ragweed/virtualenv/lib/python2.7/site-packages 2019-11-29T12:32:33.876 INFO:teuthology.orchestra.run.smithi062.stdout:Searching for six==1.9.0 2019-11-29T12:32:33.876 INFO:teuthology.orchestra.run.smithi062.stdout:Best match: six 1.9.0 2019-11-29T12:32:33.876 INFO:teuthology.orchestra.run.smithi062.stdout:Adding six 1.9.0 to easy-install.pth file 2019-11-29T12:32:33.876 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:32:33.876 INFO:teuthology.orchestra.run.smithi062.stdout:Using /usr/lib/python2.7/site-packages 2019-11-29T12:32:33.885 INFO:teuthology.orchestra.run.smithi062.stdout:Searching for greenlet==0.4.15 2019-11-29T12:32:33.886 INFO:teuthology.orchestra.run.smithi062.stdout:Best match: greenlet 0.4.15 2019-11-29T12:32:33.886 INFO:teuthology.orchestra.run.smithi062.stdout:Adding greenlet 0.4.15 to easy-install.pth file 2019-11-29T12:32:33.886 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:32:33.886 INFO:teuthology.orchestra.run.smithi062.stdout:Using /home/ubuntu/cephtest/ragweed/virtualenv/lib/python2.7/site-packages 2019-11-29T12:32:33.887 INFO:teuthology.orchestra.run.smithi062.stdout:Finished processing dependencies for ragweed==0.0.1 2019-11-29T12:32:33.906 INFO:teuthology.orchestra.run.smithi062:> cat > /home/ubuntu/cephtest/archive/ragweed.client.0.conf 2019-11-29T12:32:33.984 INFO:tasks.ragweed:Configuring boto... 2019-11-29T12:32:33.985 INFO:teuthology.orchestra.run.smithi062:> cat > /home/ubuntu/cephtest/boto.cfg 2019-11-29T12:32:34.116 INFO:teuthology.orchestra.run.smithi062:ragweed tests against rgw> RAGWEED_CONF=/home/ubuntu/cephtest/archive/ragweed.client.0.conf RAGWEED_STAGES=prepare,check BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg /home/ubuntu/cephtest/ragweed/virtualenv/bin/nosetests -w /home/ubuntu/cephtest/ragweed -v -a '!fails_on_rgw' 2019-11-29T12:33:50.021 INFO:teuthology.orchestra.run.smithi062.stderr:ragweed.tests.tests.r_test_multipart_defer_complete.test ... ok 2019-11-29T12:34:31.932 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:00:09:12.599 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T12:34:32.020 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:00:09:12.687 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T12:34:32.031 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:09:12.648 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T12:34:32.055 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:09:12.672 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T12:34:32.104 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:09:12.721 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T12:34:32.142 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:09:12.758 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T12:34:32.690 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:09:13.307 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T12:34:32.745 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:00:09:13.412 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T12:34:32.766 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:09:13.382 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T12:34:55.492 INFO:teuthology.orchestra.run.smithi062.stderr:ragweed.tests.tests.r_test_multipart_defer_update_complete.test ... ok 2019-11-29T12:35:46.232 INFO:teuthology.orchestra.run.smithi062.stderr:ragweed.tests.tests.r_test_multipart_index_versioning.test ... ok 2019-11-29T12:37:01.164 INFO:teuthology.orchestra.run.smithi062.stderr:ragweed.tests.tests.r_test_multipart_simple.test ... ok 2019-11-29T12:37:02.500 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:00:11:43.168 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T12:37:02.511 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:00:11:43.179 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T12:37:02.520 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:11:43.139 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T12:37:02.535 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:11:43.153 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T12:37:02.536 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:11:43.154 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T12:37:02.544 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:11:43.159 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T12:37:02.679 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:11:43.297 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T12:37:02.699 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:11:43.317 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T12:37:02.702 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:00:11:43.371 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T12:38:34.945 INFO:teuthology.orchestra.run.smithi062.stderr:ragweed.tests.tests.r_test_obj_storage_class.test ... ok 2019-11-29T12:41:19.465 INFO:teuthology.orchestra.run.smithi062.stderr:ragweed.tests.tests.r_test_obj_storage_class_copy.test ... ok 2019-11-29T12:42:05.966 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:00:16:46.638 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T12:42:05.969 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:00:16:46.641 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T12:42:06.012 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:16:46.635 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T12:42:06.035 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:16:46.658 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T12:42:06.050 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:16:46.672 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T12:42:06.053 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:16:46.676 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T12:42:06.159 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:00:16:46.831 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T12:42:06.235 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:16:46.858 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T12:42:06.274 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:16:46.897 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T12:42:53.565 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:00:17:34.238 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T12:42:53.577 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:00:17:34.250 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T12:42:53.611 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:17:34.235 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T12:42:53.612 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:17:34.236 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T12:42:53.614 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:17:34.238 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T12:42:53.620 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:17:34.244 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T12:42:53.635 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:00:17:34.308 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T12:42:53.655 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:17:34.278 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T12:42:53.659 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:17:34.283 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T12:43:49.565 INFO:teuthology.orchestra.run.smithi062.stderr:ragweed.tests.tests.r_test_obj_storage_class_multipart.test ... ok 2019-11-29T12:47:17.841 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:00:21:58.510 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T12:47:17.844 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:00:21:58.514 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T12:47:17.880 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:21:58.505 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T12:47:17.889 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:21:58.515 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T12:47:17.911 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:21:58.537 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T12:47:17.913 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:21:58.539 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T12:47:18.053 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:21:58.679 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T12:47:18.071 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:21:58.697 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T12:47:18.120 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:00:21:58.790 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T12:49:20.772 INFO:teuthology.orchestra.run.smithi062.stderr:ragweed.tests.tests.r_test_obj_storage_class_multipart_copy.test ... ok 2019-11-29T12:50:26.800 INFO:teuthology.orchestra.run.smithi062.stderr:ragweed.tests.tests.r_test_small_obj_data.test ... ok 2019-11-29T12:50:26.800 INFO:teuthology.orchestra.run.smithi062.stderr: 2019-11-29T12:50:26.801 INFO:teuthology.orchestra.run.smithi062.stderr:---------------------------------------------------------------------- 2019-11-29T12:50:26.801 INFO:teuthology.orchestra.run.smithi062.stderr:Ran 9 tests in 1072.256s 2019-11-29T12:50:26.801 INFO:teuthology.orchestra.run.smithi062.stderr: 2019-11-29T12:50:26.801 INFO:teuthology.orchestra.run.smithi062.stderr:OK 2019-11-29T12:50:26.821 INFO:tasks.ragweed:Cleaning up boto... 2019-11-29T12:50:26.821 INFO:teuthology.orchestra.run.smithi062:> rm /home/ubuntu/cephtest/boto.cfg 2019-11-29T12:50:26.878 INFO:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid sysuser.client.0 --purge-data 2019-11-29T12:50:27.016 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:27.027+0000 7f033da83ec0 20 rados->read ofs=0 len=0 2019-11-29T12:50:27.054 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:27.064+0000 7f033da83ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T12:50:27.054 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:27.064+0000 7f033da83ec0 20 rados->read ofs=0 len=0 2019-11-29T12:50:27.065 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:27.075+0000 7f033da83ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T12:50:27.065 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:27.075+0000 7f033da83ec0 20 rados->read ofs=0 len=0 2019-11-29T12:50:27.072 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:27.083+0000 7f033da83ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T12:50:27.072 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:27.083+0000 7f033da83ec0 20 rados->read ofs=0 len=0 2019-11-29T12:50:27.092 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:27.102+0000 7f033da83ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T12:50:27.299 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:27.310+0000 7f033da83ec0 20 RGWRados::pool_iterate: got zone_info.7f922895-c6d7-4b1b-a19c-be3df5b5a899 2019-11-29T12:50:27.300 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:27.310+0000 7f033da83ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-29T12:50:27.300 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:27.310+0000 7f033da83ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-29T12:50:27.300 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:27.310+0000 7f033da83ec0 20 RGWRados::pool_iterate: got zonegroup_info.76ba47ff-1c23-4409-aae0-24fe26589cae 2019-11-29T12:50:27.300 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:27.310+0000 7f033da83ec0 20 rados->read ofs=0 len=0 2019-11-29T12:50:27.310 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:27.320+0000 7f033da83ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T12:50:27.310 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:27.320+0000 7f033da83ec0 20 rados->read ofs=0 len=0 2019-11-29T12:50:27.321 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:27.331+0000 7f033da83ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-29T12:50:27.321 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:27.331+0000 7f033da83ec0 20 rados->read ofs=0 len=0 2019-11-29T12:50:27.329 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:27.340+0000 7f033da83ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T12:50:27.330 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:27.340+0000 7f033da83ec0 20 rados->read ofs=0 len=0 2019-11-29T12:50:27.338 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:27.349+0000 7f033da83ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-29T12:50:27.338 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:27.349+0000 7f033da83ec0 20 rados->read ofs=0 len=0 2019-11-29T12:50:27.345 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:27.355+0000 7f033da83ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T12:50:27.345 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:27.355+0000 7f033da83ec0 10 cannot find current period zonegroup using local zonegroup 2019-11-29T12:50:27.345 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:27.355+0000 7f033da83ec0 20 rados->read ofs=0 len=0 2019-11-29T12:50:27.351 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:27.362+0000 7f033da83ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T12:50:27.351 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:27.362+0000 7f033da83ec0 20 rados->read ofs=0 len=0 2019-11-29T12:50:27.359 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:27.370+0000 7f033da83ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T12:50:27.359 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:27.370+0000 7f033da83ec0 20 rados->read ofs=0 len=0 2019-11-29T12:50:27.368 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:27.378+0000 7f033da83ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-29T12:50:27.368 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:27.378+0000 7f033da83ec0 20 zonegroup default 2019-11-29T12:50:27.369 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:27.379+0000 7f033da83ec0 20 rados->read ofs=0 len=0 2019-11-29T12:50:27.376 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:27.386+0000 7f033da83ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T12:50:27.376 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:27.386+0000 7f033da83ec0 10 Cannot find current period zone using local zone 2019-11-29T12:50:27.376 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:27.386+0000 7f033da83ec0 20 rados->read ofs=0 len=0 2019-11-29T12:50:27.382 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:27.392+0000 7f033da83ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T12:50:27.382 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:27.392+0000 7f033da83ec0 20 rados->read ofs=0 len=0 2019-11-29T12:50:27.390 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:27.400+0000 7f033da83ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T12:50:27.390 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:27.400+0000 7f033da83ec0 20 rados->read ofs=0 len=0 2019-11-29T12:50:27.405 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:27.408+0000 7f033da83ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-29T12:50:27.405 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:27.408+0000 7f033da83ec0 20 zone default found 2019-11-29T12:50:27.405 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:27.408+0000 7f033da83ec0 20 started sync module instance, tier type = 2019-11-29T12:50:27.405 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:27.408+0000 7f033da83ec0 20 started zone id=7f922895-c6d7-4b1b-a19c-be3df5b5a899 (name=default) with tier type = 2019-11-29T12:50:27.793 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:27.803+0000 7f033da83ec0 20 add_watcher() i=0 2019-11-29T12:50:27.793 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:27.803+0000 7f033da83ec0 20 add_watcher() i=1 2019-11-29T12:50:27.793 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:27.803+0000 7f033da83ec0 20 add_watcher() i=2 2019-11-29T12:50:27.793 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:27.803+0000 7f033da83ec0 20 add_watcher() i=3 2019-11-29T12:50:27.793 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:27.803+0000 7f033da83ec0 20 add_watcher() i=4 2019-11-29T12:50:27.794 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:27.803+0000 7f033da83ec0 20 add_watcher() i=5 2019-11-29T12:50:27.794 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:27.803+0000 7f033da83ec0 20 add_watcher() i=6 2019-11-29T12:50:27.825 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:27.835+0000 7f033da83ec0 20 add_watcher() i=7 2019-11-29T12:50:27.825 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:27.835+0000 7f033da83ec0 2 all 8 watchers are set, enabling cache 2019-11-29T12:50:27.825 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:27.835+0000 7f02fb7de700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-29T12:50:27.827 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:27.838+0000 7f032a4af700 0 -- 172.21.15.62:0/3800930512 >> v1:172.21.15.22:6789/0 conn(0x55713e0d03e0 legacy=0x55713e0d28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2019-11-29T12:50:27.861 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:27.872+0000 7f032a4af700 0 -- 172.21.15.62:0/736142289 >> [v2:172.21.15.22:6818/9264,v1:172.21.15.22:6819/9264] conn(0x55713e0e3a50 msgr2=0x55713e0e5e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2019-11-29T12:50:29.816 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:29.826+0000 7f0269ffb700 20 reqs_thread_entry: start 2019-11-29T12:50:29.816 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:29.826+0000 7f02637fe700 20 reqs_thread_entry: start 2019-11-29T12:50:29.817 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:29.826+0000 7f033da83ec0 20 init_complete bucket index max shards: 0 2019-11-29T12:50:29.817 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:29.827+0000 7f0261ffb700 20 reqs_thread_entry: start 2019-11-29T12:50:29.817 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:29.827+0000 7f033da83ec0 20 get_system_obj_state: rctx=0x7ffdd6661358 obj=default.rgw.meta:users.uid:sysuser.client.0 state=0x55713e14d270 s->prefetch_data=0 2019-11-29T12:50:29.817 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:29.827+0000 7f033da83ec0 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2019-11-29T12:50:29.833 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:29.844+0000 7f033da83ec0 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x16 2019-11-29T12:50:29.834 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:29.844+0000 7f033da83ec0 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2019-11-29T12:50:29.834 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:29.844+0000 7f033da83ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-29T12:50:29.834 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:29.844+0000 7f033da83ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-29T12:50:29.834 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:29.844+0000 7f033da83ec0 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : type miss (requested=0x11, cached=0x16) 2019-11-29T12:50:29.834 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:29.844+0000 7f033da83ec0 20 rados->read ofs=0 len=0 2019-11-29T12:50:29.852 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:29.862+0000 7f033da83ec0 20 rados_obj.operate() r=0 bl.length=448 2019-11-29T12:50:29.852 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:29.862+0000 7f033da83ec0 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x11 2019-11-29T12:50:29.852 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:29.862+0000 7f033da83ec0 10 moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2019-11-29T12:50:29.865 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:29.876+0000 7f033da83ec0 10 removing key index: JAXGYKNYMQMBDWLJMPFG 2019-11-29T12:50:29.866 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:29.876+0000 7f033da83ec0 10 distributing notification oid=default.rgw.control:notify.3 bl.length()=170 2019-11-29T12:50:29.884 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:29.894+0000 7f030bfff700 10 RGWWatcher::handle_notify() notify_id 566935683073 cookie 93944860622064 notifier 4454 bl.length()=170 2019-11-29T12:50:30.319 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:30.329+0000 7f033da83ec0 10 removing email index: sysuser.client.0+test@test.test 2019-11-29T12:50:30.319 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:30.329+0000 7f033da83ec0 10 distributing notification oid=default.rgw.control:notify.4 bl.length()=182 2019-11-29T12:50:30.340 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:30.351+0000 7f030bfff700 10 RGWWatcher::handle_notify() notify_id 566935683076 cookie 93944860625344 notifier 4454 bl.length()=182 2019-11-29T12:50:31.354 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:31.365+0000 7f033da83ec0 10 removing user buckets index 2019-11-29T12:50:31.355 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:31.365+0000 7f033da83ec0 10 distributing notification oid=default.rgw.control:notify.3 bl.length()=173 2019-11-29T12:50:31.367 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:31.378+0000 7f030bfff700 10 RGWWatcher::handle_notify() notify_id 566935683074 cookie 93944860622064 notifier 4454 bl.length()=173 2019-11-29T12:50:31.626 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:31.636+0000 7f033da83ec0 10 removing user index: sysuser.client.0 2019-11-29T12:50:31.626 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:31.636+0000 7f033da83ec0 10 removing default.rgw.meta+users.uid+sysuser.client.0 from cache 2019-11-29T12:50:31.626 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:31.636+0000 7f033da83ec0 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=165 2019-11-29T12:50:31.641 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:31.651+0000 7f030bfff700 10 RGWWatcher::handle_notify() notify_id 566935683077 cookie 93944860619168 notifier 4454 bl.length()=165 2019-11-29T12:50:32.181 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:32.191+0000 7f033da83ec0 20 remove_watcher() i=0 2019-11-29T12:50:32.181 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:32.191+0000 7f033da83ec0 2 removed watcher, disabling cache 2019-11-29T12:50:32.269 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:32.279+0000 7f033da83ec0 20 remove_watcher() i=1 2019-11-29T12:50:32.339 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:32.349+0000 7f033da83ec0 20 remove_watcher() i=2 2019-11-29T12:50:32.400 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:32.410+0000 7f033da83ec0 20 remove_watcher() i=3 2019-11-29T12:50:32.450 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:32.460+0000 7f033da83ec0 20 remove_watcher() i=4 2019-11-29T12:50:32.516 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:32.526+0000 7f033da83ec0 20 remove_watcher() i=5 2019-11-29T12:50:32.558 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:32.568+0000 7f033da83ec0 20 remove_watcher() i=6 2019-11-29T12:50:32.603 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:32.613+0000 7f033da83ec0 20 remove_watcher() i=7 2019-11-29T12:50:32.613 INFO:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid ragweed.client.0 --purge-data 2019-11-29T12:50:32.741 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:32.751+0000 7f334a99aec0 20 rados->read ofs=0 len=0 2019-11-29T12:50:32.769 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:32.779+0000 7f334a99aec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T12:50:32.769 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:32.779+0000 7f334a99aec0 20 rados->read ofs=0 len=0 2019-11-29T12:50:32.778 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:32.788+0000 7f334a99aec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T12:50:32.778 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:32.788+0000 7f334a99aec0 20 rados->read ofs=0 len=0 2019-11-29T12:50:32.791 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:32.801+0000 7f334a99aec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T12:50:32.792 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:32.801+0000 7f334a99aec0 20 rados->read ofs=0 len=0 2019-11-29T12:50:32.817 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:32.827+0000 7f334a99aec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T12:50:33.006 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:33.016+0000 7f334a99aec0 20 RGWRados::pool_iterate: got zone_info.7f922895-c6d7-4b1b-a19c-be3df5b5a899 2019-11-29T12:50:33.007 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:33.016+0000 7f334a99aec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-29T12:50:33.007 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:33.016+0000 7f334a99aec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-29T12:50:33.007 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:33.016+0000 7f334a99aec0 20 RGWRados::pool_iterate: got zonegroup_info.76ba47ff-1c23-4409-aae0-24fe26589cae 2019-11-29T12:50:33.007 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:33.016+0000 7f334a99aec0 20 rados->read ofs=0 len=0 2019-11-29T12:50:33.015 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:33.025+0000 7f334a99aec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T12:50:33.015 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:33.025+0000 7f334a99aec0 20 rados->read ofs=0 len=0 2019-11-29T12:50:33.032 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:33.036+0000 7f334a99aec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-29T12:50:33.033 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:33.036+0000 7f334a99aec0 20 rados->read ofs=0 len=0 2019-11-29T12:50:33.038 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:33.046+0000 7f334a99aec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T12:50:33.038 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:33.046+0000 7f334a99aec0 20 rados->read ofs=0 len=0 2019-11-29T12:50:33.049 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:33.059+0000 7f334a99aec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-29T12:50:33.049 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:33.059+0000 7f334a99aec0 20 rados->read ofs=0 len=0 2019-11-29T12:50:33.059 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:33.069+0000 7f334a99aec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T12:50:33.059 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:33.069+0000 7f334a99aec0 10 cannot find current period zonegroup using local zonegroup 2019-11-29T12:50:33.059 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:33.069+0000 7f334a99aec0 20 rados->read ofs=0 len=0 2019-11-29T12:50:33.068 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:33.078+0000 7f334a99aec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T12:50:33.068 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:33.078+0000 7f334a99aec0 20 rados->read ofs=0 len=0 2019-11-29T12:50:33.081 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:33.091+0000 7f334a99aec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T12:50:33.081 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:33.091+0000 7f334a99aec0 20 rados->read ofs=0 len=0 2019-11-29T12:50:33.093 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:33.103+0000 7f334a99aec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-29T12:50:33.094 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:33.104+0000 7f334a99aec0 20 zonegroup default 2019-11-29T12:50:33.094 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:33.104+0000 7f334a99aec0 20 rados->read ofs=0 len=0 2019-11-29T12:50:33.103 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:33.112+0000 7f334a99aec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T12:50:33.104 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:33.112+0000 7f334a99aec0 10 Cannot find current period zone using local zone 2019-11-29T12:50:33.104 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:33.112+0000 7f334a99aec0 20 rados->read ofs=0 len=0 2019-11-29T12:50:33.110 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:33.121+0000 7f334a99aec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T12:50:33.111 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:33.121+0000 7f334a99aec0 20 rados->read ofs=0 len=0 2019-11-29T12:50:33.120 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:33.131+0000 7f334a99aec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T12:50:33.121 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:33.131+0000 7f334a99aec0 20 rados->read ofs=0 len=0 2019-11-29T12:50:33.130 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:33.140+0000 7f334a99aec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-29T12:50:33.131 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:33.140+0000 7f334a99aec0 20 zone default found 2019-11-29T12:50:33.131 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:33.140+0000 7f334a99aec0 20 started sync module instance, tier type = 2019-11-29T12:50:33.131 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:33.140+0000 7f334a99aec0 20 started zone id=7f922895-c6d7-4b1b-a19c-be3df5b5a899 (name=default) with tier type = 2019-11-29T12:50:33.522 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:33.532+0000 7f334a99aec0 20 add_watcher() i=0 2019-11-29T12:50:33.522 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:33.532+0000 7f334a99aec0 20 add_watcher() i=1 2019-11-29T12:50:33.522 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:33.532+0000 7f334a99aec0 20 add_watcher() i=2 2019-11-29T12:50:33.522 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:33.532+0000 7f334a99aec0 20 add_watcher() i=3 2019-11-29T12:50:33.522 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:33.532+0000 7f334a99aec0 20 add_watcher() i=4 2019-11-29T12:50:33.523 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:33.532+0000 7f334a99aec0 20 add_watcher() i=5 2019-11-29T12:50:33.525 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:33.535+0000 7f334a99aec0 20 add_watcher() i=6 2019-11-29T12:50:33.551 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:33.561+0000 7f334a99aec0 20 add_watcher() i=7 2019-11-29T12:50:33.551 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:33.561+0000 7f334a99aec0 2 all 8 watchers are set, enabling cache 2019-11-29T12:50:33.551 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:33.561+0000 7f328bfff700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-29T12:50:33.558 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:33.568+0000 7f33373c6700 0 -- 172.21.15.62:0/375546254 >> v2:172.21.15.22:3300/0 conn(0x55c5697f7d00 msgr2=0x55c5697fa210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2019-11-29T12:50:33.761 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:33.771+0000 7f33373c6700 0 --2- 172.21.15.62:0/375546254 >> v2:172.21.15.22:3300/0 conn(0x55c5697f7d00 0x55c5697fa210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2019-11-29T12:50:33.803 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:33.813+0000 7f3337bc7700 0 -- 172.21.15.62:0/1448119694 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55c5697fa010 msgr2=0x55c5697fc430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-29T12:50:35.524 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:35.534+0000 7f32767fc700 20 reqs_thread_entry: start 2019-11-29T12:50:35.524 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:35.534+0000 7f326ffff700 20 reqs_thread_entry: start 2019-11-29T12:50:35.524 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:35.534+0000 7f334a99aec0 20 init_complete bucket index max shards: 0 2019-11-29T12:50:35.525 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:35.535+0000 7f326e7fc700 20 reqs_thread_entry: start 2019-11-29T12:50:35.525 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:35.535+0000 7f334a99aec0 20 get_system_obj_state: rctx=0x7ffdb2579b68 obj=default.rgw.meta:users.uid:ragweed.client.0 state=0x55c569870be0 s->prefetch_data=0 2019-11-29T12:50:35.525 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:35.535+0000 7f334a99aec0 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2019-11-29T12:50:35.541 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:35.551+0000 7f334a99aec0 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x16 2019-11-29T12:50:35.541 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:35.551+0000 7f334a99aec0 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2019-11-29T12:50:35.541 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:35.551+0000 7f334a99aec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-29T12:50:35.542 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:35.551+0000 7f334a99aec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-29T12:50:35.542 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:35.551+0000 7f334a99aec0 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : type miss (requested=0x11, cached=0x16) 2019-11-29T12:50:35.542 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:35.551+0000 7f334a99aec0 20 rados->read ofs=0 len=0 2019-11-29T12:50:35.555 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:35.565+0000 7f334a99aec0 20 rados_obj.operate() r=0 bl.length=448 2019-11-29T12:50:35.555 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:35.565+0000 7f334a99aec0 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x11 2019-11-29T12:50:35.555 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:35.565+0000 7f334a99aec0 10 moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2019-11-29T12:50:35.584 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:35.594+0000 7f334a99aec0 20 get_system_obj_state: rctx=0x7ffdb2579930 obj=default.rgw.meta:root:test-client.0-conf state=0x55c569872500 s->prefetch_data=0 2019-11-29T12:50:35.584 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:35.594+0000 7f334a99aec0 10 cache get: name=default.rgw.meta+root+test-client.0-conf : miss 2019-11-29T12:50:35.596 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:35.606+0000 7f334a99aec0 10 cache put: name=default.rgw.meta+root+test-client.0-conf info.flags=0x6 2019-11-29T12:50:35.596 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:35.606+0000 7f334a99aec0 10 adding default.rgw.meta+root+test-client.0-conf to cache LRU end 2019-11-29T12:50:35.596 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:35.606+0000 7f334a99aec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-29T12:50:35.596 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:35.606+0000 7f334a99aec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-29T12:50:35.596 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:35.606+0000 7f334a99aec0 10 cache get: name=default.rgw.meta+root+test-client.0-conf : type miss (requested=0x1, cached=0x6) 2019-11-29T12:50:35.596 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:35.606+0000 7f334a99aec0 20 rados->read ofs=0 len=0 2019-11-29T12:50:35.605 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:35.615+0000 7f334a99aec0 20 rados_obj.operate() r=0 bl.length=200 2019-11-29T12:50:35.605 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:35.615+0000 7f334a99aec0 10 cache put: name=default.rgw.meta+root+test-client.0-conf info.flags=0x1 2019-11-29T12:50:35.606 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:35.615+0000 7f334a99aec0 10 moving default.rgw.meta+root+test-client.0-conf to cache LRU end 2019-11-29T12:50:35.606 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:35.615+0000 7f334a99aec0 20 get_system_obj_state: rctx=0x7ffdb2579930 obj=default.rgw.meta:root:.bucket.meta.test-client.0-conf:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.1 state=0x55c569874ac0 s->prefetch_data=0 2019-11-29T12:50:35.606 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:35.615+0000 7f334a99aec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.1 : miss 2019-11-29T12:50:35.628 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:35.638+0000 7f334a99aec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.1 info.flags=0x16 2019-11-29T12:50:35.628 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:35.638+0000 7f334a99aec0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-conf:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.1 to cache LRU end 2019-11-29T12:50:35.629 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:35.638+0000 7f334a99aec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-29T12:50:35.629 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:35.638+0000 7f334a99aec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-29T12:50:35.629 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:35.638+0000 7f334a99aec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-29T12:50:35.629 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:35.638+0000 7f334a99aec0 20 Read xattr: user.rgw.acl 2019-11-29T12:50:35.629 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:35.638+0000 7f334a99aec0 20 Read xattr: user.rgw.idtag 2019-11-29T12:50:35.629 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:35.638+0000 7f334a99aec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.1 : type miss (requested=0x13, cached=0x16) 2019-11-29T12:50:35.629 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:35.638+0000 7f334a99aec0 20 rados->read ofs=0 len=0 2019-11-29T12:50:35.665 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:35.675+0000 7f334a99aec0 20 rados_obj.operate() r=0 bl.length=292 2019-11-29T12:50:35.665 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:35.675+0000 7f334a99aec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.1 info.flags=0x13 2019-11-29T12:50:35.665 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:35.675+0000 7f334a99aec0 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-conf:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.1 to cache LRU end 2019-11-29T12:50:35.665 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:35.675+0000 7f334a99aec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-29T12:50:35.665 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:35.675+0000 7f334a99aec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-29T12:50:35.666 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:35.675+0000 7f334a99aec0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-conf:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.1 2019-11-29T12:50:35.699 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:35.709+0000 7f334a99aec0 10 cls_bucket_list_unordered :test-client.0-conf[7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.1]) start [] num_entries 1100 2019-11-29T12:50:35.768 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:35.777+0000 7f334a99aec0 10 RGWRados::cls_bucket_list_unordered: got tests/r_test_multipart_defer_complete[] 2019-11-29T12:50:35.768 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:35.777+0000 7f334a99aec0 10 RGWRados::cls_bucket_list_unordered: got tests/r_test_multipart_defer_update_complete[] 2019-11-29T12:50:35.768 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:35.777+0000 7f334a99aec0 10 RGWRados::cls_bucket_list_unordered: got tests/r_test_multipart_index_versioning[] 2019-11-29T12:50:35.768 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:35.777+0000 7f334a99aec0 10 RGWRados::cls_bucket_list_unordered: got tests/r_test_multipart_simple[] 2019-11-29T12:50:35.768 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:35.777+0000 7f334a99aec0 10 RGWRados::cls_bucket_list_unordered: got tests/r_test_obj_storage_class[] 2019-11-29T12:50:35.768 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:35.777+0000 7f334a99aec0 10 RGWRados::cls_bucket_list_unordered: got tests/r_test_obj_storage_class_copy[] 2019-11-29T12:50:35.769 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:35.777+0000 7f334a99aec0 10 RGWRados::cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart[] 2019-11-29T12:50:35.769 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:35.777+0000 7f334a99aec0 10 RGWRados::cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart_copy[] 2019-11-29T12:50:35.769 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:35.777+0000 7f334a99aec0 10 RGWRados::cls_bucket_list_unordered: got tests/r_test_small_obj_data[] 2019-11-29T12:50:35.769 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:35.777+0000 7f334a99aec0 20 get_obj_state: rctx=0x7ffdb2579950 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x55c569879ce8 s->prefetch_data=0 2019-11-29T12:50:35.783 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:35.793+0000 7f334a99aec0 10 manifest: total_size = 3874 2019-11-29T12:50:35.783 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:35.793+0000 7f334a99aec0 20 get_obj_state: setting s->obj_tag to 7f922895-c6d7-4b1b-a19c-be3df5b5a899.4325.13 2019-11-29T12:50:35.783 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:35.793+0000 7f334a99aec0 20 get_obj_state: rctx=0x7ffdb2579950 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x55c569879ce8 s->prefetch_data=0 2019-11-29T12:50:35.784 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:35.793+0000 7f334a99aec0 20 prepare_atomic_modification: state is not atomic. state=0x55c569879ce8 2019-11-29T12:50:35.784 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:35.793+0000 7f334a99aec0 20 bucket index object: default.rgw.buckets.index:.dir.7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.1 2019-11-29T12:50:35.897 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:35.907+0000 7f334a99aec0 20 get_obj_state: rctx=0x7ffdb2579950 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x55c569879ce8 s->prefetch_data=0 2019-11-29T12:50:35.906 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:35.916+0000 7f334a99aec0 10 manifest: total_size = 3913 2019-11-29T12:50:35.906 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:35.916+0000 7f334a99aec0 20 get_obj_state: setting s->obj_tag to 7f922895-c6d7-4b1b-a19c-be3df5b5a899.4325.30 2019-11-29T12:50:35.906 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:35.916+0000 7f334a99aec0 20 get_obj_state: rctx=0x7ffdb2579950 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x55c569879ce8 s->prefetch_data=0 2019-11-29T12:50:35.906 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:35.916+0000 7f334a99aec0 20 prepare_atomic_modification: state is not atomic. state=0x55c569879ce8 2019-11-29T12:50:35.906 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:35.916+0000 7f334a99aec0 20 bucket index object: default.rgw.buckets.index:.dir.7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.1 2019-11-29T12:50:36.105 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:36.115+0000 7f334a99aec0 20 get_obj_state: rctx=0x7ffdb2579950 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x55c569879ce8 s->prefetch_data=0 2019-11-29T12:50:36.122 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:36.132+0000 7f334a99aec0 10 manifest: total_size = 9705 2019-11-29T12:50:36.122 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:36.132+0000 7f334a99aec0 20 get_obj_state: setting s->obj_tag to 7f922895-c6d7-4b1b-a19c-be3df5b5a899.4325.56 2019-11-29T12:50:36.122 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:36.132+0000 7f334a99aec0 20 get_obj_state: rctx=0x7ffdb2579950 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x55c569879ce8 s->prefetch_data=0 2019-11-29T12:50:36.122 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:36.132+0000 7f334a99aec0 20 prepare_atomic_modification: state is not atomic. state=0x55c569879ce8 2019-11-29T12:50:36.122 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:36.132+0000 7f334a99aec0 20 bucket index object: default.rgw.buckets.index:.dir.7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.1 2019-11-29T12:50:36.282 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:36.292+0000 7f334a99aec0 20 get_obj_state: rctx=0x7ffdb2579950 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x55c569879ce8 s->prefetch_data=0 2019-11-29T12:50:36.291 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:36.301+0000 7f334a99aec0 10 manifest: total_size = 9708 2019-11-29T12:50:36.291 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:36.301+0000 7f334a99aec0 20 get_obj_state: setting s->obj_tag to 7f922895-c6d7-4b1b-a19c-be3df5b5a899.4325.72 2019-11-29T12:50:36.292 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:36.301+0000 7f334a99aec0 20 get_obj_state: rctx=0x7ffdb2579950 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x55c569879ce8 s->prefetch_data=0 2019-11-29T12:50:36.292 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:36.301+0000 7f334a99aec0 20 prepare_atomic_modification: state is not atomic. state=0x55c569879ce8 2019-11-29T12:50:36.292 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:36.301+0000 7f334a99aec0 20 bucket index object: default.rgw.buckets.index:.dir.7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.1 2019-11-29T12:50:36.467 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:36.477+0000 7f334a99aec0 20 get_obj_state: rctx=0x7ffdb2579950 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x55c569879ce8 s->prefetch_data=0 2019-11-29T12:50:36.483 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:36.493+0000 7f334a99aec0 10 manifest: total_size = 10474 2019-11-29T12:50:36.483 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:36.493+0000 7f334a99aec0 20 get_obj_state: setting s->obj_tag to 7f922895-c6d7-4b1b-a19c-be3df5b5a899.4325.87 2019-11-29T12:50:36.483 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:36.493+0000 7f334a99aec0 20 get_obj_state: rctx=0x7ffdb2579950 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x55c569879ce8 s->prefetch_data=0 2019-11-29T12:50:36.484 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:36.493+0000 7f334a99aec0 20 prepare_atomic_modification: state is not atomic. state=0x55c569879ce8 2019-11-29T12:50:36.484 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:36.493+0000 7f334a99aec0 20 bucket index object: default.rgw.buckets.index:.dir.7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.1 2019-11-29T12:50:36.636 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:36.646+0000 7f334a99aec0 20 get_obj_state: rctx=0x7ffdb2579950 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x55c569879ce8 s->prefetch_data=0 2019-11-29T12:50:36.648 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:36.658+0000 7f334a99aec0 10 manifest: total_size = 3948 2019-11-29T12:50:36.648 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:36.658+0000 7f334a99aec0 20 get_obj_state: setting s->obj_tag to 7f922895-c6d7-4b1b-a19c-be3df5b5a899.4325.120 2019-11-29T12:50:36.648 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:36.658+0000 7f334a99aec0 20 get_obj_state: rctx=0x7ffdb2579950 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x55c569879ce8 s->prefetch_data=0 2019-11-29T12:50:36.649 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:36.658+0000 7f334a99aec0 20 prepare_atomic_modification: state is not atomic. state=0x55c569879ce8 2019-11-29T12:50:36.649 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:36.658+0000 7f334a99aec0 20 bucket index object: default.rgw.buckets.index:.dir.7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.1 2019-11-29T12:50:36.819 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:36.829+0000 7f334a99aec0 20 get_obj_state: rctx=0x7ffdb2579950 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x55c569879ce8 s->prefetch_data=0 2019-11-29T12:50:36.829 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:36.839+0000 7f334a99aec0 10 manifest: total_size = 6138 2019-11-29T12:50:36.829 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:36.839+0000 7f334a99aec0 20 get_obj_state: setting s->obj_tag to 7f922895-c6d7-4b1b-a19c-be3df5b5a899.4325.189 2019-11-29T12:50:36.829 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:36.839+0000 7f334a99aec0 20 get_obj_state: rctx=0x7ffdb2579950 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x55c569879ce8 s->prefetch_data=0 2019-11-29T12:50:36.829 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:36.839+0000 7f334a99aec0 20 prepare_atomic_modification: state is not atomic. state=0x55c569879ce8 2019-11-29T12:50:36.830 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:36.839+0000 7f334a99aec0 20 bucket index object: default.rgw.buckets.index:.dir.7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.1 2019-11-29T12:50:36.966 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:36.976+0000 7f334a99aec0 20 get_obj_state: rctx=0x7ffdb2579950 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x55c569879ce8 s->prefetch_data=0 2019-11-29T12:50:36.975 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:36.985+0000 7f334a99aec0 10 manifest: total_size = 4023 2019-11-29T12:50:36.975 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:36.985+0000 7f334a99aec0 20 get_obj_state: setting s->obj_tag to 7f922895-c6d7-4b1b-a19c-be3df5b5a899.4325.246 2019-11-29T12:50:36.975 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:36.985+0000 7f334a99aec0 20 get_obj_state: rctx=0x7ffdb2579950 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x55c569879ce8 s->prefetch_data=0 2019-11-29T12:50:36.975 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:36.985+0000 7f334a99aec0 20 prepare_atomic_modification: state is not atomic. state=0x55c569879ce8 2019-11-29T12:50:36.975 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:36.985+0000 7f334a99aec0 20 bucket index object: default.rgw.buckets.index:.dir.7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.1 2019-11-29T12:50:37.137 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:37.147+0000 7f334a99aec0 20 get_obj_state: rctx=0x7ffdb2579950 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x55c569879ce8 s->prefetch_data=0 2019-11-29T12:50:37.148 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:37.158+0000 7f334a99aec0 10 manifest: total_size = 4001 2019-11-29T12:50:37.148 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:37.158+0000 7f334a99aec0 20 get_obj_state: setting s->obj_tag to 7f922895-c6d7-4b1b-a19c-be3df5b5a899.4325.322 2019-11-29T12:50:37.148 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:37.158+0000 7f334a99aec0 20 get_obj_state: rctx=0x7ffdb2579950 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x55c569879ce8 s->prefetch_data=0 2019-11-29T12:50:37.148 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:37.158+0000 7f334a99aec0 20 prepare_atomic_modification: state is not atomic. state=0x55c569879ce8 2019-11-29T12:50:37.148 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:37.158+0000 7f334a99aec0 20 bucket index object: default.rgw.buckets.index:.dir.7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.1 2019-11-29T12:50:37.337 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:37.347+0000 7f334a99aec0 10 cls_bucket_list_ordered :test-client.0-conf[7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.1]) start _multipart_[] num_entries 1001 2019-11-29T12:50:37.337 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:37.347+0000 7f334a99aec0 10 cls_bucket_list_ordered request from each of 1 shard(s) for 1002 entries to get 1001 total entries 2019-11-29T12:50:37.459 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:37.469+0000 7f334a99aec0 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-conf[7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.1])"; objs.size()=0; is_truncated=0 2019-11-29T12:50:37.566 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:37.576+0000 7f334a99aec0 20 get_system_obj_state: rctx=0x7ffdb25792e8 obj=default.rgw.meta:root:test-client.0-conf state=0x55c56987a870 s->prefetch_data=0 2019-11-29T12:50:37.566 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:37.576+0000 7f334a99aec0 10 cache get: name=default.rgw.meta+root+test-client.0-conf : type miss (requested=0x16, cached=0x3) 2019-11-29T12:50:37.581 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:37.591+0000 7f334a99aec0 10 cache put: name=default.rgw.meta+root+test-client.0-conf info.flags=0x16 2019-11-29T12:50:37.581 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:37.591+0000 7f334a99aec0 10 moving default.rgw.meta+root+test-client.0-conf to cache LRU end 2019-11-29T12:50:37.581 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:37.591+0000 7f334a99aec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-29T12:50:37.582 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:37.591+0000 7f334a99aec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-29T12:50:37.582 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:37.591+0000 7f334a99aec0 10 cache get: name=default.rgw.meta+root+test-client.0-conf : hit (requested=0x11, cached=0x17) 2019-11-29T12:50:37.582 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:37.591+0000 7f334a99aec0 10 removing default.rgw.meta+root+test-client.0-conf from cache 2019-11-29T12:50:37.582 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:37.591+0000 7f334a99aec0 10 distributing notification oid=default.rgw.control:notify.0 bl.length()=162 2019-11-29T12:50:37.624 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:37.634+0000 7f332d7fa700 10 RGWWatcher::handle_notify() notify_id 566935683072 cookie 94306366779648 notifier 4711 bl.length()=162 2019-11-29T12:50:38.306 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:38.316+0000 7f334a99aec0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-conf:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.1 from cache 2019-11-29T12:50:38.307 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:38.316+0000 7f334a99aec0 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=219 2019-11-29T12:50:38.317 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:38.327+0000 7f332d7fa700 10 RGWWatcher::handle_notify() notify_id 566935683078 cookie 94306366786192 notifier 4711 bl.length()=219 2019-11-29T12:50:38.539 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:38.549+0000 7f334a99aec0 20 get_system_obj_state: rctx=0x7ffdb2579930 obj=default.rgw.meta:root:test-client.0-r-test-multipart-defer-complete.1 state=0x55c56987b2d0 s->prefetch_data=0 2019-11-29T12:50:38.540 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:38.549+0000 7f334a99aec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 : miss 2019-11-29T12:50:38.552 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:38.561+0000 7f334a99aec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 info.flags=0x6 2019-11-29T12:50:38.552 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:38.561+0000 7f334a99aec0 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 to cache LRU end 2019-11-29T12:50:38.552 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:38.561+0000 7f334a99aec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-29T12:50:38.552 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:38.561+0000 7f334a99aec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-29T12:50:38.552 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:38.561+0000 7f334a99aec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 : type miss (requested=0x1, cached=0x6) 2019-11-29T12:50:38.552 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:38.561+0000 7f334a99aec0 20 rados->read ofs=0 len=0 2019-11-29T12:50:38.568 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:38.578+0000 7f334a99aec0 20 rados_obj.operate() r=0 bl.length=229 2019-11-29T12:50:38.568 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:38.578+0000 7f334a99aec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 info.flags=0x1 2019-11-29T12:50:38.568 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:38.578+0000 7f334a99aec0 10 moving default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 to cache LRU end 2019-11-29T12:50:38.568 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:38.578+0000 7f334a99aec0 20 get_system_obj_state: rctx=0x7ffdb2579930 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.2 state=0x55c56987a870 s->prefetch_data=0 2019-11-29T12:50:38.569 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:38.578+0000 7f334a99aec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.2 : miss 2019-11-29T12:50:38.602 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:38.611+0000 7f334a99aec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.2 info.flags=0x16 2019-11-29T12:50:38.602 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:38.611+0000 7f334a99aec0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.2 to cache LRU end 2019-11-29T12:50:38.602 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:38.611+0000 7f334a99aec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-29T12:50:38.602 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:38.611+0000 7f334a99aec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-29T12:50:38.602 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:38.611+0000 7f334a99aec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-29T12:50:38.602 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:38.611+0000 7f334a99aec0 20 Read xattr: user.rgw.acl 2019-11-29T12:50:38.603 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:38.611+0000 7f334a99aec0 20 Read xattr: user.rgw.idtag 2019-11-29T12:50:38.603 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:38.611+0000 7f334a99aec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.2 : type miss (requested=0x13, cached=0x16) 2019-11-29T12:50:38.603 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:38.611+0000 7f334a99aec0 20 rados->read ofs=0 len=0 2019-11-29T12:50:38.627 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:38.637+0000 7f334a99aec0 20 rados_obj.operate() r=0 bl.length=321 2019-11-29T12:50:38.627 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:38.637+0000 7f334a99aec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.2 info.flags=0x13 2019-11-29T12:50:38.627 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:38.637+0000 7f334a99aec0 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.2 to cache LRU end 2019-11-29T12:50:38.627 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:38.637+0000 7f334a99aec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-29T12:50:38.627 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:38.637+0000 7f334a99aec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-29T12:50:38.627 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:38.637+0000 7f334a99aec0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.2 2019-11-29T12:50:38.642 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:38.652+0000 7f334a99aec0 10 cls_bucket_list_unordered :test-client.0-r-test-multipart-defer-complete.1[7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.2]) start [] num_entries 1100 2019-11-29T12:50:38.669 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:38.679+0000 7f334a99aec0 10 RGWRados::cls_bucket_list_unordered: got foo[] 2019-11-29T12:50:38.669 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:38.679+0000 7f334a99aec0 20 get_obj_state: rctx=0x7ffdb2579950 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x55c569879c58 s->prefetch_data=0 2019-11-29T12:50:38.686 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:38.696+0000 7f334a99aec0 10 manifest: total_size = 886297 2019-11-29T12:50:38.686 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:38.696+0000 7f334a99aec0 20 get_obj_state: setting s->obj_tag to 7f922895-c6d7-4b1b-a19c-be3df5b5a899.4325.20 2019-11-29T12:50:38.686 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:38.696+0000 7f334a99aec0 20 get_obj_state: rctx=0x7ffdb2579950 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x55c569879c58 s->prefetch_data=0 2019-11-29T12:50:38.687 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:38.696+0000 7f334a99aec0 20 prepare_atomic_modification: state is not atomic. state=0x55c569879c58 2019-11-29T12:50:38.687 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:38.696+0000 7f334a99aec0 20 bucket index object: default.rgw.buckets.index:.dir.7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.2 2019-11-29T12:50:38.811 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:38.821+0000 7f334a99aec0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2019-11-29T12:50:38.811 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:38.821+0000 7f334a99aec0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=246247 2019-11-29T12:50:38.812 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:38.821+0000 7f334a99aec0 20 RGWObjManifest::operator++(): result: ofs=246247 stripe_ofs=246247 part_ofs=246247 rule->part_size=246247 2019-11-29T12:50:38.812 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:38.821+0000 7f334a99aec0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2019-11-29T12:50:38.812 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:38.821+0000 7f334a99aec0 20 RGWObjManifest::operator++(): stripe_ofs=4440551 part_ofs=246247 rule->part_size=246247 2019-11-29T12:50:38.812 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:38.821+0000 7f334a99aec0 20 RGWObjManifest::operator++(): result: ofs=492494 stripe_ofs=492494 part_ofs=492494 rule->part_size=246247 2019-11-29T12:50:38.812 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:38.821+0000 7f334a99aec0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2019-11-29T12:50:38.812 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:38.821+0000 7f334a99aec0 20 RGWObjManifest::operator++(): stripe_ofs=4686798 part_ofs=492494 rule->part_size=246247 2019-11-29T12:50:38.813 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:38.821+0000 7f334a99aec0 20 RGWObjManifest::operator++(): result: ofs=738741 stripe_ofs=738741 part_ofs=738741 rule->part_size=147556 2019-11-29T12:50:38.813 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:38.821+0000 7f334a99aec0 20 RGWObjManifest::operator++(): rule->part_size=147556 rules.size()=2 2019-11-29T12:50:38.813 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:38.821+0000 7f334a99aec0 20 RGWObjManifest::operator++(): stripe_ofs=4933045 part_ofs=738741 rule->part_size=147556 2019-11-29T12:50:38.813 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:38.821+0000 7f334a99aec0 20 RGWObjManifest::operator++(): result: ofs=886297 stripe_ofs=886297 part_ofs=886297 rule->part_size=147556 2019-11-29T12:50:38.813 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:38.821+0000 7f334a99aec0 20 garbage collection: RGWGC::send_chain - on object name: gc.0tag is: 7f922895-c6d7-4b1b-a19c-be3df5b5a899.4325.20 2019-11-29T12:50:38.913 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:38.923+0000 7f334a99aec0 10 cls_bucket_list_ordered :test-client.0-r-test-multipart-defer-complete.1[7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.2]) start _multipart_[] num_entries 1001 2019-11-29T12:50:38.913 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:38.923+0000 7f334a99aec0 10 cls_bucket_list_ordered request from each of 1 shard(s) for 1002 entries to get 1001 total entries 2019-11-29T12:50:38.932 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:38.942+0000 7f334a99aec0 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-complete.1[7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.2])"; objs.size()=0; is_truncated=0 2019-11-29T12:50:39.003 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:39.013+0000 7f334a99aec0 20 get_system_obj_state: rctx=0x7ffdb25792e8 obj=default.rgw.meta:root:test-client.0-r-test-multipart-defer-complete.1 state=0x55c569874690 s->prefetch_data=0 2019-11-29T12:50:39.003 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:39.013+0000 7f334a99aec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 : type miss (requested=0x16, cached=0x3) 2019-11-29T12:50:39.025 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:39.032+0000 7f334a99aec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 info.flags=0x16 2019-11-29T12:50:39.026 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:39.032+0000 7f334a99aec0 10 moving default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 to cache LRU end 2019-11-29T12:50:39.027 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:39.032+0000 7f334a99aec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-29T12:50:39.027 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:39.032+0000 7f334a99aec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-29T12:50:39.028 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:39.032+0000 7f334a99aec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 : hit (requested=0x11, cached=0x17) 2019-11-29T12:50:39.028 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:39.032+0000 7f334a99aec0 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 from cache 2019-11-29T12:50:39.029 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:39.032+0000 7f334a99aec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=191 2019-11-29T12:50:39.087 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:39.097+0000 7f332d7fa700 10 RGWWatcher::handle_notify() notify_id 566935683072 cookie 94306366781632 notifier 4711 bl.length()=191 2019-11-29T12:50:39.279 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:39.289+0000 7f334a99aec0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.2 from cache 2019-11-29T12:50:39.279 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:39.289+0000 7f334a99aec0 10 distributing notification oid=default.rgw.control:notify.5 bl.length()=248 2019-11-29T12:50:39.304 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:39.314+0000 7f332d7fa700 10 RGWWatcher::handle_notify() notify_id 566935683073 cookie 94306366793056 notifier 4711 bl.length()=248 2019-11-29T12:50:39.762 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:39.772+0000 7f334a99aec0 20 get_system_obj_state: rctx=0x7ffdb2579930 obj=default.rgw.meta:root:test-client.0-r-test-multipart-defer-update-complete.1 state=0x55c56987a870 s->prefetch_data=0 2019-11-29T12:50:39.762 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:39.772+0000 7f334a99aec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 : miss 2019-11-29T12:50:39.771 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:39.781+0000 7f334a99aec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 info.flags=0x6 2019-11-29T12:50:39.771 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:39.781+0000 7f334a99aec0 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 to cache LRU end 2019-11-29T12:50:39.771 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:39.781+0000 7f334a99aec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-29T12:50:39.771 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:39.781+0000 7f334a99aec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-29T12:50:39.772 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:39.781+0000 7f334a99aec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 : type miss (requested=0x1, cached=0x6) 2019-11-29T12:50:39.772 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:39.781+0000 7f334a99aec0 20 rados->read ofs=0 len=0 2019-11-29T12:50:39.787 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:39.797+0000 7f334a99aec0 20 rados_obj.operate() r=0 bl.length=236 2019-11-29T12:50:39.787 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:39.797+0000 7f334a99aec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 info.flags=0x1 2019-11-29T12:50:39.787 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:39.797+0000 7f334a99aec0 10 moving default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 to cache LRU end 2019-11-29T12:50:39.787 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:39.797+0000 7f334a99aec0 20 get_system_obj_state: rctx=0x7ffdb2579930 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.3 state=0x55c56987b2d0 s->prefetch_data=0 2019-11-29T12:50:39.788 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:39.797+0000 7f334a99aec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.3 : miss 2019-11-29T12:50:39.803 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:39.813+0000 7f334a99aec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.3 info.flags=0x16 2019-11-29T12:50:39.803 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:39.813+0000 7f334a99aec0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.3 to cache LRU end 2019-11-29T12:50:39.803 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:39.813+0000 7f334a99aec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-29T12:50:39.803 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:39.813+0000 7f334a99aec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-29T12:50:39.804 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:39.813+0000 7f334a99aec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-29T12:50:39.804 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:39.813+0000 7f334a99aec0 20 Read xattr: user.rgw.acl 2019-11-29T12:50:39.804 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:39.813+0000 7f334a99aec0 20 Read xattr: user.rgw.idtag 2019-11-29T12:50:39.804 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:39.813+0000 7f334a99aec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.3 : type miss (requested=0x13, cached=0x16) 2019-11-29T12:50:39.804 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:39.813+0000 7f334a99aec0 20 rados->read ofs=0 len=0 2019-11-29T12:50:39.826 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:39.836+0000 7f334a99aec0 20 rados_obj.operate() r=0 bl.length=328 2019-11-29T12:50:39.826 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:39.836+0000 7f334a99aec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.3 info.flags=0x13 2019-11-29T12:50:39.827 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:39.836+0000 7f334a99aec0 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.3 to cache LRU end 2019-11-29T12:50:39.827 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:39.836+0000 7f334a99aec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-29T12:50:39.827 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:39.836+0000 7f334a99aec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-29T12:50:39.827 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:39.836+0000 7f334a99aec0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.3 2019-11-29T12:50:39.862 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:39.872+0000 7f334a99aec0 10 cls_bucket_list_unordered :test-client.0-r-test-multipart-defer-update-complete.1[7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.3]) start [] num_entries 1100 2019-11-29T12:50:39.894 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:39.904+0000 7f334a99aec0 10 RGWRados::cls_bucket_list_unordered: got foo[] 2019-11-29T12:50:39.894 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:39.904+0000 7f334a99aec0 20 get_obj_state: rctx=0x7ffdb2579950 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x55c569879fc8 s->prefetch_data=0 2019-11-29T12:50:39.907 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:39.913+0000 7f334a99aec0 10 manifest: total_size = 1848 2019-11-29T12:50:39.907 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:39.913+0000 7f334a99aec0 20 get_obj_state: setting s->obj_tag to 7f922895-c6d7-4b1b-a19c-be3df5b5a899.4325.40 2019-11-29T12:50:39.908 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:39.913+0000 7f334a99aec0 20 get_obj_state: rctx=0x7ffdb2579950 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x55c569879fc8 s->prefetch_data=0 2019-11-29T12:50:39.908 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:39.913+0000 7f334a99aec0 20 prepare_atomic_modification: state is not atomic. state=0x55c569879fc8 2019-11-29T12:50:39.908 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:39.913+0000 7f334a99aec0 20 bucket index object: default.rgw.buckets.index:.dir.7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.3 2019-11-29T12:50:40.022 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:40.032+0000 7f334a99aec0 20 RGWObjManifest::operator++(): rule->part_size=515 rules.size()=2 2019-11-29T12:50:40.022 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:40.032+0000 7f334a99aec0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=515 2019-11-29T12:50:40.023 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:40.032+0000 7f334a99aec0 20 RGWObjManifest::operator++(): result: ofs=515 stripe_ofs=515 part_ofs=515 rule->part_size=515 2019-11-29T12:50:40.023 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:40.032+0000 7f334a99aec0 20 RGWObjManifest::operator++(): rule->part_size=515 rules.size()=2 2019-11-29T12:50:40.023 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:40.032+0000 7f334a99aec0 20 RGWObjManifest::operator++(): stripe_ofs=4194819 part_ofs=515 rule->part_size=515 2019-11-29T12:50:40.023 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:40.032+0000 7f334a99aec0 20 RGWObjManifest::operator++(): result: ofs=1030 stripe_ofs=1030 part_ofs=1030 rule->part_size=515 2019-11-29T12:50:40.023 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:40.032+0000 7f334a99aec0 20 RGWObjManifest::operator++(): rule->part_size=515 rules.size()=2 2019-11-29T12:50:40.023 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:40.032+0000 7f334a99aec0 20 RGWObjManifest::operator++(): stripe_ofs=4195334 part_ofs=1030 rule->part_size=515 2019-11-29T12:50:40.023 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:40.032+0000 7f334a99aec0 20 RGWObjManifest::operator++(): result: ofs=1545 stripe_ofs=1545 part_ofs=1545 rule->part_size=303 2019-11-29T12:50:40.024 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:40.032+0000 7f334a99aec0 20 RGWObjManifest::operator++(): rule->part_size=303 rules.size()=2 2019-11-29T12:50:40.024 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:40.032+0000 7f334a99aec0 20 RGWObjManifest::operator++(): stripe_ofs=4195849 part_ofs=1545 rule->part_size=303 2019-11-29T12:50:40.024 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:40.032+0000 7f334a99aec0 20 RGWObjManifest::operator++(): result: ofs=1848 stripe_ofs=1848 part_ofs=1848 rule->part_size=303 2019-11-29T12:50:40.024 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:40.032+0000 7f334a99aec0 20 garbage collection: RGWGC::send_chain - on object name: gc.2tag is: 7f922895-c6d7-4b1b-a19c-be3df5b5a899.4325.40 2019-11-29T12:50:40.136 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:40.146+0000 7f334a99aec0 10 cls_bucket_list_ordered :test-client.0-r-test-multipart-defer-update-complete.1[7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.3]) start _multipart_[] num_entries 1001 2019-11-29T12:50:40.136 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:40.146+0000 7f334a99aec0 10 cls_bucket_list_ordered request from each of 1 shard(s) for 1002 entries to get 1001 total entries 2019-11-29T12:50:40.157 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:40.167+0000 7f334a99aec0 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-update-complete.1[7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.3])"; objs.size()=0; is_truncated=0 2019-11-29T12:50:40.245 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:40.255+0000 7f334a99aec0 20 get_system_obj_state: rctx=0x7ffdb25792e8 obj=default.rgw.meta:root:test-client.0-r-test-multipart-defer-update-complete.1 state=0x55c56987b2d0 s->prefetch_data=0 2019-11-29T12:50:40.245 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:40.255+0000 7f334a99aec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 : type miss (requested=0x16, cached=0x3) 2019-11-29T12:50:40.259 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:40.269+0000 7f334a99aec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 info.flags=0x16 2019-11-29T12:50:40.259 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:40.269+0000 7f334a99aec0 10 moving default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 to cache LRU end 2019-11-29T12:50:40.259 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:40.269+0000 7f334a99aec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-29T12:50:40.259 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:40.269+0000 7f334a99aec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-29T12:50:40.260 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:40.269+0000 7f334a99aec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 : hit (requested=0x11, cached=0x17) 2019-11-29T12:50:40.260 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:40.269+0000 7f334a99aec0 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 from cache 2019-11-29T12:50:40.260 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:40.269+0000 7f334a99aec0 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=198 2019-11-29T12:50:40.272 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:40.282+0000 7f332d7fa700 10 RGWWatcher::handle_notify() notify_id 566935683079 cookie 94306366786192 notifier 4711 bl.length()=198 2019-11-29T12:50:40.695 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:40.705+0000 7f334a99aec0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.3 from cache 2019-11-29T12:50:40.695 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:40.705+0000 7f334a99aec0 10 distributing notification oid=default.rgw.control:notify.4 bl.length()=255 2019-11-29T12:50:40.711 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:40.721+0000 7f332d7fa700 10 RGWWatcher::handle_notify() notify_id 566935683080 cookie 94306366791152 notifier 4711 bl.length()=255 2019-11-29T12:50:41.225 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:41.235+0000 7f334a99aec0 20 get_system_obj_state: rctx=0x7ffdb2579930 obj=default.rgw.meta:root:test-client.0-r-test-multipart-index-versioning.1 state=0x55c569874690 s->prefetch_data=0 2019-11-29T12:50:41.225 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:41.235+0000 7f334a99aec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 : miss 2019-11-29T12:50:41.236 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:41.246+0000 7f334a99aec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 info.flags=0x6 2019-11-29T12:50:41.237 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:41.246+0000 7f334a99aec0 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 to cache LRU end 2019-11-29T12:50:41.237 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:41.246+0000 7f334a99aec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-29T12:50:41.237 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:41.246+0000 7f334a99aec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-29T12:50:41.237 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:41.246+0000 7f334a99aec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 : type miss (requested=0x1, cached=0x6) 2019-11-29T12:50:41.237 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:41.246+0000 7f334a99aec0 20 rados->read ofs=0 len=0 2019-11-29T12:50:41.250 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:41.259+0000 7f334a99aec0 20 rados_obj.operate() r=0 bl.length=231 2019-11-29T12:50:41.250 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:41.260+0000 7f334a99aec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 info.flags=0x1 2019-11-29T12:50:41.250 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:41.260+0000 7f334a99aec0 10 moving default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 to cache LRU end 2019-11-29T12:50:41.250 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:41.260+0000 7f334a99aec0 20 get_system_obj_state: rctx=0x7ffdb2579930 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.4 state=0x55c56987a870 s->prefetch_data=0 2019-11-29T12:50:41.250 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:41.260+0000 7f334a99aec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.4 : miss 2019-11-29T12:50:41.266 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:41.276+0000 7f334a99aec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.4 info.flags=0x16 2019-11-29T12:50:41.267 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:41.276+0000 7f334a99aec0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.4 to cache LRU end 2019-11-29T12:50:41.267 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:41.276+0000 7f334a99aec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-29T12:50:41.267 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:41.276+0000 7f334a99aec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-29T12:50:41.267 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:41.276+0000 7f334a99aec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-29T12:50:41.267 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:41.276+0000 7f334a99aec0 20 Read xattr: user.rgw.acl 2019-11-29T12:50:41.267 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:41.276+0000 7f334a99aec0 20 Read xattr: user.rgw.idtag 2019-11-29T12:50:41.267 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:41.276+0000 7f334a99aec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.4 : type miss (requested=0x13, cached=0x16) 2019-11-29T12:50:41.268 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:41.276+0000 7f334a99aec0 20 rados->read ofs=0 len=0 2019-11-29T12:50:41.290 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:41.300+0000 7f334a99aec0 20 rados_obj.operate() r=0 bl.length=323 2019-11-29T12:50:41.290 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:41.300+0000 7f334a99aec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.4 info.flags=0x13 2019-11-29T12:50:41.291 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:41.300+0000 7f334a99aec0 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.4 to cache LRU end 2019-11-29T12:50:41.291 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:41.300+0000 7f334a99aec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-29T12:50:41.291 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:41.300+0000 7f334a99aec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-29T12:50:41.291 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:41.300+0000 7f334a99aec0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.4 2019-11-29T12:50:41.305 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:41.315+0000 7f334a99aec0 10 cls_bucket_list_unordered :test-client.0-r-test-multipart-index-versioning.1[7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.4]) start [] num_entries 1100 2019-11-29T12:50:41.331 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:41.340+0000 7f334a99aec0 10 RGWRados::cls_bucket_list_unordered: got foo[GRAR73qExppljd6wbslUK7d3aSNc9OH] 2019-11-29T12:50:41.331 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:41.340+0000 7f334a99aec0 20 bucket index object: default.rgw.buckets.index:.dir.7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.4 2019-11-29T12:50:41.342 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:41.353+0000 7f334a99aec0 20 get_obj_state: rctx=0x7ffdb2579950 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x55c56987fc48 s->prefetch_data=0 2019-11-29T12:50:41.351 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:41.361+0000 7f334a99aec0 20 get_obj_state: setting s->obj_tag to 3mn8k3z718o994d3m74z21z7nc6q9ih9 2019-11-29T12:50:41.351 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:41.361+0000 7f334a99aec0 20 get_obj_state_impl: setting s->olh_tag to rhax1k667uw64j2yvu0xkf8ij6jryvac 2019-11-29T12:50:41.352 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:41.361+0000 7f334a99aec0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=rhax1k667uw64j2yvu0xkf8ij6jryvac 2019-11-29T12:50:41.383 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:41.392+0000 7f334a99aec0 20 bucket index object: default.rgw.buckets.index:.dir.7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.4 2019-11-29T12:50:41.503 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:41.512+0000 7f334a99aec0 20 bucket index object: default.rgw.buckets.index:.dir.7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.4 2019-11-29T12:50:41.503 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:41.512+0000 7f334a99aec0 20 bucket index object: default.rgw.buckets.index:.dir.7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.4 2019-11-29T12:50:41.531 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:41.541+0000 7f334a99aec0 20 olh_log_entry: epoch=3 op=2 key=[] 2019-11-29T12:50:41.531 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:41.541+0000 7f334a99aec0 20 olh_log_entry: epoch=3 op=3 key=foo[GRAR73qExppljd6wbslUK7d3aSNc9OH] 2019-11-29T12:50:41.531 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:41.541+0000 7f334a99aec0 20 get_obj_state: rctx=0x7ffdb2579950 obj=test-client.0-r-test-multipart-index-versioning.1:_:GRAR73qExppljd6wbslUK7d3aSNc9OH_foo state=0x55c5698873a8 s->prefetch_data=0 2019-11-29T12:50:41.542 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:41.552+0000 7f334a99aec0 10 manifest: total_size = 886297 2019-11-29T12:50:41.542 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:41.552+0000 7f334a99aec0 20 get_obj_state: setting s->obj_tag to 7f922895-c6d7-4b1b-a19c-be3df5b5a899.4325.55 2019-11-29T12:50:41.542 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:41.552+0000 7f334a99aec0 20 get_obj_state: rctx=0x7ffdb2579950 obj=test-client.0-r-test-multipart-index-versioning.1:_:GRAR73qExppljd6wbslUK7d3aSNc9OH_foo state=0x55c5698873a8 s->prefetch_data=0 2019-11-29T12:50:41.542 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:41.552+0000 7f334a99aec0 20 prepare_atomic_modification: state is not atomic. state=0x55c5698873a8 2019-11-29T12:50:41.543 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:41.552+0000 7f334a99aec0 20 bucket index object: default.rgw.buckets.index:.dir.7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.4 2019-11-29T12:50:41.667 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:41.677+0000 7f334a99aec0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2019-11-29T12:50:41.667 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:41.677+0000 7f334a99aec0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=246247 2019-11-29T12:50:41.668 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:41.677+0000 7f334a99aec0 20 RGWObjManifest::operator++(): result: ofs=246247 stripe_ofs=246247 part_ofs=246247 rule->part_size=246247 2019-11-29T12:50:41.668 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:41.677+0000 7f334a99aec0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2019-11-29T12:50:41.668 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:41.677+0000 7f334a99aec0 20 RGWObjManifest::operator++(): stripe_ofs=4440551 part_ofs=246247 rule->part_size=246247 2019-11-29T12:50:41.668 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:41.677+0000 7f334a99aec0 20 RGWObjManifest::operator++(): result: ofs=492494 stripe_ofs=492494 part_ofs=492494 rule->part_size=246247 2019-11-29T12:50:41.668 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:41.677+0000 7f334a99aec0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2019-11-29T12:50:41.668 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:41.677+0000 7f334a99aec0 20 RGWObjManifest::operator++(): stripe_ofs=4686798 part_ofs=492494 rule->part_size=246247 2019-11-29T12:50:41.668 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:41.677+0000 7f334a99aec0 20 RGWObjManifest::operator++(): result: ofs=738741 stripe_ofs=738741 part_ofs=738741 rule->part_size=147556 2019-11-29T12:50:41.669 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:41.677+0000 7f334a99aec0 20 RGWObjManifest::operator++(): rule->part_size=147556 rules.size()=2 2019-11-29T12:50:41.669 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:41.677+0000 7f334a99aec0 20 RGWObjManifest::operator++(): stripe_ofs=4933045 part_ofs=738741 rule->part_size=147556 2019-11-29T12:50:41.669 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:41.677+0000 7f334a99aec0 20 RGWObjManifest::operator++(): result: ofs=886297 stripe_ofs=886297 part_ofs=886297 rule->part_size=147556 2019-11-29T12:50:41.669 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:41.677+0000 7f334a99aec0 20 garbage collection: RGWGC::send_chain - on object name: gc.14tag is: 7f922895-c6d7-4b1b-a19c-be3df5b5a899.4325.55 2019-11-29T12:50:41.856 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:41.866+0000 7f334a99aec0 20 bucket index object: default.rgw.buckets.index:.dir.7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.4 2019-11-29T12:50:41.856 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:41.866+0000 7f334a99aec0 20 bucket index object: default.rgw.buckets.index:.dir.7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.4 2019-11-29T12:50:42.009 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:42.018+0000 7f334a99aec0 20 bucket index object: default.rgw.buckets.index:.dir.7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.4 2019-11-29T12:50:42.101 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:42.111+0000 7f334a99aec0 20 bucket index object: default.rgw.buckets.index:.dir.7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.4 2019-11-29T12:50:42.101 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:42.111+0000 7f334a99aec0 10 cls_bucket_list_ordered :test-client.0-r-test-multipart-index-versioning.1[7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.4]) start _multipart_[] num_entries 1001 2019-11-29T12:50:42.101 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:42.111+0000 7f334a99aec0 10 cls_bucket_list_ordered request from each of 1 shard(s) for 1002 entries to get 1001 total entries 2019-11-29T12:50:42.120 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:42.130+0000 7f334a99aec0 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-index-versioning.1[7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.4])"; objs.size()=0; is_truncated=0 2019-11-29T12:50:42.211 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:42.220+0000 7f334a99aec0 20 get_system_obj_state: rctx=0x7ffdb25792e8 obj=default.rgw.meta:root:test-client.0-r-test-multipart-index-versioning.1 state=0x55c56987a870 s->prefetch_data=0 2019-11-29T12:50:42.211 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:42.220+0000 7f334a99aec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 : type miss (requested=0x16, cached=0x3) 2019-11-29T12:50:42.221 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:42.231+0000 7f334a99aec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 info.flags=0x16 2019-11-29T12:50:42.221 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:42.231+0000 7f334a99aec0 10 moving default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 to cache LRU end 2019-11-29T12:50:42.221 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:42.231+0000 7f334a99aec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-29T12:50:42.222 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:42.231+0000 7f334a99aec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-29T12:50:42.222 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:42.231+0000 7f334a99aec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 : hit (requested=0x11, cached=0x17) 2019-11-29T12:50:42.222 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:42.231+0000 7f334a99aec0 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 from cache 2019-11-29T12:50:42.222 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:42.231+0000 7f334a99aec0 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=193 2019-11-29T12:50:42.236 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:42.246+0000 7f332d7fa700 10 RGWWatcher::handle_notify() notify_id 566935683081 cookie 94306366786192 notifier 4711 bl.length()=193 2019-11-29T12:50:42.515 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:42.525+0000 7f334a99aec0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.4 from cache 2019-11-29T12:50:42.515 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:42.525+0000 7f334a99aec0 10 distributing notification oid=default.rgw.control:notify.6 bl.length()=250 2019-11-29T12:50:42.530 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:42.540+0000 7f332d7fa700 10 RGWWatcher::handle_notify() notify_id 566935683074 cookie 94306366795136 notifier 4711 bl.length()=250 2019-11-29T12:50:42.996 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:43.006+0000 7f334a99aec0 20 get_system_obj_state: rctx=0x7ffdb2579930 obj=default.rgw.meta:root:test-client.0-r-test-multipart-simple.1 state=0x55c56987ac70 s->prefetch_data=0 2019-11-29T12:50:42.997 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:43.006+0000 7f334a99aec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 : miss 2019-11-29T12:50:43.007 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:43.016+0000 7f334a99aec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 info.flags=0x6 2019-11-29T12:50:43.007 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:43.016+0000 7f334a99aec0 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 to cache LRU end 2019-11-29T12:50:43.007 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:43.016+0000 7f334a99aec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-29T12:50:43.008 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:43.016+0000 7f334a99aec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-29T12:50:43.008 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:43.016+0000 7f334a99aec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 : type miss (requested=0x1, cached=0x6) 2019-11-29T12:50:43.008 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:43.016+0000 7f334a99aec0 20 rados->read ofs=0 len=0 2019-11-29T12:50:43.018 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:43.027+0000 7f334a99aec0 20 rados_obj.operate() r=0 bl.length=221 2019-11-29T12:50:43.018 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:43.027+0000 7f334a99aec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 info.flags=0x1 2019-11-29T12:50:43.018 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:43.027+0000 7f334a99aec0 10 moving default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 to cache LRU end 2019-11-29T12:50:43.019 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:43.027+0000 7f334a99aec0 20 get_system_obj_state: rctx=0x7ffdb2579930 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-simple.1:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.5 state=0x55c56987a870 s->prefetch_data=0 2019-11-29T12:50:43.019 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:43.027+0000 7f334a99aec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.5 : miss 2019-11-29T12:50:43.031 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:43.040+0000 7f334a99aec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.5 info.flags=0x16 2019-11-29T12:50:43.031 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:43.040+0000 7f334a99aec0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.5 to cache LRU end 2019-11-29T12:50:43.031 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:43.040+0000 7f334a99aec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-29T12:50:43.032 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:43.040+0000 7f334a99aec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-29T12:50:43.032 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:43.040+0000 7f334a99aec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-29T12:50:43.032 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:43.040+0000 7f334a99aec0 20 Read xattr: user.rgw.acl 2019-11-29T12:50:43.032 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:43.040+0000 7f334a99aec0 20 Read xattr: user.rgw.idtag 2019-11-29T12:50:43.032 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:43.040+0000 7f334a99aec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.5 : type miss (requested=0x13, cached=0x16) 2019-11-29T12:50:43.033 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:43.040+0000 7f334a99aec0 20 rados->read ofs=0 len=0 2019-11-29T12:50:43.048 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:43.058+0000 7f334a99aec0 20 rados_obj.operate() r=0 bl.length=313 2019-11-29T12:50:43.048 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:43.058+0000 7f334a99aec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.5 info.flags=0x13 2019-11-29T12:50:43.049 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:43.058+0000 7f334a99aec0 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.5 to cache LRU end 2019-11-29T12:50:43.049 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:43.058+0000 7f334a99aec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-29T12:50:43.049 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:43.058+0000 7f334a99aec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-29T12:50:43.049 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:43.058+0000 7f334a99aec0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.5 2019-11-29T12:50:43.062 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:43.072+0000 7f334a99aec0 10 cls_bucket_list_unordered :test-client.0-r-test-multipart-simple.1[7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.5]) start [] num_entries 1100 2019-11-29T12:50:43.087 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:43.097+0000 7f334a99aec0 10 RGWRados::cls_bucket_list_unordered: got foo[] 2019-11-29T12:50:43.088 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:43.097+0000 7f334a99aec0 20 get_obj_state: rctx=0x7ffdb2579950 obj=test-client.0-r-test-multipart-simple.1:foo state=0x55c56987fc48 s->prefetch_data=0 2019-11-29T12:50:43.098 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:43.108+0000 7f334a99aec0 10 manifest: total_size = 1848 2019-11-29T12:50:43.098 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:43.108+0000 7f334a99aec0 20 get_obj_state: setting s->obj_tag to 7f922895-c6d7-4b1b-a19c-be3df5b5a899.4325.71 2019-11-29T12:50:43.098 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:43.108+0000 7f334a99aec0 20 get_obj_state: rctx=0x7ffdb2579950 obj=test-client.0-r-test-multipart-simple.1:foo state=0x55c56987fc48 s->prefetch_data=0 2019-11-29T12:50:43.098 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:43.108+0000 7f334a99aec0 20 prepare_atomic_modification: state is not atomic. state=0x55c56987fc48 2019-11-29T12:50:43.099 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:43.108+0000 7f334a99aec0 20 bucket index object: default.rgw.buckets.index:.dir.7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.5 2019-11-29T12:50:43.208 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:43.218+0000 7f334a99aec0 20 RGWObjManifest::operator++(): rule->part_size=515 rules.size()=2 2019-11-29T12:50:43.209 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:43.218+0000 7f334a99aec0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=515 2019-11-29T12:50:43.209 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:43.218+0000 7f334a99aec0 20 RGWObjManifest::operator++(): result: ofs=515 stripe_ofs=515 part_ofs=515 rule->part_size=515 2019-11-29T12:50:43.209 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:43.218+0000 7f334a99aec0 20 RGWObjManifest::operator++(): rule->part_size=515 rules.size()=2 2019-11-29T12:50:43.209 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:43.218+0000 7f334a99aec0 20 RGWObjManifest::operator++(): stripe_ofs=4194819 part_ofs=515 rule->part_size=515 2019-11-29T12:50:43.209 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:43.218+0000 7f334a99aec0 20 RGWObjManifest::operator++(): result: ofs=1030 stripe_ofs=1030 part_ofs=1030 rule->part_size=515 2019-11-29T12:50:43.210 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:43.218+0000 7f334a99aec0 20 RGWObjManifest::operator++(): rule->part_size=515 rules.size()=2 2019-11-29T12:50:43.210 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:43.218+0000 7f334a99aec0 20 RGWObjManifest::operator++(): stripe_ofs=4195334 part_ofs=1030 rule->part_size=515 2019-11-29T12:50:43.211 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:43.218+0000 7f334a99aec0 20 RGWObjManifest::operator++(): result: ofs=1545 stripe_ofs=1545 part_ofs=1545 rule->part_size=303 2019-11-29T12:50:43.211 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:43.218+0000 7f334a99aec0 20 RGWObjManifest::operator++(): rule->part_size=303 rules.size()=2 2019-11-29T12:50:43.211 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:43.218+0000 7f334a99aec0 20 RGWObjManifest::operator++(): stripe_ofs=4195849 part_ofs=1545 rule->part_size=303 2019-11-29T12:50:43.211 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:43.218+0000 7f334a99aec0 20 RGWObjManifest::operator++(): result: ofs=1848 stripe_ofs=1848 part_ofs=1848 rule->part_size=303 2019-11-29T12:50:43.211 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:43.218+0000 7f334a99aec0 20 garbage collection: RGWGC::send_chain - on object name: gc.26tag is: 7f922895-c6d7-4b1b-a19c-be3df5b5a899.4325.71 2019-11-29T12:50:43.304 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:43.314+0000 7f334a99aec0 10 cls_bucket_list_ordered :test-client.0-r-test-multipart-simple.1[7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.5]) start _multipart_[] num_entries 1001 2019-11-29T12:50:43.305 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:43.314+0000 7f334a99aec0 10 cls_bucket_list_ordered request from each of 1 shard(s) for 1002 entries to get 1001 total entries 2019-11-29T12:50:43.321 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:43.331+0000 7f334a99aec0 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-simple.1[7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.5])"; objs.size()=0; is_truncated=0 2019-11-29T12:50:43.401 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:43.410+0000 7f334a99aec0 20 get_system_obj_state: rctx=0x7ffdb25792e8 obj=default.rgw.meta:root:test-client.0-r-test-multipart-simple.1 state=0x55c569874690 s->prefetch_data=0 2019-11-29T12:50:43.401 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:43.410+0000 7f334a99aec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 : type miss (requested=0x16, cached=0x3) 2019-11-29T12:50:43.414 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:43.423+0000 7f334a99aec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 info.flags=0x16 2019-11-29T12:50:43.414 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:43.423+0000 7f334a99aec0 10 moving default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 to cache LRU end 2019-11-29T12:50:43.414 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:43.423+0000 7f334a99aec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-29T12:50:43.414 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:43.423+0000 7f334a99aec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-29T12:50:43.414 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:43.423+0000 7f334a99aec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 : hit (requested=0x11, cached=0x17) 2019-11-29T12:50:43.415 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:43.423+0000 7f334a99aec0 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 from cache 2019-11-29T12:50:43.415 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:43.423+0000 7f334a99aec0 10 distributing notification oid=default.rgw.control:notify.4 bl.length()=183 2019-11-29T12:50:43.424 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:43.434+0000 7f332d7fa700 10 RGWWatcher::handle_notify() notify_id 566935683082 cookie 94306366791152 notifier 4711 bl.length()=183 2019-11-29T12:50:43.880 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:43.890+0000 7f334a99aec0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.5 from cache 2019-11-29T12:50:43.880 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:43.890+0000 7f334a99aec0 10 distributing notification oid=default.rgw.control:notify.0 bl.length()=240 2019-11-29T12:50:43.893 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:43.903+0000 7f332d7fa700 10 RGWWatcher::handle_notify() notify_id 566935683073 cookie 94306366779648 notifier 4711 bl.length()=240 2019-11-29T12:50:44.424 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:44.433+0000 7f334a99aec0 20 get_system_obj_state: rctx=0x7ffdb2579930 obj=default.rgw.meta:root:test-client.0-r-test-obj-storage-class-copy.1 state=0x55c569874690 s->prefetch_data=0 2019-11-29T12:50:44.424 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:44.433+0000 7f334a99aec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 : miss 2019-11-29T12:50:44.441 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:44.451+0000 7f334a99aec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x6 2019-11-29T12:50:44.442 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:44.451+0000 7f334a99aec0 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2019-11-29T12:50:44.442 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:44.451+0000 7f334a99aec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-29T12:50:44.442 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:44.451+0000 7f334a99aec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-29T12:50:44.442 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:44.451+0000 7f334a99aec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 : type miss (requested=0x1, cached=0x6) 2019-11-29T12:50:44.442 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:44.451+0000 7f334a99aec0 20 rados->read ofs=0 len=0 2019-11-29T12:50:44.458 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:44.468+0000 7f334a99aec0 20 rados_obj.operate() r=0 bl.length=227 2019-11-29T12:50:44.458 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:44.468+0000 7f334a99aec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x1 2019-11-29T12:50:44.458 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:44.468+0000 7f334a99aec0 10 moving default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2019-11-29T12:50:44.459 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:44.468+0000 7f334a99aec0 20 get_system_obj_state: rctx=0x7ffdb2579930 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.7 state=0x55c56987a870 s->prefetch_data=0 2019-11-29T12:50:44.459 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:44.468+0000 7f334a99aec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.7 : miss 2019-11-29T12:50:44.482 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:44.492+0000 7f334a99aec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.7 info.flags=0x16 2019-11-29T12:50:44.482 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:44.492+0000 7f334a99aec0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.7 to cache LRU end 2019-11-29T12:50:44.483 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:44.492+0000 7f334a99aec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-29T12:50:44.483 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:44.492+0000 7f334a99aec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-29T12:50:44.483 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:44.492+0000 7f334a99aec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-29T12:50:44.483 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:44.492+0000 7f334a99aec0 20 Read xattr: user.rgw.acl 2019-11-29T12:50:44.483 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:44.492+0000 7f334a99aec0 20 Read xattr: user.rgw.idtag 2019-11-29T12:50:44.483 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:44.492+0000 7f334a99aec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.7 : type miss (requested=0x13, cached=0x16) 2019-11-29T12:50:44.483 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:44.492+0000 7f334a99aec0 20 rados->read ofs=0 len=0 2019-11-29T12:50:44.509 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:44.519+0000 7f334a99aec0 20 rados_obj.operate() r=0 bl.length=319 2019-11-29T12:50:44.510 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:44.519+0000 7f334a99aec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.7 info.flags=0x13 2019-11-29T12:50:44.510 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:44.519+0000 7f334a99aec0 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.7 to cache LRU end 2019-11-29T12:50:44.510 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:44.519+0000 7f334a99aec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-29T12:50:44.510 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:44.519+0000 7f334a99aec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-29T12:50:44.510 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:44.519+0000 7f334a99aec0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.7 2019-11-29T12:50:44.534 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:44.544+0000 7f334a99aec0 10 cls_bucket_list_unordered :test-client.0-r-test-obj-storage-class-copy.1[7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.7]) start [] num_entries 1100 2019-11-29T12:50:44.575 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:44.584+0000 7f334a99aec0 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN[] 2019-11-29T12:50:44.575 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:44.584+0000 7f334a99aec0 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN-FROZEN[] 2019-11-29T12:50:44.575 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:44.584+0000 7f334a99aec0 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM[] 2019-11-29T12:50:44.575 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:44.584+0000 7f334a99aec0 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN-STANDARD[] 2019-11-29T12:50:44.575 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:44.584+0000 7f334a99aec0 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM[] 2019-11-29T12:50:44.575 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:44.584+0000 7f334a99aec0 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN[] 2019-11-29T12:50:44.576 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:44.584+0000 7f334a99aec0 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM[] 2019-11-29T12:50:44.576 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:44.584+0000 7f334a99aec0 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD[] 2019-11-29T12:50:44.576 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:44.584+0000 7f334a99aec0 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD[] 2019-11-29T12:50:44.576 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:44.584+0000 7f334a99aec0 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD-FROZEN[] 2019-11-29T12:50:44.576 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:44.584+0000 7f334a99aec0 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM[] 2019-11-29T12:50:44.576 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:44.584+0000 7f334a99aec0 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD-STANDARD[] 2019-11-29T12:50:44.577 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:44.584+0000 7f334a99aec0 20 get_obj_state: rctx=0x7ffdb2579950 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x55c56987fc48 s->prefetch_data=0 2019-11-29T12:50:44.594 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:44.604+0000 7f334a99aec0 10 manifest: total_size = 5242880 2019-11-29T12:50:44.594 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:44.604+0000 7f334a99aec0 20 get_obj_state: setting s->obj_tag to 7f922895-c6d7-4b1b-a19c-be3df5b5a899.4325.108 2019-11-29T12:50:44.594 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:44.604+0000 7f334a99aec0 20 get_obj_state: rctx=0x7ffdb2579950 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x55c56987fc48 s->prefetch_data=0 2019-11-29T12:50:44.595 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:44.604+0000 7f334a99aec0 20 prepare_atomic_modification: state is not atomic. state=0x55c56987fc48 2019-11-29T12:50:44.595 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:44.604+0000 7f334a99aec0 20 bucket index object: default.rgw.buckets.index:.dir.7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.7 2019-11-29T12:50:44.751 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:44.761+0000 7f334a99aec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-29T12:50:44.752 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:44.761+0000 7f334a99aec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2019-11-29T12:50:44.752 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:44.761+0000 7f334a99aec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-29T12:50:44.752 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:44.761+0000 7f334a99aec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2019-11-29T12:50:44.752 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:44.761+0000 7f334a99aec0 20 garbage collection: RGWGC::send_chain - on object name: gc.2tag is: 7f922895-c6d7-4b1b-a19c-be3df5b5a899.4325.108 2019-11-29T12:50:44.841 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:44.850+0000 7f334a99aec0 20 get_obj_state: rctx=0x7ffdb2579950 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x55c56987fc48 s->prefetch_data=0 2019-11-29T12:50:44.855 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:44.865+0000 7f334a99aec0 10 manifest: total_size = 5242880 2019-11-29T12:50:44.856 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:44.865+0000 7f334a99aec0 20 get_obj_state: setting s->obj_tag to 7f922895-c6d7-4b1b-a19c-be3df5b5a899.4325.109 2019-11-29T12:50:44.856 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:44.865+0000 7f334a99aec0 20 get_obj_state: rctx=0x7ffdb2579950 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x55c56987fc48 s->prefetch_data=0 2019-11-29T12:50:44.856 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:44.865+0000 7f334a99aec0 20 prepare_atomic_modification: state is not atomic. state=0x55c56987fc48 2019-11-29T12:50:44.856 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:44.865+0000 7f334a99aec0 20 bucket index object: default.rgw.buckets.index:.dir.7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.7 2019-11-29T12:50:44.989 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:44.999+0000 7f334a99aec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-29T12:50:44.990 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:44.999+0000 7f334a99aec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2019-11-29T12:50:44.990 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:44.999+0000 7f334a99aec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-29T12:50:44.990 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:44.999+0000 7f334a99aec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2019-11-29T12:50:44.990 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:44.999+0000 7f334a99aec0 20 garbage collection: RGWGC::send_chain - on object name: gc.13tag is: 7f922895-c6d7-4b1b-a19c-be3df5b5a899.4325.109 2019-11-29T12:50:45.089 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:45.099+0000 7f334a99aec0 20 get_obj_state: rctx=0x7ffdb2579950 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x55c56987fc48 s->prefetch_data=0 2019-11-29T12:50:45.098 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:45.108+0000 7f334a99aec0 10 manifest: total_size = 5242880 2019-11-29T12:50:45.099 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:45.108+0000 7f334a99aec0 20 get_obj_state: setting s->obj_tag to _1iRteuIrh5aEmSMRkDJVt7LaJN2jhRK 2019-11-29T12:50:45.099 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:45.108+0000 7f334a99aec0 20 get_obj_state: rctx=0x7ffdb2579950 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x55c56987fc48 s->prefetch_data=0 2019-11-29T12:50:45.099 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:45.108+0000 7f334a99aec0 20 prepare_atomic_modification: state is not atomic. state=0x55c56987fc48 2019-11-29T12:50:45.099 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:45.108+0000 7f334a99aec0 20 bucket index object: default.rgw.buckets.index:.dir.7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.7 2019-11-29T12:50:45.188 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:45.197+0000 7f334a99aec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-29T12:50:45.188 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:45.197+0000 7f334a99aec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2019-11-29T12:50:45.188 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:45.197+0000 7f334a99aec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-29T12:50:45.188 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:45.197+0000 7f334a99aec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2019-11-29T12:50:45.188 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:45.197+0000 7f334a99aec0 20 garbage collection: RGWGC::send_chain - on object name: gc.26tag is: _1iRteuIrh5aEmSMRkDJVt7LaJN2jhRK 2019-11-29T12:50:45.253 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:45.263+0000 7f334a99aec0 20 get_obj_state: rctx=0x7ffdb2579950 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x55c56987fc48 s->prefetch_data=0 2019-11-29T12:50:45.265 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:45.275+0000 7f334a99aec0 10 manifest: total_size = 5242880 2019-11-29T12:50:45.266 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:45.275+0000 7f334a99aec0 20 get_obj_state: setting s->obj_tag to _LzW7H88kItO3Kk0nxbhhEzQzZGFUDA4 2019-11-29T12:50:45.266 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:45.275+0000 7f334a99aec0 20 get_obj_state: rctx=0x7ffdb2579950 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x55c56987fc48 s->prefetch_data=0 2019-11-29T12:50:45.266 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:45.275+0000 7f334a99aec0 20 prepare_atomic_modification: state is not atomic. state=0x55c56987fc48 2019-11-29T12:50:45.266 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:45.275+0000 7f334a99aec0 20 bucket index object: default.rgw.buckets.index:.dir.7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.7 2019-11-29T12:50:45.472 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:45.481+0000 7f334a99aec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-29T12:50:45.472 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:45.481+0000 7f334a99aec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2019-11-29T12:50:45.472 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:45.481+0000 7f334a99aec0 20 garbage collection: RGWGC::send_chain - on object name: gc.3tag is: _LzW7H88kItO3Kk0nxbhhEzQzZGFUDA4 2019-11-29T12:50:45.551 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:45.561+0000 7f334a99aec0 20 get_obj_state: rctx=0x7ffdb2579950 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x55c56987fc48 s->prefetch_data=0 2019-11-29T12:50:45.563 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:45.572+0000 7f334a99aec0 10 manifest: total_size = 5242880 2019-11-29T12:50:45.563 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:45.572+0000 7f334a99aec0 20 get_obj_state: setting s->obj_tag to 7f922895-c6d7-4b1b-a19c-be3df5b5a899.4325.112 2019-11-29T12:50:45.563 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:45.572+0000 7f334a99aec0 20 get_obj_state: rctx=0x7ffdb2579950 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x55c56987fc48 s->prefetch_data=0 2019-11-29T12:50:45.563 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:45.572+0000 7f334a99aec0 20 prepare_atomic_modification: state is not atomic. state=0x55c56987fc48 2019-11-29T12:50:45.563 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:45.572+0000 7f334a99aec0 20 bucket index object: default.rgw.buckets.index:.dir.7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.7 2019-11-29T12:50:45.668 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:45.677+0000 7f334a99aec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-29T12:50:45.668 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:45.677+0000 7f334a99aec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2019-11-29T12:50:45.668 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:45.677+0000 7f334a99aec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-29T12:50:45.668 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:45.677+0000 7f334a99aec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2019-11-29T12:50:45.668 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:45.677+0000 7f334a99aec0 20 garbage collection: RGWGC::send_chain - on object name: gc.8tag is: 7f922895-c6d7-4b1b-a19c-be3df5b5a899.4325.112 2019-11-29T12:50:45.755 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:45.765+0000 7f334a99aec0 20 get_obj_state: rctx=0x7ffdb2579950 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x55c56987fc48 s->prefetch_data=0 2019-11-29T12:50:45.775 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:45.785+0000 7f334a99aec0 10 manifest: total_size = 5242880 2019-11-29T12:50:45.775 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:45.785+0000 7f334a99aec0 20 get_obj_state: setting s->obj_tag to _pPPj6_TvUb_lr5OcE7vWMfZeMqW9y9X 2019-11-29T12:50:45.776 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:45.785+0000 7f334a99aec0 20 get_obj_state: rctx=0x7ffdb2579950 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x55c56987fc48 s->prefetch_data=0 2019-11-29T12:50:45.776 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:45.785+0000 7f334a99aec0 20 prepare_atomic_modification: state is not atomic. state=0x55c56987fc48 2019-11-29T12:50:45.776 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:45.785+0000 7f334a99aec0 20 bucket index object: default.rgw.buckets.index:.dir.7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.7 2019-11-29T12:50:45.888 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:45.898+0000 7f334a99aec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-29T12:50:45.889 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:45.898+0000 7f334a99aec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2019-11-29T12:50:45.889 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:45.898+0000 7f334a99aec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-29T12:50:45.889 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:45.898+0000 7f334a99aec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2019-11-29T12:50:45.889 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:45.898+0000 7f334a99aec0 20 garbage collection: RGWGC::send_chain - on object name: gc.6tag is: _pPPj6_TvUb_lr5OcE7vWMfZeMqW9y9X 2019-11-29T12:50:45.961 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:45.971+0000 7f334a99aec0 20 get_obj_state: rctx=0x7ffdb2579950 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x55c56987fc48 s->prefetch_data=0 2019-11-29T12:50:45.970 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:45.979+0000 7f334a99aec0 10 manifest: total_size = 5242880 2019-11-29T12:50:45.970 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:45.979+0000 7f334a99aec0 20 get_obj_state: setting s->obj_tag to 7f922895-c6d7-4b1b-a19c-be3df5b5a899.4325.114 2019-11-29T12:50:45.970 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:45.979+0000 7f334a99aec0 20 get_obj_state: rctx=0x7ffdb2579950 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x55c56987fc48 s->prefetch_data=0 2019-11-29T12:50:45.970 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:45.979+0000 7f334a99aec0 20 prepare_atomic_modification: state is not atomic. state=0x55c56987fc48 2019-11-29T12:50:45.971 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:45.979+0000 7f334a99aec0 20 bucket index object: default.rgw.buckets.index:.dir.7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.7 2019-11-29T12:50:46.062 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:46.071+0000 7f334a99aec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-29T12:50:46.062 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:46.071+0000 7f334a99aec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2019-11-29T12:50:46.062 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:46.071+0000 7f334a99aec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-29T12:50:46.062 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:46.071+0000 7f334a99aec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2019-11-29T12:50:46.063 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:46.071+0000 7f334a99aec0 20 garbage collection: RGWGC::send_chain - on object name: gc.8tag is: 7f922895-c6d7-4b1b-a19c-be3df5b5a899.4325.114 2019-11-29T12:50:46.110 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:46.120+0000 7f334a99aec0 20 get_obj_state: rctx=0x7ffdb2579950 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x55c56987d9a8 s->prefetch_data=0 2019-11-29T12:50:46.121 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:46.131+0000 7f334a99aec0 10 manifest: total_size = 5242880 2019-11-29T12:50:46.121 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:46.131+0000 7f334a99aec0 20 get_obj_state: setting s->obj_tag to _nQXbyaTAzo7kS2vwAO4o0fEvrIGG5IC 2019-11-29T12:50:46.121 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:46.131+0000 7f334a99aec0 20 get_obj_state: rctx=0x7ffdb2579950 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x55c56987d9a8 s->prefetch_data=0 2019-11-29T12:50:46.122 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:46.131+0000 7f334a99aec0 20 prepare_atomic_modification: state is not atomic. state=0x55c56987d9a8 2019-11-29T12:50:46.122 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:46.131+0000 7f334a99aec0 20 bucket index object: default.rgw.buckets.index:.dir.7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.7 2019-11-29T12:50:46.382 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:46.392+0000 7f334a99aec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-29T12:50:46.382 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:46.392+0000 7f334a99aec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2019-11-29T12:50:46.383 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:46.392+0000 7f334a99aec0 20 garbage collection: RGWGC::send_chain - on object name: gc.16tag is: _nQXbyaTAzo7kS2vwAO4o0fEvrIGG5IC 2019-11-29T12:50:46.475 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:46.485+0000 7f334a99aec0 20 get_obj_state: rctx=0x7ffdb2579950 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x55c56987d9a8 s->prefetch_data=0 2019-11-29T12:50:46.491 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:46.501+0000 7f334a99aec0 10 manifest: total_size = 324167 2019-11-29T12:50:46.491 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:46.501+0000 7f334a99aec0 20 get_obj_state: setting s->obj_tag to 7f922895-c6d7-4b1b-a19c-be3df5b5a899.4325.116 2019-11-29T12:50:46.491 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:46.501+0000 7f334a99aec0 20 get_obj_state: rctx=0x7ffdb2579950 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x55c56987d9a8 s->prefetch_data=0 2019-11-29T12:50:46.492 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:46.501+0000 7f334a99aec0 20 prepare_atomic_modification: state is not atomic. state=0x55c56987d9a8 2019-11-29T12:50:46.492 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:46.501+0000 7f334a99aec0 20 bucket index object: default.rgw.buckets.index:.dir.7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.7 2019-11-29T12:50:46.632 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:46.641+0000 7f334a99aec0 20 get_obj_state: rctx=0x7ffdb2579950 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x55c56987d9a8 s->prefetch_data=0 2019-11-29T12:50:46.650 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:46.659+0000 7f334a99aec0 10 manifest: total_size = 324167 2019-11-29T12:50:46.650 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:46.659+0000 7f334a99aec0 20 get_obj_state: setting s->obj_tag to _FLYPsxcxPr89DNtl9CNzoPpLOKKL7n- 2019-11-29T12:50:46.650 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:46.659+0000 7f334a99aec0 20 get_obj_state: rctx=0x7ffdb2579950 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x55c56987d9a8 s->prefetch_data=0 2019-11-29T12:50:46.650 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:46.659+0000 7f334a99aec0 20 prepare_atomic_modification: state is not atomic. state=0x55c56987d9a8 2019-11-29T12:50:46.651 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:46.659+0000 7f334a99aec0 20 bucket index object: default.rgw.buckets.index:.dir.7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.7 2019-11-29T12:50:46.843 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:46.852+0000 7f334a99aec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-29T12:50:46.843 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:46.852+0000 7f334a99aec0 20 RGWObjManifest::operator++(): result: ofs=324167 stripe_ofs=324167 part_ofs=0 rule->part_size=0 2019-11-29T12:50:46.843 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:46.853+0000 7f334a99aec0 20 garbage collection: RGWGC::send_chain - on object name: gc.27tag is: _FLYPsxcxPr89DNtl9CNzoPpLOKKL7n- 2019-11-29T12:50:46.918 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:46.928+0000 7f334a99aec0 20 get_obj_state: rctx=0x7ffdb2579950 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x55c56987d9a8 s->prefetch_data=0 2019-11-29T12:50:46.939 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:46.949+0000 7f334a99aec0 10 manifest: total_size = 324167 2019-11-29T12:50:46.939 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:46.949+0000 7f334a99aec0 20 get_obj_state: setting s->obj_tag to _rQoCuuBVx55cC-M4Fq5-PJ6b4dhmWMx 2019-11-29T12:50:46.939 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:46.949+0000 7f334a99aec0 20 get_obj_state: rctx=0x7ffdb2579950 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x55c56987d9a8 s->prefetch_data=0 2019-11-29T12:50:46.940 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:46.949+0000 7f334a99aec0 20 prepare_atomic_modification: state is not atomic. state=0x55c56987d9a8 2019-11-29T12:50:46.940 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:46.949+0000 7f334a99aec0 20 bucket index object: default.rgw.buckets.index:.dir.7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.7 2019-11-29T12:50:47.045 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:47.055+0000 7f334a99aec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-29T12:50:47.045 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:47.055+0000 7f334a99aec0 20 RGWObjManifest::operator++(): result: ofs=324167 stripe_ofs=324167 part_ofs=0 rule->part_size=0 2019-11-29T12:50:47.045 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:47.055+0000 7f334a99aec0 20 garbage collection: RGWGC::send_chain - on object name: gc.22tag is: _rQoCuuBVx55cC-M4Fq5-PJ6b4dhmWMx 2019-11-29T12:50:47.132 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:47.141+0000 7f334a99aec0 20 get_obj_state: rctx=0x7ffdb2579950 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x55c56987fe98 s->prefetch_data=0 2019-11-29T12:50:47.150 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:47.160+0000 7f334a99aec0 10 manifest: total_size = 324167 2019-11-29T12:50:47.150 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:47.160+0000 7f334a99aec0 20 get_obj_state: setting s->obj_tag to _3IidpgC9ZuiJLub-FPM7-mrxDs7K092 2019-11-29T12:50:47.150 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:47.160+0000 7f334a99aec0 20 get_obj_state: rctx=0x7ffdb2579950 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x55c56987fe98 s->prefetch_data=0 2019-11-29T12:50:47.150 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:47.160+0000 7f334a99aec0 20 prepare_atomic_modification: state is not atomic. state=0x55c56987fe98 2019-11-29T12:50:47.150 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:47.160+0000 7f334a99aec0 20 bucket index object: default.rgw.buckets.index:.dir.7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.7 2019-11-29T12:50:47.330 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:47.340+0000 7f334a99aec0 10 cls_bucket_list_ordered :test-client.0-r-test-obj-storage-class-copy.1[7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.7]) start _multipart_[] num_entries 1001 2019-11-29T12:50:47.330 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:47.340+0000 7f334a99aec0 10 cls_bucket_list_ordered request from each of 1 shard(s) for 1002 entries to get 1001 total entries 2019-11-29T12:50:47.403 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:47.413+0000 7f334a99aec0 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-copy.1[7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.7])"; objs.size()=0; is_truncated=0 2019-11-29T12:50:47.504 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:47.514+0000 7f334a99aec0 20 get_system_obj_state: rctx=0x7ffdb25792e8 obj=default.rgw.meta:root:test-client.0-r-test-obj-storage-class-copy.1 state=0x55c56987a870 s->prefetch_data=0 2019-11-29T12:50:47.504 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:47.514+0000 7f334a99aec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 : type miss (requested=0x16, cached=0x3) 2019-11-29T12:50:47.523 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:47.532+0000 7f334a99aec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x16 2019-11-29T12:50:47.524 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:47.532+0000 7f334a99aec0 10 moving default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2019-11-29T12:50:47.524 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:47.532+0000 7f334a99aec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-29T12:50:47.524 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:47.532+0000 7f334a99aec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-29T12:50:47.524 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:47.532+0000 7f334a99aec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 : hit (requested=0x11, cached=0x17) 2019-11-29T12:50:47.524 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:47.533+0000 7f334a99aec0 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 from cache 2019-11-29T12:50:47.524 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:47.533+0000 7f334a99aec0 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=189 2019-11-29T12:50:47.540 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:47.550+0000 7f332d7fa700 10 RGWWatcher::handle_notify() notify_id 566935683083 cookie 94306366786192 notifier 4711 bl.length()=189 2019-11-29T12:50:48.072 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:48.080+0000 7f334a99aec0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.7 from cache 2019-11-29T12:50:48.072 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:48.080+0000 7f334a99aec0 10 distributing notification oid=default.rgw.control:notify.6 bl.length()=246 2019-11-29T12:50:48.087 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:48.097+0000 7f332d7fa700 10 RGWWatcher::handle_notify() notify_id 566935683075 cookie 94306366795136 notifier 4711 bl.length()=246 2019-11-29T12:50:49.185 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:49.194+0000 7f334a99aec0 20 get_system_obj_state: rctx=0x7ffdb2579930 obj=default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart-copy.1 state=0x55c56987a870 s->prefetch_data=0 2019-11-29T12:50:49.185 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:49.194+0000 7f334a99aec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 : miss 2019-11-29T12:50:49.209 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:49.219+0000 7f334a99aec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x6 2019-11-29T12:50:49.210 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:49.219+0000 7f334a99aec0 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2019-11-29T12:50:49.210 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:49.219+0000 7f334a99aec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-29T12:50:49.210 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:49.219+0000 7f334a99aec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-29T12:50:49.210 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:49.219+0000 7f334a99aec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 : type miss (requested=0x1, cached=0x6) 2019-11-29T12:50:49.210 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:49.219+0000 7f334a99aec0 20 rados->read ofs=0 len=0 2019-11-29T12:50:49.230 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:49.239+0000 7f334a99aec0 20 rados_obj.operate() r=0 bl.length=237 2019-11-29T12:50:49.230 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:49.239+0000 7f334a99aec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x1 2019-11-29T12:50:49.230 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:49.239+0000 7f334a99aec0 10 moving default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2019-11-29T12:50:49.231 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:49.239+0000 7f334a99aec0 20 get_system_obj_state: rctx=0x7ffdb2579930 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.9 state=0x55c569874690 s->prefetch_data=0 2019-11-29T12:50:49.231 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:49.239+0000 7f334a99aec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.9 : miss 2019-11-29T12:50:49.244 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:49.253+0000 7f334a99aec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.9 info.flags=0x16 2019-11-29T12:50:49.244 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:49.253+0000 7f334a99aec0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.9 to cache LRU end 2019-11-29T12:50:49.244 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:49.253+0000 7f334a99aec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-29T12:50:49.244 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:49.253+0000 7f334a99aec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-29T12:50:49.245 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:49.253+0000 7f334a99aec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-29T12:50:49.245 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:49.253+0000 7f334a99aec0 20 Read xattr: user.rgw.acl 2019-11-29T12:50:49.245 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:49.253+0000 7f334a99aec0 20 Read xattr: user.rgw.idtag 2019-11-29T12:50:49.245 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:49.253+0000 7f334a99aec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.9 : type miss (requested=0x13, cached=0x16) 2019-11-29T12:50:49.245 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:49.253+0000 7f334a99aec0 20 rados->read ofs=0 len=0 2019-11-29T12:50:49.268 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:49.277+0000 7f334a99aec0 20 rados_obj.operate() r=0 bl.length=329 2019-11-29T12:50:49.268 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:49.277+0000 7f334a99aec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.9 info.flags=0x13 2019-11-29T12:50:49.268 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:49.277+0000 7f334a99aec0 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.9 to cache LRU end 2019-11-29T12:50:49.268 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:49.277+0000 7f334a99aec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-29T12:50:49.268 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:49.277+0000 7f334a99aec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-29T12:50:49.269 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:49.277+0000 7f334a99aec0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.9 2019-11-29T12:50:49.304 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:49.313+0000 7f334a99aec0 10 cls_bucket_list_unordered :test-client.0-r-test-obj-storage-class-multipart-copy.1[7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.9]) start [] num_entries 1100 2019-11-29T12:50:49.353 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:49.362+0000 7f334a99aec0 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN[] 2019-11-29T12:50:49.353 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:49.362+0000 7f334a99aec0 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN-FROZEN[] 2019-11-29T12:50:49.353 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:49.362+0000 7f334a99aec0 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM[] 2019-11-29T12:50:49.353 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:49.362+0000 7f334a99aec0 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN-STANDARD[] 2019-11-29T12:50:49.353 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:49.362+0000 7f334a99aec0 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM[] 2019-11-29T12:50:49.354 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:49.362+0000 7f334a99aec0 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN[] 2019-11-29T12:50:49.354 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:49.362+0000 7f334a99aec0 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM[] 2019-11-29T12:50:49.354 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:49.362+0000 7f334a99aec0 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD[] 2019-11-29T12:50:49.354 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:49.362+0000 7f334a99aec0 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD[] 2019-11-29T12:50:49.354 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:49.362+0000 7f334a99aec0 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD-FROZEN[] 2019-11-29T12:50:49.354 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:49.362+0000 7f334a99aec0 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM[] 2019-11-29T12:50:49.354 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:49.362+0000 7f334a99aec0 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD-STANDARD[] 2019-11-29T12:50:49.355 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:49.362+0000 7f334a99aec0 20 get_obj_state: rctx=0x7ffdb2579950 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x55c56987fc48 s->prefetch_data=0 2019-11-29T12:50:49.365 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:49.375+0000 7f334a99aec0 10 manifest: total_size = 11534336 2019-11-29T12:50:49.366 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:49.375+0000 7f334a99aec0 20 get_obj_state: setting s->obj_tag to 7f922895-c6d7-4b1b-a19c-be3df5b5a899.4325.224 2019-11-29T12:50:49.366 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:49.375+0000 7f334a99aec0 20 get_obj_state: rctx=0x7ffdb2579950 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x55c56987fc48 s->prefetch_data=0 2019-11-29T12:50:49.366 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:49.375+0000 7f334a99aec0 20 prepare_atomic_modification: state is not atomic. state=0x55c56987fc48 2019-11-29T12:50:49.366 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:49.375+0000 7f334a99aec0 20 bucket index object: default.rgw.buckets.index:.dir.7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.9 2019-11-29T12:50:49.496 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:49.505+0000 7f334a99aec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-29T12:50:49.496 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:49.505+0000 7f334a99aec0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-11-29T12:50:49.496 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:49.505+0000 7f334a99aec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-11-29T12:50:49.496 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:49.505+0000 7f334a99aec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-29T12:50:49.496 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:49.505+0000 7f334a99aec0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2019-11-29T12:50:49.497 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:49.505+0000 7f334a99aec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2019-11-29T12:50:49.497 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:49.505+0000 7f334a99aec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-29T12:50:49.497 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:49.505+0000 7f334a99aec0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-11-29T12:50:49.497 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:49.505+0000 7f334a99aec0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-11-29T12:50:49.497 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:49.505+0000 7f334a99aec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-29T12:50:49.497 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:49.505+0000 7f334a99aec0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2019-11-29T12:50:49.498 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:49.505+0000 7f334a99aec0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2019-11-29T12:50:49.498 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:49.505+0000 7f334a99aec0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2019-11-29T12:50:49.498 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:49.505+0000 7f334a99aec0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2019-11-29T12:50:49.498 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:49.505+0000 7f334a99aec0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2019-11-29T12:50:49.498 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:49.505+0000 7f334a99aec0 20 garbage collection: RGWGC::send_chain - on object name: gc.3tag is: 7f922895-c6d7-4b1b-a19c-be3df5b5a899.4325.224 2019-11-29T12:50:49.547 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:49.556+0000 7f334a99aec0 20 get_obj_state: rctx=0x7ffdb2579950 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x55c56987fc48 s->prefetch_data=0 2019-11-29T12:50:49.556 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:49.565+0000 7f334a99aec0 10 manifest: total_size = 11534336 2019-11-29T12:50:49.556 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:49.565+0000 7f334a99aec0 20 get_obj_state: setting s->obj_tag to 7f922895-c6d7-4b1b-a19c-be3df5b5a899.4325.225 2019-11-29T12:50:49.556 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:49.565+0000 7f334a99aec0 20 get_obj_state: rctx=0x7ffdb2579950 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x55c56987fc48 s->prefetch_data=0 2019-11-29T12:50:49.556 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:49.565+0000 7f334a99aec0 20 prepare_atomic_modification: state is not atomic. state=0x55c56987fc48 2019-11-29T12:50:49.556 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:49.565+0000 7f334a99aec0 20 bucket index object: default.rgw.buckets.index:.dir.7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.9 2019-11-29T12:50:49.628 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:49.637+0000 7f334a99aec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-29T12:50:49.628 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:49.637+0000 7f334a99aec0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-11-29T12:50:49.628 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:49.637+0000 7f334a99aec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-11-29T12:50:49.629 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:49.637+0000 7f334a99aec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-29T12:50:49.629 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:49.637+0000 7f334a99aec0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2019-11-29T12:50:49.629 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:49.637+0000 7f334a99aec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2019-11-29T12:50:49.629 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:49.637+0000 7f334a99aec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-29T12:50:49.629 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:49.637+0000 7f334a99aec0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-11-29T12:50:49.629 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:49.637+0000 7f334a99aec0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-11-29T12:50:49.630 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:49.637+0000 7f334a99aec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-29T12:50:49.630 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:49.637+0000 7f334a99aec0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2019-11-29T12:50:49.630 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:49.637+0000 7f334a99aec0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2019-11-29T12:50:49.630 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:49.638+0000 7f334a99aec0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2019-11-29T12:50:49.630 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:49.638+0000 7f334a99aec0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2019-11-29T12:50:49.630 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:49.638+0000 7f334a99aec0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2019-11-29T12:50:49.631 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:49.638+0000 7f334a99aec0 20 garbage collection: RGWGC::send_chain - on object name: gc.19tag is: 7f922895-c6d7-4b1b-a19c-be3df5b5a899.4325.225 2019-11-29T12:50:49.678 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:49.687+0000 7f334a99aec0 20 get_obj_state: rctx=0x7ffdb2579950 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x55c56987fc48 s->prefetch_data=0 2019-11-29T12:50:49.687 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:49.696+0000 7f334a99aec0 10 manifest: total_size = 11534336 2019-11-29T12:50:49.687 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:49.696+0000 7f334a99aec0 20 get_obj_state: setting s->obj_tag to _sYpNNEyKpmXDgEVB2sQfDGsC7Ct3nyT 2019-11-29T12:50:49.687 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:49.696+0000 7f334a99aec0 20 get_obj_state: rctx=0x7ffdb2579950 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x55c56987fc48 s->prefetch_data=0 2019-11-29T12:50:49.687 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:49.696+0000 7f334a99aec0 20 prepare_atomic_modification: state is not atomic. state=0x55c56987fc48 2019-11-29T12:50:49.688 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:49.696+0000 7f334a99aec0 20 bucket index object: default.rgw.buckets.index:.dir.7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.9 2019-11-29T12:50:49.775 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:49.784+0000 7f334a99aec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-29T12:50:49.775 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:49.784+0000 7f334a99aec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2019-11-29T12:50:49.775 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:49.784+0000 7f334a99aec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-29T12:50:49.776 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:49.784+0000 7f334a99aec0 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2019-11-29T12:50:49.776 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:49.784+0000 7f334a99aec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-29T12:50:49.776 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:49.784+0000 7f334a99aec0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2019-11-29T12:50:49.776 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:49.784+0000 7f334a99aec0 20 garbage collection: RGWGC::send_chain - on object name: gc.16tag is: _sYpNNEyKpmXDgEVB2sQfDGsC7Ct3nyT 2019-11-29T12:50:49.902 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:49.905+0000 7f334a99aec0 20 get_obj_state: rctx=0x7ffdb2579950 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x55c56987fc48 s->prefetch_data=0 2019-11-29T12:50:49.907 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:49.916+0000 7f334a99aec0 10 manifest: total_size = 11534336 2019-11-29T12:50:49.907 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:49.917+0000 7f334a99aec0 20 get_obj_state: setting s->obj_tag to _LaO_918H25Xoxkm998Erz6069cBDDJU 2019-11-29T12:50:49.907 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:49.917+0000 7f334a99aec0 20 get_obj_state: rctx=0x7ffdb2579950 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x55c56987fc48 s->prefetch_data=0 2019-11-29T12:50:49.907 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:49.917+0000 7f334a99aec0 20 prepare_atomic_modification: state is not atomic. state=0x55c56987fc48 2019-11-29T12:50:49.908 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:49.917+0000 7f334a99aec0 20 bucket index object: default.rgw.buckets.index:.dir.7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.9 2019-11-29T12:50:50.121 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:50.131+0000 7f334a99aec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-29T12:50:50.122 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:50.131+0000 7f334a99aec0 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2019-11-29T12:50:50.122 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:50.131+0000 7f334a99aec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-29T12:50:50.122 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:50.131+0000 7f334a99aec0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2019-11-29T12:50:50.122 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:50.131+0000 7f334a99aec0 20 garbage collection: RGWGC::send_chain - on object name: gc.15tag is: _LaO_918H25Xoxkm998Erz6069cBDDJU 2019-11-29T12:50:50.217 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:50.226+0000 7f334a99aec0 20 get_obj_state: rctx=0x7ffdb2579950 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x55c56987fc48 s->prefetch_data=0 2019-11-29T12:50:50.233 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:50.242+0000 7f334a99aec0 10 manifest: total_size = 11534336 2019-11-29T12:50:50.233 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:50.242+0000 7f334a99aec0 20 get_obj_state: setting s->obj_tag to 7f922895-c6d7-4b1b-a19c-be3df5b5a899.4325.233 2019-11-29T12:50:50.233 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:50.242+0000 7f334a99aec0 20 get_obj_state: rctx=0x7ffdb2579950 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x55c56987fc48 s->prefetch_data=0 2019-11-29T12:50:50.233 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:50.242+0000 7f334a99aec0 20 prepare_atomic_modification: state is not atomic. state=0x55c56987fc48 2019-11-29T12:50:50.233 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:50.242+0000 7f334a99aec0 20 bucket index object: default.rgw.buckets.index:.dir.7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.9 2019-11-29T12:50:50.317 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:50.326+0000 7f334a99aec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-29T12:50:50.317 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:50.326+0000 7f334a99aec0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-11-29T12:50:50.317 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:50.326+0000 7f334a99aec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-11-29T12:50:50.317 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:50.326+0000 7f334a99aec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-29T12:50:50.317 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:50.326+0000 7f334a99aec0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2019-11-29T12:50:50.317 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:50.326+0000 7f334a99aec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2019-11-29T12:50:50.318 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:50.326+0000 7f334a99aec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-29T12:50:50.318 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:50.326+0000 7f334a99aec0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-11-29T12:50:50.318 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:50.326+0000 7f334a99aec0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-11-29T12:50:50.318 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:50.326+0000 7f334a99aec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-29T12:50:50.318 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:50.326+0000 7f334a99aec0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2019-11-29T12:50:50.318 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:50.326+0000 7f334a99aec0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2019-11-29T12:50:50.318 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:50.326+0000 7f334a99aec0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2019-11-29T12:50:50.318 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:50.326+0000 7f334a99aec0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2019-11-29T12:50:50.319 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:50.326+0000 7f334a99aec0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2019-11-29T12:50:50.319 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:50.326+0000 7f334a99aec0 20 garbage collection: RGWGC::send_chain - on object name: gc.25tag is: 7f922895-c6d7-4b1b-a19c-be3df5b5a899.4325.233 2019-11-29T12:50:50.396 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:50.406+0000 7f334a99aec0 20 get_obj_state: rctx=0x7ffdb2579950 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x55c56987fc48 s->prefetch_data=0 2019-11-29T12:50:50.408 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:50.417+0000 7f334a99aec0 10 manifest: total_size = 11534336 2019-11-29T12:50:50.408 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:50.417+0000 7f334a99aec0 20 get_obj_state: setting s->obj_tag to _mgvbyCLDnTPK4thmtS7Lsm_veziNBFM 2019-11-29T12:50:50.408 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:50.417+0000 7f334a99aec0 20 get_obj_state: rctx=0x7ffdb2579950 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x55c56987fc48 s->prefetch_data=0 2019-11-29T12:50:50.408 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:50.417+0000 7f334a99aec0 20 prepare_atomic_modification: state is not atomic. state=0x55c56987fc48 2019-11-29T12:50:50.408 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:50.417+0000 7f334a99aec0 20 bucket index object: default.rgw.buckets.index:.dir.7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.9 2019-11-29T12:50:50.496 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:50.505+0000 7f334a99aec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-29T12:50:50.496 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:50.505+0000 7f334a99aec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2019-11-29T12:50:50.496 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:50.505+0000 7f334a99aec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-29T12:50:50.497 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:50.505+0000 7f334a99aec0 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2019-11-29T12:50:50.497 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:50.505+0000 7f334a99aec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-29T12:50:50.497 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:50.505+0000 7f334a99aec0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2019-11-29T12:50:50.497 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:50.505+0000 7f334a99aec0 20 garbage collection: RGWGC::send_chain - on object name: gc.2tag is: _mgvbyCLDnTPK4thmtS7Lsm_veziNBFM 2019-11-29T12:50:50.598 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:50.608+0000 7f334a99aec0 20 get_obj_state: rctx=0x7ffdb2579950 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x55c56987fc48 s->prefetch_data=0 2019-11-29T12:50:50.613 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:50.622+0000 7f334a99aec0 10 manifest: total_size = 11534336 2019-11-29T12:50:50.613 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:50.622+0000 7f334a99aec0 20 get_obj_state: setting s->obj_tag to 7f922895-c6d7-4b1b-a19c-be3df5b5a899.4325.235 2019-11-29T12:50:50.613 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:50.622+0000 7f334a99aec0 20 get_obj_state: rctx=0x7ffdb2579950 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x55c56987fc48 s->prefetch_data=0 2019-11-29T12:50:50.614 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:50.622+0000 7f334a99aec0 20 prepare_atomic_modification: state is not atomic. state=0x55c56987fc48 2019-11-29T12:50:50.614 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:50.623+0000 7f334a99aec0 20 bucket index object: default.rgw.buckets.index:.dir.7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.9 2019-11-29T12:50:50.727 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:50.736+0000 7f334a99aec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-29T12:50:50.727 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:50.736+0000 7f334a99aec0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-11-29T12:50:50.727 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:50.736+0000 7f334a99aec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-11-29T12:50:50.728 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:50.737+0000 7f334a99aec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-29T12:50:50.728 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:50.737+0000 7f334a99aec0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2019-11-29T12:50:50.728 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:50.737+0000 7f334a99aec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2019-11-29T12:50:50.728 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:50.737+0000 7f334a99aec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-29T12:50:50.728 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:50.737+0000 7f334a99aec0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-11-29T12:50:50.728 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:50.737+0000 7f334a99aec0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-11-29T12:50:50.729 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:50.737+0000 7f334a99aec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-29T12:50:50.729 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:50.737+0000 7f334a99aec0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2019-11-29T12:50:50.729 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:50.737+0000 7f334a99aec0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2019-11-29T12:50:50.729 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:50.737+0000 7f334a99aec0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2019-11-29T12:50:50.729 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:50.737+0000 7f334a99aec0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2019-11-29T12:50:50.729 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:50.737+0000 7f334a99aec0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2019-11-29T12:50:50.729 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:50.737+0000 7f334a99aec0 20 garbage collection: RGWGC::send_chain - on object name: gc.20tag is: 7f922895-c6d7-4b1b-a19c-be3df5b5a899.4325.235 2019-11-29T12:50:50.805 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:50.814+0000 7f334a99aec0 20 get_obj_state: rctx=0x7ffdb2579950 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x55c56987fc48 s->prefetch_data=0 2019-11-29T12:50:50.812 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:50.822+0000 7f334a99aec0 10 manifest: total_size = 11534336 2019-11-29T12:50:50.812 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:50.822+0000 7f334a99aec0 20 get_obj_state: setting s->obj_tag to _Bc7TZy81FWTgKUxsA2_XmVIk6SDlK04 2019-11-29T12:50:50.813 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:50.822+0000 7f334a99aec0 20 get_obj_state: rctx=0x7ffdb2579950 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x55c56987fc48 s->prefetch_data=0 2019-11-29T12:50:50.813 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:50.822+0000 7f334a99aec0 20 prepare_atomic_modification: state is not atomic. state=0x55c56987fc48 2019-11-29T12:50:50.813 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:50.822+0000 7f334a99aec0 20 bucket index object: default.rgw.buckets.index:.dir.7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.9 2019-11-29T12:50:51.003 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:51.012+0000 7f334a99aec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-29T12:50:51.003 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:51.012+0000 7f334a99aec0 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2019-11-29T12:50:51.003 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:51.012+0000 7f334a99aec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-29T12:50:51.004 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:51.012+0000 7f334a99aec0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2019-11-29T12:50:51.004 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:51.012+0000 7f334a99aec0 20 garbage collection: RGWGC::send_chain - on object name: gc.4tag is: _Bc7TZy81FWTgKUxsA2_XmVIk6SDlK04 2019-11-29T12:50:51.066 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:51.075+0000 7f334a99aec0 20 get_obj_state: rctx=0x7ffdb2579950 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x55c56987fc48 s->prefetch_data=0 2019-11-29T12:50:51.078 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:51.087+0000 7f334a99aec0 10 manifest: total_size = 541681 2019-11-29T12:50:51.078 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:51.087+0000 7f334a99aec0 20 get_obj_state: setting s->obj_tag to 7f922895-c6d7-4b1b-a19c-be3df5b5a899.4325.242 2019-11-29T12:50:51.078 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:51.087+0000 7f334a99aec0 20 get_obj_state: rctx=0x7ffdb2579950 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x55c56987fc48 s->prefetch_data=0 2019-11-29T12:50:51.078 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:51.087+0000 7f334a99aec0 20 prepare_atomic_modification: state is not atomic. state=0x55c56987fc48 2019-11-29T12:50:51.079 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:51.087+0000 7f334a99aec0 20 bucket index object: default.rgw.buckets.index:.dir.7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.9 2019-11-29T12:50:51.169 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:51.179+0000 7f334a99aec0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2019-11-29T12:50:51.170 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:51.179+0000 7f334a99aec0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=246247 2019-11-29T12:50:51.170 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:51.179+0000 7f334a99aec0 20 RGWObjManifest::operator++(): result: ofs=246247 stripe_ofs=246247 part_ofs=246247 rule->part_size=246247 2019-11-29T12:50:51.170 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:51.179+0000 7f334a99aec0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2019-11-29T12:50:51.170 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:51.179+0000 7f334a99aec0 20 RGWObjManifest::operator++(): stripe_ofs=4440551 part_ofs=246247 rule->part_size=246247 2019-11-29T12:50:51.170 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:51.179+0000 7f334a99aec0 20 RGWObjManifest::operator++(): result: ofs=492494 stripe_ofs=492494 part_ofs=492494 rule->part_size=49187 2019-11-29T12:50:51.171 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:51.179+0000 7f334a99aec0 20 RGWObjManifest::operator++(): rule->part_size=49187 rules.size()=2 2019-11-29T12:50:51.171 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:51.179+0000 7f334a99aec0 20 RGWObjManifest::operator++(): stripe_ofs=4686798 part_ofs=492494 rule->part_size=49187 2019-11-29T12:50:51.171 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:51.179+0000 7f334a99aec0 20 RGWObjManifest::operator++(): result: ofs=541681 stripe_ofs=541681 part_ofs=541681 rule->part_size=49187 2019-11-29T12:50:51.171 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:51.179+0000 7f334a99aec0 20 garbage collection: RGWGC::send_chain - on object name: gc.10tag is: 7f922895-c6d7-4b1b-a19c-be3df5b5a899.4325.242 2019-11-29T12:50:51.226 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:51.235+0000 7f334a99aec0 20 get_obj_state: rctx=0x7ffdb2579950 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x55c56987fc48 s->prefetch_data=0 2019-11-29T12:50:51.246 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:51.256+0000 7f334a99aec0 10 manifest: total_size = 541681 2019-11-29T12:50:51.247 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:51.256+0000 7f334a99aec0 20 get_obj_state: setting s->obj_tag to _07GC9c-ruIRwiGXU7Yhl-cveDO8rqmz 2019-11-29T12:50:51.247 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:51.256+0000 7f334a99aec0 20 get_obj_state: rctx=0x7ffdb2579950 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x55c56987fc48 s->prefetch_data=0 2019-11-29T12:50:51.247 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:51.256+0000 7f334a99aec0 20 prepare_atomic_modification: state is not atomic. state=0x55c56987fc48 2019-11-29T12:50:51.247 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:51.256+0000 7f334a99aec0 20 bucket index object: default.rgw.buckets.index:.dir.7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.9 2019-11-29T12:50:51.351 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:51.357+0000 7f334a99aec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-29T12:50:51.351 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:51.357+0000 7f334a99aec0 20 RGWObjManifest::operator++(): result: ofs=541681 stripe_ofs=541681 part_ofs=0 rule->part_size=0 2019-11-29T12:50:51.351 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:51.357+0000 7f334a99aec0 20 garbage collection: RGWGC::send_chain - on object name: gc.17tag is: _07GC9c-ruIRwiGXU7Yhl-cveDO8rqmz 2019-11-29T12:50:51.426 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:51.435+0000 7f334a99aec0 20 get_obj_state: rctx=0x7ffdb2579950 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x55c56987fc48 s->prefetch_data=0 2019-11-29T12:50:51.437 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:51.447+0000 7f334a99aec0 10 manifest: total_size = 541681 2019-11-29T12:50:51.437 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:51.447+0000 7f334a99aec0 20 get_obj_state: setting s->obj_tag to _iCSiotg6M_NuPdEsV_SSFD1Esd6v-wh 2019-11-29T12:50:51.437 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:51.447+0000 7f334a99aec0 20 get_obj_state: rctx=0x7ffdb2579950 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x55c56987fc48 s->prefetch_data=0 2019-11-29T12:50:51.438 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:51.447+0000 7f334a99aec0 20 prepare_atomic_modification: state is not atomic. state=0x55c56987fc48 2019-11-29T12:50:51.438 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:51.447+0000 7f334a99aec0 20 bucket index object: default.rgw.buckets.index:.dir.7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.9 2019-11-29T12:50:51.536 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:51.545+0000 7f334a99aec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-29T12:50:51.536 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:51.545+0000 7f334a99aec0 20 RGWObjManifest::operator++(): result: ofs=541681 stripe_ofs=541681 part_ofs=0 rule->part_size=0 2019-11-29T12:50:51.536 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:51.545+0000 7f334a99aec0 20 garbage collection: RGWGC::send_chain - on object name: gc.29tag is: _iCSiotg6M_NuPdEsV_SSFD1Esd6v-wh 2019-11-29T12:50:51.614 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:51.623+0000 7f334a99aec0 20 get_obj_state: rctx=0x7ffdb2579950 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x55c56987fc48 s->prefetch_data=0 2019-11-29T12:50:51.623 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:51.632+0000 7f334a99aec0 10 manifest: total_size = 541681 2019-11-29T12:50:51.623 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:51.633+0000 7f334a99aec0 20 get_obj_state: setting s->obj_tag to 7f922895-c6d7-4b1b-a19c-be3df5b5a899.4325.245 2019-11-29T12:50:51.624 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:51.633+0000 7f334a99aec0 20 get_obj_state: rctx=0x7ffdb2579950 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x55c56987fc48 s->prefetch_data=0 2019-11-29T12:50:51.624 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:51.633+0000 7f334a99aec0 20 prepare_atomic_modification: state is not atomic. state=0x55c56987fc48 2019-11-29T12:50:51.624 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:51.633+0000 7f334a99aec0 20 bucket index object: default.rgw.buckets.index:.dir.7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.9 2019-11-29T12:50:51.713 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:51.722+0000 7f334a99aec0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2019-11-29T12:50:51.713 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:51.722+0000 7f334a99aec0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=246247 2019-11-29T12:50:51.714 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:51.722+0000 7f334a99aec0 20 RGWObjManifest::operator++(): result: ofs=246247 stripe_ofs=246247 part_ofs=246247 rule->part_size=246247 2019-11-29T12:50:51.714 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:51.722+0000 7f334a99aec0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2019-11-29T12:50:51.714 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:51.722+0000 7f334a99aec0 20 RGWObjManifest::operator++(): stripe_ofs=4440551 part_ofs=246247 rule->part_size=246247 2019-11-29T12:50:51.714 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:51.722+0000 7f334a99aec0 20 RGWObjManifest::operator++(): result: ofs=492494 stripe_ofs=492494 part_ofs=492494 rule->part_size=49187 2019-11-29T12:50:51.714 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:51.722+0000 7f334a99aec0 20 RGWObjManifest::operator++(): rule->part_size=49187 rules.size()=2 2019-11-29T12:50:51.714 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:51.722+0000 7f334a99aec0 20 RGWObjManifest::operator++(): stripe_ofs=4686798 part_ofs=492494 rule->part_size=49187 2019-11-29T12:50:51.714 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:51.722+0000 7f334a99aec0 20 RGWObjManifest::operator++(): result: ofs=541681 stripe_ofs=541681 part_ofs=541681 rule->part_size=49187 2019-11-29T12:50:51.715 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:51.722+0000 7f334a99aec0 20 garbage collection: RGWGC::send_chain - on object name: gc.26tag is: 7f922895-c6d7-4b1b-a19c-be3df5b5a899.4325.245 2019-11-29T12:50:51.771 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:51.781+0000 7f334a99aec0 10 cls_bucket_list_ordered :test-client.0-r-test-obj-storage-class-multipart-copy.1[7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.9]) start _multipart_[] num_entries 1001 2019-11-29T12:50:51.771 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:51.781+0000 7f334a99aec0 10 cls_bucket_list_ordered request from each of 1 shard(s) for 1002 entries to get 1001 total entries 2019-11-29T12:50:51.785 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:51.795+0000 7f334a99aec0 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart-copy.1[7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.9])"; objs.size()=0; is_truncated=0 2019-11-29T12:50:51.869 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:51.878+0000 7f334a99aec0 20 get_system_obj_state: rctx=0x7ffdb25792e8 obj=default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart-copy.1 state=0x55c56987f8f0 s->prefetch_data=0 2019-11-29T12:50:51.869 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:51.878+0000 7f334a99aec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 : type miss (requested=0x16, cached=0x3) 2019-11-29T12:50:51.884 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:51.893+0000 7f334a99aec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x16 2019-11-29T12:50:51.884 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:51.893+0000 7f334a99aec0 10 moving default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2019-11-29T12:50:51.884 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:51.893+0000 7f334a99aec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-29T12:50:51.884 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:51.893+0000 7f334a99aec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-29T12:50:51.884 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:51.893+0000 7f334a99aec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 : hit (requested=0x11, cached=0x17) 2019-11-29T12:50:51.884 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:51.893+0000 7f334a99aec0 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 from cache 2019-11-29T12:50:51.885 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:51.893+0000 7f334a99aec0 10 distributing notification oid=default.rgw.control:notify.3 bl.length()=199 2019-11-29T12:50:51.891 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:51.900+0000 7f332d7fa700 10 RGWWatcher::handle_notify() notify_id 566935683075 cookie 94306366788208 notifier 4711 bl.length()=199 2019-11-29T12:50:52.014 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:52.024+0000 7f334a99aec0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.9 from cache 2019-11-29T12:50:52.014 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:52.024+0000 7f334a99aec0 10 distributing notification oid=default.rgw.control:notify.7 bl.length()=256 2019-11-29T12:50:52.024 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:52.033+0000 7f332d7fa700 10 RGWWatcher::handle_notify() notify_id 566935683074 cookie 94306366796848 notifier 4711 bl.length()=256 2019-11-29T12:50:52.368 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:52.378+0000 7f334a99aec0 20 get_system_obj_state: rctx=0x7ffdb2579930 obj=default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart.1 state=0x55c569874690 s->prefetch_data=0 2019-11-29T12:50:52.369 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:52.378+0000 7f334a99aec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 : miss 2019-11-29T12:50:52.388 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:52.397+0000 7f334a99aec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 info.flags=0x6 2019-11-29T12:50:52.388 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:52.397+0000 7f334a99aec0 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 to cache LRU end 2019-11-29T12:50:52.388 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:52.397+0000 7f334a99aec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-29T12:50:52.388 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:52.397+0000 7f334a99aec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-29T12:50:52.389 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:52.397+0000 7f334a99aec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 : type miss (requested=0x1, cached=0x6) 2019-11-29T12:50:52.389 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:52.397+0000 7f334a99aec0 20 rados->read ofs=0 len=0 2019-11-29T12:50:52.412 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:52.422+0000 7f334a99aec0 20 rados_obj.operate() r=0 bl.length=232 2019-11-29T12:50:52.413 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:52.422+0000 7f334a99aec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 info.flags=0x1 2019-11-29T12:50:52.413 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:52.422+0000 7f334a99aec0 10 moving default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 to cache LRU end 2019-11-29T12:50:52.413 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:52.422+0000 7f334a99aec0 20 get_system_obj_state: rctx=0x7ffdb2579930 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.8 state=0x55c569879c00 s->prefetch_data=0 2019-11-29T12:50:52.413 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:52.422+0000 7f334a99aec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.8 : miss 2019-11-29T12:50:52.431 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:52.439+0000 7f334a99aec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.8 info.flags=0x16 2019-11-29T12:50:52.431 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:52.439+0000 7f334a99aec0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.8 to cache LRU end 2019-11-29T12:50:52.431 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:52.439+0000 7f334a99aec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-29T12:50:52.432 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:52.439+0000 7f334a99aec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-29T12:50:52.432 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:52.439+0000 7f334a99aec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-29T12:50:52.432 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:52.439+0000 7f334a99aec0 20 Read xattr: user.rgw.acl 2019-11-29T12:50:52.432 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:52.439+0000 7f334a99aec0 20 Read xattr: user.rgw.idtag 2019-11-29T12:50:52.432 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:52.439+0000 7f334a99aec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.8 : type miss (requested=0x13, cached=0x16) 2019-11-29T12:50:52.432 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:52.439+0000 7f334a99aec0 20 rados->read ofs=0 len=0 2019-11-29T12:50:52.459 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:52.468+0000 7f334a99aec0 20 rados_obj.operate() r=0 bl.length=324 2019-11-29T12:50:52.460 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:52.468+0000 7f334a99aec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.8 info.flags=0x13 2019-11-29T12:50:52.460 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:52.468+0000 7f334a99aec0 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.8 to cache LRU end 2019-11-29T12:50:52.460 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:52.468+0000 7f334a99aec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-29T12:50:52.460 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:52.468+0000 7f334a99aec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-29T12:50:52.460 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:52.468+0000 7f334a99aec0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.8 2019-11-29T12:50:52.485 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:52.495+0000 7f334a99aec0 10 cls_bucket_list_unordered :test-client.0-r-test-obj-storage-class-multipart.1[7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.8]) start [] num_entries 1100 2019-11-29T12:50:52.505 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:52.514+0000 7f334a99aec0 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN[] 2019-11-29T12:50:52.505 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:52.514+0000 7f334a99aec0 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM[] 2019-11-29T12:50:52.505 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:52.514+0000 7f334a99aec0 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD[] 2019-11-29T12:50:52.505 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:52.514+0000 7f334a99aec0 20 get_obj_state: rctx=0x7ffdb2579950 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x55c56987e2d8 s->prefetch_data=0 2019-11-29T12:50:52.522 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:52.532+0000 7f334a99aec0 10 manifest: total_size = 11534336 2019-11-29T12:50:52.523 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:52.532+0000 7f334a99aec0 20 get_obj_state: setting s->obj_tag to 7f922895-c6d7-4b1b-a19c-be3df5b5a899.4325.196 2019-11-29T12:50:52.523 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:52.532+0000 7f334a99aec0 20 get_obj_state: rctx=0x7ffdb2579950 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x55c56987e2d8 s->prefetch_data=0 2019-11-29T12:50:52.523 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:52.532+0000 7f334a99aec0 20 prepare_atomic_modification: state is not atomic. state=0x55c56987e2d8 2019-11-29T12:50:52.523 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:52.532+0000 7f334a99aec0 20 bucket index object: default.rgw.buckets.index:.dir.7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.8 2019-11-29T12:50:52.646 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:52.655+0000 7f334a99aec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-29T12:50:52.646 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:52.655+0000 7f334a99aec0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-11-29T12:50:52.646 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:52.655+0000 7f334a99aec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-11-29T12:50:52.646 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:52.655+0000 7f334a99aec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-29T12:50:52.646 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:52.655+0000 7f334a99aec0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2019-11-29T12:50:52.647 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:52.655+0000 7f334a99aec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2019-11-29T12:50:52.647 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:52.655+0000 7f334a99aec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-29T12:50:52.647 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:52.655+0000 7f334a99aec0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-11-29T12:50:52.647 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:52.655+0000 7f334a99aec0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-11-29T12:50:52.647 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:52.655+0000 7f334a99aec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-29T12:50:52.647 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:52.655+0000 7f334a99aec0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2019-11-29T12:50:52.647 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:52.655+0000 7f334a99aec0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2019-11-29T12:50:52.648 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:52.655+0000 7f334a99aec0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2019-11-29T12:50:52.648 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:52.655+0000 7f334a99aec0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2019-11-29T12:50:52.648 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:52.655+0000 7f334a99aec0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2019-11-29T12:50:52.648 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:52.655+0000 7f334a99aec0 20 garbage collection: RGWGC::send_chain - on object name: gc.26tag is: 7f922895-c6d7-4b1b-a19c-be3df5b5a899.4325.196 2019-11-29T12:50:52.724 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:52.733+0000 7f334a99aec0 20 get_obj_state: rctx=0x7ffdb2579950 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x55c56987eff8 s->prefetch_data=0 2019-11-29T12:50:52.738 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:52.747+0000 7f334a99aec0 10 manifest: total_size = 11534336 2019-11-29T12:50:52.738 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:52.747+0000 7f334a99aec0 20 get_obj_state: setting s->obj_tag to 7f922895-c6d7-4b1b-a19c-be3df5b5a899.4325.203 2019-11-29T12:50:52.738 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:52.747+0000 7f334a99aec0 20 get_obj_state: rctx=0x7ffdb2579950 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x55c56987eff8 s->prefetch_data=0 2019-11-29T12:50:52.738 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:52.747+0000 7f334a99aec0 20 prepare_atomic_modification: state is not atomic. state=0x55c56987eff8 2019-11-29T12:50:52.738 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:52.747+0000 7f334a99aec0 20 bucket index object: default.rgw.buckets.index:.dir.7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.8 2019-11-29T12:50:52.889 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:52.898+0000 7f334a99aec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-29T12:50:52.889 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:52.898+0000 7f334a99aec0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-11-29T12:50:52.889 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:52.898+0000 7f334a99aec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-11-29T12:50:52.889 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:52.898+0000 7f334a99aec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-29T12:50:52.889 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:52.898+0000 7f334a99aec0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2019-11-29T12:50:52.889 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:52.898+0000 7f334a99aec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2019-11-29T12:50:52.889 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:52.898+0000 7f334a99aec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-29T12:50:52.890 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:52.898+0000 7f334a99aec0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-11-29T12:50:52.890 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:52.898+0000 7f334a99aec0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-11-29T12:50:52.890 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:52.898+0000 7f334a99aec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-29T12:50:52.890 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:52.898+0000 7f334a99aec0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2019-11-29T12:50:52.890 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:52.898+0000 7f334a99aec0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2019-11-29T12:50:52.890 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:52.898+0000 7f334a99aec0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2019-11-29T12:50:52.890 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:52.898+0000 7f334a99aec0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2019-11-29T12:50:52.891 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:52.898+0000 7f334a99aec0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2019-11-29T12:50:52.891 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:52.898+0000 7f334a99aec0 20 garbage collection: RGWGC::send_chain - on object name: gc.17tag is: 7f922895-c6d7-4b1b-a19c-be3df5b5a899.4325.203 2019-11-29T12:50:52.975 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:52.985+0000 7f334a99aec0 20 get_obj_state: rctx=0x7ffdb2579950 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x55c56987eff8 s->prefetch_data=0 2019-11-29T12:50:52.984 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:52.993+0000 7f334a99aec0 10 manifest: total_size = 16377 2019-11-29T12:50:52.984 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:52.993+0000 7f334a99aec0 20 get_obj_state: setting s->obj_tag to 7f922895-c6d7-4b1b-a19c-be3df5b5a899.4325.210 2019-11-29T12:50:52.984 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:52.993+0000 7f334a99aec0 20 get_obj_state: rctx=0x7ffdb2579950 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x55c56987eff8 s->prefetch_data=0 2019-11-29T12:50:52.984 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:52.993+0000 7f334a99aec0 20 prepare_atomic_modification: state is not atomic. state=0x55c56987eff8 2019-11-29T12:50:52.984 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:52.993+0000 7f334a99aec0 20 bucket index object: default.rgw.buckets.index:.dir.7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.8 2019-11-29T12:50:53.093 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:53.102+0000 7f334a99aec0 20 RGWObjManifest::operator++(): rule->part_size=7672 rules.size()=3 2019-11-29T12:50:53.093 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:53.102+0000 7f334a99aec0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=7672 2019-11-29T12:50:53.094 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:53.102+0000 7f334a99aec0 20 RGWObjManifest::operator++(): result: ofs=7672 stripe_ofs=7672 part_ofs=7672 rule->part_size=7670 2019-11-29T12:50:53.094 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:53.102+0000 7f334a99aec0 20 RGWObjManifest::operator++(): rule->part_size=7670 rules.size()=3 2019-11-29T12:50:53.094 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:53.102+0000 7f334a99aec0 20 RGWObjManifest::operator++(): stripe_ofs=4201976 part_ofs=7672 rule->part_size=7670 2019-11-29T12:50:53.094 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:53.102+0000 7f334a99aec0 20 RGWObjManifest::operator++(): result: ofs=15342 stripe_ofs=15342 part_ofs=15342 rule->part_size=1035 2019-11-29T12:50:53.094 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:53.102+0000 7f334a99aec0 20 RGWObjManifest::operator++(): rule->part_size=1035 rules.size()=3 2019-11-29T12:50:53.094 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:53.102+0000 7f334a99aec0 20 RGWObjManifest::operator++(): stripe_ofs=4209646 part_ofs=15342 rule->part_size=1035 2019-11-29T12:50:53.094 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:53.102+0000 7f334a99aec0 20 RGWObjManifest::operator++(): result: ofs=16377 stripe_ofs=16377 part_ofs=16377 rule->part_size=1035 2019-11-29T12:50:53.095 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:53.102+0000 7f334a99aec0 20 garbage collection: RGWGC::send_chain - on object name: gc.7tag is: 7f922895-c6d7-4b1b-a19c-be3df5b5a899.4325.210 2019-11-29T12:50:53.151 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:53.160+0000 7f334a99aec0 10 cls_bucket_list_ordered :test-client.0-r-test-obj-storage-class-multipart.1[7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.8]) start _multipart_[] num_entries 1001 2019-11-29T12:50:53.151 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:53.160+0000 7f334a99aec0 10 cls_bucket_list_ordered request from each of 1 shard(s) for 1002 entries to get 1001 total entries 2019-11-29T12:50:53.164 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:53.173+0000 7f334a99aec0 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart.1[7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.8])"; objs.size()=0; is_truncated=0 2019-11-29T12:50:53.229 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:53.238+0000 7f334a99aec0 20 get_system_obj_state: rctx=0x7ffdb25792e8 obj=default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart.1 state=0x55c569879c00 s->prefetch_data=0 2019-11-29T12:50:53.229 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:53.238+0000 7f334a99aec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 : type miss (requested=0x16, cached=0x3) 2019-11-29T12:50:53.248 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:53.255+0000 7f334a99aec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 info.flags=0x16 2019-11-29T12:50:53.248 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:53.255+0000 7f334a99aec0 10 moving default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 to cache LRU end 2019-11-29T12:50:53.248 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:53.255+0000 7f334a99aec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-29T12:50:53.248 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:53.255+0000 7f334a99aec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-29T12:50:53.248 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:53.255+0000 7f334a99aec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 : hit (requested=0x11, cached=0x17) 2019-11-29T12:50:53.248 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:53.255+0000 7f334a99aec0 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 from cache 2019-11-29T12:50:53.249 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:53.255+0000 7f334a99aec0 10 distributing notification oid=default.rgw.control:notify.5 bl.length()=194 2019-11-29T12:50:53.264 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:53.273+0000 7f332d7fa700 10 RGWWatcher::handle_notify() notify_id 566935683074 cookie 94306366793056 notifier 4711 bl.length()=194 2019-11-29T12:50:53.615 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:53.624+0000 7f334a99aec0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.8 from cache 2019-11-29T12:50:53.615 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:53.624+0000 7f334a99aec0 10 distributing notification oid=default.rgw.control:notify.7 bl.length()=251 2019-11-29T12:50:53.624 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:53.633+0000 7f332d7fa700 10 RGWWatcher::handle_notify() notify_id 566935683075 cookie 94306366796848 notifier 4711 bl.length()=251 2019-11-29T12:50:53.907 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:53.917+0000 7f334a99aec0 20 get_system_obj_state: rctx=0x7ffdb2579930 obj=default.rgw.meta:root:test-client.0-r-test-obj-storage-class.1 state=0x55c569874690 s->prefetch_data=0 2019-11-29T12:50:53.907 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:53.917+0000 7f334a99aec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 : miss 2019-11-29T12:50:53.920 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:53.929+0000 7f334a99aec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 info.flags=0x6 2019-11-29T12:50:53.920 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:53.929+0000 7f334a99aec0 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 to cache LRU end 2019-11-29T12:50:53.921 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:53.929+0000 7f334a99aec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-29T12:50:53.921 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:53.929+0000 7f334a99aec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-29T12:50:53.921 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:53.929+0000 7f334a99aec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 : type miss (requested=0x1, cached=0x6) 2019-11-29T12:50:53.921 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:53.929+0000 7f334a99aec0 20 rados->read ofs=0 len=0 2019-11-29T12:50:53.929 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:53.938+0000 7f334a99aec0 20 rados_obj.operate() r=0 bl.length=222 2019-11-29T12:50:53.929 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:53.938+0000 7f334a99aec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 info.flags=0x1 2019-11-29T12:50:53.929 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:53.938+0000 7f334a99aec0 10 moving default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 to cache LRU end 2019-11-29T12:50:53.930 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:53.938+0000 7f334a99aec0 20 get_system_obj_state: rctx=0x7ffdb2579930 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class.1:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.6 state=0x55c569879c00 s->prefetch_data=0 2019-11-29T12:50:53.930 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:53.938+0000 7f334a99aec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.6 : miss 2019-11-29T12:50:53.942 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:53.952+0000 7f334a99aec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.6 info.flags=0x16 2019-11-29T12:50:53.943 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:53.952+0000 7f334a99aec0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.6 to cache LRU end 2019-11-29T12:50:53.943 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:53.952+0000 7f334a99aec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-29T12:50:53.943 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:53.952+0000 7f334a99aec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-29T12:50:53.943 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:53.952+0000 7f334a99aec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-29T12:50:53.943 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:53.952+0000 7f334a99aec0 20 Read xattr: user.rgw.acl 2019-11-29T12:50:53.944 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:53.952+0000 7f334a99aec0 20 Read xattr: user.rgw.idtag 2019-11-29T12:50:53.944 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:53.952+0000 7f334a99aec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.6 : type miss (requested=0x13, cached=0x16) 2019-11-29T12:50:53.944 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:53.952+0000 7f334a99aec0 20 rados->read ofs=0 len=0 2019-11-29T12:50:53.962 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:53.971+0000 7f334a99aec0 20 rados_obj.operate() r=0 bl.length=314 2019-11-29T12:50:53.962 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:53.971+0000 7f334a99aec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.6 info.flags=0x13 2019-11-29T12:50:53.962 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:53.971+0000 7f334a99aec0 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.6 to cache LRU end 2019-11-29T12:50:53.962 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:53.971+0000 7f334a99aec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-29T12:50:53.963 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:53.971+0000 7f334a99aec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-29T12:50:53.963 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:53.971+0000 7f334a99aec0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.6 2019-11-29T12:50:53.982 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:53.991+0000 7f334a99aec0 10 cls_bucket_list_unordered :test-client.0-r-test-obj-storage-class.1[7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.6]) start [] num_entries 1100 2019-11-29T12:50:54.008 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:54.017+0000 7f334a99aec0 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN[] 2019-11-29T12:50:54.008 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:54.017+0000 7f334a99aec0 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM[] 2019-11-29T12:50:54.008 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:54.017+0000 7f334a99aec0 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD[] 2019-11-29T12:50:54.008 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:54.017+0000 7f334a99aec0 20 get_obj_state: rctx=0x7ffdb2579950 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x55c56987e2d8 s->prefetch_data=0 2019-11-29T12:50:54.022 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:54.032+0000 7f334a99aec0 10 manifest: total_size = 10485760 2019-11-29T12:50:54.023 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:54.032+0000 7f334a99aec0 20 get_obj_state: setting s->obj_tag to 7f922895-c6d7-4b1b-a19c-be3df5b5a899.4325.84 2019-11-29T12:50:54.023 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:54.032+0000 7f334a99aec0 20 get_obj_state: rctx=0x7ffdb2579950 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x55c56987e2d8 s->prefetch_data=0 2019-11-29T12:50:54.023 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:54.032+0000 7f334a99aec0 20 prepare_atomic_modification: state is not atomic. state=0x55c56987e2d8 2019-11-29T12:50:54.023 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:54.032+0000 7f334a99aec0 20 bucket index object: default.rgw.buckets.index:.dir.7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.6 2019-11-29T12:50:54.120 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:54.128+0000 7f334a99aec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-29T12:50:54.120 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:54.128+0000 7f334a99aec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2019-11-29T12:50:54.120 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:54.128+0000 7f334a99aec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-29T12:50:54.121 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:54.128+0000 7f334a99aec0 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2019-11-29T12:50:54.121 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:54.128+0000 7f334a99aec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-29T12:50:54.121 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:54.128+0000 7f334a99aec0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2019-11-29T12:50:54.121 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:54.128+0000 7f334a99aec0 20 garbage collection: RGWGC::send_chain - on object name: gc.11tag is: 7f922895-c6d7-4b1b-a19c-be3df5b5a899.4325.84 2019-11-29T12:50:54.218 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:54.227+0000 7f334a99aec0 20 get_obj_state: rctx=0x7ffdb2579950 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x55c56987e2d8 s->prefetch_data=0 2019-11-29T12:50:54.227 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:54.237+0000 7f334a99aec0 10 manifest: total_size = 10485760 2019-11-29T12:50:54.228 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:54.237+0000 7f334a99aec0 20 get_obj_state: setting s->obj_tag to 7f922895-c6d7-4b1b-a19c-be3df5b5a899.4325.85 2019-11-29T12:50:54.228 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:54.237+0000 7f334a99aec0 20 get_obj_state: rctx=0x7ffdb2579950 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x55c56987e2d8 s->prefetch_data=0 2019-11-29T12:50:54.228 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:54.237+0000 7f334a99aec0 20 prepare_atomic_modification: state is not atomic. state=0x55c56987e2d8 2019-11-29T12:50:54.228 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:54.237+0000 7f334a99aec0 20 bucket index object: default.rgw.buckets.index:.dir.7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.6 2019-11-29T12:50:54.319 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:54.328+0000 7f334a99aec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-29T12:50:54.319 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:54.328+0000 7f334a99aec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2019-11-29T12:50:54.319 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:54.328+0000 7f334a99aec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-29T12:50:54.319 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:54.328+0000 7f334a99aec0 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2019-11-29T12:50:54.320 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:54.328+0000 7f334a99aec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-29T12:50:54.320 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:54.328+0000 7f334a99aec0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2019-11-29T12:50:54.320 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:54.328+0000 7f334a99aec0 20 garbage collection: RGWGC::send_chain - on object name: gc.22tag is: 7f922895-c6d7-4b1b-a19c-be3df5b5a899.4325.85 2019-11-29T12:50:54.379 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:54.388+0000 7f334a99aec0 20 get_obj_state: rctx=0x7ffdb2579950 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x55c56987e2d8 s->prefetch_data=0 2019-11-29T12:50:54.387 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:54.396+0000 7f334a99aec0 10 manifest: total_size = 3293 2019-11-29T12:50:54.387 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:54.396+0000 7f334a99aec0 20 get_obj_state: setting s->obj_tag to 7f922895-c6d7-4b1b-a19c-be3df5b5a899.4325.86 2019-11-29T12:50:54.388 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:54.396+0000 7f334a99aec0 20 get_obj_state: rctx=0x7ffdb2579950 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x55c56987e2d8 s->prefetch_data=0 2019-11-29T12:50:54.388 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:54.396+0000 7f334a99aec0 20 prepare_atomic_modification: state is not atomic. state=0x55c56987e2d8 2019-11-29T12:50:54.388 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:54.396+0000 7f334a99aec0 20 bucket index object: default.rgw.buckets.index:.dir.7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.6 2019-11-29T12:50:54.481 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:54.490+0000 7f334a99aec0 10 cls_bucket_list_ordered :test-client.0-r-test-obj-storage-class.1[7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.6]) start _multipart_[] num_entries 1001 2019-11-29T12:50:54.481 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:54.490+0000 7f334a99aec0 10 cls_bucket_list_ordered request from each of 1 shard(s) for 1002 entries to get 1001 total entries 2019-11-29T12:50:54.552 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:54.561+0000 7f334a99aec0 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class.1[7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.6])"; objs.size()=0; is_truncated=0 2019-11-29T12:50:54.623 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:54.632+0000 7f334a99aec0 20 get_system_obj_state: rctx=0x7ffdb25792e8 obj=default.rgw.meta:root:test-client.0-r-test-obj-storage-class.1 state=0x55c56987e020 s->prefetch_data=0 2019-11-29T12:50:54.623 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:54.632+0000 7f334a99aec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 : type miss (requested=0x16, cached=0x3) 2019-11-29T12:50:54.637 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:54.646+0000 7f334a99aec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 info.flags=0x16 2019-11-29T12:50:54.638 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:54.646+0000 7f334a99aec0 10 moving default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 to cache LRU end 2019-11-29T12:50:54.638 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:54.646+0000 7f334a99aec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-29T12:50:54.638 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:54.646+0000 7f334a99aec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-29T12:50:54.638 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:54.646+0000 7f334a99aec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 : hit (requested=0x11, cached=0x17) 2019-11-29T12:50:54.638 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:54.646+0000 7f334a99aec0 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 from cache 2019-11-29T12:50:54.638 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:54.646+0000 7f334a99aec0 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=184 2019-11-29T12:50:54.660 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:54.670+0000 7f332d7fa700 10 RGWWatcher::handle_notify() notify_id 566935683084 cookie 94306366786192 notifier 4711 bl.length()=184 2019-11-29T12:50:55.028 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:55.037+0000 7f334a99aec0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.6 from cache 2019-11-29T12:50:55.028 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:55.037+0000 7f334a99aec0 10 distributing notification oid=default.rgw.control:notify.4 bl.length()=241 2019-11-29T12:50:55.040 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:55.049+0000 7f332d7fa700 10 RGWWatcher::handle_notify() notify_id 566935683085 cookie 94306366791152 notifier 4711 bl.length()=241 2019-11-29T12:50:55.552 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:55.561+0000 7f328bfff700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-29T12:50:55.924 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:55.933+0000 7f334a99aec0 20 get_system_obj_state: rctx=0x7ffdb2579930 obj=default.rgw.meta:root:test-client.0-r-test-small-obj-data.1 state=0x55c569874690 s->prefetch_data=0 2019-11-29T12:50:55.924 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:55.933+0000 7f334a99aec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 : miss 2019-11-29T12:50:55.947 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:55.956+0000 7f334a99aec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 info.flags=0x6 2019-11-29T12:50:55.948 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:55.956+0000 7f334a99aec0 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 to cache LRU end 2019-11-29T12:50:55.948 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:55.956+0000 7f334a99aec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-29T12:50:55.948 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:55.957+0000 7f334a99aec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-29T12:50:55.948 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:55.957+0000 7f334a99aec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 : type miss (requested=0x1, cached=0x6) 2019-11-29T12:50:55.948 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:55.957+0000 7f334a99aec0 20 rados->read ofs=0 len=0 2019-11-29T12:50:55.963 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:55.972+0000 7f334a99aec0 20 rados_obj.operate() r=0 bl.length=221 2019-11-29T12:50:55.963 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:55.972+0000 7f334a99aec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 info.flags=0x1 2019-11-29T12:50:55.963 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:55.972+0000 7f334a99aec0 10 moving default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 to cache LRU end 2019-11-29T12:50:55.963 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:55.972+0000 7f334a99aec0 20 get_system_obj_state: rctx=0x7ffdb2579930 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.1:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.10 state=0x55c56987e020 s->prefetch_data=0 2019-11-29T12:50:55.963 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:55.972+0000 7f334a99aec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.10 : miss 2019-11-29T12:50:55.975 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:55.985+0000 7f334a99aec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.10 info.flags=0x16 2019-11-29T12:50:55.976 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:55.985+0000 7f334a99aec0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.10 to cache LRU end 2019-11-29T12:50:55.976 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:55.985+0000 7f334a99aec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-29T12:50:55.976 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:55.985+0000 7f334a99aec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-29T12:50:55.976 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:55.985+0000 7f334a99aec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-29T12:50:55.976 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:55.985+0000 7f334a99aec0 20 Read xattr: user.rgw.acl 2019-11-29T12:50:55.976 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:55.985+0000 7f334a99aec0 20 Read xattr: user.rgw.idtag 2019-11-29T12:50:55.977 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:55.985+0000 7f334a99aec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.10 : type miss (requested=0x13, cached=0x16) 2019-11-29T12:50:55.977 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:55.985+0000 7f334a99aec0 20 rados->read ofs=0 len=0 2019-11-29T12:50:55.993 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:56.002+0000 7f334a99aec0 20 rados_obj.operate() r=0 bl.length=313 2019-11-29T12:50:55.993 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:56.002+0000 7f334a99aec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.10 info.flags=0x13 2019-11-29T12:50:55.993 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:56.002+0000 7f334a99aec0 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.10 to cache LRU end 2019-11-29T12:50:55.994 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:56.002+0000 7f334a99aec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-29T12:50:55.994 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:56.002+0000 7f334a99aec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-29T12:50:55.994 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:56.002+0000 7f334a99aec0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.10 2019-11-29T12:50:56.006 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:56.015+0000 7f334a99aec0 10 cls_bucket_list_unordered :test-client.0-r-test-small-obj-data.1[7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.10]) start [] num_entries 1100 2019-11-29T12:50:56.049 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:56.058+0000 7f334a99aec0 10 RGWRados::cls_bucket_list_unordered: got __[] 2019-11-29T12:50:56.049 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:56.058+0000 7f334a99aec0 10 RGWRados::cls_bucket_list_unordered: got __ _[] 2019-11-29T12:50:56.049 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:56.058+0000 7f334a99aec0 10 RGWRados::cls_bucket_list_unordered: got ___[] 2019-11-29T12:50:56.049 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:56.058+0000 7f334a99aec0 10 RGWRados::cls_bucket_list_unordered: got obj[] 2019-11-29T12:50:56.049 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:56.058+0000 7f334a99aec0 20 get_obj_state: rctx=0x7ffdb2579950 obj=test-client.0-r-test-small-obj-data.1:__ state=0x55c56987e2d8 s->prefetch_data=0 2019-11-29T12:50:56.058 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:56.067+0000 7f334a99aec0 10 manifest: total_size = 1048576 2019-11-29T12:50:56.058 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:56.067+0000 7f334a99aec0 20 get_obj_state: setting s->obj_tag to 7f922895-c6d7-4b1b-a19c-be3df5b5a899.4325.305 2019-11-29T12:50:56.058 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:56.067+0000 7f334a99aec0 20 get_obj_state: rctx=0x7ffdb2579950 obj=test-client.0-r-test-small-obj-data.1:__ state=0x55c56987e2d8 s->prefetch_data=0 2019-11-29T12:50:56.058 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:56.067+0000 7f334a99aec0 20 prepare_atomic_modification: state is not atomic. state=0x55c56987e2d8 2019-11-29T12:50:56.058 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:56.067+0000 7f334a99aec0 20 bucket index object: default.rgw.buckets.index:.dir.7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.10 2019-11-29T12:50:56.268 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:56.277+0000 7f334a99aec0 20 get_obj_state: rctx=0x7ffdb2579950 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x55c56987e2d8 s->prefetch_data=0 2019-11-29T12:50:56.289 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:56.298+0000 7f334a99aec0 10 manifest: total_size = 1048576 2019-11-29T12:50:56.289 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:56.298+0000 7f334a99aec0 20 get_obj_state: setting s->obj_tag to 7f922895-c6d7-4b1b-a19c-be3df5b5a899.4325.307 2019-11-29T12:50:56.289 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:56.298+0000 7f334a99aec0 20 get_obj_state: rctx=0x7ffdb2579950 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x55c56987e2d8 s->prefetch_data=0 2019-11-29T12:50:56.289 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:56.298+0000 7f334a99aec0 20 prepare_atomic_modification: state is not atomic. state=0x55c56987e2d8 2019-11-29T12:50:56.290 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:56.298+0000 7f334a99aec0 20 bucket index object: default.rgw.buckets.index:.dir.7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.10 2019-11-29T12:50:56.464 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:56.473+0000 7f334a99aec0 20 get_obj_state: rctx=0x7ffdb2579950 obj=test-client.0-r-test-small-obj-data.1:___ state=0x55c56987e2d8 s->prefetch_data=0 2019-11-29T12:50:56.520 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:56.529+0000 7f334a99aec0 10 manifest: total_size = 49187 2019-11-29T12:50:56.521 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:56.529+0000 7f334a99aec0 20 get_obj_state: setting s->obj_tag to 7f922895-c6d7-4b1b-a19c-be3df5b5a899.4325.306 2019-11-29T12:50:56.521 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:56.529+0000 7f334a99aec0 20 get_obj_state: rctx=0x7ffdb2579950 obj=test-client.0-r-test-small-obj-data.1:___ state=0x55c56987e2d8 s->prefetch_data=0 2019-11-29T12:50:56.521 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:56.529+0000 7f334a99aec0 20 prepare_atomic_modification: state is not atomic. state=0x55c56987e2d8 2019-11-29T12:50:56.521 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:56.529+0000 7f334a99aec0 20 bucket index object: default.rgw.buckets.index:.dir.7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.10 2019-11-29T12:50:56.694 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:56.704+0000 7f334a99aec0 20 get_obj_state: rctx=0x7ffdb2579950 obj=test-client.0-r-test-small-obj-data.1:obj state=0x55c56987e2d8 s->prefetch_data=0 2019-11-29T12:50:56.703 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:56.712+0000 7f334a99aec0 10 manifest: total_size = 110 2019-11-29T12:50:56.703 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:56.712+0000 7f334a99aec0 20 get_obj_state: setting s->obj_tag to 7f922895-c6d7-4b1b-a19c-be3df5b5a899.4325.304 2019-11-29T12:50:56.703 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:56.712+0000 7f334a99aec0 20 get_obj_state: rctx=0x7ffdb2579950 obj=test-client.0-r-test-small-obj-data.1:obj state=0x55c56987e2d8 s->prefetch_data=0 2019-11-29T12:50:56.703 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:56.712+0000 7f334a99aec0 20 prepare_atomic_modification: state is not atomic. state=0x55c56987e2d8 2019-11-29T12:50:56.703 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:56.712+0000 7f334a99aec0 20 bucket index object: default.rgw.buckets.index:.dir.7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.10 2019-11-29T12:50:56.849 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:56.858+0000 7f334a99aec0 10 cls_bucket_list_ordered :test-client.0-r-test-small-obj-data.1[7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.10]) start _multipart_[] num_entries 1001 2019-11-29T12:50:56.849 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:56.858+0000 7f334a99aec0 10 cls_bucket_list_ordered request from each of 1 shard(s) for 1002 entries to get 1001 total entries 2019-11-29T12:50:56.924 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:56.933+0000 7f334a99aec0 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.1[7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.10])"; objs.size()=0; is_truncated=0 2019-11-29T12:50:56.984 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:56.993+0000 7f334a99aec0 20 get_system_obj_state: rctx=0x7ffdb25792e8 obj=default.rgw.meta:root:test-client.0-r-test-small-obj-data.1 state=0x55c569874690 s->prefetch_data=0 2019-11-29T12:50:56.984 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:56.993+0000 7f334a99aec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 : type miss (requested=0x16, cached=0x3) 2019-11-29T12:50:56.994 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:57.003+0000 7f334a99aec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 info.flags=0x16 2019-11-29T12:50:56.994 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:57.003+0000 7f334a99aec0 10 moving default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 to cache LRU end 2019-11-29T12:50:56.994 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:57.003+0000 7f334a99aec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-29T12:50:56.995 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:57.003+0000 7f334a99aec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-29T12:50:56.995 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:57.003+0000 7f334a99aec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 : hit (requested=0x11, cached=0x17) 2019-11-29T12:50:56.995 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:57.003+0000 7f334a99aec0 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 from cache 2019-11-29T12:50:56.995 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:57.003+0000 7f334a99aec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=181 2019-11-29T12:50:57.004 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:57.014+0000 7f332d7fa700 10 RGWWatcher::handle_notify() notify_id 566935683075 cookie 94306366781632 notifier 4711 bl.length()=181 2019-11-29T12:50:57.705 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:57.714+0000 7f334a99aec0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.10 from cache 2019-11-29T12:50:57.705 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:57.714+0000 7f334a99aec0 10 distributing notification oid=default.rgw.control:notify.0 bl.length()=239 2019-11-29T12:50:57.718 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:57.727+0000 7f332d7fa700 10 RGWWatcher::handle_notify() notify_id 566935683076 cookie 94306366779648 notifier 4711 bl.length()=239 2019-11-29T12:50:58.140 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:58.149+0000 7f334a99aec0 20 get_system_obj_state: rctx=0x7ffdb2579930 obj=default.rgw.meta:root:test-client.0-r-test-small-obj-data.2 state=0x55c56987e020 s->prefetch_data=0 2019-11-29T12:50:58.140 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:58.149+0000 7f334a99aec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 : miss 2019-11-29T12:50:58.153 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:58.162+0000 7f334a99aec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 info.flags=0x6 2019-11-29T12:50:58.153 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:58.162+0000 7f334a99aec0 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 to cache LRU end 2019-11-29T12:50:58.153 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:58.162+0000 7f334a99aec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-29T12:50:58.153 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:58.162+0000 7f334a99aec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-29T12:50:58.153 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:58.162+0000 7f334a99aec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 : type miss (requested=0x1, cached=0x6) 2019-11-29T12:50:58.154 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:58.162+0000 7f334a99aec0 20 rados->read ofs=0 len=0 2019-11-29T12:50:58.165 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:58.175+0000 7f334a99aec0 20 rados_obj.operate() r=0 bl.length=221 2019-11-29T12:50:58.166 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:58.175+0000 7f334a99aec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 info.flags=0x1 2019-11-29T12:50:58.166 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:58.175+0000 7f334a99aec0 10 moving default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 to cache LRU end 2019-11-29T12:50:58.166 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:58.175+0000 7f334a99aec0 20 get_system_obj_state: rctx=0x7ffdb2579930 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.2:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.11 state=0x55c56987ed20 s->prefetch_data=0 2019-11-29T12:50:58.166 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:58.175+0000 7f334a99aec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.11 : miss 2019-11-29T12:50:58.178 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:58.188+0000 7f334a99aec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.11 info.flags=0x16 2019-11-29T12:50:58.179 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:58.188+0000 7f334a99aec0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.11 to cache LRU end 2019-11-29T12:50:58.179 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:58.188+0000 7f334a99aec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-29T12:50:58.179 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:58.188+0000 7f334a99aec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-29T12:50:58.179 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:58.188+0000 7f334a99aec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-29T12:50:58.179 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:58.188+0000 7f334a99aec0 20 Read xattr: user.rgw.acl 2019-11-29T12:50:58.179 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:58.188+0000 7f334a99aec0 20 Read xattr: user.rgw.idtag 2019-11-29T12:50:58.179 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:58.188+0000 7f334a99aec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.11 : type miss (requested=0x13, cached=0x16) 2019-11-29T12:50:58.180 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:58.188+0000 7f334a99aec0 20 rados->read ofs=0 len=0 2019-11-29T12:50:58.203 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:58.212+0000 7f334a99aec0 20 rados_obj.operate() r=0 bl.length=313 2019-11-29T12:50:58.203 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:58.212+0000 7f334a99aec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.11 info.flags=0x13 2019-11-29T12:50:58.203 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:58.212+0000 7f334a99aec0 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.11 to cache LRU end 2019-11-29T12:50:58.203 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:58.212+0000 7f334a99aec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-29T12:50:58.203 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:58.212+0000 7f334a99aec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-29T12:50:58.204 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:58.212+0000 7f334a99aec0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.11 2019-11-29T12:50:58.220 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:58.229+0000 7f334a99aec0 10 cls_bucket_list_unordered :test-client.0-r-test-small-obj-data.2[7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.11]) start [] num_entries 1100 2019-11-29T12:50:58.243 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:58.252+0000 7f334a99aec0 10 RGWRados::cls_bucket_list_unordered: got __[] 2019-11-29T12:50:58.244 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:58.252+0000 7f334a99aec0 10 RGWRados::cls_bucket_list_unordered: got __ _[] 2019-11-29T12:50:58.244 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:58.252+0000 7f334a99aec0 10 RGWRados::cls_bucket_list_unordered: got ___[] 2019-11-29T12:50:58.244 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:58.252+0000 7f334a99aec0 10 RGWRados::cls_bucket_list_unordered: got obj[] 2019-11-29T12:50:58.244 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:58.252+0000 7f334a99aec0 20 get_obj_state: rctx=0x7ffdb2579950 obj=test-client.0-r-test-small-obj-data.2:__ state=0x55c56987e2d8 s->prefetch_data=0 2019-11-29T12:50:58.257 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:58.266+0000 7f334a99aec0 10 manifest: total_size = 524288 2019-11-29T12:50:58.257 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:58.266+0000 7f334a99aec0 20 get_obj_state: setting s->obj_tag to 7f922895-c6d7-4b1b-a19c-be3df5b5a899.4325.312 2019-11-29T12:50:58.257 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:58.266+0000 7f334a99aec0 20 get_obj_state: rctx=0x7ffdb2579950 obj=test-client.0-r-test-small-obj-data.2:__ state=0x55c56987e2d8 s->prefetch_data=0 2019-11-29T12:50:58.257 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:58.266+0000 7f334a99aec0 20 prepare_atomic_modification: state is not atomic. state=0x55c56987e2d8 2019-11-29T12:50:58.257 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:58.266+0000 7f334a99aec0 20 bucket index object: default.rgw.buckets.index:.dir.7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.11 2019-11-29T12:50:58.404 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:58.413+0000 7f334a99aec0 20 get_obj_state: rctx=0x7ffdb2579950 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x55c56987e2d8 s->prefetch_data=0 2019-11-29T12:50:58.413 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:58.422+0000 7f334a99aec0 10 manifest: total_size = 524288 2019-11-29T12:50:58.413 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:58.422+0000 7f334a99aec0 20 get_obj_state: setting s->obj_tag to 7f922895-c6d7-4b1b-a19c-be3df5b5a899.4325.314 2019-11-29T12:50:58.413 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:58.422+0000 7f334a99aec0 20 get_obj_state: rctx=0x7ffdb2579950 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x55c56987e2d8 s->prefetch_data=0 2019-11-29T12:50:58.413 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:58.422+0000 7f334a99aec0 20 prepare_atomic_modification: state is not atomic. state=0x55c56987e2d8 2019-11-29T12:50:58.414 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:58.422+0000 7f334a99aec0 20 bucket index object: default.rgw.buckets.index:.dir.7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.11 2019-11-29T12:50:58.593 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:58.602+0000 7f334a99aec0 20 get_obj_state: rctx=0x7ffdb2579950 obj=test-client.0-r-test-small-obj-data.2:___ state=0x55c56987e2d8 s->prefetch_data=0 2019-11-29T12:50:58.606 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:58.615+0000 7f334a99aec0 10 manifest: total_size = 24595 2019-11-29T12:50:58.607 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:58.615+0000 7f334a99aec0 20 get_obj_state: setting s->obj_tag to 7f922895-c6d7-4b1b-a19c-be3df5b5a899.4325.313 2019-11-29T12:50:58.607 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:58.615+0000 7f334a99aec0 20 get_obj_state: rctx=0x7ffdb2579950 obj=test-client.0-r-test-small-obj-data.2:___ state=0x55c56987e2d8 s->prefetch_data=0 2019-11-29T12:50:58.607 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:58.615+0000 7f334a99aec0 20 prepare_atomic_modification: state is not atomic. state=0x55c56987e2d8 2019-11-29T12:50:58.607 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:58.615+0000 7f334a99aec0 20 bucket index object: default.rgw.buckets.index:.dir.7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.11 2019-11-29T12:50:58.753 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:58.762+0000 7f334a99aec0 20 get_obj_state: rctx=0x7ffdb2579950 obj=test-client.0-r-test-small-obj-data.2:obj state=0x55c56987e2d8 s->prefetch_data=0 2019-11-29T12:50:58.761 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:58.771+0000 7f334a99aec0 10 manifest: total_size = 527 2019-11-29T12:50:58.762 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:58.771+0000 7f334a99aec0 20 get_obj_state: setting s->obj_tag to 7f922895-c6d7-4b1b-a19c-be3df5b5a899.4325.311 2019-11-29T12:50:58.762 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:58.771+0000 7f334a99aec0 20 get_obj_state: rctx=0x7ffdb2579950 obj=test-client.0-r-test-small-obj-data.2:obj state=0x55c56987e2d8 s->prefetch_data=0 2019-11-29T12:50:58.762 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:58.771+0000 7f334a99aec0 20 prepare_atomic_modification: state is not atomic. state=0x55c56987e2d8 2019-11-29T12:50:58.762 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:58.771+0000 7f334a99aec0 20 bucket index object: default.rgw.buckets.index:.dir.7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.11 2019-11-29T12:50:58.866 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:58.875+0000 7f334a99aec0 10 cls_bucket_list_ordered :test-client.0-r-test-small-obj-data.2[7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.11]) start _multipart_[] num_entries 1001 2019-11-29T12:50:58.866 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:58.875+0000 7f334a99aec0 10 cls_bucket_list_ordered request from each of 1 shard(s) for 1002 entries to get 1001 total entries 2019-11-29T12:50:58.927 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:58.936+0000 7f334a99aec0 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.2[7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.11])"; objs.size()=0; is_truncated=0 2019-11-29T12:50:58.984 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:58.993+0000 7f334a99aec0 20 get_system_obj_state: rctx=0x7ffdb25792e8 obj=default.rgw.meta:root:test-client.0-r-test-small-obj-data.2 state=0x55c56987ed20 s->prefetch_data=0 2019-11-29T12:50:58.984 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:58.993+0000 7f334a99aec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 : type miss (requested=0x16, cached=0x3) 2019-11-29T12:50:58.997 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:59.006+0000 7f334a99aec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 info.flags=0x16 2019-11-29T12:50:58.998 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:59.006+0000 7f334a99aec0 10 moving default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 to cache LRU end 2019-11-29T12:50:58.998 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:59.006+0000 7f334a99aec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-29T12:50:58.998 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:59.006+0000 7f334a99aec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-29T12:50:58.998 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:59.006+0000 7f334a99aec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 : hit (requested=0x11, cached=0x17) 2019-11-29T12:50:58.998 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:59.006+0000 7f334a99aec0 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 from cache 2019-11-29T12:50:58.998 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:59.006+0000 7f334a99aec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=181 2019-11-29T12:50:59.017 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:59.027+0000 7f332d7fa700 10 RGWWatcher::handle_notify() notify_id 566935683076 cookie 94306366781632 notifier 4711 bl.length()=181 2019-11-29T12:50:59.242 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:59.251+0000 7f334a99aec0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.11 from cache 2019-11-29T12:50:59.242 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:59.251+0000 7f334a99aec0 10 distributing notification oid=default.rgw.control:notify.0 bl.length()=239 2019-11-29T12:50:59.257 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:59.266+0000 7f332d7fa700 10 RGWWatcher::handle_notify() notify_id 566935683077 cookie 94306366779648 notifier 4711 bl.length()=239 2019-11-29T12:50:59.408 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:59.417+0000 7f334a99aec0 20 get_system_obj_state: rctx=0x7ffdb2579930 obj=default.rgw.meta:root:test-client.0-r-test-small-obj-data.3 state=0x55c56987e020 s->prefetch_data=0 2019-11-29T12:50:59.408 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:59.417+0000 7f334a99aec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 : miss 2019-11-29T12:50:59.418 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:59.427+0000 7f334a99aec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 info.flags=0x6 2019-11-29T12:50:59.418 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:59.427+0000 7f334a99aec0 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 to cache LRU end 2019-11-29T12:50:59.418 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:59.427+0000 7f334a99aec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-29T12:50:59.418 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:59.427+0000 7f334a99aec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-29T12:50:59.418 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:59.427+0000 7f334a99aec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 : type miss (requested=0x1, cached=0x6) 2019-11-29T12:50:59.419 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:59.427+0000 7f334a99aec0 20 rados->read ofs=0 len=0 2019-11-29T12:50:59.428 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:59.437+0000 7f334a99aec0 20 rados_obj.operate() r=0 bl.length=221 2019-11-29T12:50:59.429 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:59.437+0000 7f334a99aec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 info.flags=0x1 2019-11-29T12:50:59.429 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:59.437+0000 7f334a99aec0 10 moving default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 to cache LRU end 2019-11-29T12:50:59.429 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:59.437+0000 7f334a99aec0 20 get_system_obj_state: rctx=0x7ffdb2579930 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.3:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.12 state=0x55c56987ed20 s->prefetch_data=0 2019-11-29T12:50:59.429 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:59.437+0000 7f334a99aec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.12 : miss 2019-11-29T12:50:59.442 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:59.451+0000 7f334a99aec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.12 info.flags=0x16 2019-11-29T12:50:59.442 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:59.451+0000 7f334a99aec0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.12 to cache LRU end 2019-11-29T12:50:59.443 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:59.451+0000 7f334a99aec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-29T12:50:59.443 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:59.451+0000 7f334a99aec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-29T12:50:59.443 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:59.451+0000 7f334a99aec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-29T12:50:59.443 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:59.451+0000 7f334a99aec0 20 Read xattr: user.rgw.acl 2019-11-29T12:50:59.443 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:59.451+0000 7f334a99aec0 20 Read xattr: user.rgw.idtag 2019-11-29T12:50:59.443 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:59.451+0000 7f334a99aec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.12 : type miss (requested=0x13, cached=0x16) 2019-11-29T12:50:59.444 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:59.451+0000 7f334a99aec0 20 rados->read ofs=0 len=0 2019-11-29T12:50:59.459 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:59.468+0000 7f334a99aec0 20 rados_obj.operate() r=0 bl.length=313 2019-11-29T12:50:59.459 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:59.468+0000 7f334a99aec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.12 info.flags=0x13 2019-11-29T12:50:59.459 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:59.468+0000 7f334a99aec0 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.12 to cache LRU end 2019-11-29T12:50:59.459 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:59.468+0000 7f334a99aec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-29T12:50:59.460 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:59.468+0000 7f334a99aec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-29T12:50:59.460 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:59.468+0000 7f334a99aec0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.12 2019-11-29T12:50:59.475 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:59.484+0000 7f334a99aec0 10 cls_bucket_list_unordered :test-client.0-r-test-small-obj-data.3[7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.12]) start [] num_entries 1100 2019-11-29T12:50:59.510 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:59.519+0000 7f334a99aec0 10 RGWRados::cls_bucket_list_unordered: got __[] 2019-11-29T12:50:59.510 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:59.519+0000 7f334a99aec0 10 RGWRados::cls_bucket_list_unordered: got __ _[] 2019-11-29T12:50:59.510 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:59.519+0000 7f334a99aec0 10 RGWRados::cls_bucket_list_unordered: got ___[] 2019-11-29T12:50:59.510 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:59.519+0000 7f334a99aec0 10 RGWRados::cls_bucket_list_unordered: got obj[] 2019-11-29T12:50:59.511 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:59.519+0000 7f334a99aec0 20 get_obj_state: rctx=0x7ffdb2579950 obj=test-client.0-r-test-small-obj-data.3:__ state=0x55c56987e2d8 s->prefetch_data=0 2019-11-29T12:50:59.523 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:59.532+0000 7f334a99aec0 10 manifest: total_size = 0 2019-11-29T12:50:59.524 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:59.532+0000 7f334a99aec0 20 get_obj_state: setting s->obj_tag to 7f922895-c6d7-4b1b-a19c-be3df5b5a899.4325.319 2019-11-29T12:50:59.524 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:59.532+0000 7f334a99aec0 20 get_obj_state: rctx=0x7ffdb2579950 obj=test-client.0-r-test-small-obj-data.3:__ state=0x55c56987e2d8 s->prefetch_data=0 2019-11-29T12:50:59.524 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:59.532+0000 7f334a99aec0 20 prepare_atomic_modification: state is not atomic. state=0x55c56987e2d8 2019-11-29T12:50:59.524 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:59.532+0000 7f334a99aec0 20 bucket index object: default.rgw.buckets.index:.dir.7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.12 2019-11-29T12:50:59.626 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:59.635+0000 7f334a99aec0 20 get_obj_state: rctx=0x7ffdb2579950 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x55c56987e2d8 s->prefetch_data=0 2019-11-29T12:50:59.642 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:59.651+0000 7f334a99aec0 10 manifest: total_size = 0 2019-11-29T12:50:59.642 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:59.651+0000 7f334a99aec0 20 get_obj_state: setting s->obj_tag to 7f922895-c6d7-4b1b-a19c-be3df5b5a899.4325.321 2019-11-29T12:50:59.642 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:59.651+0000 7f334a99aec0 20 get_obj_state: rctx=0x7ffdb2579950 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x55c56987e2d8 s->prefetch_data=0 2019-11-29T12:50:59.642 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:59.651+0000 7f334a99aec0 20 prepare_atomic_modification: state is not atomic. state=0x55c56987e2d8 2019-11-29T12:50:59.642 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:59.651+0000 7f334a99aec0 20 bucket index object: default.rgw.buckets.index:.dir.7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.12 2019-11-29T12:50:59.788 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:59.797+0000 7f334a99aec0 20 get_obj_state: rctx=0x7ffdb2579950 obj=test-client.0-r-test-small-obj-data.3:___ state=0x55c56987e2d8 s->prefetch_data=0 2019-11-29T12:50:59.801 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:59.810+0000 7f334a99aec0 10 manifest: total_size = 0 2019-11-29T12:50:59.801 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:59.810+0000 7f334a99aec0 20 get_obj_state: setting s->obj_tag to 7f922895-c6d7-4b1b-a19c-be3df5b5a899.4325.320 2019-11-29T12:50:59.802 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:59.810+0000 7f334a99aec0 20 get_obj_state: rctx=0x7ffdb2579950 obj=test-client.0-r-test-small-obj-data.3:___ state=0x55c56987e2d8 s->prefetch_data=0 2019-11-29T12:50:59.802 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:59.810+0000 7f334a99aec0 20 prepare_atomic_modification: state is not atomic. state=0x55c56987e2d8 2019-11-29T12:50:59.802 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:50:59.810+0000 7f334a99aec0 20 bucket index object: default.rgw.buckets.index:.dir.7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.12 2019-11-29T12:51:00.000 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:00.009+0000 7f334a99aec0 20 get_obj_state: rctx=0x7ffdb2579950 obj=test-client.0-r-test-small-obj-data.3:obj state=0x55c56987e2d8 s->prefetch_data=0 2019-11-29T12:51:00.013 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:00.022+0000 7f334a99aec0 10 manifest: total_size = 0 2019-11-29T12:51:00.013 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:00.022+0000 7f334a99aec0 20 get_obj_state: setting s->obj_tag to 7f922895-c6d7-4b1b-a19c-be3df5b5a899.4325.318 2019-11-29T12:51:00.014 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:00.022+0000 7f334a99aec0 20 get_obj_state: rctx=0x7ffdb2579950 obj=test-client.0-r-test-small-obj-data.3:obj state=0x55c56987e2d8 s->prefetch_data=0 2019-11-29T12:51:00.014 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:00.022+0000 7f334a99aec0 20 prepare_atomic_modification: state is not atomic. state=0x55c56987e2d8 2019-11-29T12:51:00.014 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:00.022+0000 7f334a99aec0 20 bucket index object: default.rgw.buckets.index:.dir.7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.12 2019-11-29T12:51:00.169 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:00.178+0000 7f334a99aec0 10 cls_bucket_list_ordered :test-client.0-r-test-small-obj-data.3[7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.12]) start _multipart_[] num_entries 1001 2019-11-29T12:51:00.169 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:00.178+0000 7f334a99aec0 10 cls_bucket_list_ordered request from each of 1 shard(s) for 1002 entries to get 1001 total entries 2019-11-29T12:51:00.253 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:00.262+0000 7f334a99aec0 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.3[7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.12])"; objs.size()=0; is_truncated=0 2019-11-29T12:51:00.331 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:00.340+0000 7f334a99aec0 20 get_system_obj_state: rctx=0x7ffdb25792e8 obj=default.rgw.meta:root:test-client.0-r-test-small-obj-data.3 state=0x55c56987ea60 s->prefetch_data=0 2019-11-29T12:51:00.331 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:00.340+0000 7f334a99aec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 : type miss (requested=0x16, cached=0x3) 2019-11-29T12:51:00.350 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:00.359+0000 7f334a99aec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 info.flags=0x16 2019-11-29T12:51:00.350 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:00.359+0000 7f334a99aec0 10 moving default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 to cache LRU end 2019-11-29T12:51:00.350 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:00.359+0000 7f334a99aec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-29T12:51:00.350 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:00.359+0000 7f334a99aec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-29T12:51:00.350 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:00.359+0000 7f334a99aec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 : hit (requested=0x11, cached=0x17) 2019-11-29T12:51:00.350 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:00.359+0000 7f334a99aec0 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 from cache 2019-11-29T12:51:00.351 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:00.359+0000 7f334a99aec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=181 2019-11-29T12:51:00.364 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:00.373+0000 7f332d7fa700 10 RGWWatcher::handle_notify() notify_id 566935683077 cookie 94306366781632 notifier 4711 bl.length()=181 2019-11-29T12:51:00.464 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:00.473+0000 7f334a99aec0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.12 from cache 2019-11-29T12:51:00.464 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:00.473+0000 7f334a99aec0 10 distributing notification oid=default.rgw.control:notify.0 bl.length()=239 2019-11-29T12:51:00.472 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:00.481+0000 7f332d7fa700 10 RGWWatcher::handle_notify() notify_id 566935683078 cookie 94306366779648 notifier 4711 bl.length()=239 2019-11-29T12:51:01.429 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:01.439+0000 7f334a99aec0 10 removing key index: INJMFBCBSYLUQCKOTIHA 2019-11-29T12:51:01.430 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:01.439+0000 7f334a99aec0 10 distributing notification oid=default.rgw.control:notify.6 bl.length()=170 2019-11-29T12:51:01.441 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:01.450+0000 7f332d7fa700 10 RGWWatcher::handle_notify() notify_id 566935683076 cookie 94306366795136 notifier 4711 bl.length()=170 2019-11-29T12:51:02.127 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:02.136+0000 7f334a99aec0 10 removing email index: ragweed.client.0+test@test.test 2019-11-29T12:51:02.127 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:02.136+0000 7f334a99aec0 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=182 2019-11-29T12:51:02.142 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:02.151+0000 7f332d7fa700 10 RGWWatcher::handle_notify() notify_id 566935683086 cookie 94306366786192 notifier 4711 bl.length()=182 2019-11-29T12:51:02.489 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:02.498+0000 7f334a99aec0 10 removing user buckets index 2019-11-29T12:51:02.490 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:02.498+0000 7f334a99aec0 10 distributing notification oid=default.rgw.control:notify.5 bl.length()=173 2019-11-29T12:51:02.508 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:02.517+0000 7f332d7fa700 10 RGWWatcher::handle_notify() notify_id 566935683078 cookie 94306366793056 notifier 4711 bl.length()=173 2019-11-29T12:51:02.590 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:02.599+0000 7f334a99aec0 10 removing user index: ragweed.client.0 2019-11-29T12:51:02.590 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:02.599+0000 7f334a99aec0 10 removing default.rgw.meta+users.uid+ragweed.client.0 from cache 2019-11-29T12:51:02.590 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:02.599+0000 7f334a99aec0 10 distributing notification oid=default.rgw.control:notify.4 bl.length()=165 2019-11-29T12:51:02.606 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:02.616+0000 7f332d7fa700 10 RGWWatcher::handle_notify() notify_id 566935683087 cookie 94306366791152 notifier 4711 bl.length()=165 2019-11-29T12:51:03.267 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:03.276+0000 7f334a99aec0 20 remove_watcher() i=0 2019-11-29T12:51:03.267 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:03.276+0000 7f334a99aec0 2 removed watcher, disabling cache 2019-11-29T12:51:03.312 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:03.321+0000 7f334a99aec0 20 remove_watcher() i=1 2019-11-29T12:51:03.378 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:03.387+0000 7f334a99aec0 20 remove_watcher() i=2 2019-11-29T12:51:03.431 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:03.440+0000 7f334a99aec0 20 remove_watcher() i=3 2019-11-29T12:51:03.490 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:03.499+0000 7f334a99aec0 20 remove_watcher() i=4 2019-11-29T12:51:03.549 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:03.558+0000 7f334a99aec0 20 remove_watcher() i=5 2019-11-29T12:51:03.603 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:03.612+0000 7f334a99aec0 20 remove_watcher() i=6 2019-11-29T12:51:03.655 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:03.664+0000 7f334a99aec0 20 remove_watcher() i=7 2019-11-29T12:51:03.664 INFO:tasks.ragweed:Removing ragweed... 2019-11-29T12:51:03.664 INFO:teuthology.orchestra.run.smithi062:> rm -rf /home/ubuntu/cephtest/ragweed 2019-11-29T12:51:03.785 INFO:teuthology.run_tasks:Running task s3tests-java... 2019-11-29T12:51:03.796 DEBUG:tasks.s3tests_java:S3 Tests Java: __INIT__ 2019-11-29T12:51:03.796 DEBUG:tasks.s3tests_java:S3 Tests Java: SETUP 2019-11-29T12:51:03.796 INFO:tasks.s3tests_java:S3 Tests Java: Downloading test suite... 2019-11-29T12:51:03.797 INFO:teuthology.orchestra.run.smithi062:> git clone -b master https://github.com/ceph/java_s3tests.git /home/ubuntu/cephtest/s3-tests-java 2019-11-29T12:51:03.842 INFO:teuthology.orchestra.run.smithi062.stdout:Cloning into '/home/ubuntu/cephtest/s3-tests-java'... 2019-11-29T12:51:09.397 INFO:tasks.s3tests_java:S3 Tests Java: Installing required packages... 2019-11-29T12:51:09.397 INFO:teuthology.orchestra.run.smithi062:> /home/ubuntu/cephtest/s3-tests-java/bootstrap.sh 2019-11-29T12:51:12.069 INFO:teuthology.orchestra.run.smithi062.stdout: Gradle will be installed under /opt/gradle 2019-11-29T12:51:12.116 INFO:teuthology.orchestra.run.smithi062.stderr:--2019-11-29 12:51:12-- https://services.gradle.org/distributions/gradle-4.7-bin.zip 2019-11-29T12:51:12.133 INFO:teuthology.orchestra.run.smithi062.stderr:Resolving services.gradle.org (services.gradle.org)... 104.18.190.9, 104.18.191.9, 2606:4700::6812:be09, ... 2019-11-29T12:51:12.142 INFO:teuthology.orchestra.run.smithi062.stderr:Connecting to services.gradle.org (services.gradle.org)|104.18.190.9|:443... connected. 2019-11-29T12:51:12.184 INFO:teuthology.orchestra.run.smithi062.stderr:HTTP request sent, awaiting response... 301 Moved Permanently 2019-11-29T12:51:12.184 INFO:teuthology.orchestra.run.smithi062.stderr:Location: https://downloads.gradle-dn.com/distributions/gradle-4.7-bin.zip [following] 2019-11-29T12:51:12.184 INFO:teuthology.orchestra.run.smithi062.stderr:--2019-11-29 12:51:12-- https://downloads.gradle-dn.com/distributions/gradle-4.7-bin.zip 2019-11-29T12:51:12.221 INFO:teuthology.orchestra.run.smithi062.stderr:Resolving downloads.gradle-dn.com (downloads.gradle-dn.com)... 104.17.160.20, 104.17.159.20, 2606:4700::6811:a014, ... 2019-11-29T12:51:12.230 INFO:teuthology.orchestra.run.smithi062.stderr:Connecting to downloads.gradle-dn.com (downloads.gradle-dn.com)|104.17.160.20|:443... connected. 2019-11-29T12:51:12.266 INFO:teuthology.orchestra.run.smithi062.stderr:HTTP request sent, awaiting response... 200 OK 2019-11-29T12:51:12.266 INFO:teuthology.orchestra.run.smithi062.stderr:Length: 75323957 (72M) [application/zip] 2019-11-29T12:51:12.266 INFO:teuthology.orchestra.run.smithi062.stderr:Saving to: ‘gradle-4.7-bin.zip’ 2019-11-29T12:51:12.267 INFO:teuthology.orchestra.run.smithi062.stderr: 2019-11-29T12:51:12.274 INFO:teuthology.orchestra.run.smithi062.stderr: 0K .......... .......... .......... .......... .......... 0% 6.60M 11s 2019-11-29T12:51:12.276 INFO:teuthology.orchestra.run.smithi062.stderr: 50K .......... .......... .......... .......... .......... 0% 102M 6s 2019-11-29T12:51:12.284 INFO:teuthology.orchestra.run.smithi062.stderr: 100K .......... .......... .......... .......... .......... 0% 6.83M 7s 2019-11-29T12:51:12.285 INFO:teuthology.orchestra.run.smithi062.stderr: 150K .......... .......... .......... .......... .......... 0% 122M 6s 2019-11-29T12:51:12.285 INFO:teuthology.orchestra.run.smithi062.stderr: 200K .......... .......... .......... .......... .......... 0% 141M 5s 2019-11-29T12:51:12.285 INFO:teuthology.orchestra.run.smithi062.stderr: 250K .......... .......... .......... .......... .......... 0% 129M 4s 2019-11-29T12:51:12.291 INFO:teuthology.orchestra.run.smithi062.stderr: 300K .......... .......... .......... .......... .......... 0% 7.60M 5s 2019-11-29T12:51:12.291 INFO:teuthology.orchestra.run.smithi062.stderr: 350K .......... .......... .......... .......... .......... 0% 178M 4s 2019-11-29T12:51:12.291 INFO:teuthology.orchestra.run.smithi062.stderr: 400K .......... .......... .......... .......... .......... 0% 130M 4s 2019-11-29T12:51:12.297 INFO:teuthology.orchestra.run.smithi062.stderr: 450K .......... .......... .......... .......... .......... 0% 116M 3s 2019-11-29T12:51:12.297 INFO:teuthology.orchestra.run.smithi062.stderr: 500K .......... .......... .......... .......... .......... 0% 137M 3s 2019-11-29T12:51:12.298 INFO:teuthology.orchestra.run.smithi062.stderr: 550K .......... .......... .......... .......... .......... 0% 122M 3s 2019-11-29T12:51:12.298 INFO:teuthology.orchestra.run.smithi062.stderr: 600K .......... .......... .......... .......... .......... 0% 162M 3s 2019-11-29T12:51:12.299 INFO:teuthology.orchestra.run.smithi062.stderr: 650K .......... .......... .......... .......... .......... 0% 96.8M 3s 2019-11-29T12:51:12.299 INFO:teuthology.orchestra.run.smithi062.stderr: 700K .......... .......... .......... .......... .......... 1% 9.67M 3s 2019-11-29T12:51:12.299 INFO:teuthology.orchestra.run.smithi062.stderr: 750K .......... .......... .......... .......... .......... 1% 114M 3s 2019-11-29T12:51:12.299 INFO:teuthology.orchestra.run.smithi062.stderr: 800K .......... .......... .......... .......... .......... 1% 128M 3s 2019-11-29T12:51:13.310 INFO:teuthology.orchestra.run.smithi062.stderr: 850K .......... .......... .......... .......... .......... 1% 135M 3s 2019-11-29T12:51:13.310 INFO:teuthology.orchestra.run.smithi062.stderr: 900K .......... .......... .......... .......... .......... 1% 118M 2s 2019-11-29T12:51:13.310 INFO:teuthology.orchestra.run.smithi062.stderr: 950K .......... .......... .......... .......... .......... 1% 110M 2s 2019-11-29T12:51:13.310 INFO:teuthology.orchestra.run.smithi062.stderr: 1000K .......... .......... .......... .......... .......... 1% 115M 2s 2019-11-29T12:51:13.311 INFO:teuthology.orchestra.run.smithi062.stderr: 1050K .......... .......... .......... .......... .......... 1% 132M 2s 2019-11-29T12:51:13.311 INFO:teuthology.orchestra.run.smithi062.stderr: 1100K .......... .......... .......... .......... .......... 1% 261M 2s 2019-11-29T12:51:13.311 INFO:teuthology.orchestra.run.smithi062.stderr: 1150K .......... .......... .......... .......... .......... 1% 119M 2s 2019-11-29T12:51:13.311 INFO:teuthology.orchestra.run.smithi062.stderr: 1200K .......... .......... .......... .......... .......... 1% 117M 2s 2019-11-29T12:51:13.311 INFO:teuthology.orchestra.run.smithi062.stderr: 1250K .......... .......... .......... .......... .......... 1% 122M 2s 2019-11-29T12:51:13.311 INFO:teuthology.orchestra.run.smithi062.stderr: 1300K .......... .......... .......... .......... .......... 1% 120M 2s 2019-11-29T12:51:13.312 INFO:teuthology.orchestra.run.smithi062.stderr: 1350K .......... .......... .......... .......... .......... 1% 106M 2s 2019-11-29T12:51:13.312 INFO:teuthology.orchestra.run.smithi062.stderr: 1400K .......... .......... .......... .......... .......... 1% 129M 2s 2019-11-29T12:51:13.312 INFO:teuthology.orchestra.run.smithi062.stderr: 1450K .......... .......... .......... .......... .......... 2% 115M 2s 2019-11-29T12:51:13.312 INFO:teuthology.orchestra.run.smithi062.stderr: 1500K .......... .......... .......... .......... .......... 2% 108M 2s 2019-11-29T12:51:13.312 INFO:teuthology.orchestra.run.smithi062.stderr: 1550K .......... .......... .......... .......... .......... 2% 44.1M 2s 2019-11-29T12:51:13.312 INFO:teuthology.orchestra.run.smithi062.stderr: 1600K .......... .......... .......... .......... .......... 2% 133M 2s 2019-11-29T12:51:13.312 INFO:teuthology.orchestra.run.smithi062.stderr: 1650K .......... .......... .......... .......... .......... 2% 259M 2s 2019-11-29T12:51:13.313 INFO:teuthology.orchestra.run.smithi062.stderr: 1700K .......... .......... .......... .......... .......... 2% 144M 2s 2019-11-29T12:51:13.313 INFO:teuthology.orchestra.run.smithi062.stderr: 1750K .......... .......... .......... .......... .......... 2% 139M 2s 2019-11-29T12:51:13.313 INFO:teuthology.orchestra.run.smithi062.stderr: 1800K .......... .......... .......... .......... .......... 2% 134M 2s 2019-11-29T12:51:13.313 INFO:teuthology.orchestra.run.smithi062.stderr: 1850K .......... .......... .......... .......... .......... 2% 160M 1s 2019-11-29T12:51:13.313 INFO:teuthology.orchestra.run.smithi062.stderr: 1900K .......... .......... .......... .......... .......... 2% 359M 1s 2019-11-29T12:51:13.313 INFO:teuthology.orchestra.run.smithi062.stderr: 1950K .......... .......... .......... .......... .......... 2% 171M 1s 2019-11-29T12:51:13.313 INFO:teuthology.orchestra.run.smithi062.stderr: 2000K .......... .......... .......... .......... .......... 2% 168M 1s 2019-11-29T12:51:13.313 INFO:teuthology.orchestra.run.smithi062.stderr: 2050K .......... .......... .......... .......... .......... 2% 146M 1s 2019-11-29T12:51:13.314 INFO:teuthology.orchestra.run.smithi062.stderr: 2100K .......... .......... .......... .......... .......... 2% 156M 1s 2019-11-29T12:51:13.314 INFO:teuthology.orchestra.run.smithi062.stderr: 2150K .......... .......... .......... .......... .......... 2% 310M 1s 2019-11-29T12:51:13.314 INFO:teuthology.orchestra.run.smithi062.stderr: 2200K .......... .......... .......... .......... .......... 3% 155M 1s 2019-11-29T12:51:13.314 INFO:teuthology.orchestra.run.smithi062.stderr: 2250K .......... .......... .......... .......... .......... 3% 167M 1s 2019-11-29T12:51:13.314 INFO:teuthology.orchestra.run.smithi062.stderr: 2300K .......... .......... .......... .......... .......... 3% 164M 1s 2019-11-29T12:51:13.314 INFO:teuthology.orchestra.run.smithi062.stderr: 2350K .......... .......... .......... .......... .......... 3% 156M 1s 2019-11-29T12:51:13.314 INFO:teuthology.orchestra.run.smithi062.stderr: 2400K .......... .......... .......... .......... .......... 3% 327M 1s 2019-11-29T12:51:13.315 INFO:teuthology.orchestra.run.smithi062.stderr: 2450K .......... .......... .......... .......... .......... 3% 156M 1s 2019-11-29T12:51:13.315 INFO:teuthology.orchestra.run.smithi062.stderr: 2500K .......... .......... .......... .......... .......... 3% 198M 1s 2019-11-29T12:51:13.315 INFO:teuthology.orchestra.run.smithi062.stderr: 2550K .......... .......... .......... .......... .......... 3% 174M 1s 2019-11-29T12:51:13.315 INFO:teuthology.orchestra.run.smithi062.stderr: 2600K .......... .......... .......... .......... .......... 3% 161M 1s 2019-11-29T12:51:13.315 INFO:teuthology.orchestra.run.smithi062.stderr: 2650K .......... .......... .......... .......... .......... 3% 374M 1s 2019-11-29T12:51:13.315 INFO:teuthology.orchestra.run.smithi062.stderr: 2700K .......... .......... .......... .......... .......... 3% 190M 1s 2019-11-29T12:51:13.315 INFO:teuthology.orchestra.run.smithi062.stderr: 2750K .......... .......... .......... .......... .......... 3% 188M 1s 2019-11-29T12:51:13.315 INFO:teuthology.orchestra.run.smithi062.stderr: 2800K .......... .......... .......... .......... .......... 3% 190M 1s 2019-11-29T12:51:13.316 INFO:teuthology.orchestra.run.smithi062.stderr: 2850K .......... .......... .......... .......... .......... 3% 401M 1s 2019-11-29T12:51:13.316 INFO:teuthology.orchestra.run.smithi062.stderr: 2900K .......... .......... .......... .......... .......... 4% 203M 1s 2019-11-29T12:51:13.316 INFO:teuthology.orchestra.run.smithi062.stderr: 2950K .......... .......... .......... .......... .......... 4% 196M 1s 2019-11-29T12:51:13.316 INFO:teuthology.orchestra.run.smithi062.stderr: 3000K .......... .......... .......... .......... .......... 4% 222M 1s 2019-11-29T12:51:13.316 INFO:teuthology.orchestra.run.smithi062.stderr: 3050K .......... .......... .......... .......... .......... 4% 324M 1s 2019-11-29T12:51:13.316 INFO:teuthology.orchestra.run.smithi062.stderr: 3100K .......... .......... .......... .......... .......... 4% 196M 1s 2019-11-29T12:51:13.317 INFO:teuthology.orchestra.run.smithi062.stderr: 3150K .......... .......... .......... .......... .......... 4% 313M 1s 2019-11-29T12:51:13.317 INFO:teuthology.orchestra.run.smithi062.stderr: 3200K .......... .......... .......... .......... .......... 4% 368M 1s 2019-11-29T12:51:13.317 INFO:teuthology.orchestra.run.smithi062.stderr: 3250K .......... .......... .......... .......... .......... 4% 375M 1s 2019-11-29T12:51:13.317 INFO:teuthology.orchestra.run.smithi062.stderr: 3300K .......... .......... .......... .......... .......... 4% 372M 1s 2019-11-29T12:51:13.317 INFO:teuthology.orchestra.run.smithi062.stderr: 3350K .......... .......... .......... .......... .......... 4% 329M 1s 2019-11-29T12:51:13.317 INFO:teuthology.orchestra.run.smithi062.stderr: 3400K .......... .......... .......... .......... .......... 4% 370M 1s 2019-11-29T12:51:13.317 INFO:teuthology.orchestra.run.smithi062.stderr: 3450K .......... .......... .......... .......... .......... 4% 388M 1s 2019-11-29T12:51:13.318 INFO:teuthology.orchestra.run.smithi062.stderr: 3500K .......... .......... .......... .......... .......... 4% 367M 1s 2019-11-29T12:51:13.318 INFO:teuthology.orchestra.run.smithi062.stderr: 3550K .......... .......... .......... .......... .......... 4% 282M 1s 2019-11-29T12:51:13.318 INFO:teuthology.orchestra.run.smithi062.stderr: 3600K .......... .......... .......... .......... .......... 4% 370M 1s 2019-11-29T12:51:13.318 INFO:teuthology.orchestra.run.smithi062.stderr: 3650K .......... .......... .......... .......... .......... 5% 358M 1s 2019-11-29T12:51:13.318 INFO:teuthology.orchestra.run.smithi062.stderr: 3700K .......... .......... .......... .......... .......... 5% 377M 1s 2019-11-29T12:51:13.318 INFO:teuthology.orchestra.run.smithi062.stderr: 3750K .......... .......... .......... .......... .......... 5% 338M 1s 2019-11-29T12:51:13.318 INFO:teuthology.orchestra.run.smithi062.stderr: 3800K .......... .......... .......... .......... .......... 5% 367M 1s 2019-11-29T12:51:13.319 INFO:teuthology.orchestra.run.smithi062.stderr: 3850K .......... .......... .......... .......... .......... 5% 331M 1s 2019-11-29T12:51:13.319 INFO:teuthology.orchestra.run.smithi062.stderr: 3900K .......... .......... .......... .......... .......... 5% 308M 1s 2019-11-29T12:51:13.319 INFO:teuthology.orchestra.run.smithi062.stderr: 3950K .......... .......... .......... .......... .......... 5% 284M 1s 2019-11-29T12:51:13.319 INFO:teuthology.orchestra.run.smithi062.stderr: 4000K .......... .......... .......... .......... .......... 5% 320M 1s 2019-11-29T12:51:13.319 INFO:teuthology.orchestra.run.smithi062.stderr: 4050K .......... .......... .......... .......... .......... 5% 351M 1s 2019-11-29T12:51:13.319 INFO:teuthology.orchestra.run.smithi062.stderr: 4100K .......... .......... .......... .......... .......... 5% 348M 1s 2019-11-29T12:51:13.319 INFO:teuthology.orchestra.run.smithi062.stderr: 4150K .......... .......... .......... .......... .......... 5% 302M 1s 2019-11-29T12:51:13.320 INFO:teuthology.orchestra.run.smithi062.stderr: 4200K .......... .......... .......... .......... .......... 5% 339M 1s 2019-11-29T12:51:13.320 INFO:teuthology.orchestra.run.smithi062.stderr: 4250K .......... .......... .......... .......... .......... 5% 303M 1s 2019-11-29T12:51:13.320 INFO:teuthology.orchestra.run.smithi062.stderr: 4300K .......... .......... .......... .......... .......... 5% 290M 1s 2019-11-29T12:51:13.320 INFO:teuthology.orchestra.run.smithi062.stderr: 4350K .......... .......... .......... .......... .......... 5% 276M 1s 2019-11-29T12:51:13.320 INFO:teuthology.orchestra.run.smithi062.stderr: 4400K .......... .......... .......... .......... .......... 6% 297M 1s 2019-11-29T12:51:13.320 INFO:teuthology.orchestra.run.smithi062.stderr: 4450K .......... .......... .......... .......... .......... 6% 313M 1s 2019-11-29T12:51:13.320 INFO:teuthology.orchestra.run.smithi062.stderr: 4500K .......... .......... .......... .......... .......... 6% 299M 1s 2019-11-29T12:51:13.321 INFO:teuthology.orchestra.run.smithi062.stderr: 4550K .......... .......... .......... .......... .......... 6% 331M 1s 2019-11-29T12:51:13.321 INFO:teuthology.orchestra.run.smithi062.stderr: 4600K .......... .......... .......... .......... .......... 6% 374M 1s 2019-11-29T12:51:13.321 INFO:teuthology.orchestra.run.smithi062.stderr: 4650K .......... .......... .......... .......... .......... 6% 371M 1s 2019-11-29T12:51:13.321 INFO:teuthology.orchestra.run.smithi062.stderr: 4700K .......... .......... .......... .......... .......... 6% 384M 1s 2019-11-29T12:51:13.321 INFO:teuthology.orchestra.run.smithi062.stderr: 4750K .......... .......... .......... .......... .......... 6% 315M 1s 2019-11-29T12:51:13.321 INFO:teuthology.orchestra.run.smithi062.stderr: 4800K .......... .......... .......... .......... .......... 6% 348M 1s 2019-11-29T12:51:13.321 INFO:teuthology.orchestra.run.smithi062.stderr: 4850K .......... .......... .......... .......... .......... 6% 378M 1s 2019-11-29T12:51:13.321 INFO:teuthology.orchestra.run.smithi062.stderr: 4900K .......... .......... .......... .......... .......... 6% 366M 1s 2019-11-29T12:51:13.322 INFO:teuthology.orchestra.run.smithi062.stderr: 4950K .......... .......... .......... .......... .......... 6% 271M 1s 2019-11-29T12:51:13.322 INFO:teuthology.orchestra.run.smithi062.stderr: 5000K .......... .......... .......... .......... .......... 6% 347M 1s 2019-11-29T12:51:13.322 INFO:teuthology.orchestra.run.smithi062.stderr: 5050K .......... .......... .......... .......... .......... 6% 338M 1s 2019-11-29T12:51:13.322 INFO:teuthology.orchestra.run.smithi062.stderr: 5100K .......... .......... .......... .......... .......... 7% 353M 1s 2019-11-29T12:51:13.322 INFO:teuthology.orchestra.run.smithi062.stderr: 5150K .......... .......... .......... .......... .......... 7% 300M 1s 2019-11-29T12:51:13.322 INFO:teuthology.orchestra.run.smithi062.stderr: 5200K .......... .......... .......... .......... .......... 7% 376M 1s 2019-11-29T12:51:13.322 INFO:teuthology.orchestra.run.smithi062.stderr: 5250K .......... .......... .......... .......... .......... 7% 371M 1s 2019-11-29T12:51:13.323 INFO:teuthology.orchestra.run.smithi062.stderr: 5300K .......... .......... .......... .......... .......... 7% 373M 1s 2019-11-29T12:51:13.323 INFO:teuthology.orchestra.run.smithi062.stderr: 5350K .......... .......... .......... .......... .......... 7% 330M 1s 2019-11-29T12:51:13.323 INFO:teuthology.orchestra.run.smithi062.stderr: 5400K .......... .......... .......... .......... .......... 7% 369M 1s 2019-11-29T12:51:13.323 INFO:teuthology.orchestra.run.smithi062.stderr: 5450K .......... .......... .......... .......... .......... 7% 390M 1s 2019-11-29T12:51:13.323 INFO:teuthology.orchestra.run.smithi062.stderr: 5500K .......... .......... .......... .......... .......... 7% 355M 1s 2019-11-29T12:51:13.323 INFO:teuthology.orchestra.run.smithi062.stderr: 5550K .......... .......... .......... .......... .......... 7% 245M 1s 2019-11-29T12:51:13.323 INFO:teuthology.orchestra.run.smithi062.stderr: 5600K .......... .......... .......... .......... .......... 7% 356M 1s 2019-11-29T12:51:13.323 INFO:teuthology.orchestra.run.smithi062.stderr: 5650K .......... .......... .......... .......... .......... 7% 388M 1s 2019-11-29T12:51:13.324 INFO:teuthology.orchestra.run.smithi062.stderr: 5700K .......... .......... .......... .......... .......... 7% 376M 1s 2019-11-29T12:51:13.324 INFO:teuthology.orchestra.run.smithi062.stderr: 5750K .......... .......... .......... .......... .......... 7% 324M 1s 2019-11-29T12:51:13.324 INFO:teuthology.orchestra.run.smithi062.stderr: 5800K .......... .......... .......... .......... .......... 7% 367M 1s 2019-11-29T12:51:13.324 INFO:teuthology.orchestra.run.smithi062.stderr: 5850K .......... .......... .......... .......... .......... 8% 359M 1s 2019-11-29T12:51:13.324 INFO:teuthology.orchestra.run.smithi062.stderr: 5900K .......... .......... .......... .......... .......... 8% 354M 1s 2019-11-29T12:51:13.324 INFO:teuthology.orchestra.run.smithi062.stderr: 5950K .......... .......... .......... .......... .......... 8% 308M 1s 2019-11-29T12:51:13.324 INFO:teuthology.orchestra.run.smithi062.stderr: 6000K .......... .......... .......... .......... .......... 8% 365M 1s 2019-11-29T12:51:13.325 INFO:teuthology.orchestra.run.smithi062.stderr: 6050K .......... .......... .......... .......... .......... 8% 363M 1s 2019-11-29T12:51:13.325 INFO:teuthology.orchestra.run.smithi062.stderr: 6100K .......... .......... .......... .......... .......... 8% 368M 1s 2019-11-29T12:51:13.325 INFO:teuthology.orchestra.run.smithi062.stderr: 6150K .......... .......... .......... .......... .......... 8% 320M 1s 2019-11-29T12:51:13.325 INFO:teuthology.orchestra.run.smithi062.stderr: 6200K .......... .......... .......... .......... .......... 8% 358M 1s 2019-11-29T12:51:13.325 INFO:teuthology.orchestra.run.smithi062.stderr: 6250K .......... .......... .......... .......... .......... 8% 376M 1s 2019-11-29T12:51:13.325 INFO:teuthology.orchestra.run.smithi062.stderr: 6300K .......... .......... .......... .......... .......... 8% 357M 1s 2019-11-29T12:51:13.325 INFO:teuthology.orchestra.run.smithi062.stderr: 6350K .......... .......... .......... .......... .......... 8% 326M 1s 2019-11-29T12:51:13.326 INFO:teuthology.orchestra.run.smithi062.stderr: 6400K .......... .......... .......... .......... .......... 8% 319M 1s 2019-11-29T12:51:13.326 INFO:teuthology.orchestra.run.smithi062.stderr: 6450K .......... .......... .......... .......... .......... 8% 383M 1s 2019-11-29T12:51:13.326 INFO:teuthology.orchestra.run.smithi062.stderr: 6500K .......... .......... .......... .......... .......... 8% 380M 1s 2019-11-29T12:51:13.326 INFO:teuthology.orchestra.run.smithi062.stderr: 6550K .......... .......... .......... .......... .......... 8% 325M 1s 2019-11-29T12:51:13.326 INFO:teuthology.orchestra.run.smithi062.stderr: 6600K .......... .......... .......... .......... .......... 9% 386M 1s 2019-11-29T12:51:13.326 INFO:teuthology.orchestra.run.smithi062.stderr: 6650K .......... .......... .......... .......... .......... 9% 388M 1s 2019-11-29T12:51:13.327 INFO:teuthology.orchestra.run.smithi062.stderr: 6700K .......... .......... .......... .......... .......... 9% 364M 1s 2019-11-29T12:51:13.327 INFO:teuthology.orchestra.run.smithi062.stderr: 6750K .......... .......... .......... .......... .......... 9% 312M 1s 2019-11-29T12:51:13.327 INFO:teuthology.orchestra.run.smithi062.stderr: 6800K .......... .......... .......... .......... .......... 9% 379M 1s 2019-11-29T12:51:13.327 INFO:teuthology.orchestra.run.smithi062.stderr: 6850K .......... .......... .......... .......... .......... 9% 393M 1s 2019-11-29T12:51:13.327 INFO:teuthology.orchestra.run.smithi062.stderr: 6900K .......... .......... .......... .......... .......... 9% 356M 1s 2019-11-29T12:51:13.327 INFO:teuthology.orchestra.run.smithi062.stderr: 6950K .......... .......... .......... .......... .......... 9% 262M 1s 2019-11-29T12:51:13.327 INFO:teuthology.orchestra.run.smithi062.stderr: 7000K .......... .......... .......... .......... .......... 9% 404M 1s 2019-11-29T12:51:13.328 INFO:teuthology.orchestra.run.smithi062.stderr: 7050K .......... .......... .......... .......... .......... 9% 318M 1s 2019-11-29T12:51:13.328 INFO:teuthology.orchestra.run.smithi062.stderr: 7100K .......... .......... .......... .......... .......... 9% 339M 1s 2019-11-29T12:51:13.328 INFO:teuthology.orchestra.run.smithi062.stderr: 7150K .......... .......... .......... .......... .......... 9% 336M 1s 2019-11-29T12:51:13.328 INFO:teuthology.orchestra.run.smithi062.stderr: 7200K .......... .......... .......... .......... .......... 9% 350M 1s 2019-11-29T12:51:13.328 INFO:teuthology.orchestra.run.smithi062.stderr: 7250K .......... .......... .......... .......... .......... 9% 362M 1s 2019-11-29T12:51:13.328 INFO:teuthology.orchestra.run.smithi062.stderr: 7300K .......... .......... .......... .......... .......... 9% 357M 1s 2019-11-29T12:51:13.328 INFO:teuthology.orchestra.run.smithi062.stderr: 7350K .......... .......... .......... .......... .......... 10% 346M 1s 2019-11-29T12:51:13.329 INFO:teuthology.orchestra.run.smithi062.stderr: 7400K .......... .......... .......... .......... .......... 10% 440M 1s 2019-11-29T12:51:13.329 INFO:teuthology.orchestra.run.smithi062.stderr: 7450K .......... .......... .......... .......... .......... 10% 423M 1s 2019-11-29T12:51:13.329 INFO:teuthology.orchestra.run.smithi062.stderr: 7500K .......... .......... .......... .......... .......... 10% 384M 1s 2019-11-29T12:51:13.329 INFO:teuthology.orchestra.run.smithi062.stderr: 7550K .......... .......... .......... .......... .......... 10% 322M 1s 2019-11-29T12:51:13.329 INFO:teuthology.orchestra.run.smithi062.stderr: 7600K .......... .......... .......... .......... .......... 10% 422M 1s 2019-11-29T12:51:13.329 INFO:teuthology.orchestra.run.smithi062.stderr: 7650K .......... .......... .......... .......... .......... 10% 401M 1s 2019-11-29T12:51:13.329 INFO:teuthology.orchestra.run.smithi062.stderr: 7700K .......... .......... .......... .......... .......... 10% 372M 0s 2019-11-29T12:51:13.330 INFO:teuthology.orchestra.run.smithi062.stderr: 7750K .......... .......... .......... .......... .......... 10% 212M 0s 2019-11-29T12:51:13.330 INFO:teuthology.orchestra.run.smithi062.stderr: 7800K .......... .......... .......... .......... .......... 10% 360M 0s 2019-11-29T12:51:13.330 INFO:teuthology.orchestra.run.smithi062.stderr: 7850K .......... .......... .......... .......... .......... 10% 231M 0s 2019-11-29T12:51:13.330 INFO:teuthology.orchestra.run.smithi062.stderr: 7900K .......... .......... .......... .......... .......... 10% 167M 0s 2019-11-29T12:51:13.330 INFO:teuthology.orchestra.run.smithi062.stderr: 7950K .......... .......... .......... .......... .......... 10% 72.1M 0s 2019-11-29T12:51:13.330 INFO:teuthology.orchestra.run.smithi062.stderr: 8000K .......... .......... .......... .......... .......... 10% 365M 0s 2019-11-29T12:51:13.330 INFO:teuthology.orchestra.run.smithi062.stderr: 8050K .......... .......... .......... .......... .......... 11% 408M 0s 2019-11-29T12:51:13.330 INFO:teuthology.orchestra.run.smithi062.stderr: 8100K .......... .......... .......... .......... .......... 11% 373M 0s 2019-11-29T12:51:13.331 INFO:teuthology.orchestra.run.smithi062.stderr: 8150K .......... .......... .......... .......... .......... 11% 33.7M 0s 2019-11-29T12:51:13.331 INFO:teuthology.orchestra.run.smithi062.stderr: 8200K .......... .......... .......... .......... .......... 11% 329M 0s 2019-11-29T12:51:13.331 INFO:teuthology.orchestra.run.smithi062.stderr: 8250K .......... .......... .......... .......... .......... 11% 298M 0s 2019-11-29T12:51:13.331 INFO:teuthology.orchestra.run.smithi062.stderr: 8300K .......... .......... .......... .......... .......... 11% 369M 0s 2019-11-29T12:51:13.331 INFO:teuthology.orchestra.run.smithi062.stderr: 8350K .......... .......... .......... .......... .......... 11% 304M 0s 2019-11-29T12:51:13.331 INFO:teuthology.orchestra.run.smithi062.stderr: 8400K .......... .......... .......... .......... .......... 11% 378M 0s 2019-11-29T12:51:13.331 INFO:teuthology.orchestra.run.smithi062.stderr: 8450K .......... .......... .......... .......... .......... 11% 398M 0s 2019-11-29T12:51:13.332 INFO:teuthology.orchestra.run.smithi062.stderr: 8500K .......... .......... .......... .......... .......... 11% 417M 0s 2019-11-29T12:51:13.332 INFO:teuthology.orchestra.run.smithi062.stderr: 8550K .......... .......... .......... .......... .......... 11% 379M 0s 2019-11-29T12:51:13.332 INFO:teuthology.orchestra.run.smithi062.stderr: 8600K .......... .......... .......... .......... .......... 11% 362M 0s 2019-11-29T12:51:13.332 INFO:teuthology.orchestra.run.smithi062.stderr: 8650K .......... .......... .......... .......... .......... 11% 84.3M 0s 2019-11-29T12:51:13.332 INFO:teuthology.orchestra.run.smithi062.stderr: 8700K .......... .......... .......... .......... .......... 11% 102M 0s 2019-11-29T12:51:13.332 INFO:teuthology.orchestra.run.smithi062.stderr: 8750K .......... .......... .......... .......... .......... 11% 205M 0s 2019-11-29T12:51:13.332 INFO:teuthology.orchestra.run.smithi062.stderr: 8800K .......... .......... .......... .......... .......... 12% 91.1M 0s 2019-11-29T12:51:13.333 INFO:teuthology.orchestra.run.smithi062.stderr: 8850K .......... .......... .......... .......... .......... 12% 369M 0s 2019-11-29T12:51:13.333 INFO:teuthology.orchestra.run.smithi062.stderr: 8900K .......... .......... .......... .......... .......... 12% 422M 0s 2019-11-29T12:51:13.333 INFO:teuthology.orchestra.run.smithi062.stderr: 8950K .......... .......... .......... .......... .......... 12% 44.6M 0s 2019-11-29T12:51:13.333 INFO:teuthology.orchestra.run.smithi062.stderr: 9000K .......... .......... .......... .......... .......... 12% 239M 0s 2019-11-29T12:51:13.333 INFO:teuthology.orchestra.run.smithi062.stderr: 9050K .......... .......... .......... .......... .......... 12% 356M 0s 2019-11-29T12:51:13.333 INFO:teuthology.orchestra.run.smithi062.stderr: 9100K .......... .......... .......... .......... .......... 12% 393M 0s 2019-11-29T12:51:13.334 INFO:teuthology.orchestra.run.smithi062.stderr: 9150K .......... .......... .......... .......... .......... 12% 349M 0s 2019-11-29T12:51:13.334 INFO:teuthology.orchestra.run.smithi062.stderr: 9200K .......... .......... .......... .......... .......... 12% 413M 0s 2019-11-29T12:51:13.334 INFO:teuthology.orchestra.run.smithi062.stderr: 9250K .......... .......... .......... .......... .......... 12% 31.9M 0s 2019-11-29T12:51:13.334 INFO:teuthology.orchestra.run.smithi062.stderr: 9300K .......... .......... .......... .......... .......... 12% 344M 0s 2019-11-29T12:51:13.334 INFO:teuthology.orchestra.run.smithi062.stderr: 9350K .......... .......... .......... .......... .......... 12% 285M 0s 2019-11-29T12:51:13.334 INFO:teuthology.orchestra.run.smithi062.stderr: 9400K .......... .......... .......... .......... .......... 12% 343M 0s 2019-11-29T12:51:13.334 INFO:teuthology.orchestra.run.smithi062.stderr: 9450K .......... .......... .......... .......... .......... 12% 357M 0s 2019-11-29T12:51:13.335 INFO:teuthology.orchestra.run.smithi062.stderr: 9500K .......... .......... .......... .......... .......... 12% 319M 0s 2019-11-29T12:51:13.335 INFO:teuthology.orchestra.run.smithi062.stderr: 9550K .......... .......... .......... .......... .......... 13% 290M 0s 2019-11-29T12:51:13.335 INFO:teuthology.orchestra.run.smithi062.stderr: 9600K .......... .......... .......... .......... .......... 13% 377M 0s 2019-11-29T12:51:13.335 INFO:teuthology.orchestra.run.smithi062.stderr: 9650K .......... .......... .......... .......... .......... 13% 382M 0s 2019-11-29T12:51:13.335 INFO:teuthology.orchestra.run.smithi062.stderr: 9700K .......... .......... .......... .......... .......... 13% 413M 0s 2019-11-29T12:51:13.335 INFO:teuthology.orchestra.run.smithi062.stderr: 9750K .......... .......... .......... .......... .......... 13% 338M 0s 2019-11-29T12:51:13.335 INFO:teuthology.orchestra.run.smithi062.stderr: 9800K .......... .......... .......... .......... .......... 13% 379M 0s 2019-11-29T12:51:13.336 INFO:teuthology.orchestra.run.smithi062.stderr: 9850K .......... .......... .......... .......... .......... 13% 279M 0s 2019-11-29T12:51:13.336 INFO:teuthology.orchestra.run.smithi062.stderr: 9900K .......... .......... .......... .......... .......... 13% 342M 0s 2019-11-29T12:51:13.336 INFO:teuthology.orchestra.run.smithi062.stderr: 9950K .......... .......... .......... .......... .......... 13% 62.0M 0s 2019-11-29T12:51:13.336 INFO:teuthology.orchestra.run.smithi062.stderr: 10000K .......... .......... .......... .......... .......... 13% 254M 0s 2019-11-29T12:51:13.336 INFO:teuthology.orchestra.run.smithi062.stderr: 10050K .......... .......... .......... .......... .......... 13% 313M 0s 2019-11-29T12:51:13.336 INFO:teuthology.orchestra.run.smithi062.stderr: 10100K .......... .......... .......... .......... .......... 13% 263M 0s 2019-11-29T12:51:13.337 INFO:teuthology.orchestra.run.smithi062.stderr: 10150K .......... .......... .......... .......... .......... 13% 242M 0s 2019-11-29T12:51:13.337 INFO:teuthology.orchestra.run.smithi062.stderr: 10200K .......... .......... .......... .......... .......... 13% 328M 0s 2019-11-29T12:51:13.337 INFO:teuthology.orchestra.run.smithi062.stderr: 10250K .......... .......... .......... .......... .......... 14% 354M 0s 2019-11-29T12:51:13.337 INFO:teuthology.orchestra.run.smithi062.stderr: 10300K .......... .......... .......... .......... .......... 14% 104M 0s 2019-11-29T12:51:13.337 INFO:teuthology.orchestra.run.smithi062.stderr: 10350K .......... .......... .......... .......... .......... 14% 101M 0s 2019-11-29T12:51:13.337 INFO:teuthology.orchestra.run.smithi062.stderr: 10400K .......... .......... .......... .......... .......... 14% 250M 0s 2019-11-29T12:51:13.337 INFO:teuthology.orchestra.run.smithi062.stderr: 10450K .......... .......... .......... .......... .......... 14% 91.2M 0s 2019-11-29T12:51:13.337 INFO:teuthology.orchestra.run.smithi062.stderr: 10500K .......... .......... .......... .......... .......... 14% 252M 0s 2019-11-29T12:51:13.338 INFO:teuthology.orchestra.run.smithi062.stderr: 10550K .......... .......... .......... .......... .......... 14% 315M 0s 2019-11-29T12:51:13.338 INFO:teuthology.orchestra.run.smithi062.stderr: 10600K .......... .......... .......... .......... .......... 14% 323M 0s 2019-11-29T12:51:13.338 INFO:teuthology.orchestra.run.smithi062.stderr: 10650K .......... .......... .......... .......... .......... 14% 232M 0s 2019-11-29T12:51:13.338 INFO:teuthology.orchestra.run.smithi062.stderr: 10700K .......... .......... .......... .......... .......... 14% 353M 0s 2019-11-29T12:51:13.338 INFO:teuthology.orchestra.run.smithi062.stderr: 10750K .......... .......... .......... .......... .......... 14% 120M 0s 2019-11-29T12:51:13.338 INFO:teuthology.orchestra.run.smithi062.stderr: 10800K .......... .......... .......... .......... .......... 14% 336M 0s 2019-11-29T12:51:13.338 INFO:teuthology.orchestra.run.smithi062.stderr: 10850K .......... .......... .......... .......... .......... 14% 342M 0s 2019-11-29T12:51:13.339 INFO:teuthology.orchestra.run.smithi062.stderr: 10900K .......... .......... .......... .......... .......... 14% 205M 0s 2019-11-29T12:51:13.339 INFO:teuthology.orchestra.run.smithi062.stderr: 10950K .......... .......... .......... .......... .......... 14% 81.9M 0s 2019-11-29T12:51:13.339 INFO:teuthology.orchestra.run.smithi062.stderr: 11000K .......... .......... .......... .......... .......... 15% 307M 0s 2019-11-29T12:51:13.339 INFO:teuthology.orchestra.run.smithi062.stderr: 11050K .......... .......... .......... .......... .......... 15% 335M 0s 2019-11-29T12:51:13.339 INFO:teuthology.orchestra.run.smithi062.stderr: 11100K .......... .......... .......... .......... .......... 15% 213M 0s 2019-11-29T12:51:13.339 INFO:teuthology.orchestra.run.smithi062.stderr: 11150K .......... .......... .......... .......... .......... 15% 113M 0s 2019-11-29T12:51:13.339 INFO:teuthology.orchestra.run.smithi062.stderr: 11200K .......... .......... .......... .......... .......... 15% 147M 0s 2019-11-29T12:51:13.339 INFO:teuthology.orchestra.run.smithi062.stderr: 11250K .......... .......... .......... .......... .......... 15% 147M 0s 2019-11-29T12:51:13.340 INFO:teuthology.orchestra.run.smithi062.stderr: 11300K .......... .......... .......... .......... .......... 15% 156M 0s 2019-11-29T12:51:13.340 INFO:teuthology.orchestra.run.smithi062.stderr: 11350K .......... .......... .......... .......... .......... 15% 133M 0s 2019-11-29T12:51:13.340 INFO:teuthology.orchestra.run.smithi062.stderr: 11400K .......... .......... .......... .......... .......... 15% 186M 0s 2019-11-29T12:51:13.340 INFO:teuthology.orchestra.run.smithi062.stderr: 11450K .......... .......... .......... .......... .......... 15% 188M 0s 2019-11-29T12:51:13.340 INFO:teuthology.orchestra.run.smithi062.stderr: 11500K .......... .......... .......... .......... .......... 15% 178M 0s 2019-11-29T12:51:13.340 INFO:teuthology.orchestra.run.smithi062.stderr: 11550K .......... .......... .......... .......... .......... 15% 151M 0s 2019-11-29T12:51:13.340 INFO:teuthology.orchestra.run.smithi062.stderr: 11600K .......... .......... .......... .......... .......... 15% 185M 0s 2019-11-29T12:51:13.341 INFO:teuthology.orchestra.run.smithi062.stderr: 11650K .......... .......... .......... .......... .......... 15% 188M 0s 2019-11-29T12:51:13.341 INFO:teuthology.orchestra.run.smithi062.stderr: 11700K .......... .......... .......... .......... .......... 15% 117M 0s 2019-11-29T12:51:13.341 INFO:teuthology.orchestra.run.smithi062.stderr: 11750K .......... .......... .......... .......... .......... 16% 257M 0s 2019-11-29T12:51:13.341 INFO:teuthology.orchestra.run.smithi062.stderr: 11800K .......... .......... .......... .......... .......... 16% 412M 0s 2019-11-29T12:51:13.341 INFO:teuthology.orchestra.run.smithi062.stderr: 11850K .......... .......... .......... .......... .......... 16% 109M 0s 2019-11-29T12:51:13.341 INFO:teuthology.orchestra.run.smithi062.stderr: 11900K .......... .......... .......... .......... .......... 16% 348M 0s 2019-11-29T12:51:13.341 INFO:teuthology.orchestra.run.smithi062.stderr: 11950K .......... .......... .......... .......... .......... 16% 303M 0s 2019-11-29T12:51:13.342 INFO:teuthology.orchestra.run.smithi062.stderr: 12000K .......... .......... .......... .......... .......... 16% 52.1M 0s 2019-11-29T12:51:13.342 INFO:teuthology.orchestra.run.smithi062.stderr: 12050K .......... .......... .......... .......... .......... 16% 377M 0s 2019-11-29T12:51:13.342 INFO:teuthology.orchestra.run.smithi062.stderr: 12100K .......... .......... .......... .......... .......... 16% 79.9M 0s 2019-11-29T12:51:13.342 INFO:teuthology.orchestra.run.smithi062.stderr: 12150K .......... .......... .......... .......... .......... 16% 264M 0s 2019-11-29T12:51:13.342 INFO:teuthology.orchestra.run.smithi062.stderr: 12200K .......... .......... .......... .......... .......... 16% 350M 0s 2019-11-29T12:51:13.342 INFO:teuthology.orchestra.run.smithi062.stderr: 12250K .......... .......... .......... .......... .......... 16% 377M 0s 2019-11-29T12:51:13.342 INFO:teuthology.orchestra.run.smithi062.stderr: 12300K .......... .......... .......... .......... .......... 16% 19.2M 0s 2019-11-29T12:51:13.343 INFO:teuthology.orchestra.run.smithi062.stderr: 12350K .......... .......... .......... .......... .......... 16% 184M 0s 2019-11-29T12:51:13.343 INFO:teuthology.orchestra.run.smithi062.stderr: 12400K .......... .......... .......... .......... .......... 16% 293M 0s 2019-11-29T12:51:13.343 INFO:teuthology.orchestra.run.smithi062.stderr: 12450K .......... .......... .......... .......... .......... 16% 368M 0s 2019-11-29T12:51:13.343 INFO:teuthology.orchestra.run.smithi062.stderr: 12500K .......... .......... .......... .......... .......... 17% 323M 0s 2019-11-29T12:51:13.343 INFO:teuthology.orchestra.run.smithi062.stderr: 12550K .......... .......... .......... .......... .......... 17% 301M 0s 2019-11-29T12:51:13.343 INFO:teuthology.orchestra.run.smithi062.stderr: 12600K .......... .......... .......... .......... .......... 17% 341M 0s 2019-11-29T12:51:13.344 INFO:teuthology.orchestra.run.smithi062.stderr: 12650K .......... .......... .......... .......... .......... 17% 251M 0s 2019-11-29T12:51:13.344 INFO:teuthology.orchestra.run.smithi062.stderr: 12700K .......... .......... .......... .......... .......... 17% 233M 0s 2019-11-29T12:51:13.344 INFO:teuthology.orchestra.run.smithi062.stderr: 12750K .......... .......... .......... .......... .......... 17% 192M 0s 2019-11-29T12:51:13.344 INFO:teuthology.orchestra.run.smithi062.stderr: 12800K .......... .......... .......... .......... .......... 17% 206M 0s 2019-11-29T12:51:13.344 INFO:teuthology.orchestra.run.smithi062.stderr: 12850K .......... .......... .......... .......... .......... 17% 230M 0s 2019-11-29T12:51:13.344 INFO:teuthology.orchestra.run.smithi062.stderr: 12900K .......... .......... .......... .......... .......... 17% 237M 0s 2019-11-29T12:51:13.344 INFO:teuthology.orchestra.run.smithi062.stderr: 12950K .......... .......... .......... .......... .......... 17% 257M 0s 2019-11-29T12:51:13.345 INFO:teuthology.orchestra.run.smithi062.stderr: 13000K .......... .......... .......... .......... .......... 17% 383M 0s 2019-11-29T12:51:13.345 INFO:teuthology.orchestra.run.smithi062.stderr: 13050K .......... .......... .......... .......... .......... 17% 136M 0s 2019-11-29T12:51:13.345 INFO:teuthology.orchestra.run.smithi062.stderr: 13100K .......... .......... .......... .......... .......... 17% 85.3M 0s 2019-11-29T12:51:13.345 INFO:teuthology.orchestra.run.smithi062.stderr: 13150K .......... .......... .......... .......... .......... 17% 232M 0s 2019-11-29T12:51:13.345 INFO:teuthology.orchestra.run.smithi062.stderr: 13200K .......... .......... .......... .......... .......... 18% 382M 0s 2019-11-29T12:51:13.345 INFO:teuthology.orchestra.run.smithi062.stderr: 13250K .......... .......... .......... .......... .......... 18% 36.7M 0s 2019-11-29T12:51:13.345 INFO:teuthology.orchestra.run.smithi062.stderr: 13300K .......... .......... .......... .......... .......... 18% 321M 0s 2019-11-29T12:51:13.346 INFO:teuthology.orchestra.run.smithi062.stderr: 13350K .......... .......... .......... .......... .......... 18% 254M 0s 2019-11-29T12:51:13.346 INFO:teuthology.orchestra.run.smithi062.stderr: 13400K .......... .......... .......... .......... .......... 18% 293M 0s 2019-11-29T12:51:13.346 INFO:teuthology.orchestra.run.smithi062.stderr: 13450K .......... .......... .......... .......... .......... 18% 330M 0s 2019-11-29T12:51:13.346 INFO:teuthology.orchestra.run.smithi062.stderr: 13500K .......... .......... .......... .......... .......... 18% 338M 0s 2019-11-29T12:51:13.346 INFO:teuthology.orchestra.run.smithi062.stderr: 13550K .......... .......... .......... .......... .......... 18% 276M 0s 2019-11-29T12:51:13.346 INFO:teuthology.orchestra.run.smithi062.stderr: 13600K .......... .......... .......... .......... .......... 18% 329M 0s 2019-11-29T12:51:13.346 INFO:teuthology.orchestra.run.smithi062.stderr: 13650K .......... .......... .......... .......... .......... 18% 329M 0s 2019-11-29T12:51:13.347 INFO:teuthology.orchestra.run.smithi062.stderr: 13700K .......... .......... .......... .......... .......... 18% 155M 0s 2019-11-29T12:51:13.347 INFO:teuthology.orchestra.run.smithi062.stderr: 13750K .......... .......... .......... .......... .......... 18% 302M 0s 2019-11-29T12:51:13.347 INFO:teuthology.orchestra.run.smithi062.stderr: 13800K .......... .......... .......... .......... .......... 18% 134M 0s 2019-11-29T12:51:13.347 INFO:teuthology.orchestra.run.smithi062.stderr: 13850K .......... .......... .......... .......... .......... 18% 337M 0s 2019-11-29T12:51:13.347 INFO:teuthology.orchestra.run.smithi062.stderr: 13900K .......... .......... .......... .......... .......... 18% 338M 0s 2019-11-29T12:51:13.347 INFO:teuthology.orchestra.run.smithi062.stderr: 13950K .......... .......... .......... .......... .......... 19% 122M 0s 2019-11-29T12:51:13.347 INFO:teuthology.orchestra.run.smithi062.stderr: 14000K .......... .......... .......... .......... .......... 19% 350M 0s 2019-11-29T12:51:13.347 INFO:teuthology.orchestra.run.smithi062.stderr: 14050K .......... .......... .......... .......... .......... 19% 81.8M 0s 2019-11-29T12:51:13.348 INFO:teuthology.orchestra.run.smithi062.stderr: 14100K .......... .......... .......... .......... .......... 19% 306M 0s 2019-11-29T12:51:13.348 INFO:teuthology.orchestra.run.smithi062.stderr: 14150K .......... .......... .......... .......... .......... 19% 298M 0s 2019-11-29T12:51:13.348 INFO:teuthology.orchestra.run.smithi062.stderr: 14200K .......... .......... .......... .......... .......... 19% 119M 0s 2019-11-29T12:51:13.348 INFO:teuthology.orchestra.run.smithi062.stderr: 14250K .......... .......... .......... .......... .......... 19% 345M 0s 2019-11-29T12:51:13.348 INFO:teuthology.orchestra.run.smithi062.stderr: 14300K .......... .......... .......... .......... .......... 19% 107M 0s 2019-11-29T12:51:13.348 INFO:teuthology.orchestra.run.smithi062.stderr: 14350K .......... .......... .......... .......... .......... 19% 74.1M 0s 2019-11-29T12:51:13.348 INFO:teuthology.orchestra.run.smithi062.stderr: 14400K .......... .......... .......... .......... .......... 19% 267M 0s 2019-11-29T12:51:13.349 INFO:teuthology.orchestra.run.smithi062.stderr: 14450K .......... .......... .......... .......... .......... 19% 343M 0s 2019-11-29T12:51:13.349 INFO:teuthology.orchestra.run.smithi062.stderr: 14500K .......... .......... .......... .......... .......... 19% 196M 0s 2019-11-29T12:51:13.349 INFO:teuthology.orchestra.run.smithi062.stderr: 14550K .......... .......... .......... .......... .......... 19% 124M 0s 2019-11-29T12:51:13.349 INFO:teuthology.orchestra.run.smithi062.stderr: 14600K .......... .......... .......... .......... .......... 19% 280M 0s 2019-11-29T12:51:13.349 INFO:teuthology.orchestra.run.smithi062.stderr: 14650K .......... .......... .......... .......... .......... 19% 334M 0s 2019-11-29T12:51:13.349 INFO:teuthology.orchestra.run.smithi062.stderr: 14700K .......... .......... .......... .......... .......... 20% 234M 0s 2019-11-29T12:51:13.349 INFO:teuthology.orchestra.run.smithi062.stderr: 14750K .......... .......... .......... .......... .......... 20% 289M 0s 2019-11-29T12:51:13.349 INFO:teuthology.orchestra.run.smithi062.stderr: 14800K .......... .......... .......... .......... .......... 20% 176M 0s 2019-11-29T12:51:13.350 INFO:teuthology.orchestra.run.smithi062.stderr: 14850K .......... .......... .......... .......... .......... 20% 219M 0s 2019-11-29T12:51:13.350 INFO:teuthology.orchestra.run.smithi062.stderr: 14900K .......... .......... .......... .......... .......... 20% 139M 0s 2019-11-29T12:51:13.350 INFO:teuthology.orchestra.run.smithi062.stderr: 14950K .......... .......... .......... .......... .......... 20% 256M 0s 2019-11-29T12:51:13.350 INFO:teuthology.orchestra.run.smithi062.stderr: 15000K .......... .......... .......... .......... .......... 20% 382M 0s 2019-11-29T12:51:13.350 INFO:teuthology.orchestra.run.smithi062.stderr: 15050K .......... .......... .......... .......... .......... 20% 411M 0s 2019-11-29T12:51:13.350 INFO:teuthology.orchestra.run.smithi062.stderr: 15100K .......... .......... .......... .......... .......... 20% 150M 0s 2019-11-29T12:51:13.350 INFO:teuthology.orchestra.run.smithi062.stderr: 15150K .......... .......... .......... .......... .......... 20% 341M 0s 2019-11-29T12:51:13.351 INFO:teuthology.orchestra.run.smithi062.stderr: 15200K .......... .......... .......... .......... .......... 20% 84.0M 0s 2019-11-29T12:51:13.351 INFO:teuthology.orchestra.run.smithi062.stderr: 15250K .......... .......... .......... .......... .......... 20% 369M 0s 2019-11-29T12:51:13.351 INFO:teuthology.orchestra.run.smithi062.stderr: 15300K .......... .......... .......... .......... .......... 20% 358M 0s 2019-11-29T12:51:13.351 INFO:teuthology.orchestra.run.smithi062.stderr: 15350K .......... .......... .......... .......... .......... 20% 354M 0s 2019-11-29T12:51:13.351 INFO:teuthology.orchestra.run.smithi062.stderr: 15400K .......... .......... .......... .......... .......... 21% 124M 0s 2019-11-29T12:51:13.351 INFO:teuthology.orchestra.run.smithi062.stderr: 15450K .......... .......... .......... .......... .......... 21% 401M 0s 2019-11-29T12:51:13.352 INFO:teuthology.orchestra.run.smithi062.stderr: 15500K .......... .......... .......... .......... .......... 21% 140M 0s 2019-11-29T12:51:13.352 INFO:teuthology.orchestra.run.smithi062.stderr: 15550K .......... .......... .......... .......... .......... 21% 267M 0s 2019-11-29T12:51:13.352 INFO:teuthology.orchestra.run.smithi062.stderr: 15600K .......... .......... .......... .......... .......... 21% 106M 0s 2019-11-29T12:51:13.352 INFO:teuthology.orchestra.run.smithi062.stderr: 15650K .......... .......... .......... .......... .......... 21% 378M 0s 2019-11-29T12:51:13.352 INFO:teuthology.orchestra.run.smithi062.stderr: 15700K .......... .......... .......... .......... .......... 21% 416M 0s 2019-11-29T12:51:13.352 INFO:teuthology.orchestra.run.smithi062.stderr: 15750K .......... .......... .......... .......... .......... 21% 223M 0s 2019-11-29T12:51:13.352 INFO:teuthology.orchestra.run.smithi062.stderr: 15800K .......... .......... .......... .......... .......... 21% 402M 0s 2019-11-29T12:51:13.353 INFO:teuthology.orchestra.run.smithi062.stderr: 15850K .......... .......... .......... .......... .......... 21% 24.1M 0s 2019-11-29T12:51:13.353 INFO:teuthology.orchestra.run.smithi062.stderr: 15900K .......... .......... .......... .......... .......... 21% 314M 0s 2019-11-29T12:51:13.353 INFO:teuthology.orchestra.run.smithi062.stderr: 15950K .......... .......... .......... .......... .......... 21% 285M 0s 2019-11-29T12:51:13.353 INFO:teuthology.orchestra.run.smithi062.stderr: 16000K .......... .......... .......... .......... .......... 21% 343M 0s 2019-11-29T12:51:13.353 INFO:teuthology.orchestra.run.smithi062.stderr: 16050K .......... .......... .......... .......... .......... 21% 344M 0s 2019-11-29T12:51:13.353 INFO:teuthology.orchestra.run.smithi062.stderr: 16100K .......... .......... .......... .......... .......... 21% 325M 0s 2019-11-29T12:51:13.353 INFO:teuthology.orchestra.run.smithi062.stderr: 16150K .......... .......... .......... .......... .......... 22% 343M 0s 2019-11-29T12:51:13.354 INFO:teuthology.orchestra.run.smithi062.stderr: 16200K .......... .......... .......... .......... .......... 22% 419M 0s 2019-11-29T12:51:13.354 INFO:teuthology.orchestra.run.smithi062.stderr: 16250K .......... .......... .......... .......... .......... 22% 434M 0s 2019-11-29T12:51:13.354 INFO:teuthology.orchestra.run.smithi062.stderr: 16300K .......... .......... .......... .......... .......... 22% 434M 0s 2019-11-29T12:51:13.354 INFO:teuthology.orchestra.run.smithi062.stderr: 16350K .......... .......... .......... .......... .......... 22% 312M 0s 2019-11-29T12:51:13.354 INFO:teuthology.orchestra.run.smithi062.stderr: 16400K .......... .......... .......... .......... .......... 22% 388M 0s 2019-11-29T12:51:13.354 INFO:teuthology.orchestra.run.smithi062.stderr: 16450K .......... .......... .......... .......... .......... 22% 395M 0s 2019-11-29T12:51:13.354 INFO:teuthology.orchestra.run.smithi062.stderr: 16500K .......... .......... .......... .......... .......... 22% 420M 0s 2019-11-29T12:51:13.354 INFO:teuthology.orchestra.run.smithi062.stderr: 16550K .......... .......... .......... .......... .......... 22% 274M 0s 2019-11-29T12:51:13.355 INFO:teuthology.orchestra.run.smithi062.stderr: 16600K .......... .......... .......... .......... .......... 22% 388M 0s 2019-11-29T12:51:13.355 INFO:teuthology.orchestra.run.smithi062.stderr: 16650K .......... .......... .......... .......... .......... 22% 121M 0s 2019-11-29T12:51:13.355 INFO:teuthology.orchestra.run.smithi062.stderr: 16700K .......... .......... .......... .......... .......... 22% 374M 0s 2019-11-29T12:51:13.355 INFO:teuthology.orchestra.run.smithi062.stderr: 16750K .......... .......... .......... .......... .......... 22% 111M 0s 2019-11-29T12:51:13.355 INFO:teuthology.orchestra.run.smithi062.stderr: 16800K .......... .......... .......... .......... .......... 22% 371M 0s 2019-11-29T12:51:13.355 INFO:teuthology.orchestra.run.smithi062.stderr: 16850K .......... .......... .......... .......... .......... 22% 419M 0s 2019-11-29T12:51:13.355 INFO:teuthology.orchestra.run.smithi062.stderr: 16900K .......... .......... .......... .......... .......... 23% 427M 0s 2019-11-29T12:51:13.356 INFO:teuthology.orchestra.run.smithi062.stderr: 16950K .......... .......... .......... .......... .......... 23% 29.4M 0s 2019-11-29T12:51:13.356 INFO:teuthology.orchestra.run.smithi062.stderr: 17000K .......... .......... .......... .......... .......... 23% 376M 0s 2019-11-29T12:51:13.356 INFO:teuthology.orchestra.run.smithi062.stderr: 17050K .......... .......... .......... .......... .......... 23% 397M 0s 2019-11-29T12:51:13.356 INFO:teuthology.orchestra.run.smithi062.stderr: 17100K .......... .......... .......... .......... .......... 23% 381M 0s 2019-11-29T12:51:13.356 INFO:teuthology.orchestra.run.smithi062.stderr: 17150K .......... .......... .......... .......... .......... 23% 311M 0s 2019-11-29T12:51:13.356 INFO:teuthology.orchestra.run.smithi062.stderr: 17200K .......... .......... .......... .......... .......... 23% 376M 0s 2019-11-29T12:51:13.356 INFO:teuthology.orchestra.run.smithi062.stderr: 17250K .......... .......... .......... .......... .......... 23% 361M 0s 2019-11-29T12:51:13.357 INFO:teuthology.orchestra.run.smithi062.stderr: 17300K .......... .......... .......... .......... .......... 23% 408M 0s 2019-11-29T12:51:13.357 INFO:teuthology.orchestra.run.smithi062.stderr: 17350K .......... .......... .......... .......... .......... 23% 351M 0s 2019-11-29T12:51:13.357 INFO:teuthology.orchestra.run.smithi062.stderr: 17400K .......... .......... .......... .......... .......... 23% 432M 0s 2019-11-29T12:51:13.357 INFO:teuthology.orchestra.run.smithi062.stderr: 17450K .......... .......... .......... .......... .......... 23% 91.9M 0s 2019-11-29T12:51:13.357 INFO:teuthology.orchestra.run.smithi062.stderr: 17500K .......... .......... .......... .......... .......... 23% 393M 0s 2019-11-29T12:51:13.357 INFO:teuthology.orchestra.run.smithi062.stderr: 17550K .......... .......... .......... .......... .......... 23% 330M 0s 2019-11-29T12:51:13.357 INFO:teuthology.orchestra.run.smithi062.stderr: 17600K .......... .......... .......... .......... .......... 23% 422M 0s 2019-11-29T12:51:13.357 INFO:teuthology.orchestra.run.smithi062.stderr: 17650K .......... .......... .......... .......... .......... 24% 246M 0s 2019-11-29T12:51:13.358 INFO:teuthology.orchestra.run.smithi062.stderr: 17700K .......... .......... .......... .......... .......... 24% 365M 0s 2019-11-29T12:51:13.358 INFO:teuthology.orchestra.run.smithi062.stderr: 17750K .......... .......... .......... .......... .......... 24% 68.5M 0s 2019-11-29T12:51:13.358 INFO:teuthology.orchestra.run.smithi062.stderr: 17800K .......... .......... .......... .......... .......... 24% 298M 0s 2019-11-29T12:51:13.358 INFO:teuthology.orchestra.run.smithi062.stderr: 17850K .......... .......... .......... .......... .......... 24% 376M 0s 2019-11-29T12:51:13.358 INFO:teuthology.orchestra.run.smithi062.stderr: 17900K .......... .......... .......... .......... .......... 24% 405M 0s 2019-11-29T12:51:13.358 INFO:teuthology.orchestra.run.smithi062.stderr: 17950K .......... .......... .......... .......... .......... 24% 111M 0s 2019-11-29T12:51:13.358 INFO:teuthology.orchestra.run.smithi062.stderr: 18000K .......... .......... .......... .......... .......... 24% 389M 0s 2019-11-29T12:51:13.359 INFO:teuthology.orchestra.run.smithi062.stderr: 18050K .......... .......... .......... .......... .......... 24% 157M 0s 2019-11-29T12:51:13.359 INFO:teuthology.orchestra.run.smithi062.stderr: 18100K .......... .......... .......... .......... .......... 24% 400M 0s 2019-11-29T12:51:13.359 INFO:teuthology.orchestra.run.smithi062.stderr: 18150K .......... .......... .......... .......... .......... 24% 25.5M 0s 2019-11-29T12:51:13.359 INFO:teuthology.orchestra.run.smithi062.stderr: 18200K .......... .......... .......... .......... .......... 24% 349M 0s 2019-11-29T12:51:13.359 INFO:teuthology.orchestra.run.smithi062.stderr: 18250K .......... .......... .......... .......... .......... 24% 330M 0s 2019-11-29T12:51:13.359 INFO:teuthology.orchestra.run.smithi062.stderr: 18300K .......... .......... .......... .......... .......... 24% 391M 0s 2019-11-29T12:51:13.359 INFO:teuthology.orchestra.run.smithi062.stderr: 18350K .......... .......... .......... .......... .......... 25% 332M 0s 2019-11-29T12:51:13.360 INFO:teuthology.orchestra.run.smithi062.stderr: 18400K .......... .......... .......... .......... .......... 25% 392M 0s 2019-11-29T12:51:13.360 INFO:teuthology.orchestra.run.smithi062.stderr: 18450K .......... .......... .......... .......... .......... 25% 410M 0s 2019-11-29T12:51:13.360 INFO:teuthology.orchestra.run.smithi062.stderr: 18500K .......... .......... .......... .......... .......... 25% 430M 0s 2019-11-29T12:51:13.360 INFO:teuthology.orchestra.run.smithi062.stderr: 18550K .......... .......... .......... .......... .......... 25% 166M 0s 2019-11-29T12:51:13.360 INFO:teuthology.orchestra.run.smithi062.stderr: 18600K .......... .......... .......... .......... .......... 25% 380M 0s 2019-11-29T12:51:13.360 INFO:teuthology.orchestra.run.smithi062.stderr: 18650K .......... .......... .......... .......... .......... 25% 373M 0s 2019-11-29T12:51:13.361 INFO:teuthology.orchestra.run.smithi062.stderr: 18700K .......... .......... .......... .......... .......... 25% 81.7M 0s 2019-11-29T12:51:13.361 INFO:teuthology.orchestra.run.smithi062.stderr: 18750K .......... .......... .......... .......... .......... 25% 298M 0s 2019-11-29T12:51:13.361 INFO:teuthology.orchestra.run.smithi062.stderr: 18800K .......... .......... .......... .......... .......... 25% 134M 0s 2019-11-29T12:51:13.361 INFO:teuthology.orchestra.run.smithi062.stderr: 18850K .......... .......... .......... .......... .......... 25% 364M 0s 2019-11-29T12:51:13.361 INFO:teuthology.orchestra.run.smithi062.stderr: 18900K .......... .......... .......... .......... .......... 25% 373M 0s 2019-11-29T12:51:13.361 INFO:teuthology.orchestra.run.smithi062.stderr: 18950K .......... .......... .......... .......... .......... 25% 138M 0s 2019-11-29T12:51:13.361 INFO:teuthology.orchestra.run.smithi062.stderr: 19000K .......... .......... .......... .......... .......... 25% 83.2M 0s 2019-11-29T12:51:13.362 INFO:teuthology.orchestra.run.smithi062.stderr: 19050K .......... .......... .......... .......... .......... 25% 330M 0s 2019-11-29T12:51:13.362 INFO:teuthology.orchestra.run.smithi062.stderr: 19100K .......... .......... .......... .......... .......... 26% 375M 0s 2019-11-29T12:51:13.362 INFO:teuthology.orchestra.run.smithi062.stderr: 19150K .......... .......... .......... .......... .......... 26% 130M 0s 2019-11-29T12:51:13.362 INFO:teuthology.orchestra.run.smithi062.stderr: 19200K .......... .......... .......... .......... .......... 26% 366M 0s 2019-11-29T12:51:13.362 INFO:teuthology.orchestra.run.smithi062.stderr: 19250K .......... .......... .......... .......... .......... 26% 403M 0s 2019-11-29T12:51:13.362 INFO:teuthology.orchestra.run.smithi062.stderr: 19300K .......... .......... .......... .......... .......... 26% 137M 0s 2019-11-29T12:51:13.362 INFO:teuthology.orchestra.run.smithi062.stderr: 19350K .......... .......... .......... .......... .......... 26% 330M 0s 2019-11-29T12:51:13.363 INFO:teuthology.orchestra.run.smithi062.stderr: 19400K .......... .......... .......... .......... .......... 26% 138M 0s 2019-11-29T12:51:13.363 INFO:teuthology.orchestra.run.smithi062.stderr: 19450K .......... .......... .......... .......... .......... 26% 73.3M 0s 2019-11-29T12:51:13.363 INFO:teuthology.orchestra.run.smithi062.stderr: 19500K .......... .......... .......... .......... .......... 26% 394M 0s 2019-11-29T12:51:13.363 INFO:teuthology.orchestra.run.smithi062.stderr: 19550K .......... .......... .......... .......... .......... 26% 221M 0s 2019-11-29T12:51:13.363 INFO:teuthology.orchestra.run.smithi062.stderr: 19600K .......... .......... .......... .......... .......... 26% 272M 0s 2019-11-29T12:51:13.363 INFO:teuthology.orchestra.run.smithi062.stderr: 19650K .......... .......... .......... .......... .......... 26% 184M 0s 2019-11-29T12:51:13.363 INFO:teuthology.orchestra.run.smithi062.stderr: 19700K .......... .......... .......... .......... .......... 26% 23.2M 0s 2019-11-29T12:51:13.364 INFO:teuthology.orchestra.run.smithi062.stderr: 19750K .......... .......... .......... .......... .......... 26% 320M 0s 2019-11-29T12:51:13.364 INFO:teuthology.orchestra.run.smithi062.stderr: 19800K .......... .......... .......... .......... .......... 26% 404M 0s 2019-11-29T12:51:13.364 INFO:teuthology.orchestra.run.smithi062.stderr: 19850K .......... .......... .......... .......... .......... 27% 375M 0s 2019-11-29T12:51:13.364 INFO:teuthology.orchestra.run.smithi062.stderr: 19900K .......... .......... .......... .......... .......... 27% 411M 0s 2019-11-29T12:51:13.364 INFO:teuthology.orchestra.run.smithi062.stderr: 19950K .......... .......... .......... .......... .......... 27% 373M 0s 2019-11-29T12:51:13.364 INFO:teuthology.orchestra.run.smithi062.stderr: 20000K .......... .......... .......... .......... .......... 27% 410M 0s 2019-11-29T12:51:13.364 INFO:teuthology.orchestra.run.smithi062.stderr: 20050K .......... .......... .......... .......... .......... 27% 426M 0s 2019-11-29T12:51:13.364 INFO:teuthology.orchestra.run.smithi062.stderr: 20100K .......... .......... .......... .......... .......... 27% 41.1M 0s 2019-11-29T12:51:13.365 INFO:teuthology.orchestra.run.smithi062.stderr: 20150K .......... .......... .......... .......... .......... 27% 315M 0s 2019-11-29T12:51:13.365 INFO:teuthology.orchestra.run.smithi062.stderr: 20200K .......... .......... .......... .......... .......... 27% 387M 0s 2019-11-29T12:51:13.365 INFO:teuthology.orchestra.run.smithi062.stderr: 20250K .......... .......... .......... .......... .......... 27% 400M 0s 2019-11-29T12:51:13.365 INFO:teuthology.orchestra.run.smithi062.stderr: 20300K .......... .......... .......... .......... .......... 27% 407M 0s 2019-11-29T12:51:13.365 INFO:teuthology.orchestra.run.smithi062.stderr: 20350K .......... .......... .......... .......... .......... 27% 350M 0s 2019-11-29T12:51:13.365 INFO:teuthology.orchestra.run.smithi062.stderr: 20400K .......... .......... .......... .......... .......... 27% 426M 0s 2019-11-29T12:51:13.365 INFO:teuthology.orchestra.run.smithi062.stderr: 20450K .......... .......... .......... .......... .......... 27% 391M 0s 2019-11-29T12:51:13.366 INFO:teuthology.orchestra.run.smithi062.stderr: 20500K .......... .......... .......... .......... .......... 27% 408M 0s 2019-11-29T12:51:13.366 INFO:teuthology.orchestra.run.smithi062.stderr: 20550K .......... .......... .......... .......... .......... 28% 167M 0s 2019-11-29T12:51:13.366 INFO:teuthology.orchestra.run.smithi062.stderr: 20600K .......... .......... .......... .......... .......... 28% 294M 0s 2019-11-29T12:51:13.366 INFO:teuthology.orchestra.run.smithi062.stderr: 20650K .......... .......... .......... .......... .......... 28% 425M 0s 2019-11-29T12:51:13.366 INFO:teuthology.orchestra.run.smithi062.stderr: 20700K .......... .......... .......... .......... .......... 28% 295M 0s 2019-11-29T12:51:13.366 INFO:teuthology.orchestra.run.smithi062.stderr: 20750K .......... .......... .......... .......... .......... 28% 281M 0s 2019-11-29T12:51:13.366 INFO:teuthology.orchestra.run.smithi062.stderr: 20800K .......... .......... .......... .......... .......... 28% 99.3M 0s 2019-11-29T12:51:13.366 INFO:teuthology.orchestra.run.smithi062.stderr: 20850K .......... .......... .......... .......... .......... 28% 290M 0s 2019-11-29T12:51:13.367 INFO:teuthology.orchestra.run.smithi062.stderr: 20900K .......... .......... .......... .......... .......... 28% 320M 0s 2019-11-29T12:51:13.367 INFO:teuthology.orchestra.run.smithi062.stderr: 20950K .......... .......... .......... .......... .......... 28% 109M 0s 2019-11-29T12:51:13.367 INFO:teuthology.orchestra.run.smithi062.stderr: 21000K .......... .......... .......... .......... .......... 28% 290M 0s 2019-11-29T12:51:13.367 INFO:teuthology.orchestra.run.smithi062.stderr: 21050K .......... .......... .......... .......... .......... 28% 193M 0s 2019-11-29T12:51:13.367 INFO:teuthology.orchestra.run.smithi062.stderr: 21100K .......... .......... .......... .......... .......... 28% 199M 0s 2019-11-29T12:51:13.367 INFO:teuthology.orchestra.run.smithi062.stderr: 21150K .......... .......... .......... .......... .......... 28% 267M 0s 2019-11-29T12:51:13.367 INFO:teuthology.orchestra.run.smithi062.stderr: 21200K .......... .......... .......... .......... .......... 28% 317M 0s 2019-11-29T12:51:13.368 INFO:teuthology.orchestra.run.smithi062.stderr: 21250K .......... .......... .......... .......... .......... 28% 104M 0s 2019-11-29T12:51:13.368 INFO:teuthology.orchestra.run.smithi062.stderr: 21300K .......... .......... .......... .......... .......... 29% 318M 0s 2019-11-29T12:51:13.368 INFO:teuthology.orchestra.run.smithi062.stderr: 21350K .......... .......... .......... .......... .......... 29% 219M 0s 2019-11-29T12:51:13.368 INFO:teuthology.orchestra.run.smithi062.stderr: 21400K .......... .......... .......... .......... .......... 29% 269M 0s 2019-11-29T12:51:13.368 INFO:teuthology.orchestra.run.smithi062.stderr: 21450K .......... .......... .......... .......... .......... 29% 245M 0s 2019-11-29T12:51:13.368 INFO:teuthology.orchestra.run.smithi062.stderr: 21500K .......... .......... .......... .......... .......... 29% 289M 0s 2019-11-29T12:51:13.369 INFO:teuthology.orchestra.run.smithi062.stderr: 21550K .......... .......... .......... .......... .......... 29% 244M 0s 2019-11-29T12:51:13.369 INFO:teuthology.orchestra.run.smithi062.stderr: 21600K .......... .......... .......... .......... .......... 29% 111M 0s 2019-11-29T12:51:13.369 INFO:teuthology.orchestra.run.smithi062.stderr: 21650K .......... .......... .......... .......... .......... 29% 221M 0s 2019-11-29T12:51:13.369 INFO:teuthology.orchestra.run.smithi062.stderr: 21700K .......... .......... .......... .......... .......... 29% 284M 0s 2019-11-29T12:51:13.369 INFO:teuthology.orchestra.run.smithi062.stderr: 21750K .......... .......... .......... .......... .......... 29% 70.5M 0s 2019-11-29T12:51:13.369 INFO:teuthology.orchestra.run.smithi062.stderr: 21800K .......... .......... .......... .......... .......... 29% 256M 0s 2019-11-29T12:51:13.369 INFO:teuthology.orchestra.run.smithi062.stderr: 21850K .......... .......... .......... .......... .......... 29% 240M 0s 2019-11-29T12:51:13.370 INFO:teuthology.orchestra.run.smithi062.stderr: 21900K .......... .......... .......... .......... .......... 29% 312M 0s 2019-11-29T12:51:13.370 INFO:teuthology.orchestra.run.smithi062.stderr: 21950K .......... .......... .......... .......... .......... 29% 206M 0s 2019-11-29T12:51:13.370 INFO:teuthology.orchestra.run.smithi062.stderr: 22000K .......... .......... .......... .......... .......... 29% 94.0M 0s 2019-11-29T12:51:13.370 INFO:teuthology.orchestra.run.smithi062.stderr: 22050K .......... .......... .......... .......... .......... 30% 319M 0s 2019-11-29T12:51:13.370 INFO:teuthology.orchestra.run.smithi062.stderr: 22100K .......... .......... .......... .......... .......... 30% 123M 0s 2019-11-29T12:51:13.370 INFO:teuthology.orchestra.run.smithi062.stderr: 22150K .......... .......... .......... .......... .......... 30% 217M 0s 2019-11-29T12:51:13.370 INFO:teuthology.orchestra.run.smithi062.stderr: 22200K .......... .......... .......... .......... .......... 30% 339M 0s 2019-11-29T12:51:13.371 INFO:teuthology.orchestra.run.smithi062.stderr: 22250K .......... .......... .......... .......... .......... 30% 73.9M 0s 2019-11-29T12:51:13.371 INFO:teuthology.orchestra.run.smithi062.stderr: 22300K .......... .......... .......... .......... .......... 30% 249M 0s 2019-11-29T12:51:13.371 INFO:teuthology.orchestra.run.smithi062.stderr: 22350K .......... .......... .......... .......... .......... 30% 17.3M 0s 2019-11-29T12:51:13.371 INFO:teuthology.orchestra.run.smithi062.stderr: 22400K .......... .......... .......... .......... .......... 30% 202M 0s 2019-11-29T12:51:13.371 INFO:teuthology.orchestra.run.smithi062.stderr: 22450K .......... .......... .......... .......... .......... 30% 295M 0s 2019-11-29T12:51:13.371 INFO:teuthology.orchestra.run.smithi062.stderr: 22500K .......... .......... .......... .......... .......... 30% 224M 0s 2019-11-29T12:51:13.371 INFO:teuthology.orchestra.run.smithi062.stderr: 22550K .......... .......... .......... .......... .......... 30% 264M 0s 2019-11-29T12:51:13.372 INFO:teuthology.orchestra.run.smithi062.stderr: 22600K .......... .......... .......... .......... .......... 30% 274M 0s 2019-11-29T12:51:13.372 INFO:teuthology.orchestra.run.smithi062.stderr: 22650K .......... .......... .......... .......... .......... 30% 323M 0s 2019-11-29T12:51:13.372 INFO:teuthology.orchestra.run.smithi062.stderr: 22700K .......... .......... .......... .......... .......... 30% 378M 0s 2019-11-29T12:51:13.372 INFO:teuthology.orchestra.run.smithi062.stderr: 22750K .......... .......... .......... .......... .......... 30% 321M 0s 2019-11-29T12:51:13.372 INFO:teuthology.orchestra.run.smithi062.stderr: 22800K .......... .......... .......... .......... .......... 31% 372M 0s 2019-11-29T12:51:13.372 INFO:teuthology.orchestra.run.smithi062.stderr: 22850K .......... .......... .......... .......... .......... 31% 365M 0s 2019-11-29T12:51:13.372 INFO:teuthology.orchestra.run.smithi062.stderr: 22900K .......... .......... .......... .......... .......... 31% 389M 0s 2019-11-29T12:51:13.372 INFO:teuthology.orchestra.run.smithi062.stderr: 22950K .......... .......... .......... .......... .......... 31% 349M 0s 2019-11-29T12:51:13.373 INFO:teuthology.orchestra.run.smithi062.stderr: 23000K .......... .......... .......... .......... .......... 31% 325M 0s 2019-11-29T12:51:13.373 INFO:teuthology.orchestra.run.smithi062.stderr: 23050K .......... .......... .......... .......... .......... 31% 293M 0s 2019-11-29T12:51:13.373 INFO:teuthology.orchestra.run.smithi062.stderr: 23100K .......... .......... .......... .......... .......... 31% 386M 0s 2019-11-29T12:51:13.373 INFO:teuthology.orchestra.run.smithi062.stderr: 23150K .......... .......... .......... .......... .......... 31% 154M 0s 2019-11-29T12:51:13.373 INFO:teuthology.orchestra.run.smithi062.stderr: 23200K .......... .......... .......... .......... .......... 31% 305M 0s 2019-11-29T12:51:13.373 INFO:teuthology.orchestra.run.smithi062.stderr: 23250K .......... .......... .......... .......... .......... 31% 129M 0s 2019-11-29T12:51:13.373 INFO:teuthology.orchestra.run.smithi062.stderr: 23300K .......... .......... .......... .......... .......... 31% 276M 0s 2019-11-29T12:51:13.374 INFO:teuthology.orchestra.run.smithi062.stderr: 23350K .......... .......... .......... .......... .......... 31% 332M 0s 2019-11-29T12:51:13.374 INFO:teuthology.orchestra.run.smithi062.stderr: 23400K .......... .......... .......... .......... .......... 31% 95.5M 0s 2019-11-29T12:51:13.374 INFO:teuthology.orchestra.run.smithi062.stderr: 23450K .......... .......... .......... .......... .......... 31% 258M 0s 2019-11-29T12:51:13.374 INFO:teuthology.orchestra.run.smithi062.stderr: 23500K .......... .......... .......... .......... .......... 32% 365M 0s 2019-11-29T12:51:13.374 INFO:teuthology.orchestra.run.smithi062.stderr: 23550K .......... .......... .......... .......... .......... 32% 76.9M 0s 2019-11-29T12:51:13.374 INFO:teuthology.orchestra.run.smithi062.stderr: 23600K .......... .......... .......... .......... .......... 32% 399M 0s 2019-11-29T12:51:13.374 INFO:teuthology.orchestra.run.smithi062.stderr: 23650K .......... .......... .......... .......... .......... 32% 15.6M 0s 2019-11-29T12:51:13.374 INFO:teuthology.orchestra.run.smithi062.stderr: 23700K .......... .......... .......... .......... .......... 32% 292M 0s 2019-11-29T12:51:13.375 INFO:teuthology.orchestra.run.smithi062.stderr: 23750K .......... .......... .......... .......... .......... 32% 262M 0s 2019-11-29T12:51:13.375 INFO:teuthology.orchestra.run.smithi062.stderr: 23800K .......... .......... .......... .......... .......... 32% 286M 0s 2019-11-29T12:51:13.375 INFO:teuthology.orchestra.run.smithi062.stderr: 23850K .......... .......... .......... .......... .......... 32% 275M 0s 2019-11-29T12:51:13.375 INFO:teuthology.orchestra.run.smithi062.stderr: 23900K .......... .......... .......... .......... .......... 32% 249M 0s 2019-11-29T12:51:13.375 INFO:teuthology.orchestra.run.smithi062.stderr: 23950K .......... .......... .......... .......... .......... 32% 217M 0s 2019-11-29T12:51:13.375 INFO:teuthology.orchestra.run.smithi062.stderr: 24000K .......... .......... .......... .......... .......... 32% 354M 0s 2019-11-29T12:51:13.375 INFO:teuthology.orchestra.run.smithi062.stderr: 24050K .......... .......... .......... .......... .......... 32% 356M 0s 2019-11-29T12:51:13.376 INFO:teuthology.orchestra.run.smithi062.stderr: 24100K .......... .......... .......... .......... .......... 32% 297M 0s 2019-11-29T12:51:13.376 INFO:teuthology.orchestra.run.smithi062.stderr: 24150K .......... .......... .......... .......... .......... 32% 279M 0s 2019-11-29T12:51:13.376 INFO:teuthology.orchestra.run.smithi062.stderr: 24200K .......... .......... .......... .......... .......... 32% 399M 0s 2019-11-29T12:51:13.376 INFO:teuthology.orchestra.run.smithi062.stderr: 24250K .......... .......... .......... .......... .......... 33% 404M 0s 2019-11-29T12:51:13.376 INFO:teuthology.orchestra.run.smithi062.stderr: 24300K .......... .......... .......... .......... .......... 33% 396M 0s 2019-11-29T12:51:13.376 INFO:teuthology.orchestra.run.smithi062.stderr: 24350K .......... .......... .......... .......... .......... 33% 341M 0s 2019-11-29T12:51:13.376 INFO:teuthology.orchestra.run.smithi062.stderr: 24400K .......... .......... .......... .......... .......... 33% 19.3M 0s 2019-11-29T12:51:13.377 INFO:teuthology.orchestra.run.smithi062.stderr: 24450K .......... .......... .......... .......... .......... 33% 264M 0s 2019-11-29T12:51:13.377 INFO:teuthology.orchestra.run.smithi062.stderr: 24500K .......... .......... .......... .......... .......... 33% 293M 0s 2019-11-29T12:51:13.377 INFO:teuthology.orchestra.run.smithi062.stderr: 24550K .......... .......... .......... .......... .......... 33% 216M 0s 2019-11-29T12:51:13.377 INFO:teuthology.orchestra.run.smithi062.stderr: 24600K .......... .......... .......... .......... .......... 33% 250M 0s 2019-11-29T12:51:13.377 INFO:teuthology.orchestra.run.smithi062.stderr: 24650K .......... .......... .......... .......... .......... 33% 290M 0s 2019-11-29T12:51:13.377 INFO:teuthology.orchestra.run.smithi062.stderr: 24700K .......... .......... .......... .......... .......... 33% 295M 0s 2019-11-29T12:51:13.378 INFO:teuthology.orchestra.run.smithi062.stderr: 24750K .......... .......... .......... .......... .......... 33% 242M 0s 2019-11-29T12:51:13.378 INFO:teuthology.orchestra.run.smithi062.stderr: 24800K .......... .......... .......... .......... .......... 33% 289M 0s 2019-11-29T12:51:13.378 INFO:teuthology.orchestra.run.smithi062.stderr: 24850K .......... .......... .......... .......... .......... 33% 291M 0s 2019-11-29T12:51:13.378 INFO:teuthology.orchestra.run.smithi062.stderr: 24900K .......... .......... .......... .......... .......... 33% 375M 0s 2019-11-29T12:51:13.378 INFO:teuthology.orchestra.run.smithi062.stderr: 24950K .......... .......... .......... .......... .......... 33% 335M 0s 2019-11-29T12:51:13.378 INFO:teuthology.orchestra.run.smithi062.stderr: 25000K .......... .......... .......... .......... .......... 34% 392M 0s 2019-11-29T12:51:13.378 INFO:teuthology.orchestra.run.smithi062.stderr: 25050K .......... .......... .......... .......... .......... 34% 382M 0s 2019-11-29T12:51:13.379 INFO:teuthology.orchestra.run.smithi062.stderr: 25100K .......... .......... .......... .......... .......... 34% 368M 0s 2019-11-29T12:51:13.379 INFO:teuthology.orchestra.run.smithi062.stderr: 25150K .......... .......... .......... .......... .......... 34% 247M 0s 2019-11-29T12:51:13.379 INFO:teuthology.orchestra.run.smithi062.stderr: 25200K .......... .......... .......... .......... .......... 34% 366M 0s 2019-11-29T12:51:13.379 INFO:teuthology.orchestra.run.smithi062.stderr: 25250K .......... .......... .......... .......... .......... 34% 359M 0s 2019-11-29T12:51:13.379 INFO:teuthology.orchestra.run.smithi062.stderr: 25300K .......... .......... .......... .......... .......... 34% 290M 0s 2019-11-29T12:51:13.379 INFO:teuthology.orchestra.run.smithi062.stderr: 25350K .......... .......... .......... .......... .......... 34% 337M 0s 2019-11-29T12:51:13.379 INFO:teuthology.orchestra.run.smithi062.stderr: 25400K .......... .......... .......... .......... .......... 34% 371M 0s 2019-11-29T12:51:13.380 INFO:teuthology.orchestra.run.smithi062.stderr: 25450K .......... .......... .......... .......... .......... 34% 386M 0s 2019-11-29T12:51:13.380 INFO:teuthology.orchestra.run.smithi062.stderr: 25500K .......... .......... .......... .......... .......... 34% 404M 0s 2019-11-29T12:51:13.380 INFO:teuthology.orchestra.run.smithi062.stderr: 25550K .......... .......... .......... .......... .......... 34% 49.5M 0s 2019-11-29T12:51:13.380 INFO:teuthology.orchestra.run.smithi062.stderr: 25600K .......... .......... .......... .......... .......... 34% 282M 0s 2019-11-29T12:51:13.380 INFO:teuthology.orchestra.run.smithi062.stderr: 25650K .......... .......... .......... .......... .......... 34% 308M 0s 2019-11-29T12:51:13.380 INFO:teuthology.orchestra.run.smithi062.stderr: 25700K .......... .......... .......... .......... .......... 35% 310M 0s 2019-11-29T12:51:13.380 INFO:teuthology.orchestra.run.smithi062.stderr: 25750K .......... .......... .......... .......... .......... 35% 334M 0s 2019-11-29T12:51:13.381 INFO:teuthology.orchestra.run.smithi062.stderr: 25800K .......... .......... .......... .......... .......... 35% 323M 0s 2019-11-29T12:51:13.381 INFO:teuthology.orchestra.run.smithi062.stderr: 25850K .......... .......... .......... .......... .......... 35% 121M 0s 2019-11-29T12:51:13.381 INFO:teuthology.orchestra.run.smithi062.stderr: 25900K .......... .......... .......... .......... .......... 35% 345M 0s 2019-11-29T12:51:13.381 INFO:teuthology.orchestra.run.smithi062.stderr: 25950K .......... .......... .......... .......... .......... 35% 282M 0s 2019-11-29T12:51:13.381 INFO:teuthology.orchestra.run.smithi062.stderr: 26000K .......... .......... .......... .......... .......... 35% 115M 0s 2019-11-29T12:51:13.381 INFO:teuthology.orchestra.run.smithi062.stderr: 26050K .......... .......... .......... .......... .......... 35% 286M 0s 2019-11-29T12:51:13.381 INFO:teuthology.orchestra.run.smithi062.stderr: 26100K .......... .......... .......... .......... .......... 35% 111M 0s 2019-11-29T12:51:13.381 INFO:teuthology.orchestra.run.smithi062.stderr: 26150K .......... .......... .......... .......... .......... 35% 242M 0s 2019-11-29T12:51:13.382 INFO:teuthology.orchestra.run.smithi062.stderr: 26200K .......... .......... .......... .......... .......... 35% 404M 0s 2019-11-29T12:51:13.382 INFO:teuthology.orchestra.run.smithi062.stderr: 26250K .......... .......... .......... .......... .......... 35% 255M 0s 2019-11-29T12:51:13.382 INFO:teuthology.orchestra.run.smithi062.stderr: 26300K .......... .......... .......... .......... .......... 35% 360M 0s 2019-11-29T12:51:13.382 INFO:teuthology.orchestra.run.smithi062.stderr: 26350K .......... .......... .......... .......... .......... 35% 66.4M 0s 2019-11-29T12:51:13.382 INFO:teuthology.orchestra.run.smithi062.stderr: 26400K .......... .......... .......... .......... .......... 35% 379M 0s 2019-11-29T12:51:13.382 INFO:teuthology.orchestra.run.smithi062.stderr: 26450K .......... .......... .......... .......... .......... 36% 180M 0s 2019-11-29T12:51:13.382 INFO:teuthology.orchestra.run.smithi062.stderr: 26500K .......... .......... .......... .......... .......... 36% 327M 0s 2019-11-29T12:51:13.383 INFO:teuthology.orchestra.run.smithi062.stderr: 26550K .......... .......... .......... .......... .......... 36% 113M 0s 2019-11-29T12:51:13.383 INFO:teuthology.orchestra.run.smithi062.stderr: 26600K .......... .......... .......... .......... .......... 36% 286M 0s 2019-11-29T12:51:13.383 INFO:teuthology.orchestra.run.smithi062.stderr: 26650K .......... .......... .......... .......... .......... 36% 10.2M 0s 2019-11-29T12:51:13.383 INFO:teuthology.orchestra.run.smithi062.stderr: 26700K .......... .......... .......... .......... .......... 36% 248M 0s 2019-11-29T12:51:13.383 INFO:teuthology.orchestra.run.smithi062.stderr: 26750K .......... .......... .......... .......... .......... 36% 244M 0s 2019-11-29T12:51:13.383 INFO:teuthology.orchestra.run.smithi062.stderr: 26800K .......... .......... .......... .......... .......... 36% 353M 0s 2019-11-29T12:51:13.383 INFO:teuthology.orchestra.run.smithi062.stderr: 26850K .......... .......... .......... .......... .......... 36% 269M 0s 2019-11-29T12:51:13.383 INFO:teuthology.orchestra.run.smithi062.stderr: 26900K .......... .......... .......... .......... .......... 36% 328M 0s 2019-11-29T12:51:13.384 INFO:teuthology.orchestra.run.smithi062.stderr: 26950K .......... .......... .......... .......... .......... 36% 308M 0s 2019-11-29T12:51:13.384 INFO:teuthology.orchestra.run.smithi062.stderr: 27000K .......... .......... .......... .......... .......... 36% 278M 0s 2019-11-29T12:51:13.384 INFO:teuthology.orchestra.run.smithi062.stderr: 27050K .......... .......... .......... .......... .......... 36% 313M 0s 2019-11-29T12:51:13.384 INFO:teuthology.orchestra.run.smithi062.stderr: 27100K .......... .......... .......... .......... .......... 36% 296M 0s 2019-11-29T12:51:13.384 INFO:teuthology.orchestra.run.smithi062.stderr: 27150K .......... .......... .......... .......... .......... 36% 218M 0s 2019-11-29T12:51:13.384 INFO:teuthology.orchestra.run.smithi062.stderr: 27200K .......... .......... .......... .......... .......... 37% 244M 0s 2019-11-29T12:51:13.384 INFO:teuthology.orchestra.run.smithi062.stderr: 27250K .......... .......... .......... .......... .......... 37% 334M 0s 2019-11-29T12:51:13.385 INFO:teuthology.orchestra.run.smithi062.stderr: 27300K .......... .......... .......... .......... .......... 37% 366M 0s 2019-11-29T12:51:13.385 INFO:teuthology.orchestra.run.smithi062.stderr: 27350K .......... .......... .......... .......... .......... 37% 338M 0s 2019-11-29T12:51:13.385 INFO:teuthology.orchestra.run.smithi062.stderr: 27400K .......... .......... .......... .......... .......... 37% 379M 0s 2019-11-29T12:51:13.385 INFO:teuthology.orchestra.run.smithi062.stderr: 27450K .......... .......... .......... .......... .......... 37% 386M 0s 2019-11-29T12:51:13.385 INFO:teuthology.orchestra.run.smithi062.stderr: 27500K .......... .......... .......... .......... .......... 37% 377M 0s 2019-11-29T12:51:13.385 INFO:teuthology.orchestra.run.smithi062.stderr: 27550K .......... .......... .......... .......... .......... 37% 335M 0s 2019-11-29T12:51:13.385 INFO:teuthology.orchestra.run.smithi062.stderr: 27600K .......... .......... .......... .......... .......... 37% 407M 0s 2019-11-29T12:51:13.385 INFO:teuthology.orchestra.run.smithi062.stderr: 27650K .......... .......... .......... .......... .......... 37% 390M 0s 2019-11-29T12:51:13.386 INFO:teuthology.orchestra.run.smithi062.stderr: 27700K .......... .......... .......... .......... .......... 37% 397M 0s 2019-11-29T12:51:13.386 INFO:teuthology.orchestra.run.smithi062.stderr: 27750K .......... .......... .......... .......... .......... 37% 338M 0s 2019-11-29T12:51:13.386 INFO:teuthology.orchestra.run.smithi062.stderr: 27800K .......... .......... .......... .......... .......... 37% 17.1M 0s 2019-11-29T12:51:13.386 INFO:teuthology.orchestra.run.smithi062.stderr: 27850K .......... .......... .......... .......... .......... 37% 252M 0s 2019-11-29T12:51:13.386 INFO:teuthology.orchestra.run.smithi062.stderr: 27900K .......... .......... .......... .......... .......... 37% 278M 0s 2019-11-29T12:51:13.386 INFO:teuthology.orchestra.run.smithi062.stderr: 27950K .......... .......... .......... .......... .......... 38% 238M 0s 2019-11-29T12:51:13.386 INFO:teuthology.orchestra.run.smithi062.stderr: 28000K .......... .......... .......... .......... .......... 38% 254M 0s 2019-11-29T12:51:13.387 INFO:teuthology.orchestra.run.smithi062.stderr: 28050K .......... .......... .......... .......... .......... 38% 312M 0s 2019-11-29T12:51:13.387 INFO:teuthology.orchestra.run.smithi062.stderr: 28100K .......... .......... .......... .......... .......... 38% 284M 0s 2019-11-29T12:51:13.387 INFO:teuthology.orchestra.run.smithi062.stderr: 28150K .......... .......... .......... .......... .......... 38% 261M 0s 2019-11-29T12:51:13.387 INFO:teuthology.orchestra.run.smithi062.stderr: 28200K .......... .......... .......... .......... .......... 38% 236M 0s 2019-11-29T12:51:13.387 INFO:teuthology.orchestra.run.smithi062.stderr: 28250K .......... .......... .......... .......... .......... 38% 319M 0s 2019-11-29T12:51:13.387 INFO:teuthology.orchestra.run.smithi062.stderr: 28300K .......... .......... .......... .......... .......... 38% 284M 0s 2019-11-29T12:51:13.387 INFO:teuthology.orchestra.run.smithi062.stderr: 28350K .......... .......... .......... .......... .......... 38% 241M 0s 2019-11-29T12:51:13.388 INFO:teuthology.orchestra.run.smithi062.stderr: 28400K .......... .......... .......... .......... .......... 38% 273M 0s 2019-11-29T12:51:13.388 INFO:teuthology.orchestra.run.smithi062.stderr: 28450K .......... .......... .......... .......... .......... 38% 296M 0s 2019-11-29T12:51:13.388 INFO:teuthology.orchestra.run.smithi062.stderr: 28500K .......... .......... .......... .......... .......... 38% 299M 0s 2019-11-29T12:51:13.388 INFO:teuthology.orchestra.run.smithi062.stderr: 28550K .......... .......... .......... .......... .......... 38% 275M 0s 2019-11-29T12:51:13.388 INFO:teuthology.orchestra.run.smithi062.stderr: 28600K .......... .......... .......... .......... .......... 38% 269M 0s 2019-11-29T12:51:13.388 INFO:teuthology.orchestra.run.smithi062.stderr: 28650K .......... .......... .......... .......... .......... 39% 342M 0s 2019-11-29T12:51:13.388 INFO:teuthology.orchestra.run.smithi062.stderr: 28700K .......... .......... .......... .......... .......... 39% 346M 0s 2019-11-29T12:51:13.388 INFO:teuthology.orchestra.run.smithi062.stderr: 28750K .......... .......... .......... .......... .......... 39% 250M 0s 2019-11-29T12:51:13.389 INFO:teuthology.orchestra.run.smithi062.stderr: 28800K .......... .......... .......... .......... .......... 39% 286M 0s 2019-11-29T12:51:13.389 INFO:teuthology.orchestra.run.smithi062.stderr: 28850K .......... .......... .......... .......... .......... 39% 272M 0s 2019-11-29T12:51:13.389 INFO:teuthology.orchestra.run.smithi062.stderr: 28900K .......... .......... .......... .......... .......... 39% 379M 0s 2019-11-29T12:51:13.389 INFO:teuthology.orchestra.run.smithi062.stderr: 28950K .......... .......... .......... .......... .......... 39% 244M 0s 2019-11-29T12:51:13.389 INFO:teuthology.orchestra.run.smithi062.stderr: 29000K .......... .......... .......... .......... .......... 39% 258M 0s 2019-11-29T12:51:13.389 INFO:teuthology.orchestra.run.smithi062.stderr: 29050K .......... .......... .......... .......... .......... 39% 214M 0s 2019-11-29T12:51:13.389 INFO:teuthology.orchestra.run.smithi062.stderr: 29100K .......... .......... .......... .......... .......... 39% 262M 0s 2019-11-29T12:51:13.390 INFO:teuthology.orchestra.run.smithi062.stderr: 29150K .......... .......... .......... .......... .......... 39% 236M 0s 2019-11-29T12:51:13.390 INFO:teuthology.orchestra.run.smithi062.stderr: 29200K .......... .......... .......... .......... .......... 39% 247M 0s 2019-11-29T12:51:13.390 INFO:teuthology.orchestra.run.smithi062.stderr: 29250K .......... .......... .......... .......... .......... 39% 251M 0s 2019-11-29T12:51:13.390 INFO:teuthology.orchestra.run.smithi062.stderr: 29300K .......... .......... .......... .......... .......... 39% 327M 0s 2019-11-29T12:51:13.390 INFO:teuthology.orchestra.run.smithi062.stderr: 29350K .......... .......... .......... .......... .......... 39% 347M 0s 2019-11-29T12:51:13.390 INFO:teuthology.orchestra.run.smithi062.stderr: 29400K .......... .......... .......... .......... .......... 40% 367M 0s 2019-11-29T12:51:13.390 INFO:teuthology.orchestra.run.smithi062.stderr: 29450K .......... .......... .......... .......... .......... 40% 388M 0s 2019-11-29T12:51:13.391 INFO:teuthology.orchestra.run.smithi062.stderr: 29500K .......... .......... .......... .......... .......... 40% 403M 0s 2019-11-29T12:51:13.391 INFO:teuthology.orchestra.run.smithi062.stderr: 29550K .......... .......... .......... .......... .......... 40% 319M 0s 2019-11-29T12:51:13.391 INFO:teuthology.orchestra.run.smithi062.stderr: 29600K .......... .......... .......... .......... .......... 40% 376M 0s 2019-11-29T12:51:13.391 INFO:teuthology.orchestra.run.smithi062.stderr: 29650K .......... .......... .......... .......... .......... 40% 374M 0s 2019-11-29T12:51:13.391 INFO:teuthology.orchestra.run.smithi062.stderr: 29700K .......... .......... .......... .......... .......... 40% 388M 0s 2019-11-29T12:51:13.391 INFO:teuthology.orchestra.run.smithi062.stderr: 29750K .......... .......... .......... .......... .......... 40% 329M 0s 2019-11-29T12:51:13.391 INFO:teuthology.orchestra.run.smithi062.stderr: 29800K .......... .......... .......... .......... .......... 40% 357M 0s 2019-11-29T12:51:13.392 INFO:teuthology.orchestra.run.smithi062.stderr: 29850K .......... .......... .......... .......... .......... 40% 356M 0s 2019-11-29T12:51:13.392 INFO:teuthology.orchestra.run.smithi062.stderr: 29900K .......... .......... .......... .......... .......... 40% 340M 0s 2019-11-29T12:51:13.392 INFO:teuthology.orchestra.run.smithi062.stderr: 29950K .......... .......... .......... .......... .......... 40% 293M 0s 2019-11-29T12:51:13.392 INFO:teuthology.orchestra.run.smithi062.stderr: 30000K .......... .......... .......... .......... .......... 40% 366M 0s 2019-11-29T12:51:13.392 INFO:teuthology.orchestra.run.smithi062.stderr: 30050K .......... .......... .......... .......... .......... 40% 296M 0s 2019-11-29T12:51:13.392 INFO:teuthology.orchestra.run.smithi062.stderr: 30100K .......... .......... .......... .......... .......... 40% 234M 0s 2019-11-29T12:51:13.393 INFO:teuthology.orchestra.run.smithi062.stderr: 30150K .......... .......... .......... .......... .......... 41% 210M 0s 2019-11-29T12:51:13.393 INFO:teuthology.orchestra.run.smithi062.stderr: 30200K .......... .......... .......... .......... .......... 41% 229M 0s 2019-11-29T12:51:13.393 INFO:teuthology.orchestra.run.smithi062.stderr: 30250K .......... .......... .......... .......... .......... 41% 256M 0s 2019-11-29T12:51:13.393 INFO:teuthology.orchestra.run.smithi062.stderr: 30300K .......... .......... .......... .......... .......... 41% 250M 0s 2019-11-29T12:51:13.393 INFO:teuthology.orchestra.run.smithi062.stderr: 30350K .......... .......... .......... .......... .......... 41% 205M 0s 2019-11-29T12:51:13.393 INFO:teuthology.orchestra.run.smithi062.stderr: 30400K .......... .......... .......... .......... .......... 41% 326M 0s 2019-11-29T12:51:13.393 INFO:teuthology.orchestra.run.smithi062.stderr: 30450K .......... .......... .......... .......... .......... 41% 350M 0s 2019-11-29T12:51:13.394 INFO:teuthology.orchestra.run.smithi062.stderr: 30500K .......... .......... .......... .......... .......... 41% 277M 0s 2019-11-29T12:51:13.394 INFO:teuthology.orchestra.run.smithi062.stderr: 30550K .......... .......... .......... .......... .......... 41% 293M 0s 2019-11-29T12:51:13.394 INFO:teuthology.orchestra.run.smithi062.stderr: 30600K .......... .......... .......... .......... .......... 41% 308M 0s 2019-11-29T12:51:13.394 INFO:teuthology.orchestra.run.smithi062.stderr: 30650K .......... .......... .......... .......... .......... 41% 408M 0s 2019-11-29T12:51:13.394 INFO:teuthology.orchestra.run.smithi062.stderr: 30700K .......... .......... .......... .......... .......... 41% 341M 0s 2019-11-29T12:51:13.394 INFO:teuthology.orchestra.run.smithi062.stderr: 30750K .......... .......... .......... .......... .......... 41% 282M 0s 2019-11-29T12:51:13.394 INFO:teuthology.orchestra.run.smithi062.stderr: 30800K .......... .......... .......... .......... .......... 41% 266M 0s 2019-11-29T12:51:13.394 INFO:teuthology.orchestra.run.smithi062.stderr: 30850K .......... .......... .......... .......... .......... 42% 343M 0s 2019-11-29T12:51:13.395 INFO:teuthology.orchestra.run.smithi062.stderr: 30900K .......... .......... .......... .......... .......... 42% 367M 0s 2019-11-29T12:51:13.395 INFO:teuthology.orchestra.run.smithi062.stderr: 30950K .......... .......... .......... .......... .......... 42% 308M 0s 2019-11-29T12:51:13.395 INFO:teuthology.orchestra.run.smithi062.stderr: 31000K .......... .......... .......... .......... .......... 42% 319M 0s 2019-11-29T12:51:13.395 INFO:teuthology.orchestra.run.smithi062.stderr: 31050K .......... .......... .......... .......... .......... 42% 326M 0s 2019-11-29T12:51:13.395 INFO:teuthology.orchestra.run.smithi062.stderr: 31100K .......... .......... .......... .......... .......... 42% 295M 0s 2019-11-29T12:51:13.395 INFO:teuthology.orchestra.run.smithi062.stderr: 31150K .......... .......... .......... .......... .......... 42% 248M 0s 2019-11-29T12:51:13.395 INFO:teuthology.orchestra.run.smithi062.stderr: 31200K .......... .......... .......... .......... .......... 42% 315M 0s 2019-11-29T12:51:13.396 INFO:teuthology.orchestra.run.smithi062.stderr: 31250K .......... .......... .......... .......... .......... 42% 373M 0s 2019-11-29T12:51:13.396 INFO:teuthology.orchestra.run.smithi062.stderr: 31300K .......... .......... .......... .......... .......... 42% 290M 0s 2019-11-29T12:51:13.396 INFO:teuthology.orchestra.run.smithi062.stderr: 31350K .......... .......... .......... .......... .......... 42% 217M 0s 2019-11-29T12:51:13.396 INFO:teuthology.orchestra.run.smithi062.stderr: 31400K .......... .......... .......... .......... .......... 42% 268M 0s 2019-11-29T12:51:13.396 INFO:teuthology.orchestra.run.smithi062.stderr: 31450K .......... .......... .......... .......... .......... 42% 270M 0s 2019-11-29T12:51:13.396 INFO:teuthology.orchestra.run.smithi062.stderr: 31500K .......... .......... .......... .......... .......... 42% 305M 0s 2019-11-29T12:51:13.396 INFO:teuthology.orchestra.run.smithi062.stderr: 31550K .......... .......... .......... .......... .......... 42% 221M 0s 2019-11-29T12:51:13.396 INFO:teuthology.orchestra.run.smithi062.stderr: 31600K .......... .......... .......... .......... .......... 43% 367M 0s 2019-11-29T12:51:13.397 INFO:teuthology.orchestra.run.smithi062.stderr: 31650K .......... .......... .......... .......... .......... 43% 282M 0s 2019-11-29T12:51:13.397 INFO:teuthology.orchestra.run.smithi062.stderr: 31700K .......... .......... .......... .......... .......... 43% 290M 0s 2019-11-29T12:51:13.397 INFO:teuthology.orchestra.run.smithi062.stderr: 31750K .......... .......... .......... .......... .......... 43% 323M 0s 2019-11-29T12:51:13.397 INFO:teuthology.orchestra.run.smithi062.stderr: 31800K .......... .......... .......... .......... .......... 43% 377M 0s 2019-11-29T12:51:13.397 INFO:teuthology.orchestra.run.smithi062.stderr: 31850K .......... .......... .......... .......... .......... 43% 398M 0s 2019-11-29T12:51:13.397 INFO:teuthology.orchestra.run.smithi062.stderr: 31900K .......... .......... .......... .......... .......... 43% 377M 0s 2019-11-29T12:51:13.397 INFO:teuthology.orchestra.run.smithi062.stderr: 31950K .......... .......... .......... .......... .......... 43% 311M 0s 2019-11-29T12:51:13.398 INFO:teuthology.orchestra.run.smithi062.stderr: 32000K .......... .......... .......... .......... .......... 43% 390M 0s 2019-11-29T12:51:13.398 INFO:teuthology.orchestra.run.smithi062.stderr: 32050K .......... .......... .......... .......... .......... 43% 355M 0s 2019-11-29T12:51:13.398 INFO:teuthology.orchestra.run.smithi062.stderr: 32100K .......... .......... .......... .......... .......... 43% 379M 0s 2019-11-29T12:51:13.398 INFO:teuthology.orchestra.run.smithi062.stderr: 32150K .......... .......... .......... .......... .......... 43% 336M 0s 2019-11-29T12:51:13.398 INFO:teuthology.orchestra.run.smithi062.stderr: 32200K .......... .......... .......... .......... .......... 43% 388M 0s 2019-11-29T12:51:13.398 INFO:teuthology.orchestra.run.smithi062.stderr: 32250K .......... .......... .......... .......... .......... 43% 388M 0s 2019-11-29T12:51:13.398 INFO:teuthology.orchestra.run.smithi062.stderr: 32300K .......... .......... .......... .......... .......... 43% 396M 0s 2019-11-29T12:51:13.399 INFO:teuthology.orchestra.run.smithi062.stderr: 32350K .......... .......... .......... .......... .......... 44% 323M 0s 2019-11-29T12:51:13.399 INFO:teuthology.orchestra.run.smithi062.stderr: 32400K .......... .......... .......... .......... .......... 44% 340M 0s 2019-11-29T12:51:13.399 INFO:teuthology.orchestra.run.smithi062.stderr: 32450K .......... .......... .......... .......... .......... 44% 273M 0s 2019-11-29T12:51:13.399 INFO:teuthology.orchestra.run.smithi062.stderr: 32500K .......... .......... .......... .......... .......... 44% 241M 0s 2019-11-29T12:51:13.399 INFO:teuthology.orchestra.run.smithi062.stderr: 32550K .......... .......... .......... .......... .......... 44% 235M 0s 2019-11-29T12:51:13.399 INFO:teuthology.orchestra.run.smithi062.stderr: 32600K .......... .......... .......... .......... .......... 44% 269M 0s 2019-11-29T12:51:13.399 INFO:teuthology.orchestra.run.smithi062.stderr: 32650K .......... .......... .......... .......... .......... 44% 250M 0s 2019-11-29T12:51:13.400 INFO:teuthology.orchestra.run.smithi062.stderr: 32700K .......... .......... .......... .......... .......... 44% 306M 0s 2019-11-29T12:51:13.400 INFO:teuthology.orchestra.run.smithi062.stderr: 32750K .......... .......... .......... .......... .......... 44% 227M 0s 2019-11-29T12:51:13.400 INFO:teuthology.orchestra.run.smithi062.stderr: 32800K .......... .......... .......... .......... .......... 44% 292M 0s 2019-11-29T12:51:13.400 INFO:teuthology.orchestra.run.smithi062.stderr: 32850K .......... .......... .......... .......... .......... 44% 284M 0s 2019-11-29T12:51:13.400 INFO:teuthology.orchestra.run.smithi062.stderr: 32900K .......... .......... .......... .......... .......... 44% 260M 0s 2019-11-29T12:51:13.400 INFO:teuthology.orchestra.run.smithi062.stderr: 32950K .......... .......... .......... .......... .......... 44% 228M 0s 2019-11-29T12:51:13.400 INFO:teuthology.orchestra.run.smithi062.stderr: 33000K .......... .......... .......... .......... .......... 44% 286M 0s 2019-11-29T12:51:13.401 INFO:teuthology.orchestra.run.smithi062.stderr: 33050K .......... .......... .......... .......... .......... 44% 308M 0s 2019-11-29T12:51:13.401 INFO:teuthology.orchestra.run.smithi062.stderr: 33100K .......... .......... .......... .......... .......... 45% 281M 0s 2019-11-29T12:51:13.401 INFO:teuthology.orchestra.run.smithi062.stderr: 33150K .......... .......... .......... .......... .......... 45% 220M 0s 2019-11-29T12:51:13.401 INFO:teuthology.orchestra.run.smithi062.stderr: 33200K .......... .......... .......... .......... .......... 45% 307M 0s 2019-11-29T12:51:13.401 INFO:teuthology.orchestra.run.smithi062.stderr: 33250K .......... .......... .......... .......... .......... 45% 291M 0s 2019-11-29T12:51:13.401 INFO:teuthology.orchestra.run.smithi062.stderr: 33300K .......... .......... .......... .......... .......... 45% 296M 0s 2019-11-29T12:51:13.402 INFO:teuthology.orchestra.run.smithi062.stderr: 33350K .......... .......... .......... .......... .......... 45% 292M 0s 2019-11-29T12:51:13.402 INFO:teuthology.orchestra.run.smithi062.stderr: 33400K .......... .......... .......... .......... .......... 45% 321M 0s 2019-11-29T12:51:13.402 INFO:teuthology.orchestra.run.smithi062.stderr: 33450K .......... .......... .......... .......... .......... 45% 383M 0s 2019-11-29T12:51:13.402 INFO:teuthology.orchestra.run.smithi062.stderr: 33500K .......... .......... .......... .......... .......... 45% 307M 0s 2019-11-29T12:51:13.402 INFO:teuthology.orchestra.run.smithi062.stderr: 33550K .......... .......... .......... .......... .......... 45% 304M 0s 2019-11-29T12:51:13.402 INFO:teuthology.orchestra.run.smithi062.stderr: 33600K .......... .......... .......... .......... .......... 45% 334M 0s 2019-11-29T12:51:13.403 INFO:teuthology.orchestra.run.smithi062.stderr: 33650K .......... .......... .......... .......... .......... 45% 280M 0s 2019-11-29T12:51:13.403 INFO:teuthology.orchestra.run.smithi062.stderr: 33700K .......... .......... .......... .......... .......... 45% 291M 0s 2019-11-29T12:51:13.403 INFO:teuthology.orchestra.run.smithi062.stderr: 33750K .......... .......... .......... .......... .......... 45% 284M 0s 2019-11-29T12:51:13.403 INFO:teuthology.orchestra.run.smithi062.stderr: 33800K .......... .......... .......... .......... .......... 46% 347M 0s 2019-11-29T12:51:13.403 INFO:teuthology.orchestra.run.smithi062.stderr: 33850K .......... .......... .......... .......... .......... 46% 291M 0s 2019-11-29T12:51:13.403 INFO:teuthology.orchestra.run.smithi062.stderr: 33900K .......... .......... .......... .......... .......... 46% 358M 0s 2019-11-29T12:51:13.404 INFO:teuthology.orchestra.run.smithi062.stderr: 33950K .......... .......... .......... .......... .......... 46% 209M 0s 2019-11-29T12:51:13.404 INFO:teuthology.orchestra.run.smithi062.stderr: 34000K .......... .......... .......... .......... .......... 46% 336M 0s 2019-11-29T12:51:13.404 INFO:teuthology.orchestra.run.smithi062.stderr: 34050K .......... .......... .......... .......... .......... 46% 293M 0s 2019-11-29T12:51:13.404 INFO:teuthology.orchestra.run.smithi062.stderr: 34100K .......... .......... .......... .......... .......... 46% 355M 0s 2019-11-29T12:51:13.404 INFO:teuthology.orchestra.run.smithi062.stderr: 34150K .......... .......... .......... .......... .......... 46% 256M 0s 2019-11-29T12:51:13.404 INFO:teuthology.orchestra.run.smithi062.stderr: 34200K .......... .......... .......... .......... .......... 46% 368M 0s 2019-11-29T12:51:13.405 INFO:teuthology.orchestra.run.smithi062.stderr: 34250K .......... .......... .......... .......... .......... 46% 362M 0s 2019-11-29T12:51:13.405 INFO:teuthology.orchestra.run.smithi062.stderr: 34300K .......... .......... .......... .......... .......... 46% 383M 0s 2019-11-29T12:51:13.405 INFO:teuthology.orchestra.run.smithi062.stderr: 34350K .......... .......... .......... .......... .......... 46% 307M 0s 2019-11-29T12:51:13.405 INFO:teuthology.orchestra.run.smithi062.stderr: 34400K .......... .......... .......... .......... .......... 46% 360M 0s 2019-11-29T12:51:13.405 INFO:teuthology.orchestra.run.smithi062.stderr: 34450K .......... .......... .......... .......... .......... 46% 376M 0s 2019-11-29T12:51:13.405 INFO:teuthology.orchestra.run.smithi062.stderr: 34500K .......... .......... .......... .......... .......... 46% 366M 0s 2019-11-29T12:51:13.405 INFO:teuthology.orchestra.run.smithi062.stderr: 34550K .......... .......... .......... .......... .......... 47% 330M 0s 2019-11-29T12:51:13.406 INFO:teuthology.orchestra.run.smithi062.stderr: 34600K .......... .......... .......... .......... .......... 47% 377M 0s 2019-11-29T12:51:13.406 INFO:teuthology.orchestra.run.smithi062.stderr: 34650K .......... .......... .......... .......... .......... 47% 388M 0s 2019-11-29T12:51:13.406 INFO:teuthology.orchestra.run.smithi062.stderr: 34700K .......... .......... .......... .......... .......... 47% 376M 0s 2019-11-29T12:51:13.406 INFO:teuthology.orchestra.run.smithi062.stderr: 34750K .......... .......... .......... .......... .......... 47% 299M 0s 2019-11-29T12:51:13.406 INFO:teuthology.orchestra.run.smithi062.stderr: 34800K .......... .......... .......... .......... .......... 47% 314M 0s 2019-11-29T12:51:13.406 INFO:teuthology.orchestra.run.smithi062.stderr: 34850K .......... .......... .......... .......... .......... 47% 200M 0s 2019-11-29T12:51:13.406 INFO:teuthology.orchestra.run.smithi062.stderr: 34900K .......... .......... .......... .......... .......... 47% 275M 0s 2019-11-29T12:51:13.406 INFO:teuthology.orchestra.run.smithi062.stderr: 34950K .......... .......... .......... .......... .......... 47% 237M 0s 2019-11-29T12:51:13.407 INFO:teuthology.orchestra.run.smithi062.stderr: 35000K .......... .......... .......... .......... .......... 47% 247M 0s 2019-11-29T12:51:13.407 INFO:teuthology.orchestra.run.smithi062.stderr: 35050K .......... .......... .......... .......... .......... 47% 286M 0s 2019-11-29T12:51:13.407 INFO:teuthology.orchestra.run.smithi062.stderr: 35100K .......... .......... .......... .......... .......... 47% 292M 0s 2019-11-29T12:51:13.407 INFO:teuthology.orchestra.run.smithi062.stderr: 35150K .......... .......... .......... .......... .......... 47% 240M 0s 2019-11-29T12:51:13.407 INFO:teuthology.orchestra.run.smithi062.stderr: 35200K .......... .......... .......... .......... .......... 47% 290M 0s 2019-11-29T12:51:13.407 INFO:teuthology.orchestra.run.smithi062.stderr: 35250K .......... .......... .......... .......... .......... 47% 263M 0s 2019-11-29T12:51:13.407 INFO:teuthology.orchestra.run.smithi062.stderr: 35300K .......... .......... .......... .......... .......... 48% 325M 0s 2019-11-29T12:51:13.408 INFO:teuthology.orchestra.run.smithi062.stderr: 35350K .......... .......... .......... .......... .......... 48% 220M 0s 2019-11-29T12:51:13.408 INFO:teuthology.orchestra.run.smithi062.stderr: 35400K .......... .......... .......... .......... .......... 48% 326M 0s 2019-11-29T12:51:13.408 INFO:teuthology.orchestra.run.smithi062.stderr: 35450K .......... .......... .......... .......... .......... 48% 276M 0s 2019-11-29T12:51:13.408 INFO:teuthology.orchestra.run.smithi062.stderr: 35500K .......... .......... .......... .......... .......... 48% 306M 0s 2019-11-29T12:51:13.408 INFO:teuthology.orchestra.run.smithi062.stderr: 35550K .......... .......... .......... .......... .......... 48% 272M 0s 2019-11-29T12:51:13.408 INFO:teuthology.orchestra.run.smithi062.stderr: 35600K .......... .......... .......... .......... .......... 48% 328M 0s 2019-11-29T12:51:13.408 INFO:teuthology.orchestra.run.smithi062.stderr: 35650K .......... .......... .......... .......... .......... 48% 316M 0s 2019-11-29T12:51:13.408 INFO:teuthology.orchestra.run.smithi062.stderr: 35700K .......... .......... .......... .......... .......... 48% 281M 0s 2019-11-29T12:51:13.409 INFO:teuthology.orchestra.run.smithi062.stderr: 35750K .......... .......... .......... .......... .......... 48% 251M 0s 2019-11-29T12:51:13.409 INFO:teuthology.orchestra.run.smithi062.stderr: 35800K .......... .......... .......... .......... .......... 48% 285M 0s 2019-11-29T12:51:13.409 INFO:teuthology.orchestra.run.smithi062.stderr: 35850K .......... .......... .......... .......... .......... 48% 341M 0s 2019-11-29T12:51:13.409 INFO:teuthology.orchestra.run.smithi062.stderr: 35900K .......... .......... .......... .......... .......... 48% 394M 0s 2019-11-29T12:51:13.409 INFO:teuthology.orchestra.run.smithi062.stderr: 35950K .......... .......... .......... .......... .......... 48% 243M 0s 2019-11-29T12:51:13.409 INFO:teuthology.orchestra.run.smithi062.stderr: 36000K .......... .......... .......... .......... .......... 49% 240M 0s 2019-11-29T12:51:13.409 INFO:teuthology.orchestra.run.smithi062.stderr: 36050K .......... .......... .......... .......... .......... 49% 297M 0s 2019-11-29T12:51:13.410 INFO:teuthology.orchestra.run.smithi062.stderr: 36100K .......... .......... .......... .......... .......... 49% 329M 0s 2019-11-29T12:51:13.410 INFO:teuthology.orchestra.run.smithi062.stderr: 36150K .......... .......... .......... .......... .......... 49% 217M 0s 2019-11-29T12:51:13.410 INFO:teuthology.orchestra.run.smithi062.stderr: 36200K .......... .......... .......... .......... .......... 49% 296M 0s 2019-11-29T12:51:13.410 INFO:teuthology.orchestra.run.smithi062.stderr: 36250K .......... .......... .......... .......... .......... 49% 216M 0s 2019-11-29T12:51:13.410 INFO:teuthology.orchestra.run.smithi062.stderr: 36300K .......... .......... .......... .......... .......... 49% 326M 0s 2019-11-29T12:51:13.410 INFO:teuthology.orchestra.run.smithi062.stderr: 36350K .......... .......... .......... .......... .......... 49% 319M 0s 2019-11-29T12:51:13.410 INFO:teuthology.orchestra.run.smithi062.stderr: 36400K .......... .......... .......... .......... .......... 49% 291M 0s 2019-11-29T12:51:13.410 INFO:teuthology.orchestra.run.smithi062.stderr: 36450K .......... .......... .......... .......... .......... 49% 263M 0s 2019-11-29T12:51:13.411 INFO:teuthology.orchestra.run.smithi062.stderr: 36500K .......... .......... .......... .......... .......... 49% 365M 0s 2019-11-29T12:51:13.411 INFO:teuthology.orchestra.run.smithi062.stderr: 36550K .......... .......... .......... .......... .......... 49% 318M 0s 2019-11-29T12:51:13.411 INFO:teuthology.orchestra.run.smithi062.stderr: 36600K .......... .......... .......... .......... .......... 49% 381M 0s 2019-11-29T12:51:13.411 INFO:teuthology.orchestra.run.smithi062.stderr: 36650K .......... .......... .......... .......... .......... 49% 374M 0s 2019-11-29T12:51:13.411 INFO:teuthology.orchestra.run.smithi062.stderr: 36700K .......... .......... .......... .......... .......... 49% 357M 0s 2019-11-29T12:51:13.411 INFO:teuthology.orchestra.run.smithi062.stderr: 36750K .......... .......... .......... .......... .......... 50% 307M 0s 2019-11-29T12:51:13.411 INFO:teuthology.orchestra.run.smithi062.stderr: 36800K .......... .......... .......... .......... .......... 50% 379M 0s 2019-11-29T12:51:13.412 INFO:teuthology.orchestra.run.smithi062.stderr: 36850K .......... .......... .......... .......... .......... 50% 382M 0s 2019-11-29T12:51:13.412 INFO:teuthology.orchestra.run.smithi062.stderr: 36900K .......... .......... .......... .......... .......... 50% 387M 0s 2019-11-29T12:51:13.412 INFO:teuthology.orchestra.run.smithi062.stderr: 36950K .......... .......... .......... .......... .......... 50% 321M 0s 2019-11-29T12:51:13.412 INFO:teuthology.orchestra.run.smithi062.stderr: 37000K .......... .......... .......... .......... .......... 50% 372M 0s 2019-11-29T12:51:13.412 INFO:teuthology.orchestra.run.smithi062.stderr: 37050K .......... .......... .......... .......... .......... 50% 299M 0s 2019-11-29T12:51:13.412 INFO:teuthology.orchestra.run.smithi062.stderr: 37100K .......... .......... .......... .......... .......... 50% 246M 0s 2019-11-29T12:51:13.412 INFO:teuthology.orchestra.run.smithi062.stderr: 37150K .......... .......... .......... .......... .......... 50% 244M 0s 2019-11-29T12:51:13.412 INFO:teuthology.orchestra.run.smithi062.stderr: 37200K .......... .......... .......... .......... .......... 50% 262M 0s 2019-11-29T12:51:13.413 INFO:teuthology.orchestra.run.smithi062.stderr: 37250K .......... .......... .......... .......... .......... 50% 255M 0s 2019-11-29T12:51:13.413 INFO:teuthology.orchestra.run.smithi062.stderr: 37300K .......... .......... .......... .......... .......... 50% 304M 0s 2019-11-29T12:51:13.413 INFO:teuthology.orchestra.run.smithi062.stderr: 37350K .......... .......... .......... .......... .......... 50% 241M 0s 2019-11-29T12:51:13.413 INFO:teuthology.orchestra.run.smithi062.stderr: 37400K .......... .......... .......... .......... .......... 50% 274M 0s 2019-11-29T12:51:13.413 INFO:teuthology.orchestra.run.smithi062.stderr: 37450K .......... .......... .......... .......... .......... 50% 285M 0s 2019-11-29T12:51:13.413 INFO:teuthology.orchestra.run.smithi062.stderr: 37500K .......... .......... .......... .......... .......... 51% 265M 0s 2019-11-29T12:51:13.413 INFO:teuthology.orchestra.run.smithi062.stderr: 37550K .......... .......... .......... .......... .......... 51% 268M 0s 2019-11-29T12:51:13.414 INFO:teuthology.orchestra.run.smithi062.stderr: 37600K .......... .......... .......... .......... .......... 51% 314M 0s 2019-11-29T12:51:13.414 INFO:teuthology.orchestra.run.smithi062.stderr: 37650K .......... .......... .......... .......... .......... 51% 334M 0s 2019-11-29T12:51:13.414 INFO:teuthology.orchestra.run.smithi062.stderr: 37700K .......... .......... .......... .......... .......... 51% 229M 0s 2019-11-29T12:51:13.414 INFO:teuthology.orchestra.run.smithi062.stderr: 37750K .......... .......... .......... .......... .......... 51% 258M 0s 2019-11-29T12:51:13.414 INFO:teuthology.orchestra.run.smithi062.stderr: 37800K .......... .......... .......... .......... .......... 51% 275M 0s 2019-11-29T12:51:13.414 INFO:teuthology.orchestra.run.smithi062.stderr: 37850K .......... .......... .......... .......... .......... 51% 348M 0s 2019-11-29T12:51:13.414 INFO:teuthology.orchestra.run.smithi062.stderr: 37900K .......... .......... .......... .......... .......... 51% 319M 0s 2019-11-29T12:51:13.415 INFO:teuthology.orchestra.run.smithi062.stderr: 37950K .......... .......... .......... .......... .......... 51% 277M 0s 2019-11-29T12:51:13.415 INFO:teuthology.orchestra.run.smithi062.stderr: 38000K .......... .......... .......... .......... .......... 51% 354M 0s 2019-11-29T12:51:13.415 INFO:teuthology.orchestra.run.smithi062.stderr: 38050K .......... .......... .......... .......... .......... 51% 302M 0s 2019-11-29T12:51:13.415 INFO:teuthology.orchestra.run.smithi062.stderr: 38100K .......... .......... .......... .......... .......... 51% 289M 0s 2019-11-29T12:51:13.415 INFO:teuthology.orchestra.run.smithi062.stderr: 38150K .......... .......... .......... .......... .......... 51% 328M 0s 2019-11-29T12:51:13.415 INFO:teuthology.orchestra.run.smithi062.stderr: 38200K .......... .......... .......... .......... .......... 51% 366M 0s 2019-11-29T12:51:13.415 INFO:teuthology.orchestra.run.smithi062.stderr: 38250K .......... .......... .......... .......... .......... 52% 314M 0s 2019-11-29T12:51:13.416 INFO:teuthology.orchestra.run.smithi062.stderr: 38300K .......... .......... .......... .......... .......... 52% 260M 0s 2019-11-29T12:51:13.416 INFO:teuthology.orchestra.run.smithi062.stderr: 38350K .......... .......... .......... .......... .......... 52% 244M 0s 2019-11-29T12:51:13.416 INFO:teuthology.orchestra.run.smithi062.stderr: 38400K .......... .......... .......... .......... .......... 52% 327M 0s 2019-11-29T12:51:13.416 INFO:teuthology.orchestra.run.smithi062.stderr: 38450K .......... .......... .......... .......... .......... 52% 269M 0s 2019-11-29T12:51:13.416 INFO:teuthology.orchestra.run.smithi062.stderr: 38500K .......... .......... .......... .......... .......... 52% 238M 0s 2019-11-29T12:51:13.416 INFO:teuthology.orchestra.run.smithi062.stderr: 38550K .......... .......... .......... .......... .......... 52% 290M 0s 2019-11-29T12:51:13.417 INFO:teuthology.orchestra.run.smithi062.stderr: 38600K .......... .......... .......... .......... .......... 52% 351M 0s 2019-11-29T12:51:13.417 INFO:teuthology.orchestra.run.smithi062.stderr: 38650K .......... .......... .......... .......... .......... 52% 328M 0s 2019-11-29T12:51:13.417 INFO:teuthology.orchestra.run.smithi062.stderr: 38700K .......... .......... .......... .......... .......... 52% 227M 0s 2019-11-29T12:51:13.417 INFO:teuthology.orchestra.run.smithi062.stderr: 38750K .......... .......... .......... .......... .......... 52% 233M 0s 2019-11-29T12:51:13.417 INFO:teuthology.orchestra.run.smithi062.stderr: 38800K .......... .......... .......... .......... .......... 52% 354M 0s 2019-11-29T12:51:13.417 INFO:teuthology.orchestra.run.smithi062.stderr: 38850K .......... .......... .......... .......... .......... 52% 364M 0s 2019-11-29T12:51:13.417 INFO:teuthology.orchestra.run.smithi062.stderr: 38900K .......... .......... .......... .......... .......... 52% 380M 0s 2019-11-29T12:51:13.418 INFO:teuthology.orchestra.run.smithi062.stderr: 38950K .......... .......... .......... .......... .......... 53% 338M 0s 2019-11-29T12:51:13.418 INFO:teuthology.orchestra.run.smithi062.stderr: 39000K .......... .......... .......... .......... .......... 53% 331M 0s 2019-11-29T12:51:13.418 INFO:teuthology.orchestra.run.smithi062.stderr: 39050K .......... .......... .......... .......... .......... 53% 349M 0s 2019-11-29T12:51:13.418 INFO:teuthology.orchestra.run.smithi062.stderr: 39100K .......... .......... .......... .......... .......... 53% 365M 0s 2019-11-29T12:51:13.418 INFO:teuthology.orchestra.run.smithi062.stderr: 39150K .......... .......... .......... .......... .......... 53% 329M 0s 2019-11-29T12:51:13.418 INFO:teuthology.orchestra.run.smithi062.stderr: 39200K .......... .......... .......... .......... .......... 53% 360M 0s 2019-11-29T12:51:13.418 INFO:teuthology.orchestra.run.smithi062.stderr: 39250K .......... .......... .......... .......... .......... 53% 382M 0s 2019-11-29T12:51:13.419 INFO:teuthology.orchestra.run.smithi062.stderr: 39300K .......... .......... .......... .......... .......... 53% 386M 0s 2019-11-29T12:51:13.419 INFO:teuthology.orchestra.run.smithi062.stderr: 39350K .......... .......... .......... .......... .......... 53% 307M 0s 2019-11-29T12:51:13.419 INFO:teuthology.orchestra.run.smithi062.stderr: 39400K .......... .......... .......... .......... .......... 53% 269M 0s 2019-11-29T12:51:13.419 INFO:teuthology.orchestra.run.smithi062.stderr: 39450K .......... .......... .......... .......... .......... 53% 301M 0s 2019-11-29T12:51:13.419 INFO:teuthology.orchestra.run.smithi062.stderr: 39500K .......... .......... .......... .......... .......... 53% 261M 0s 2019-11-29T12:51:13.419 INFO:teuthology.orchestra.run.smithi062.stderr: 39550K .......... .......... .......... .......... .......... 53% 226M 0s 2019-11-29T12:51:13.419 INFO:teuthology.orchestra.run.smithi062.stderr: 39600K .......... .......... .......... .......... .......... 53% 280M 0s 2019-11-29T12:51:13.420 INFO:teuthology.orchestra.run.smithi062.stderr: 39650K .......... .......... .......... .......... .......... 53% 292M 0s 2019-11-29T12:51:13.420 INFO:teuthology.orchestra.run.smithi062.stderr: 39700K .......... .......... .......... .......... .......... 54% 214M 0s 2019-11-29T12:51:13.420 INFO:teuthology.orchestra.run.smithi062.stderr: 39750K .......... .......... .......... .......... .......... 54% 201M 0s 2019-11-29T12:51:13.420 INFO:teuthology.orchestra.run.smithi062.stderr: 39800K .......... .......... .......... .......... .......... 54% 289M 0s 2019-11-29T12:51:13.420 INFO:teuthology.orchestra.run.smithi062.stderr: 39850K .......... .......... .......... .......... .......... 54% 341M 0s 2019-11-29T12:51:13.420 INFO:teuthology.orchestra.run.smithi062.stderr: 39900K .......... .......... .......... .......... .......... 54% 212M 0s 2019-11-29T12:51:13.420 INFO:teuthology.orchestra.run.smithi062.stderr: 39950K .......... .......... .......... .......... .......... 54% 251M 0s 2019-11-29T12:51:13.420 INFO:teuthology.orchestra.run.smithi062.stderr: 40000K .......... .......... .......... .......... .......... 54% 354M 0s 2019-11-29T12:51:13.421 INFO:teuthology.orchestra.run.smithi062.stderr: 40050K .......... .......... .......... .......... .......... 54% 353M 0s 2019-11-29T12:51:13.421 INFO:teuthology.orchestra.run.smithi062.stderr: 40100K .......... .......... .......... .......... .......... 54% 324M 0s 2019-11-29T12:51:13.421 INFO:teuthology.orchestra.run.smithi062.stderr: 40150K .......... .......... .......... .......... .......... 54% 365M 0s 2019-11-29T12:51:13.421 INFO:teuthology.orchestra.run.smithi062.stderr: 40200K .......... .......... .......... .......... .......... 54% 381M 0s 2019-11-29T12:51:13.421 INFO:teuthology.orchestra.run.smithi062.stderr: 40250K .......... .......... .......... .......... .......... 54% 324M 0s 2019-11-29T12:51:13.421 INFO:teuthology.orchestra.run.smithi062.stderr: 40300K .......... .......... .......... .......... .......... 54% 422M 0s 2019-11-29T12:51:13.421 INFO:teuthology.orchestra.run.smithi062.stderr: 40350K .......... .......... .......... .......... .......... 54% 274M 0s 2019-11-29T12:51:13.422 INFO:teuthology.orchestra.run.smithi062.stderr: 40400K .......... .......... .......... .......... .......... 54% 289M 0s 2019-11-29T12:51:13.422 INFO:teuthology.orchestra.run.smithi062.stderr: 40450K .......... .......... .......... .......... .......... 55% 340M 0s 2019-11-29T12:51:13.422 INFO:teuthology.orchestra.run.smithi062.stderr: 40500K .......... .......... .......... .......... .......... 55% 421M 0s 2019-11-29T12:51:13.422 INFO:teuthology.orchestra.run.smithi062.stderr: 40550K .......... .......... .......... .......... .......... 55% 317M 0s 2019-11-29T12:51:13.422 INFO:teuthology.orchestra.run.smithi062.stderr: 40600K .......... .......... .......... .......... .......... 55% 346M 0s 2019-11-29T12:51:13.422 INFO:teuthology.orchestra.run.smithi062.stderr: 40650K .......... .......... .......... .......... .......... 55% 312M 0s 2019-11-29T12:51:13.422 INFO:teuthology.orchestra.run.smithi062.stderr: 40700K .......... .......... .......... .......... .......... 55% 354M 0s 2019-11-29T12:51:13.422 INFO:teuthology.orchestra.run.smithi062.stderr: 40750K .......... .......... .......... .......... .......... 55% 313M 0s 2019-11-29T12:51:13.423 INFO:teuthology.orchestra.run.smithi062.stderr: 40800K .......... .......... .......... .......... .......... 55% 302M 0s 2019-11-29T12:51:13.423 INFO:teuthology.orchestra.run.smithi062.stderr: 40850K .......... .......... .......... .......... .......... 55% 396M 0s 2019-11-29T12:51:13.423 INFO:teuthology.orchestra.run.smithi062.stderr: 40900K .......... .......... .......... .......... .......... 55% 389M 0s 2019-11-29T12:51:13.423 INFO:teuthology.orchestra.run.smithi062.stderr: 40950K .......... .......... .......... .......... .......... 55% 279M 0s 2019-11-29T12:51:13.423 INFO:teuthology.orchestra.run.smithi062.stderr: 41000K .......... .......... .......... .......... .......... 55% 374M 0s 2019-11-29T12:51:13.423 INFO:teuthology.orchestra.run.smithi062.stderr: 41050K .......... .......... .......... .......... .......... 55% 386M 0s 2019-11-29T12:51:13.423 INFO:teuthology.orchestra.run.smithi062.stderr: 41100K .......... .......... .......... .......... .......... 55% 334M 0s 2019-11-29T12:51:13.424 INFO:teuthology.orchestra.run.smithi062.stderr: 41150K .......... .......... .......... .......... .......... 56% 309M 0s 2019-11-29T12:51:13.424 INFO:teuthology.orchestra.run.smithi062.stderr: 41200K .......... .......... .......... .......... .......... 56% 350M 0s 2019-11-29T12:51:13.424 INFO:teuthology.orchestra.run.smithi062.stderr: 41250K .......... .......... .......... .......... .......... 56% 320M 0s 2019-11-29T12:51:13.424 INFO:teuthology.orchestra.run.smithi062.stderr: 41300K .......... .......... .......... .......... .......... 56% 377M 0s 2019-11-29T12:51:13.424 INFO:teuthology.orchestra.run.smithi062.stderr: 41350K .......... .......... .......... .......... .......... 56% 363M 0s 2019-11-29T12:51:13.424 INFO:teuthology.orchestra.run.smithi062.stderr: 41400K .......... .......... .......... .......... .......... 56% 428M 0s 2019-11-29T12:51:13.424 INFO:teuthology.orchestra.run.smithi062.stderr: 41450K .......... .......... .......... .......... .......... 56% 417M 0s 2019-11-29T12:51:13.424 INFO:teuthology.orchestra.run.smithi062.stderr: 41500K .......... .......... .......... .......... .......... 56% 323M 0s 2019-11-29T12:51:13.425 INFO:teuthology.orchestra.run.smithi062.stderr: 41550K .......... .......... .......... .......... .......... 56% 323M 0s 2019-11-29T12:51:13.425 INFO:teuthology.orchestra.run.smithi062.stderr: 41600K .......... .......... .......... .......... .......... 56% 402M 0s 2019-11-29T12:51:13.425 INFO:teuthology.orchestra.run.smithi062.stderr: 41650K .......... .......... .......... .......... .......... 56% 375M 0s 2019-11-29T12:51:13.425 INFO:teuthology.orchestra.run.smithi062.stderr: 41700K .......... .......... .......... .......... .......... 56% 435M 0s 2019-11-29T12:51:13.425 INFO:teuthology.orchestra.run.smithi062.stderr: 41750K .......... .......... .......... .......... .......... 56% 362M 0s 2019-11-29T12:51:13.425 INFO:teuthology.orchestra.run.smithi062.stderr: 41800K .......... .......... .......... .......... .......... 56% 440M 0s 2019-11-29T12:51:13.425 INFO:teuthology.orchestra.run.smithi062.stderr: 41850K .......... .......... .......... .......... .......... 56% 414M 0s 2019-11-29T12:51:13.426 INFO:teuthology.orchestra.run.smithi062.stderr: 41900K .......... .......... .......... .......... .......... 57% 338M 0s 2019-11-29T12:51:13.426 INFO:teuthology.orchestra.run.smithi062.stderr: 41950K .......... .......... .......... .......... .......... 57% 336M 0s 2019-11-29T12:51:13.426 INFO:teuthology.orchestra.run.smithi062.stderr: 42000K .......... .......... .......... .......... .......... 57% 376M 0s 2019-11-29T12:51:13.426 INFO:teuthology.orchestra.run.smithi062.stderr: 42050K .......... .......... .......... .......... .......... 57% 352M 0s 2019-11-29T12:51:13.426 INFO:teuthology.orchestra.run.smithi062.stderr: 42100K .......... .......... .......... .......... .......... 57% 291M 0s 2019-11-29T12:51:13.426 INFO:teuthology.orchestra.run.smithi062.stderr: 42150K .......... .......... .......... .......... .......... 57% 285M 0s 2019-11-29T12:51:13.426 INFO:teuthology.orchestra.run.smithi062.stderr: 42200K .......... .......... .......... .......... .......... 57% 302M 0s 2019-11-29T12:51:13.426 INFO:teuthology.orchestra.run.smithi062.stderr: 42250K .......... .......... .......... .......... .......... 57% 403M 0s 2019-11-29T12:51:13.427 INFO:teuthology.orchestra.run.smithi062.stderr: 42300K .......... .......... .......... .......... .......... 57% 333M 0s 2019-11-29T12:51:13.427 INFO:teuthology.orchestra.run.smithi062.stderr: 42350K .......... .......... .......... .......... .......... 57% 302M 0s 2019-11-29T12:51:13.427 INFO:teuthology.orchestra.run.smithi062.stderr: 42400K .......... .......... .......... .......... .......... 57% 353M 0s 2019-11-29T12:51:13.427 INFO:teuthology.orchestra.run.smithi062.stderr: 42450K .......... .......... .......... .......... .......... 57% 389M 0s 2019-11-29T12:51:13.427 INFO:teuthology.orchestra.run.smithi062.stderr: 42500K .......... .......... .......... .......... .......... 57% 337M 0s 2019-11-29T12:51:13.427 INFO:teuthology.orchestra.run.smithi062.stderr: 42550K .......... .......... .......... .......... .......... 57% 293M 0s 2019-11-29T12:51:13.427 INFO:teuthology.orchestra.run.smithi062.stderr: 42600K .......... .......... .......... .......... .......... 57% 311M 0s 2019-11-29T12:51:13.428 INFO:teuthology.orchestra.run.smithi062.stderr: 42650K .......... .......... .......... .......... .......... 58% 371M 0s 2019-11-29T12:51:13.428 INFO:teuthology.orchestra.run.smithi062.stderr: 42700K .......... .......... .......... .......... .......... 58% 300M 0s 2019-11-29T12:51:13.428 INFO:teuthology.orchestra.run.smithi062.stderr: 42750K .......... .......... .......... .......... .......... 58% 327M 0s 2019-11-29T12:51:13.428 INFO:teuthology.orchestra.run.smithi062.stderr: 42800K .......... .......... .......... .......... .......... 58% 411M 0s 2019-11-29T12:51:13.428 INFO:teuthology.orchestra.run.smithi062.stderr: 42850K .......... .......... .......... .......... .......... 58% 322M 0s 2019-11-29T12:51:13.428 INFO:teuthology.orchestra.run.smithi062.stderr: 42900K .......... .......... .......... .......... .......... 58% 287M 0s 2019-11-29T12:51:13.428 INFO:teuthology.orchestra.run.smithi062.stderr: 42950K .......... .......... .......... .......... .......... 58% 291M 0s 2019-11-29T12:51:13.428 INFO:teuthology.orchestra.run.smithi062.stderr: 43000K .......... .......... .......... .......... .......... 58% 331M 0s 2019-11-29T12:51:13.429 INFO:teuthology.orchestra.run.smithi062.stderr: 43050K .......... .......... .......... .......... .......... 58% 331M 0s 2019-11-29T12:51:13.429 INFO:teuthology.orchestra.run.smithi062.stderr: 43100K .......... .......... .......... .......... .......... 58% 362M 0s 2019-11-29T12:51:13.429 INFO:teuthology.orchestra.run.smithi062.stderr: 43150K .......... .......... .......... .......... .......... 58% 298M 0s 2019-11-29T12:51:13.429 INFO:teuthology.orchestra.run.smithi062.stderr: 43200K .......... .......... .......... .......... .......... 58% 302M 0s 2019-11-29T12:51:13.429 INFO:teuthology.orchestra.run.smithi062.stderr: 43250K .......... .......... .......... .......... .......... 58% 320M 0s 2019-11-29T12:51:13.429 INFO:teuthology.orchestra.run.smithi062.stderr: 43300K .......... .......... .......... .......... .......... 58% 389M 0s 2019-11-29T12:51:13.429 INFO:teuthology.orchestra.run.smithi062.stderr: 43350K .......... .......... .......... .......... .......... 59% 283M 0s 2019-11-29T12:51:13.430 INFO:teuthology.orchestra.run.smithi062.stderr: 43400K .......... .......... .......... .......... .......... 59% 425M 0s 2019-11-29T12:51:13.430 INFO:teuthology.orchestra.run.smithi062.stderr: 43450K .......... .......... .......... .......... .......... 59% 337M 0s 2019-11-29T12:51:13.430 INFO:teuthology.orchestra.run.smithi062.stderr: 43500K .......... .......... .......... .......... .......... 59% 363M 0s 2019-11-29T12:51:13.430 INFO:teuthology.orchestra.run.smithi062.stderr: 43550K .......... .......... .......... .......... .......... 59% 330M 0s 2019-11-29T12:51:13.430 INFO:teuthology.orchestra.run.smithi062.stderr: 43600K .......... .......... .......... .......... .......... 59% 385M 0s 2019-11-29T12:51:13.430 INFO:teuthology.orchestra.run.smithi062.stderr: 43650K .......... .......... .......... .......... .......... 59% 391M 0s 2019-11-29T12:51:13.430 INFO:teuthology.orchestra.run.smithi062.stderr: 43700K .......... .......... .......... .......... .......... 59% 440M 0s 2019-11-29T12:51:13.431 INFO:teuthology.orchestra.run.smithi062.stderr: 43750K .......... .......... .......... .......... .......... 59% 313M 0s 2019-11-29T12:51:13.431 INFO:teuthology.orchestra.run.smithi062.stderr: 43800K .......... .......... .......... .......... .......... 59% 357M 0s 2019-11-29T12:51:13.431 INFO:teuthology.orchestra.run.smithi062.stderr: 43850K .......... .......... .......... .......... .......... 59% 335M 0s 2019-11-29T12:51:13.431 INFO:teuthology.orchestra.run.smithi062.stderr: 43900K .......... .......... .......... .......... .......... 59% 282M 0s 2019-11-29T12:51:13.431 INFO:teuthology.orchestra.run.smithi062.stderr: 43950K .......... .......... .......... .......... .......... 59% 269M 0s 2019-11-29T12:51:13.431 INFO:teuthology.orchestra.run.smithi062.stderr: 44000K .......... .......... .......... .......... .......... 59% 436M 0s 2019-11-29T12:51:13.432 INFO:teuthology.orchestra.run.smithi062.stderr: 44050K .......... .......... .......... .......... .......... 59% 425M 0s 2019-11-29T12:51:13.432 INFO:teuthology.orchestra.run.smithi062.stderr: 44100K .......... .......... .......... .......... .......... 60% 313M 0s 2019-11-29T12:51:13.432 INFO:teuthology.orchestra.run.smithi062.stderr: 44150K .......... .......... .......... .......... .......... 60% 319M 0s 2019-11-29T12:51:13.432 INFO:teuthology.orchestra.run.smithi062.stderr: 44200K .......... .......... .......... .......... .......... 60% 363M 0s 2019-11-29T12:51:13.432 INFO:teuthology.orchestra.run.smithi062.stderr: 44250K .......... .......... .......... .......... .......... 60% 360M 0s 2019-11-29T12:51:13.432 INFO:teuthology.orchestra.run.smithi062.stderr: 44300K .......... .......... .......... .......... .......... 60% 384M 0s 2019-11-29T12:51:13.432 INFO:teuthology.orchestra.run.smithi062.stderr: 44350K .......... .......... .......... .......... .......... 60% 390M 0s 2019-11-29T12:51:13.433 INFO:teuthology.orchestra.run.smithi062.stderr: 44400K .......... .......... .......... .......... .......... 60% 439M 0s 2019-11-29T12:51:13.433 INFO:teuthology.orchestra.run.smithi062.stderr: 44450K .......... .......... .......... .......... .......... 60% 403M 0s 2019-11-29T12:51:13.433 INFO:teuthology.orchestra.run.smithi062.stderr: 44500K .......... .......... .......... .......... .......... 60% 399M 0s 2019-11-29T12:51:13.433 INFO:teuthology.orchestra.run.smithi062.stderr: 44550K .......... .......... .......... .......... .......... 60% 295M 0s 2019-11-29T12:51:13.433 INFO:teuthology.orchestra.run.smithi062.stderr: 44600K .......... .......... .......... .......... .......... 60% 350M 0s 2019-11-29T12:51:13.433 INFO:teuthology.orchestra.run.smithi062.stderr: 44650K .......... .......... .......... .......... .......... 60% 433M 0s 2019-11-29T12:51:13.433 INFO:teuthology.orchestra.run.smithi062.stderr: 44700K .......... .......... .......... .......... .......... 60% 386M 0s 2019-11-29T12:51:13.434 INFO:teuthology.orchestra.run.smithi062.stderr: 44750K .......... .......... .......... .......... .......... 60% 308M 0s 2019-11-29T12:51:13.434 INFO:teuthology.orchestra.run.smithi062.stderr: 44800K .......... .......... .......... .......... .......... 60% 387M 0s 2019-11-29T12:51:13.434 INFO:teuthology.orchestra.run.smithi062.stderr: 44850K .......... .......... .......... .......... .......... 61% 343M 0s 2019-11-29T12:51:13.434 INFO:teuthology.orchestra.run.smithi062.stderr: 44900K .......... .......... .......... .......... .......... 61% 385M 0s 2019-11-29T12:51:13.434 INFO:teuthology.orchestra.run.smithi062.stderr: 44950K .......... .......... .......... .......... .......... 61% 329M 0s 2019-11-29T12:51:13.434 INFO:teuthology.orchestra.run.smithi062.stderr: 45000K .......... .......... .......... .......... .......... 61% 313M 0s 2019-11-29T12:51:13.435 INFO:teuthology.orchestra.run.smithi062.stderr: 45050K .......... .......... .......... .......... .......... 61% 387M 0s 2019-11-29T12:51:13.435 INFO:teuthology.orchestra.run.smithi062.stderr: 45100K .......... .......... .......... .......... .......... 61% 389M 0s 2019-11-29T12:51:13.435 INFO:teuthology.orchestra.run.smithi062.stderr: 45150K .......... .......... .......... .......... .......... 61% 348M 0s 2019-11-29T12:51:13.435 INFO:teuthology.orchestra.run.smithi062.stderr: 45200K .......... .......... .......... .......... .......... 61% 374M 0s 2019-11-29T12:51:13.435 INFO:teuthology.orchestra.run.smithi062.stderr: 45250K .......... .......... .......... .......... .......... 61% 351M 0s 2019-11-29T12:51:13.435 INFO:teuthology.orchestra.run.smithi062.stderr: 45300K .......... .......... .......... .......... .......... 61% 368M 0s 2019-11-29T12:51:13.435 INFO:teuthology.orchestra.run.smithi062.stderr: 45350K .......... .......... .......... .......... .......... 61% 318M 0s 2019-11-29T12:51:13.435 INFO:teuthology.orchestra.run.smithi062.stderr: 45400K .......... .......... .......... .......... .......... 61% 403M 0s 2019-11-29T12:51:13.436 INFO:teuthology.orchestra.run.smithi062.stderr: 45450K .......... .......... .......... .......... .......... 61% 379M 0s 2019-11-29T12:51:13.436 INFO:teuthology.orchestra.run.smithi062.stderr: 45500K .......... .......... .......... .......... .......... 61% 429M 0s 2019-11-29T12:51:13.436 INFO:teuthology.orchestra.run.smithi062.stderr: 45550K .......... .......... .......... .......... .......... 61% 353M 0s 2019-11-29T12:51:13.436 INFO:teuthology.orchestra.run.smithi062.stderr: 45600K .......... .......... .......... .......... .......... 62% 353M 0s 2019-11-29T12:51:13.436 INFO:teuthology.orchestra.run.smithi062.stderr: 45650K .......... .......... .......... .......... .......... 62% 359M 0s 2019-11-29T12:51:13.436 INFO:teuthology.orchestra.run.smithi062.stderr: 45700K .......... .......... .......... .......... .......... 62% 380M 0s 2019-11-29T12:51:13.436 INFO:teuthology.orchestra.run.smithi062.stderr: 45750K .......... .......... .......... .......... .......... 62% 212M 0s 2019-11-29T12:51:13.437 INFO:teuthology.orchestra.run.smithi062.stderr: 45800K .......... .......... .......... .......... .......... 62% 307M 0s 2019-11-29T12:51:13.437 INFO:teuthology.orchestra.run.smithi062.stderr: 45850K .......... .......... .......... .......... .......... 62% 392M 0s 2019-11-29T12:51:13.437 INFO:teuthology.orchestra.run.smithi062.stderr: 45900K .......... .......... .......... .......... .......... 62% 335M 0s 2019-11-29T12:51:13.437 INFO:teuthology.orchestra.run.smithi062.stderr: 45950K .......... .......... .......... .......... .......... 62% 342M 0s 2019-11-29T12:51:13.437 INFO:teuthology.orchestra.run.smithi062.stderr: 46000K .......... .......... .......... .......... .......... 62% 369M 0s 2019-11-29T12:51:13.437 INFO:teuthology.orchestra.run.smithi062.stderr: 46050K .......... .......... .......... .......... .......... 62% 383M 0s 2019-11-29T12:51:13.437 INFO:teuthology.orchestra.run.smithi062.stderr: 46100K .......... .......... .......... .......... .......... 62% 364M 0s 2019-11-29T12:51:13.438 INFO:teuthology.orchestra.run.smithi062.stderr: 46150K .......... .......... .......... .......... .......... 62% 296M 0s 2019-11-29T12:51:13.438 INFO:teuthology.orchestra.run.smithi062.stderr: 46200K .......... .......... .......... .......... .......... 62% 383M 0s 2019-11-29T12:51:13.438 INFO:teuthology.orchestra.run.smithi062.stderr: 46250K .......... .......... .......... .......... .......... 62% 355M 0s 2019-11-29T12:51:13.438 INFO:teuthology.orchestra.run.smithi062.stderr: 46300K .......... .......... .......... .......... .......... 63% 385M 0s 2019-11-29T12:51:13.438 INFO:teuthology.orchestra.run.smithi062.stderr: 46350K .......... .......... .......... .......... .......... 63% 352M 0s 2019-11-29T12:51:13.438 INFO:teuthology.orchestra.run.smithi062.stderr: 46400K .......... .......... .......... .......... .......... 63% 389M 0s 2019-11-29T12:51:13.438 INFO:teuthology.orchestra.run.smithi062.stderr: 46450K .......... .......... .......... .......... .......... 63% 429M 0s 2019-11-29T12:51:13.438 INFO:teuthology.orchestra.run.smithi062.stderr: 46500K .......... .......... .......... .......... .......... 63% 440M 0s 2019-11-29T12:51:13.439 INFO:teuthology.orchestra.run.smithi062.stderr: 46550K .......... .......... .......... .......... .......... 63% 312M 0s 2019-11-29T12:51:13.439 INFO:teuthology.orchestra.run.smithi062.stderr: 46600K .......... .......... .......... .......... .......... 63% 380M 0s 2019-11-29T12:51:13.439 INFO:teuthology.orchestra.run.smithi062.stderr: 46650K .......... .......... .......... .......... .......... 63% 362M 0s 2019-11-29T12:51:13.439 INFO:teuthology.orchestra.run.smithi062.stderr: 46700K .......... .......... .......... .......... .......... 63% 366M 0s 2019-11-29T12:51:13.439 INFO:teuthology.orchestra.run.smithi062.stderr: 46750K .......... .......... .......... .......... .......... 63% 334M 0s 2019-11-29T12:51:13.439 INFO:teuthology.orchestra.run.smithi062.stderr: 46800K .......... .......... .......... .......... .......... 63% 427M 0s 2019-11-29T12:51:13.439 INFO:teuthology.orchestra.run.smithi062.stderr: 46850K .......... .......... .......... .......... .......... 63% 383M 0s 2019-11-29T12:51:13.440 INFO:teuthology.orchestra.run.smithi062.stderr: 46900K .......... .......... .......... .......... .......... 63% 321M 0s 2019-11-29T12:51:13.440 INFO:teuthology.orchestra.run.smithi062.stderr: 46950K .......... .......... .......... .......... .......... 63% 285M 0s 2019-11-29T12:51:13.440 INFO:teuthology.orchestra.run.smithi062.stderr: 47000K .......... .......... .......... .......... .......... 63% 305M 0s 2019-11-29T12:51:13.440 INFO:teuthology.orchestra.run.smithi062.stderr: 47050K .......... .......... .......... .......... .......... 64% 336M 0s 2019-11-29T12:51:13.440 INFO:teuthology.orchestra.run.smithi062.stderr: 47100K .......... .......... .......... .......... .......... 64% 359M 0s 2019-11-29T12:51:13.440 INFO:teuthology.orchestra.run.smithi062.stderr: 47150K .......... .......... .......... .......... .......... 64% 394M 0s 2019-11-29T12:51:13.440 INFO:teuthology.orchestra.run.smithi062.stderr: 47200K .......... .......... .......... .......... .......... 64% 296M 0s 2019-11-29T12:51:13.440 INFO:teuthology.orchestra.run.smithi062.stderr: 47250K .......... .......... .......... .......... .......... 64% 175M 0s 2019-11-29T12:51:13.441 INFO:teuthology.orchestra.run.smithi062.stderr: 47300K .......... .......... .......... .......... .......... 64% 151M 0s 2019-11-29T12:51:13.441 INFO:teuthology.orchestra.run.smithi062.stderr: 47350K .......... .......... .......... .......... .......... 64% 164M 0s 2019-11-29T12:51:13.441 INFO:teuthology.orchestra.run.smithi062.stderr: 47400K .......... .......... .......... .......... .......... 64% 202M 0s 2019-11-29T12:51:13.441 INFO:teuthology.orchestra.run.smithi062.stderr: 47450K .......... .......... .......... .......... .......... 64% 191M 0s 2019-11-29T12:51:13.441 INFO:teuthology.orchestra.run.smithi062.stderr: 47500K .......... .......... .......... .......... .......... 64% 212M 0s 2019-11-29T12:51:13.441 INFO:teuthology.orchestra.run.smithi062.stderr: 47550K .......... .......... .......... .......... .......... 64% 148M 0s 2019-11-29T12:51:13.441 INFO:teuthology.orchestra.run.smithi062.stderr: 47600K .......... .......... .......... .......... .......... 64% 177M 0s 2019-11-29T12:51:13.442 INFO:teuthology.orchestra.run.smithi062.stderr: 47650K .......... .......... .......... .......... .......... 64% 160M 0s 2019-11-29T12:51:13.442 INFO:teuthology.orchestra.run.smithi062.stderr: 47700K .......... .......... .......... .......... .......... 64% 175M 0s 2019-11-29T12:51:13.442 INFO:teuthology.orchestra.run.smithi062.stderr: 47750K .......... .......... .......... .......... .......... 64% 120M 0s 2019-11-29T12:51:13.442 INFO:teuthology.orchestra.run.smithi062.stderr: 47800K .......... .......... .......... .......... .......... 65% 152M 0s 2019-11-29T12:51:13.442 INFO:teuthology.orchestra.run.smithi062.stderr: 47850K .......... .......... .......... .......... .......... 65% 187M 0s 2019-11-29T12:51:13.442 INFO:teuthology.orchestra.run.smithi062.stderr: 47900K .......... .......... .......... .......... .......... 65% 185M 0s 2019-11-29T12:51:13.442 INFO:teuthology.orchestra.run.smithi062.stderr: 47950K .......... .......... .......... .......... .......... 65% 139M 0s 2019-11-29T12:51:13.442 INFO:teuthology.orchestra.run.smithi062.stderr: 48000K .......... .......... .......... .......... .......... 65% 184M 0s 2019-11-29T12:51:13.443 INFO:teuthology.orchestra.run.smithi062.stderr: 48050K .......... .......... .......... .......... .......... 65% 279M 0s 2019-11-29T12:51:13.443 INFO:teuthology.orchestra.run.smithi062.stderr: 48100K .......... .......... .......... .......... .......... 65% 321M 0s 2019-11-29T12:51:13.443 INFO:teuthology.orchestra.run.smithi062.stderr: 48150K .......... .......... .......... .......... .......... 65% 260M 0s 2019-11-29T12:51:13.443 INFO:teuthology.orchestra.run.smithi062.stderr: 48200K .......... .......... .......... .......... .......... 65% 367M 0s 2019-11-29T12:51:13.443 INFO:teuthology.orchestra.run.smithi062.stderr: 48250K .......... .......... .......... .......... .......... 65% 318M 0s 2019-11-29T12:51:13.443 INFO:teuthology.orchestra.run.smithi062.stderr: 48300K .......... .......... .......... .......... .......... 65% 411M 0s 2019-11-29T12:51:13.443 INFO:teuthology.orchestra.run.smithi062.stderr: 48350K .......... .......... .......... .......... .......... 65% 314M 0s 2019-11-29T12:51:13.444 INFO:teuthology.orchestra.run.smithi062.stderr: 48400K .......... .......... .......... .......... .......... 65% 328M 0s 2019-11-29T12:51:13.444 INFO:teuthology.orchestra.run.smithi062.stderr: 48450K .......... .......... .......... .......... .......... 65% 336M 0s 2019-11-29T12:51:13.444 INFO:teuthology.orchestra.run.smithi062.stderr: 48500K .......... .......... .......... .......... .......... 66% 354M 0s 2019-11-29T12:51:13.444 INFO:teuthology.orchestra.run.smithi062.stderr: 48550K .......... .......... .......... .......... .......... 66% 230M 0s 2019-11-29T12:51:13.444 INFO:teuthology.orchestra.run.smithi062.stderr: 48600K .......... .......... .......... .......... .......... 66% 191M 0s 2019-11-29T12:51:13.444 INFO:teuthology.orchestra.run.smithi062.stderr: 48650K .......... .......... .......... .......... .......... 66% 145M 0s 2019-11-29T12:51:13.444 INFO:teuthology.orchestra.run.smithi062.stderr: 48700K .......... .......... .......... .......... .......... 66% 202M 0s 2019-11-29T12:51:13.444 INFO:teuthology.orchestra.run.smithi062.stderr: 48750K .......... .......... .......... .......... .......... 66% 227M 0s 2019-11-29T12:51:13.445 INFO:teuthology.orchestra.run.smithi062.stderr: 48800K .......... .......... .......... .......... .......... 66% 189M 0s 2019-11-29T12:51:13.445 INFO:teuthology.orchestra.run.smithi062.stderr: 48850K .......... .......... .......... .......... .......... 66% 200M 0s 2019-11-29T12:51:13.445 INFO:teuthology.orchestra.run.smithi062.stderr: 48900K .......... .......... .......... .......... .......... 66% 208M 0s 2019-11-29T12:51:13.445 INFO:teuthology.orchestra.run.smithi062.stderr: 48950K .......... .......... .......... .......... .......... 66% 176M 0s 2019-11-29T12:51:13.445 INFO:teuthology.orchestra.run.smithi062.stderr: 49000K .......... .......... .......... .......... .......... 66% 207M 0s 2019-11-29T12:51:13.445 INFO:teuthology.orchestra.run.smithi062.stderr: 49050K .......... .......... .......... .......... .......... 66% 191M 0s 2019-11-29T12:51:13.445 INFO:teuthology.orchestra.run.smithi062.stderr: 49100K .......... .......... .......... .......... .......... 66% 241M 0s 2019-11-29T12:51:13.446 INFO:teuthology.orchestra.run.smithi062.stderr: 49150K .......... .......... .......... .......... .......... 66% 205M 0s 2019-11-29T12:51:13.446 INFO:teuthology.orchestra.run.smithi062.stderr: 49200K .......... .......... .......... .......... .......... 66% 242M 0s 2019-11-29T12:51:13.446 INFO:teuthology.orchestra.run.smithi062.stderr: 49250K .......... .......... .......... .......... .......... 67% 197M 0s 2019-11-29T12:51:13.446 INFO:teuthology.orchestra.run.smithi062.stderr: 49300K .......... .......... .......... .......... .......... 67% 236M 0s 2019-11-29T12:51:13.446 INFO:teuthology.orchestra.run.smithi062.stderr: 49350K .......... .......... .......... .......... .......... 67% 185M 0s 2019-11-29T12:51:13.446 INFO:teuthology.orchestra.run.smithi062.stderr: 49400K .......... .......... .......... .......... .......... 67% 228M 0s 2019-11-29T12:51:13.446 INFO:teuthology.orchestra.run.smithi062.stderr: 49450K .......... .......... .......... .......... .......... 67% 241M 0s 2019-11-29T12:51:13.447 INFO:teuthology.orchestra.run.smithi062.stderr: 49500K .......... .......... .......... .......... .......... 67% 277M 0s 2019-11-29T12:51:13.447 INFO:teuthology.orchestra.run.smithi062.stderr: 49550K .......... .......... .......... .......... .......... 67% 167M 0s 2019-11-29T12:51:13.447 INFO:teuthology.orchestra.run.smithi062.stderr: 49600K .......... .......... .......... .......... .......... 67% 199M 0s 2019-11-29T12:51:13.447 INFO:teuthology.orchestra.run.smithi062.stderr: 49650K .......... .......... .......... .......... .......... 67% 271M 0s 2019-11-29T12:51:13.447 INFO:teuthology.orchestra.run.smithi062.stderr: 49700K .......... .......... .......... .......... .......... 67% 211M 0s 2019-11-29T12:51:13.447 INFO:teuthology.orchestra.run.smithi062.stderr: 49750K .......... .......... .......... .......... .......... 67% 169M 0s 2019-11-29T12:51:13.448 INFO:teuthology.orchestra.run.smithi062.stderr: 49800K .......... .......... .......... .......... .......... 67% 228M 0s 2019-11-29T12:51:13.448 INFO:teuthology.orchestra.run.smithi062.stderr: 49850K .......... .......... .......... .......... .......... 67% 208M 0s 2019-11-29T12:51:13.448 INFO:teuthology.orchestra.run.smithi062.stderr: 49900K .......... .......... .......... .......... .......... 67% 192M 0s 2019-11-29T12:51:13.448 INFO:teuthology.orchestra.run.smithi062.stderr: 49950K .......... .......... .......... .......... .......... 67% 228M 0s 2019-11-29T12:51:13.448 INFO:teuthology.orchestra.run.smithi062.stderr: 50000K .......... .......... .......... .......... .......... 68% 197M 0s 2019-11-29T12:51:13.448 INFO:teuthology.orchestra.run.smithi062.stderr: 50050K .......... .......... .......... .......... .......... 68% 166M 0s 2019-11-29T12:51:13.448 INFO:teuthology.orchestra.run.smithi062.stderr: 50100K .......... .......... .......... .......... .......... 68% 218M 0s 2019-11-29T12:51:13.449 INFO:teuthology.orchestra.run.smithi062.stderr: 50150K .......... .......... .......... .......... .......... 68% 187M 0s 2019-11-29T12:51:13.449 INFO:teuthology.orchestra.run.smithi062.stderr: 50200K .......... .......... .......... .......... .......... 68% 218M 0s 2019-11-29T12:51:13.449 INFO:teuthology.orchestra.run.smithi062.stderr: 50250K .......... .......... .......... .......... .......... 68% 239M 0s 2019-11-29T12:51:13.449 INFO:teuthology.orchestra.run.smithi062.stderr: 50300K .......... .......... .......... .......... .......... 68% 241M 0s 2019-11-29T12:51:13.449 INFO:teuthology.orchestra.run.smithi062.stderr: 50350K .......... .......... .......... .......... .......... 68% 245M 0s 2019-11-29T12:51:13.449 INFO:teuthology.orchestra.run.smithi062.stderr: 50400K .......... .......... .......... .......... .......... 68% 265M 0s 2019-11-29T12:51:13.450 INFO:teuthology.orchestra.run.smithi062.stderr: 50450K .......... .......... .......... .......... .......... 68% 209M 0s 2019-11-29T12:51:13.450 INFO:teuthology.orchestra.run.smithi062.stderr: 50500K .......... .......... .......... .......... .......... 68% 207M 0s 2019-11-29T12:51:13.450 INFO:teuthology.orchestra.run.smithi062.stderr: 50550K .......... .......... .......... .......... .......... 68% 199M 0s 2019-11-29T12:51:13.450 INFO:teuthology.orchestra.run.smithi062.stderr: 50600K .......... .......... .......... .......... .......... 68% 217M 0s 2019-11-29T12:51:13.450 INFO:teuthology.orchestra.run.smithi062.stderr: 50650K .......... .......... .......... .......... .......... 68% 234M 0s 2019-11-29T12:51:13.450 INFO:teuthology.orchestra.run.smithi062.stderr: 50700K .......... .......... .......... .......... .......... 68% 209M 0s 2019-11-29T12:51:13.450 INFO:teuthology.orchestra.run.smithi062.stderr: 50750K .......... .......... .......... .......... .......... 69% 242M 0s 2019-11-29T12:51:13.450 INFO:teuthology.orchestra.run.smithi062.stderr: 50800K .......... .......... .......... .......... .......... 69% 236M 0s 2019-11-29T12:51:13.451 INFO:teuthology.orchestra.run.smithi062.stderr: 50850K .......... .......... .......... .......... .......... 69% 218M 0s 2019-11-29T12:51:13.451 INFO:teuthology.orchestra.run.smithi062.stderr: 50900K .......... .......... .......... .......... .......... 69% 266M 0s 2019-11-29T12:51:13.451 INFO:teuthology.orchestra.run.smithi062.stderr: 50950K .......... .......... .......... .......... .......... 69% 189M 0s 2019-11-29T12:51:13.451 INFO:teuthology.orchestra.run.smithi062.stderr: 51000K .......... .......... .......... .......... .......... 69% 210M 0s 2019-11-29T12:51:13.451 INFO:teuthology.orchestra.run.smithi062.stderr: 51050K .......... .......... .......... .......... .......... 69% 267M 0s 2019-11-29T12:51:13.451 INFO:teuthology.orchestra.run.smithi062.stderr: 51100K .......... .......... .......... .......... .......... 69% 180M 0s 2019-11-29T12:51:13.452 INFO:teuthology.orchestra.run.smithi062.stderr: 51150K .......... .......... .......... .......... .......... 69% 236M 0s 2019-11-29T12:51:13.452 INFO:teuthology.orchestra.run.smithi062.stderr: 51200K .......... .......... .......... .......... .......... 69% 170M 0s 2019-11-29T12:51:13.452 INFO:teuthology.orchestra.run.smithi062.stderr: 51250K .......... .......... .......... .......... .......... 69% 249M 0s 2019-11-29T12:51:13.452 INFO:teuthology.orchestra.run.smithi062.stderr: 51300K .......... .......... .......... .......... .......... 69% 216M 0s 2019-11-29T12:51:13.452 INFO:teuthology.orchestra.run.smithi062.stderr: 51350K .......... .......... .......... .......... .......... 69% 172M 0s 2019-11-29T12:51:13.452 INFO:teuthology.orchestra.run.smithi062.stderr: 51400K .......... .......... .......... .......... .......... 69% 222M 0s 2019-11-29T12:51:13.452 INFO:teuthology.orchestra.run.smithi062.stderr: 51450K .......... .......... .......... .......... .......... 70% 225M 0s 2019-11-29T12:51:13.452 INFO:teuthology.orchestra.run.smithi062.stderr: 51500K .......... .......... .......... .......... .......... 70% 201M 0s 2019-11-29T12:51:13.453 INFO:teuthology.orchestra.run.smithi062.stderr: 51550K .......... .......... .......... .......... .......... 70% 164M 0s 2019-11-29T12:51:13.453 INFO:teuthology.orchestra.run.smithi062.stderr: 51600K .......... .......... .......... .......... .......... 70% 234M 0s 2019-11-29T12:51:13.453 INFO:teuthology.orchestra.run.smithi062.stderr: 51650K .......... .......... .......... .......... .......... 70% 206M 0s 2019-11-29T12:51:13.453 INFO:teuthology.orchestra.run.smithi062.stderr: 51700K .......... .......... .......... .......... .......... 70% 203M 0s 2019-11-29T12:51:13.453 INFO:teuthology.orchestra.run.smithi062.stderr: 51750K .......... .......... .......... .......... .......... 70% 155M 0s 2019-11-29T12:51:13.453 INFO:teuthology.orchestra.run.smithi062.stderr: 51800K .......... .......... .......... .......... .......... 70% 229M 0s 2019-11-29T12:51:13.454 INFO:teuthology.orchestra.run.smithi062.stderr: 51850K .......... .......... .......... .......... .......... 70% 192M 0s 2019-11-29T12:51:13.454 INFO:teuthology.orchestra.run.smithi062.stderr: 51900K .......... .......... .......... .......... .......... 70% 198M 0s 2019-11-29T12:51:13.454 INFO:teuthology.orchestra.run.smithi062.stderr: 51950K .......... .......... .......... .......... .......... 70% 201M 0s 2019-11-29T12:51:13.454 INFO:teuthology.orchestra.run.smithi062.stderr: 52000K .......... .......... .......... .......... .......... 70% 266M 0s 2019-11-29T12:51:13.455 INFO:teuthology.orchestra.run.smithi062.stderr: 52050K .......... .......... .......... .......... .......... 70% 198M 0s 2019-11-29T12:51:13.455 INFO:teuthology.orchestra.run.smithi062.stderr: 52100K .......... .......... .......... .......... .......... 70% 181M 0s 2019-11-29T12:51:13.455 INFO:teuthology.orchestra.run.smithi062.stderr: 52150K .......... .......... .......... .......... .......... 70% 169M 0s 2019-11-29T12:51:13.455 INFO:teuthology.orchestra.run.smithi062.stderr: 52200K .......... .......... .......... .......... .......... 71% 203M 0s 2019-11-29T12:51:13.455 INFO:teuthology.orchestra.run.smithi062.stderr: 52250K .......... .......... .......... .......... .......... 71% 207M 0s 2019-11-29T12:51:13.455 INFO:teuthology.orchestra.run.smithi062.stderr: 52300K .......... .......... .......... .......... .......... 71% 226M 0s 2019-11-29T12:51:13.455 INFO:teuthology.orchestra.run.smithi062.stderr: 52350K .......... .......... .......... .......... .......... 71% 181M 0s 2019-11-29T12:51:13.456 INFO:teuthology.orchestra.run.smithi062.stderr: 52400K .......... .......... .......... .......... .......... 71% 219M 0s 2019-11-29T12:51:13.456 INFO:teuthology.orchestra.run.smithi062.stderr: 52450K .......... .......... .......... .......... .......... 71% 216M 0s 2019-11-29T12:51:13.456 INFO:teuthology.orchestra.run.smithi062.stderr: 52500K .......... .......... .......... .......... .......... 71% 202M 0s 2019-11-29T12:51:13.456 INFO:teuthology.orchestra.run.smithi062.stderr: 52550K .......... .......... .......... .......... .......... 71% 174M 0s 2019-11-29T12:51:13.456 INFO:teuthology.orchestra.run.smithi062.stderr: 52600K .......... .......... .......... .......... .......... 71% 207M 0s 2019-11-29T12:51:13.456 INFO:teuthology.orchestra.run.smithi062.stderr: 52650K .......... .......... .......... .......... .......... 71% 209M 0s 2019-11-29T12:51:13.456 INFO:teuthology.orchestra.run.smithi062.stderr: 52700K .......... .......... .......... .......... .......... 71% 234M 0s 2019-11-29T12:51:13.456 INFO:teuthology.orchestra.run.smithi062.stderr: 52750K .......... .......... .......... .......... .......... 71% 146M 0s 2019-11-29T12:51:13.457 INFO:teuthology.orchestra.run.smithi062.stderr: 52800K .......... .......... .......... .......... .......... 71% 191M 0s 2019-11-29T12:51:13.457 INFO:teuthology.orchestra.run.smithi062.stderr: 52850K .......... .......... .......... .......... .......... 71% 257M 0s 2019-11-29T12:51:13.457 INFO:teuthology.orchestra.run.smithi062.stderr: 52900K .......... .......... .......... .......... .......... 71% 252M 0s 2019-11-29T12:51:13.457 INFO:teuthology.orchestra.run.smithi062.stderr: 52950K .......... .......... .......... .......... .......... 72% 145M 0s 2019-11-29T12:51:13.457 INFO:teuthology.orchestra.run.smithi062.stderr: 53000K .......... .......... .......... .......... .......... 72% 189M 0s 2019-11-29T12:51:13.457 INFO:teuthology.orchestra.run.smithi062.stderr: 53050K .......... .......... .......... .......... .......... 72% 214M 0s 2019-11-29T12:51:13.457 INFO:teuthology.orchestra.run.smithi062.stderr: 53100K .......... .......... .......... .......... .......... 72% 198M 0s 2019-11-29T12:51:13.458 INFO:teuthology.orchestra.run.smithi062.stderr: 53150K .......... .......... .......... .......... .......... 72% 233M 0s 2019-11-29T12:51:13.458 INFO:teuthology.orchestra.run.smithi062.stderr: 53200K .......... .......... .......... .......... .......... 72% 208M 0s 2019-11-29T12:51:13.458 INFO:teuthology.orchestra.run.smithi062.stderr: 53250K .......... .......... .......... .......... .......... 72% 220M 0s 2019-11-29T12:51:13.458 INFO:teuthology.orchestra.run.smithi062.stderr: 53300K .......... .......... .......... .......... .......... 72% 204M 0s 2019-11-29T12:51:13.458 INFO:teuthology.orchestra.run.smithi062.stderr: 53350K .......... .......... .......... .......... .......... 72% 214M 0s 2019-11-29T12:51:13.458 INFO:teuthology.orchestra.run.smithi062.stderr: 53400K .......... .......... .......... .......... .......... 72% 243M 0s 2019-11-29T12:51:13.458 INFO:teuthology.orchestra.run.smithi062.stderr: 53450K .......... .......... .......... .......... .......... 72% 187M 0s 2019-11-29T12:51:13.458 INFO:teuthology.orchestra.run.smithi062.stderr: 53500K .......... .......... .......... .......... .......... 72% 248M 0s 2019-11-29T12:51:13.459 INFO:teuthology.orchestra.run.smithi062.stderr: 53550K .......... .......... .......... .......... .......... 72% 190M 0s 2019-11-29T12:51:13.459 INFO:teuthology.orchestra.run.smithi062.stderr: 53600K .......... .......... .......... .......... .......... 72% 250M 0s 2019-11-29T12:51:13.459 INFO:teuthology.orchestra.run.smithi062.stderr: 53650K .......... .......... .......... .......... .......... 73% 188M 0s 2019-11-29T12:51:13.459 INFO:teuthology.orchestra.run.smithi062.stderr: 53700K .......... .......... .......... .......... .......... 73% 267M 0s 2019-11-29T12:51:13.459 INFO:teuthology.orchestra.run.smithi062.stderr: 53750K .......... .......... .......... .......... .......... 73% 169M 0s 2019-11-29T12:51:13.459 INFO:teuthology.orchestra.run.smithi062.stderr: 53800K .......... .......... .......... .......... .......... 73% 219M 0s 2019-11-29T12:51:13.459 INFO:teuthology.orchestra.run.smithi062.stderr: 53850K .......... .......... .......... .......... .......... 73% 217M 0s 2019-11-29T12:51:13.460 INFO:teuthology.orchestra.run.smithi062.stderr: 53900K .......... .......... .......... .......... .......... 73% 206M 0s 2019-11-29T12:51:13.460 INFO:teuthology.orchestra.run.smithi062.stderr: 53950K .......... .......... .......... .......... .......... 73% 211M 0s 2019-11-29T12:51:13.460 INFO:teuthology.orchestra.run.smithi062.stderr: 54000K .......... .......... .......... .......... .......... 73% 215M 0s 2019-11-29T12:51:13.460 INFO:teuthology.orchestra.run.smithi062.stderr: 54050K .......... .......... .......... .......... .......... 73% 212M 0s 2019-11-29T12:51:13.460 INFO:teuthology.orchestra.run.smithi062.stderr: 54100K .......... .......... .......... .......... .......... 73% 231M 0s 2019-11-29T12:51:13.460 INFO:teuthology.orchestra.run.smithi062.stderr: 54150K .......... .......... .......... .......... .......... 73% 187M 0s 2019-11-29T12:51:13.460 INFO:teuthology.orchestra.run.smithi062.stderr: 54200K .......... .......... .......... .......... .......... 73% 181M 0s 2019-11-29T12:51:13.460 INFO:teuthology.orchestra.run.smithi062.stderr: 54250K .......... .......... .......... .......... .......... 73% 232M 0s 2019-11-29T12:51:13.461 INFO:teuthology.orchestra.run.smithi062.stderr: 54300K .......... .......... .......... .......... .......... 73% 204M 0s 2019-11-29T12:51:13.461 INFO:teuthology.orchestra.run.smithi062.stderr: 54350K .......... .......... .......... .......... .......... 73% 179M 0s 2019-11-29T12:51:13.461 INFO:teuthology.orchestra.run.smithi062.stderr: 54400K .......... .......... .......... .......... .......... 74% 215M 0s 2019-11-29T12:51:13.461 INFO:teuthology.orchestra.run.smithi062.stderr: 54450K .......... .......... .......... .......... .......... 74% 230M 0s 2019-11-29T12:51:13.461 INFO:teuthology.orchestra.run.smithi062.stderr: 54500K .......... .......... .......... .......... .......... 74% 249M 0s 2019-11-29T12:51:13.461 INFO:teuthology.orchestra.run.smithi062.stderr: 54550K .......... .......... .......... .......... .......... 74% 196M 0s 2019-11-29T12:51:13.461 INFO:teuthology.orchestra.run.smithi062.stderr: 54600K .......... .......... .......... .......... .......... 74% 203M 0s 2019-11-29T12:51:13.462 INFO:teuthology.orchestra.run.smithi062.stderr: 54650K .......... .......... .......... .......... .......... 74% 258M 0s 2019-11-29T12:51:13.462 INFO:teuthology.orchestra.run.smithi062.stderr: 54700K .......... .......... .......... .......... .......... 74% 211M 0s 2019-11-29T12:51:13.462 INFO:teuthology.orchestra.run.smithi062.stderr: 54750K .......... .......... .......... .......... .......... 74% 179M 0s 2019-11-29T12:51:13.462 INFO:teuthology.orchestra.run.smithi062.stderr: 54800K .......... .......... .......... .......... .......... 74% 265M 0s 2019-11-29T12:51:13.462 INFO:teuthology.orchestra.run.smithi062.stderr: 54850K .......... .......... .......... .......... .......... 74% 215M 0s 2019-11-29T12:51:13.462 INFO:teuthology.orchestra.run.smithi062.stderr: 54900K .......... .......... .......... .......... .......... 74% 216M 0s 2019-11-29T12:51:13.462 INFO:teuthology.orchestra.run.smithi062.stderr: 54950K .......... .......... .......... .......... .......... 74% 183M 0s 2019-11-29T12:51:13.463 INFO:teuthology.orchestra.run.smithi062.stderr: 55000K .......... .......... .......... .......... .......... 74% 264M 0s 2019-11-29T12:51:13.463 INFO:teuthology.orchestra.run.smithi062.stderr: 55050K .......... .......... .......... .......... .......... 74% 207M 0s 2019-11-29T12:51:13.463 INFO:teuthology.orchestra.run.smithi062.stderr: 55100K .......... .......... .......... .......... .......... 74% 211M 0s 2019-11-29T12:51:13.463 INFO:teuthology.orchestra.run.smithi062.stderr: 55150K .......... .......... .......... .......... .......... 75% 198M 0s 2019-11-29T12:51:13.463 INFO:teuthology.orchestra.run.smithi062.stderr: 55200K .......... .......... .......... .......... .......... 75% 264M 0s 2019-11-29T12:51:13.463 INFO:teuthology.orchestra.run.smithi062.stderr: 55250K .......... .......... .......... .......... .......... 75% 223M 0s 2019-11-29T12:51:13.464 INFO:teuthology.orchestra.run.smithi062.stderr: 55300K .......... .......... .......... .......... .......... 75% 200M 0s 2019-11-29T12:51:13.464 INFO:teuthology.orchestra.run.smithi062.stderr: 55350K .......... .......... .......... .......... .......... 75% 184M 0s 2019-11-29T12:51:13.464 INFO:teuthology.orchestra.run.smithi062.stderr: 55400K .......... .......... .......... .......... .......... 75% 201M 0s 2019-11-29T12:51:13.464 INFO:teuthology.orchestra.run.smithi062.stderr: 55450K .......... .......... .......... .......... .......... 75% 250M 0s 2019-11-29T12:51:13.464 INFO:teuthology.orchestra.run.smithi062.stderr: 55500K .......... .......... .......... .......... .......... 75% 187M 0s 2019-11-29T12:51:13.464 INFO:teuthology.orchestra.run.smithi062.stderr: 55550K .......... .......... .......... .......... .......... 75% 213M 0s 2019-11-29T12:51:13.464 INFO:teuthology.orchestra.run.smithi062.stderr: 55600K .......... .......... .......... .......... .......... 75% 216M 0s 2019-11-29T12:51:13.465 INFO:teuthology.orchestra.run.smithi062.stderr: 55650K .......... .......... .......... .......... .......... 75% 221M 0s 2019-11-29T12:51:13.465 INFO:teuthology.orchestra.run.smithi062.stderr: 55700K .......... .......... .......... .......... .......... 75% 196M 0s 2019-11-29T12:51:13.465 INFO:teuthology.orchestra.run.smithi062.stderr: 55750K .......... .......... .......... .......... .......... 75% 219M 0s 2019-11-29T12:51:13.465 INFO:teuthology.orchestra.run.smithi062.stderr: 55800K .......... .......... .......... .......... .......... 75% 200M 0s 2019-11-29T12:51:13.465 INFO:teuthology.orchestra.run.smithi062.stderr: 55850K .......... .......... .......... .......... .......... 75% 225M 0s 2019-11-29T12:51:13.465 INFO:teuthology.orchestra.run.smithi062.stderr: 55900K .......... .......... .......... .......... .......... 76% 211M 0s 2019-11-29T12:51:13.465 INFO:teuthology.orchestra.run.smithi062.stderr: 55950K .......... .......... .......... .......... .......... 76% 184M 0s 2019-11-29T12:51:13.466 INFO:teuthology.orchestra.run.smithi062.stderr: 56000K .......... .......... .......... .......... .......... 76% 258M 0s 2019-11-29T12:51:13.466 INFO:teuthology.orchestra.run.smithi062.stderr: 56050K .......... .......... .......... .......... .......... 76% 206M 0s 2019-11-29T12:51:13.466 INFO:teuthology.orchestra.run.smithi062.stderr: 56100K .......... .......... .......... .......... .......... 76% 191M 0s 2019-11-29T12:51:13.466 INFO:teuthology.orchestra.run.smithi062.stderr: 56150K .......... .......... .......... .......... .......... 76% 234M 0s 2019-11-29T12:51:13.466 INFO:teuthology.orchestra.run.smithi062.stderr: 56200K .......... .......... .......... .......... .......... 76% 230M 0s 2019-11-29T12:51:13.466 INFO:teuthology.orchestra.run.smithi062.stderr: 56250K .......... .......... .......... .......... .......... 76% 179M 0s 2019-11-29T12:51:13.466 INFO:teuthology.orchestra.run.smithi062.stderr: 56300K .......... .......... .......... .......... .......... 76% 224M 0s 2019-11-29T12:51:13.467 INFO:teuthology.orchestra.run.smithi062.stderr: 56350K .......... .......... .......... .......... .......... 76% 166M 0s 2019-11-29T12:51:13.467 INFO:teuthology.orchestra.run.smithi062.stderr: 56400K .......... .......... .......... .......... .......... 76% 193M 0s 2019-11-29T12:51:13.467 INFO:teuthology.orchestra.run.smithi062.stderr: 56450K .......... .......... .......... .......... .......... 76% 201M 0s 2019-11-29T12:51:13.467 INFO:teuthology.orchestra.run.smithi062.stderr: 56500K .......... .......... .......... .......... .......... 76% 212M 0s 2019-11-29T12:51:13.467 INFO:teuthology.orchestra.run.smithi062.stderr: 56550K .......... .......... .......... .......... .......... 76% 204M 0s 2019-11-29T12:51:13.467 INFO:teuthology.orchestra.run.smithi062.stderr: 56600K .......... .......... .......... .......... .......... 77% 238M 0s 2019-11-29T12:51:13.467 INFO:teuthology.orchestra.run.smithi062.stderr: 56650K .......... .......... .......... .......... .......... 77% 237M 0s 2019-11-29T12:51:13.467 INFO:teuthology.orchestra.run.smithi062.stderr: 56700K .......... .......... .......... .......... .......... 77% 173M 0s 2019-11-29T12:51:13.468 INFO:teuthology.orchestra.run.smithi062.stderr: 56750K .......... .......... .......... .......... .......... 77% 189M 0s 2019-11-29T12:51:13.468 INFO:teuthology.orchestra.run.smithi062.stderr: 56800K .......... .......... .......... .......... .......... 77% 245M 0s 2019-11-29T12:51:13.468 INFO:teuthology.orchestra.run.smithi062.stderr: 56850K .......... .......... .......... .......... .......... 77% 190M 0s 2019-11-29T12:51:13.468 INFO:teuthology.orchestra.run.smithi062.stderr: 56900K .......... .......... .......... .......... .......... 77% 226M 0s 2019-11-29T12:51:13.468 INFO:teuthology.orchestra.run.smithi062.stderr: 56950K .......... .......... .......... .......... .......... 77% 226M 0s 2019-11-29T12:51:13.468 INFO:teuthology.orchestra.run.smithi062.stderr: 57000K .......... .......... .......... .......... .......... 77% 207M 0s 2019-11-29T12:51:13.468 INFO:teuthology.orchestra.run.smithi062.stderr: 57050K .......... .......... .......... .......... .......... 77% 215M 0s 2019-11-29T12:51:13.469 INFO:teuthology.orchestra.run.smithi062.stderr: 57100K .......... .......... .......... .......... .......... 77% 200M 0s 2019-11-29T12:51:13.469 INFO:teuthology.orchestra.run.smithi062.stderr: 57150K .......... .......... .......... .......... .......... 77% 195M 0s 2019-11-29T12:51:13.469 INFO:teuthology.orchestra.run.smithi062.stderr: 57200K .......... .......... .......... .......... .......... 77% 199M 0s 2019-11-29T12:51:13.469 INFO:teuthology.orchestra.run.smithi062.stderr: 57250K .......... .......... .......... .......... .......... 77% 202M 0s 2019-11-29T12:51:13.469 INFO:teuthology.orchestra.run.smithi062.stderr: 57300K .......... .......... .......... .......... .......... 77% 200M 0s 2019-11-29T12:51:13.469 INFO:teuthology.orchestra.run.smithi062.stderr: 57350K .......... .......... .......... .......... .......... 78% 223M 0s 2019-11-29T12:51:13.469 INFO:teuthology.orchestra.run.smithi062.stderr: 57400K .......... .......... .......... .......... .......... 78% 219M 0s 2019-11-29T12:51:13.469 INFO:teuthology.orchestra.run.smithi062.stderr: 57450K .......... .......... .......... .......... .......... 78% 237M 0s 2019-11-29T12:51:13.470 INFO:teuthology.orchestra.run.smithi062.stderr: 57500K .......... .......... .......... .......... .......... 78% 235M 0s 2019-11-29T12:51:13.470 INFO:teuthology.orchestra.run.smithi062.stderr: 57550K .......... .......... .......... .......... .......... 78% 161M 0s 2019-11-29T12:51:13.470 INFO:teuthology.orchestra.run.smithi062.stderr: 57600K .......... .......... .......... .......... .......... 78% 260M 0s 2019-11-29T12:51:13.470 INFO:teuthology.orchestra.run.smithi062.stderr: 57650K .......... .......... .......... .......... .......... 78% 228M 0s 2019-11-29T12:51:13.470 INFO:teuthology.orchestra.run.smithi062.stderr: 57700K .......... .......... .......... .......... .......... 78% 232M 0s 2019-11-29T12:51:13.470 INFO:teuthology.orchestra.run.smithi062.stderr: 57750K .......... .......... .......... .......... .......... 78% 181M 0s 2019-11-29T12:51:13.470 INFO:teuthology.orchestra.run.smithi062.stderr: 57800K .......... .......... .......... .......... .......... 78% 253M 0s 2019-11-29T12:51:13.471 INFO:teuthology.orchestra.run.smithi062.stderr: 57850K .......... .......... .......... .......... .......... 78% 188M 0s 2019-11-29T12:51:13.471 INFO:teuthology.orchestra.run.smithi062.stderr: 57900K .......... .......... .......... .......... .......... 78% 202M 0s 2019-11-29T12:51:13.471 INFO:teuthology.orchestra.run.smithi062.stderr: 57950K .......... .......... .......... .......... .......... 78% 168M 0s 2019-11-29T12:51:13.471 INFO:teuthology.orchestra.run.smithi062.stderr: 58000K .......... .......... .......... .......... .......... 78% 264M 0s 2019-11-29T12:51:13.471 INFO:teuthology.orchestra.run.smithi062.stderr: 58050K .......... .......... .......... .......... .......... 78% 201M 0s 2019-11-29T12:51:13.471 INFO:teuthology.orchestra.run.smithi062.stderr: 58100K .......... .......... .......... .......... .......... 79% 261M 0s 2019-11-29T12:51:13.472 INFO:teuthology.orchestra.run.smithi062.stderr: 58150K .......... .......... .......... .......... .......... 79% 169M 0s 2019-11-29T12:51:13.472 INFO:teuthology.orchestra.run.smithi062.stderr: 58200K .......... .......... .......... .......... .......... 79% 244M 0s 2019-11-29T12:51:13.472 INFO:teuthology.orchestra.run.smithi062.stderr: 58250K .......... .......... .......... .......... .......... 79% 250M 0s 2019-11-29T12:51:13.472 INFO:teuthology.orchestra.run.smithi062.stderr: 58300K .......... .......... .......... .......... .......... 79% 191M 0s 2019-11-29T12:51:13.472 INFO:teuthology.orchestra.run.smithi062.stderr: 58350K .......... .......... .......... .......... .......... 79% 193M 0s 2019-11-29T12:51:13.472 INFO:teuthology.orchestra.run.smithi062.stderr: 58400K .......... .......... .......... .......... .......... 79% 207M 0s 2019-11-29T12:51:13.472 INFO:teuthology.orchestra.run.smithi062.stderr: 58450K .......... .......... .......... .......... .......... 79% 234M 0s 2019-11-29T12:51:13.473 INFO:teuthology.orchestra.run.smithi062.stderr: 58500K .......... .......... .......... .......... .......... 79% 197M 0s 2019-11-29T12:51:13.473 INFO:teuthology.orchestra.run.smithi062.stderr: 58550K .......... .......... .......... .......... .......... 79% 213M 0s 2019-11-29T12:51:13.473 INFO:teuthology.orchestra.run.smithi062.stderr: 58600K .......... .......... .......... .......... .......... 79% 179M 0s 2019-11-29T12:51:13.473 INFO:teuthology.orchestra.run.smithi062.stderr: 58650K .......... .......... .......... .......... .......... 79% 217M 0s 2019-11-29T12:51:13.473 INFO:teuthology.orchestra.run.smithi062.stderr: 58700K .......... .......... .......... .......... .......... 79% 179M 0s 2019-11-29T12:51:13.473 INFO:teuthology.orchestra.run.smithi062.stderr: 58750K .......... .......... .......... .......... .......... 79% 178M 0s 2019-11-29T12:51:13.473 INFO:teuthology.orchestra.run.smithi062.stderr: 58800K .......... .......... .......... .......... .......... 80% 234M 0s 2019-11-29T12:51:13.473 INFO:teuthology.orchestra.run.smithi062.stderr: 58850K .......... .......... .......... .......... .......... 80% 223M 0s 2019-11-29T12:51:13.474 INFO:teuthology.orchestra.run.smithi062.stderr: 58900K .......... .......... .......... .......... .......... 80% 225M 0s 2019-11-29T12:51:13.475 INFO:teuthology.orchestra.run.smithi062.stderr: 58950K .......... .......... .......... .......... .......... 80% 236M 0s 2019-11-29T12:51:13.475 INFO:teuthology.orchestra.run.smithi062.stderr: 59000K .......... .......... .......... .......... .......... 80% 197M 0s 2019-11-29T12:51:13.476 INFO:teuthology.orchestra.run.smithi062.stderr: 59050K .......... .......... .......... .......... .......... 80% 236M 0s 2019-11-29T12:51:13.476 INFO:teuthology.orchestra.run.smithi062.stderr: 59100K .......... .......... .......... .......... .......... 80% 249M 0s 2019-11-29T12:51:13.476 INFO:teuthology.orchestra.run.smithi062.stderr: 59150K .......... .......... .......... .......... .......... 80% 202M 0s 2019-11-29T12:51:13.476 INFO:teuthology.orchestra.run.smithi062.stderr: 59200K .......... .......... .......... .......... .......... 80% 191M 0s 2019-11-29T12:51:13.476 INFO:teuthology.orchestra.run.smithi062.stderr: 59250K .......... .......... .......... .......... .......... 80% 215M 0s 2019-11-29T12:51:13.476 INFO:teuthology.orchestra.run.smithi062.stderr: 59300K .......... .......... .......... .......... .......... 80% 204M 0s 2019-11-29T12:51:13.476 INFO:teuthology.orchestra.run.smithi062.stderr: 59350K .......... .......... .......... .......... .......... 80% 172M 0s 2019-11-29T12:51:13.477 INFO:teuthology.orchestra.run.smithi062.stderr: 59400K .......... .......... .......... .......... .......... 80% 264M 0s 2019-11-29T12:51:13.477 INFO:teuthology.orchestra.run.smithi062.stderr: 59450K .......... .......... .......... .......... .......... 80% 190M 0s 2019-11-29T12:51:13.477 INFO:teuthology.orchestra.run.smithi062.stderr: 59500K .......... .......... .......... .......... .......... 80% 222M 0s 2019-11-29T12:51:13.477 INFO:teuthology.orchestra.run.smithi062.stderr: 59550K .......... .......... .......... .......... .......... 81% 188M 0s 2019-11-29T12:51:13.477 INFO:teuthology.orchestra.run.smithi062.stderr: 59600K .......... .......... .......... .......... .......... 81% 196M 0s 2019-11-29T12:51:13.477 INFO:teuthology.orchestra.run.smithi062.stderr: 59650K .......... .......... .......... .......... .......... 81% 205M 0s 2019-11-29T12:51:13.477 INFO:teuthology.orchestra.run.smithi062.stderr: 59700K .......... .......... .......... .......... .......... 81% 259M 0s 2019-11-29T12:51:13.478 INFO:teuthology.orchestra.run.smithi062.stderr: 59750K .......... .......... .......... .......... .......... 81% 201M 0s 2019-11-29T12:51:13.478 INFO:teuthology.orchestra.run.smithi062.stderr: 59800K .......... .......... .......... .......... .......... 81% 200M 0s 2019-11-29T12:51:13.478 INFO:teuthology.orchestra.run.smithi062.stderr: 59850K .......... .......... .......... .......... .......... 81% 196M 0s 2019-11-29T12:51:13.478 INFO:teuthology.orchestra.run.smithi062.stderr: 59900K .......... .......... .......... .......... .......... 81% 204M 0s 2019-11-29T12:51:13.478 INFO:teuthology.orchestra.run.smithi062.stderr: 59950K .......... .......... .......... .......... .......... 81% 195M 0s 2019-11-29T12:51:13.478 INFO:teuthology.orchestra.run.smithi062.stderr: 60000K .......... .......... .......... .......... .......... 81% 221M 0s 2019-11-29T12:51:13.478 INFO:teuthology.orchestra.run.smithi062.stderr: 60050K .......... .......... .......... .......... .......... 81% 255M 0s 2019-11-29T12:51:13.479 INFO:teuthology.orchestra.run.smithi062.stderr: 60100K .......... .......... .......... .......... .......... 81% 191M 0s 2019-11-29T12:51:13.479 INFO:teuthology.orchestra.run.smithi062.stderr: 60150K .......... .......... .......... .......... .......... 81% 222M 0s 2019-11-29T12:51:13.479 INFO:teuthology.orchestra.run.smithi062.stderr: 60200K .......... .......... .......... .......... .......... 81% 266M 0s 2019-11-29T12:51:13.479 INFO:teuthology.orchestra.run.smithi062.stderr: 60250K .......... .......... .......... .......... .......... 81% 190M 0s 2019-11-29T12:51:13.479 INFO:teuthology.orchestra.run.smithi062.stderr: 60300K .......... .......... .......... .......... .......... 82% 196M 0s 2019-11-29T12:51:13.479 INFO:teuthology.orchestra.run.smithi062.stderr: 60350K .......... .......... .......... .......... .......... 82% 184M 0s 2019-11-29T12:51:13.479 INFO:teuthology.orchestra.run.smithi062.stderr: 60400K .......... .......... .......... .......... .......... 82% 185M 0s 2019-11-29T12:51:13.479 INFO:teuthology.orchestra.run.smithi062.stderr: 60450K .......... .......... .......... .......... .......... 82% 257M 0s 2019-11-29T12:51:13.480 INFO:teuthology.orchestra.run.smithi062.stderr: 60500K .......... .......... .......... .......... .......... 82% 208M 0s 2019-11-29T12:51:13.480 INFO:teuthology.orchestra.run.smithi062.stderr: 60550K .......... .......... .......... .......... .......... 82% 179M 0s 2019-11-29T12:51:13.480 INFO:teuthology.orchestra.run.smithi062.stderr: 60600K .......... .......... .......... .......... .......... 82% 263M 0s 2019-11-29T12:51:13.480 INFO:teuthology.orchestra.run.smithi062.stderr: 60650K .......... .......... .......... .......... .......... 82% 201M 0s 2019-11-29T12:51:13.480 INFO:teuthology.orchestra.run.smithi062.stderr: 60700K .......... .......... .......... .......... .......... 82% 227M 0s 2019-11-29T12:51:13.480 INFO:teuthology.orchestra.run.smithi062.stderr: 60750K .......... .......... .......... .......... .......... 82% 152M 0s 2019-11-29T12:51:13.481 INFO:teuthology.orchestra.run.smithi062.stderr: 60800K .......... .......... .......... .......... .......... 82% 248M 0s 2019-11-29T12:51:13.481 INFO:teuthology.orchestra.run.smithi062.stderr: 60850K .......... .......... .......... .......... .......... 82% 209M 0s 2019-11-29T12:51:13.481 INFO:teuthology.orchestra.run.smithi062.stderr: 60900K .......... .......... .......... .......... .......... 82% 203M 0s 2019-11-29T12:51:13.481 INFO:teuthology.orchestra.run.smithi062.stderr: 60950K .......... .......... .......... .......... .......... 82% 209M 0s 2019-11-29T12:51:13.481 INFO:teuthology.orchestra.run.smithi062.stderr: 61000K .......... .......... .......... .......... .......... 82% 232M 0s 2019-11-29T12:51:13.481 INFO:teuthology.orchestra.run.smithi062.stderr: 61050K .......... .......... .......... .......... .......... 83% 210M 0s 2019-11-29T12:51:13.481 INFO:teuthology.orchestra.run.smithi062.stderr: 61100K .......... .......... .......... .......... .......... 83% 193M 0s 2019-11-29T12:51:13.482 INFO:teuthology.orchestra.run.smithi062.stderr: 61150K .......... .......... .......... .......... .......... 83% 164M 0s 2019-11-29T12:51:13.482 INFO:teuthology.orchestra.run.smithi062.stderr: 61200K .......... .......... .......... .......... .......... 83% 214M 0s 2019-11-29T12:51:13.482 INFO:teuthology.orchestra.run.smithi062.stderr: 61250K .......... .......... .......... .......... .......... 83% 196M 0s 2019-11-29T12:51:13.482 INFO:teuthology.orchestra.run.smithi062.stderr: 61300K .......... .......... .......... .......... .......... 83% 252M 0s 2019-11-29T12:51:13.482 INFO:teuthology.orchestra.run.smithi062.stderr: 61350K .......... .......... .......... .......... .......... 83% 173M 0s 2019-11-29T12:51:13.482 INFO:teuthology.orchestra.run.smithi062.stderr: 61400K .......... .......... .......... .......... .......... 83% 213M 0s 2019-11-29T12:51:13.482 INFO:teuthology.orchestra.run.smithi062.stderr: 61450K .......... .......... .......... .......... .......... 83% 210M 0s 2019-11-29T12:51:13.483 INFO:teuthology.orchestra.run.smithi062.stderr: 61500K .......... .......... .......... .......... .......... 83% 210M 0s 2019-11-29T12:51:13.483 INFO:teuthology.orchestra.run.smithi062.stderr: 61550K .......... .......... .......... .......... .......... 83% 205M 0s 2019-11-29T12:51:13.483 INFO:teuthology.orchestra.run.smithi062.stderr: 61600K .......... .......... .......... .......... .......... 83% 221M 0s 2019-11-29T12:51:13.483 INFO:teuthology.orchestra.run.smithi062.stderr: 61650K .......... .......... .......... .......... .......... 83% 214M 0s 2019-11-29T12:51:13.483 INFO:teuthology.orchestra.run.smithi062.stderr: 61700K .......... .......... .......... .......... .......... 83% 222M 0s 2019-11-29T12:51:13.483 INFO:teuthology.orchestra.run.smithi062.stderr: 61750K .......... .......... .......... .......... .......... 84% 202M 0s 2019-11-29T12:51:13.483 INFO:teuthology.orchestra.run.smithi062.stderr: 61800K .......... .......... .......... .......... .......... 84% 210M 0s 2019-11-29T12:51:13.484 INFO:teuthology.orchestra.run.smithi062.stderr: 61850K .......... .......... .......... .......... .......... 84% 172M 0s 2019-11-29T12:51:13.484 INFO:teuthology.orchestra.run.smithi062.stderr: 61900K .......... .......... .......... .......... .......... 84% 247M 0s 2019-11-29T12:51:13.484 INFO:teuthology.orchestra.run.smithi062.stderr: 61950K .......... .......... .......... .......... .......... 84% 193M 0s 2019-11-29T12:51:13.484 INFO:teuthology.orchestra.run.smithi062.stderr: 62000K .......... .......... .......... .......... .......... 84% 198M 0s 2019-11-29T12:51:13.484 INFO:teuthology.orchestra.run.smithi062.stderr: 62050K .......... .......... .......... .......... .......... 84% 269M 0s 2019-11-29T12:51:13.484 INFO:teuthology.orchestra.run.smithi062.stderr: 62100K .......... .......... .......... .......... .......... 84% 253M 0s 2019-11-29T12:51:13.484 INFO:teuthology.orchestra.run.smithi062.stderr: 62150K .......... .......... .......... .......... .......... 84% 162M 0s 2019-11-29T12:51:13.484 INFO:teuthology.orchestra.run.smithi062.stderr: 62200K .......... .......... .......... .......... .......... 84% 239M 0s 2019-11-29T12:51:13.485 INFO:teuthology.orchestra.run.smithi062.stderr: 62250K .......... .......... .......... .......... .......... 84% 213M 0s 2019-11-29T12:51:13.485 INFO:teuthology.orchestra.run.smithi062.stderr: 62300K .......... .......... .......... .......... .......... 84% 254M 0s 2019-11-29T12:51:13.485 INFO:teuthology.orchestra.run.smithi062.stderr: 62350K .......... .......... .......... .......... .......... 84% 177M 0s 2019-11-29T12:51:13.485 INFO:teuthology.orchestra.run.smithi062.stderr: 62400K .......... .......... .......... .......... .......... 84% 223M 0s 2019-11-29T12:51:13.485 INFO:teuthology.orchestra.run.smithi062.stderr: 62450K .......... .......... .......... .......... .......... 84% 245M 0s 2019-11-29T12:51:13.485 INFO:teuthology.orchestra.run.smithi062.stderr: 62500K .......... .......... .......... .......... .......... 85% 219M 0s 2019-11-29T12:51:13.485 INFO:teuthology.orchestra.run.smithi062.stderr: 62550K .......... .......... .......... .......... .......... 85% 187M 0s 2019-11-29T12:51:13.486 INFO:teuthology.orchestra.run.smithi062.stderr: 62600K .......... .......... .......... .......... .......... 85% 250M 0s 2019-11-29T12:51:13.486 INFO:teuthology.orchestra.run.smithi062.stderr: 62650K .......... .......... .......... .......... .......... 85% 190M 0s 2019-11-29T12:51:13.486 INFO:teuthology.orchestra.run.smithi062.stderr: 62700K .......... .......... .......... .......... .......... 85% 221M 0s 2019-11-29T12:51:13.486 INFO:teuthology.orchestra.run.smithi062.stderr: 62750K .......... .......... .......... .......... .......... 85% 189M 0s 2019-11-29T12:51:13.486 INFO:teuthology.orchestra.run.smithi062.stderr: 62800K .......... .......... .......... .......... .......... 85% 238M 0s 2019-11-29T12:51:13.486 INFO:teuthology.orchestra.run.smithi062.stderr: 62850K .......... .......... .......... .......... .......... 85% 201M 0s 2019-11-29T12:51:13.486 INFO:teuthology.orchestra.run.smithi062.stderr: 62900K .......... .......... .......... .......... .......... 85% 200M 0s 2019-11-29T12:51:13.486 INFO:teuthology.orchestra.run.smithi062.stderr: 62950K .......... .......... .......... .......... .......... 85% 193M 0s 2019-11-29T12:51:13.487 INFO:teuthology.orchestra.run.smithi062.stderr: 63000K .......... .......... .......... .......... .......... 85% 224M 0s 2019-11-29T12:51:13.487 INFO:teuthology.orchestra.run.smithi062.stderr: 63050K .......... .......... .......... .......... .......... 85% 201M 0s 2019-11-29T12:51:13.487 INFO:teuthology.orchestra.run.smithi062.stderr: 63100K .......... .......... .......... .......... .......... 85% 273M 0s 2019-11-29T12:51:13.487 INFO:teuthology.orchestra.run.smithi062.stderr: 63150K .......... .......... .......... .......... .......... 85% 160M 0s 2019-11-29T12:51:13.487 INFO:teuthology.orchestra.run.smithi062.stderr: 63200K .......... .......... .......... .......... .......... 85% 265M 0s 2019-11-29T12:51:13.487 INFO:teuthology.orchestra.run.smithi062.stderr: 63250K .......... .......... .......... .......... .......... 86% 204M 0s 2019-11-29T12:51:13.487 INFO:teuthology.orchestra.run.smithi062.stderr: 63300K .......... .......... .......... .......... .......... 86% 204M 0s 2019-11-29T12:51:13.488 INFO:teuthology.orchestra.run.smithi062.stderr: 63350K .......... .......... .......... .......... .......... 86% 190M 0s 2019-11-29T12:51:13.488 INFO:teuthology.orchestra.run.smithi062.stderr: 63400K .......... .......... .......... .......... .......... 86% 223M 0s 2019-11-29T12:51:13.488 INFO:teuthology.orchestra.run.smithi062.stderr: 63450K .......... .......... .......... .......... .......... 86% 266M 0s 2019-11-29T12:51:13.488 INFO:teuthology.orchestra.run.smithi062.stderr: 63500K .......... .......... .......... .......... .......... 86% 179M 0s 2019-11-29T12:51:13.488 INFO:teuthology.orchestra.run.smithi062.stderr: 63550K .......... .......... .......... .......... .......... 86% 192M 0s 2019-11-29T12:51:13.488 INFO:teuthology.orchestra.run.smithi062.stderr: 63600K .......... .......... .......... .......... .......... 86% 185M 0s 2019-11-29T12:51:13.488 INFO:teuthology.orchestra.run.smithi062.stderr: 63650K .......... .......... .......... .......... .......... 86% 261M 0s 2019-11-29T12:51:13.489 INFO:teuthology.orchestra.run.smithi062.stderr: 63700K .......... .......... .......... .......... .......... 86% 269M 0s 2019-11-29T12:51:13.489 INFO:teuthology.orchestra.run.smithi062.stderr: 63750K .......... .......... .......... .......... .......... 86% 155M 0s 2019-11-29T12:51:13.489 INFO:teuthology.orchestra.run.smithi062.stderr: 63800K .......... .......... .......... .......... .......... 86% 209M 0s 2019-11-29T12:51:13.489 INFO:teuthology.orchestra.run.smithi062.stderr: 63850K .......... .......... .......... .......... .......... 86% 222M 0s 2019-11-29T12:51:13.489 INFO:teuthology.orchestra.run.smithi062.stderr: 63900K .......... .......... .......... .......... .......... 86% 228M 0s 2019-11-29T12:51:13.489 INFO:teuthology.orchestra.run.smithi062.stderr: 63950K .......... .......... .......... .......... .......... 87% 182M 0s 2019-11-29T12:51:13.489 INFO:teuthology.orchestra.run.smithi062.stderr: 64000K .......... .......... .......... .......... .......... 87% 203M 0s 2019-11-29T12:51:13.489 INFO:teuthology.orchestra.run.smithi062.stderr: 64050K .......... .......... .......... .......... .......... 87% 195M 0s 2019-11-29T12:51:13.490 INFO:teuthology.orchestra.run.smithi062.stderr: 64100K .......... .......... .......... .......... .......... 87% 187M 0s 2019-11-29T12:51:13.490 INFO:teuthology.orchestra.run.smithi062.stderr: 64150K .......... .......... .......... .......... .......... 87% 186M 0s 2019-11-29T12:51:13.490 INFO:teuthology.orchestra.run.smithi062.stderr: 64200K .......... .......... .......... .......... .......... 87% 229M 0s 2019-11-29T12:51:13.490 INFO:teuthology.orchestra.run.smithi062.stderr: 64250K .......... .......... .......... .......... .......... 87% 208M 0s 2019-11-29T12:51:13.490 INFO:teuthology.orchestra.run.smithi062.stderr: 64300K .......... .......... .......... .......... .......... 87% 211M 0s 2019-11-29T12:51:13.490 INFO:teuthology.orchestra.run.smithi062.stderr: 64350K .......... .......... .......... .......... .......... 87% 182M 0s 2019-11-29T12:51:13.490 INFO:teuthology.orchestra.run.smithi062.stderr: 64400K .......... .......... .......... .......... .......... 87% 202M 0s 2019-11-29T12:51:13.491 INFO:teuthology.orchestra.run.smithi062.stderr: 64450K .......... .......... .......... .......... .......... 87% 195M 0s 2019-11-29T12:51:13.491 INFO:teuthology.orchestra.run.smithi062.stderr: 64500K .......... .......... .......... .......... .......... 87% 181M 0s 2019-11-29T12:51:13.491 INFO:teuthology.orchestra.run.smithi062.stderr: 64550K .......... .......... .......... .......... .......... 87% 161M 0s 2019-11-29T12:51:13.491 INFO:teuthology.orchestra.run.smithi062.stderr: 64600K .......... .......... .......... .......... .......... 87% 223M 0s 2019-11-29T12:51:13.491 INFO:teuthology.orchestra.run.smithi062.stderr: 64650K .......... .......... .......... .......... .......... 87% 224M 0s 2019-11-29T12:51:13.491 INFO:teuthology.orchestra.run.smithi062.stderr: 64700K .......... .......... .......... .......... .......... 88% 189M 0s 2019-11-29T12:51:13.491 INFO:teuthology.orchestra.run.smithi062.stderr: 64750K .......... .......... .......... .......... .......... 88% 199M 0s 2019-11-29T12:51:13.491 INFO:teuthology.orchestra.run.smithi062.stderr: 64800K .......... .......... .......... .......... .......... 88% 233M 0s 2019-11-29T12:51:13.492 INFO:teuthology.orchestra.run.smithi062.stderr: 64850K .......... .......... .......... .......... .......... 88% 198M 0s 2019-11-29T12:51:13.492 INFO:teuthology.orchestra.run.smithi062.stderr: 64900K .......... .......... .......... .......... .......... 88% 188M 0s 2019-11-29T12:51:13.492 INFO:teuthology.orchestra.run.smithi062.stderr: 64950K .......... .......... .......... .......... .......... 88% 190M 0s 2019-11-29T12:51:13.492 INFO:teuthology.orchestra.run.smithi062.stderr: 65000K .......... .......... .......... .......... .......... 88% 355M 0s 2019-11-29T12:51:13.492 INFO:teuthology.orchestra.run.smithi062.stderr: 65050K .......... .......... .......... .......... .......... 88% 370M 0s 2019-11-29T12:51:13.492 INFO:teuthology.orchestra.run.smithi062.stderr: 65100K .......... .......... .......... .......... .......... 88% 320M 0s 2019-11-29T12:51:13.492 INFO:teuthology.orchestra.run.smithi062.stderr: 65150K .......... .......... .......... .......... .......... 88% 280M 0s 2019-11-29T12:51:13.493 INFO:teuthology.orchestra.run.smithi062.stderr: 65200K .......... .......... .......... .......... .......... 88% 396M 0s 2019-11-29T12:51:13.493 INFO:teuthology.orchestra.run.smithi062.stderr: 65250K .......... .......... .......... .......... .......... 88% 288M 0s 2019-11-29T12:51:13.493 INFO:teuthology.orchestra.run.smithi062.stderr: 65300K .......... .......... .......... .......... .......... 88% 374M 0s 2019-11-29T12:51:13.493 INFO:teuthology.orchestra.run.smithi062.stderr: 65350K .......... .......... .......... .......... .......... 88% 359M 0s 2019-11-29T12:51:13.493 INFO:teuthology.orchestra.run.smithi062.stderr: 65400K .......... .......... .......... .......... .......... 88% 385M 0s 2019-11-29T12:51:13.493 INFO:teuthology.orchestra.run.smithi062.stderr: 65450K .......... .......... .......... .......... .......... 89% 372M 0s 2019-11-29T12:51:13.493 INFO:teuthology.orchestra.run.smithi062.stderr: 65500K .......... .......... .......... .......... .......... 89% 315M 0s 2019-11-29T12:51:13.494 INFO:teuthology.orchestra.run.smithi062.stderr: 65550K .......... .......... .......... .......... .......... 89% 229M 0s 2019-11-29T12:51:13.494 INFO:teuthology.orchestra.run.smithi062.stderr: 65600K .......... .......... .......... .......... .......... 89% 328M 0s 2019-11-29T12:51:13.494 INFO:teuthology.orchestra.run.smithi062.stderr: 65650K .......... .......... .......... .......... .......... 89% 280M 0s 2019-11-29T12:51:13.494 INFO:teuthology.orchestra.run.smithi062.stderr: 65700K .......... .......... .......... .......... .......... 89% 211M 0s 2019-11-29T12:51:13.494 INFO:teuthology.orchestra.run.smithi062.stderr: 65750K .......... .......... .......... .......... .......... 89% 217M 0s 2019-11-29T12:51:13.494 INFO:teuthology.orchestra.run.smithi062.stderr: 65800K .......... .......... .......... .......... .......... 89% 192M 0s 2019-11-29T12:51:13.494 INFO:teuthology.orchestra.run.smithi062.stderr: 65850K .......... .......... .......... .......... .......... 89% 260M 0s 2019-11-29T12:51:13.494 INFO:teuthology.orchestra.run.smithi062.stderr: 65900K .......... .......... .......... .......... .......... 89% 212M 0s 2019-11-29T12:51:13.495 INFO:teuthology.orchestra.run.smithi062.stderr: 65950K .......... .......... .......... .......... .......... 89% 169M 0s 2019-11-29T12:51:13.495 INFO:teuthology.orchestra.run.smithi062.stderr: 66000K .......... .......... .......... .......... .......... 89% 261M 0s 2019-11-29T12:51:13.495 INFO:teuthology.orchestra.run.smithi062.stderr: 66050K .......... .......... .......... .......... .......... 89% 205M 0s 2019-11-29T12:51:13.495 INFO:teuthology.orchestra.run.smithi062.stderr: 66100K .......... .......... .......... .......... .......... 89% 212M 0s 2019-11-29T12:51:13.495 INFO:teuthology.orchestra.run.smithi062.stderr: 66150K .......... .......... .......... .......... .......... 89% 175M 0s 2019-11-29T12:51:13.495 INFO:teuthology.orchestra.run.smithi062.stderr: 66200K .......... .......... .......... .......... .......... 90% 211M 0s 2019-11-29T12:51:13.495 INFO:teuthology.orchestra.run.smithi062.stderr: 66250K .......... .......... .......... .......... .......... 90% 227M 0s 2019-11-29T12:51:13.496 INFO:teuthology.orchestra.run.smithi062.stderr: 66300K .......... .......... .......... .......... .......... 90% 217M 0s 2019-11-29T12:51:13.496 INFO:teuthology.orchestra.run.smithi062.stderr: 66350K .......... .......... .......... .......... .......... 90% 194M 0s 2019-11-29T12:51:13.496 INFO:teuthology.orchestra.run.smithi062.stderr: 66400K .......... .......... .......... .......... .......... 90% 236M 0s 2019-11-29T12:51:13.496 INFO:teuthology.orchestra.run.smithi062.stderr: 66450K .......... .......... .......... .......... .......... 90% 189M 0s 2019-11-29T12:51:13.496 INFO:teuthology.orchestra.run.smithi062.stderr: 66500K .......... .......... .......... .......... .......... 90% 244M 0s 2019-11-29T12:51:13.496 INFO:teuthology.orchestra.run.smithi062.stderr: 66550K .......... .......... .......... .......... .......... 90% 174M 0s 2019-11-29T12:51:13.496 INFO:teuthology.orchestra.run.smithi062.stderr: 66600K .......... .......... .......... .......... .......... 90% 209M 0s 2019-11-29T12:51:13.496 INFO:teuthology.orchestra.run.smithi062.stderr: 66650K .......... .......... .......... .......... .......... 90% 246M 0s 2019-11-29T12:51:13.497 INFO:teuthology.orchestra.run.smithi062.stderr: 66700K .......... .......... .......... .......... .......... 90% 206M 0s 2019-11-29T12:51:13.497 INFO:teuthology.orchestra.run.smithi062.stderr: 66750K .......... .......... .......... .......... .......... 90% 174M 0s 2019-11-29T12:51:13.497 INFO:teuthology.orchestra.run.smithi062.stderr: 66800K .......... .......... .......... .......... .......... 90% 211M 0s 2019-11-29T12:51:13.497 INFO:teuthology.orchestra.run.smithi062.stderr: 66850K .......... .......... .......... .......... .......... 90% 258M 0s 2019-11-29T12:51:13.497 INFO:teuthology.orchestra.run.smithi062.stderr: 66900K .......... .......... .......... .......... .......... 91% 208M 0s 2019-11-29T12:51:13.497 INFO:teuthology.orchestra.run.smithi062.stderr: 66950K .......... .......... .......... .......... .......... 91% 184M 0s 2019-11-29T12:51:13.497 INFO:teuthology.orchestra.run.smithi062.stderr: 67000K .......... .......... .......... .......... .......... 91% 207M 0s 2019-11-29T12:51:13.498 INFO:teuthology.orchestra.run.smithi062.stderr: 67050K .......... .......... .......... .......... .......... 91% 229M 0s 2019-11-29T12:51:13.498 INFO:teuthology.orchestra.run.smithi062.stderr: 67100K .......... .......... .......... .......... .......... 91% 261M 0s 2019-11-29T12:51:13.498 INFO:teuthology.orchestra.run.smithi062.stderr: 67150K .......... .......... .......... .......... .......... 91% 200M 0s 2019-11-29T12:51:13.498 INFO:teuthology.orchestra.run.smithi062.stderr: 67200K .......... .......... .......... .......... .......... 91% 172M 0s 2019-11-29T12:51:13.498 INFO:teuthology.orchestra.run.smithi062.stderr: 67250K .......... .......... .......... .......... .......... 91% 200M 0s 2019-11-29T12:51:13.498 INFO:teuthology.orchestra.run.smithi062.stderr: 67300K .......... .......... .......... .......... .......... 91% 193M 0s 2019-11-29T12:51:13.498 INFO:teuthology.orchestra.run.smithi062.stderr: 67350K .......... .......... .......... .......... .......... 91% 232M 0s 2019-11-29T12:51:13.498 INFO:teuthology.orchestra.run.smithi062.stderr: 67400K .......... .......... .......... .......... .......... 91% 201M 0s 2019-11-29T12:51:13.499 INFO:teuthology.orchestra.run.smithi062.stderr: 67450K .......... .......... .......... .......... .......... 91% 223M 0s 2019-11-29T12:51:13.499 INFO:teuthology.orchestra.run.smithi062.stderr: 67500K .......... .......... .......... .......... .......... 91% 220M 0s 2019-11-29T12:51:13.499 INFO:teuthology.orchestra.run.smithi062.stderr: 67550K .......... .......... .......... .......... .......... 91% 168M 0s 2019-11-29T12:51:13.499 INFO:teuthology.orchestra.run.smithi062.stderr: 67600K .......... .......... .......... .......... .......... 91% 264M 0s 2019-11-29T12:51:13.499 INFO:teuthology.orchestra.run.smithi062.stderr: 67650K .......... .......... .......... .......... .......... 92% 220M 0s 2019-11-29T12:51:13.499 INFO:teuthology.orchestra.run.smithi062.stderr: 67700K .......... .......... .......... .......... .......... 92% 165M 0s 2019-11-29T12:51:13.499 INFO:teuthology.orchestra.run.smithi062.stderr: 67750K .......... .......... .......... .......... .......... 92% 185M 0s 2019-11-29T12:51:13.500 INFO:teuthology.orchestra.run.smithi062.stderr: 67800K .......... .......... .......... .......... .......... 92% 234M 0s 2019-11-29T12:51:13.500 INFO:teuthology.orchestra.run.smithi062.stderr: 67850K .......... .......... .......... .......... .......... 92% 222M 0s 2019-11-29T12:51:13.500 INFO:teuthology.orchestra.run.smithi062.stderr: 67900K .......... .......... .......... .......... .......... 92% 211M 0s 2019-11-29T12:51:13.500 INFO:teuthology.orchestra.run.smithi062.stderr: 67950K .......... .......... .......... .......... .......... 92% 189M 0s 2019-11-29T12:51:13.500 INFO:teuthology.orchestra.run.smithi062.stderr: 68000K .......... .......... .......... .......... .......... 92% 197M 0s 2019-11-29T12:51:13.500 INFO:teuthology.orchestra.run.smithi062.stderr: 68050K .......... .......... .......... .......... .......... 92% 217M 0s 2019-11-29T12:51:13.500 INFO:teuthology.orchestra.run.smithi062.stderr: 68100K .......... .......... .......... .......... .......... 92% 262M 0s 2019-11-29T12:51:13.500 INFO:teuthology.orchestra.run.smithi062.stderr: 68150K .......... .......... .......... .......... .......... 92% 197M 0s 2019-11-29T12:51:13.501 INFO:teuthology.orchestra.run.smithi062.stderr: 68200K .......... .......... .......... .......... .......... 92% 205M 0s 2019-11-29T12:51:13.501 INFO:teuthology.orchestra.run.smithi062.stderr: 68250K .......... .......... .......... .......... .......... 92% 247M 0s 2019-11-29T12:51:13.501 INFO:teuthology.orchestra.run.smithi062.stderr: 68300K .......... .......... .......... .......... .......... 92% 255M 0s 2019-11-29T12:51:13.501 INFO:teuthology.orchestra.run.smithi062.stderr: 68350K .......... .......... .......... .......... .......... 92% 179M 0s 2019-11-29T12:51:13.501 INFO:teuthology.orchestra.run.smithi062.stderr: 68400K .......... .......... .......... .......... .......... 93% 193M 0s 2019-11-29T12:51:13.501 INFO:teuthology.orchestra.run.smithi062.stderr: 68450K .......... .......... .......... .......... .......... 93% 254M 0s 2019-11-29T12:51:13.501 INFO:teuthology.orchestra.run.smithi062.stderr: 68500K .......... .......... .......... .......... .......... 93% 234M 0s 2019-11-29T12:51:13.502 INFO:teuthology.orchestra.run.smithi062.stderr: 68550K .......... .......... .......... .......... .......... 93% 186M 0s 2019-11-29T12:51:13.502 INFO:teuthology.orchestra.run.smithi062.stderr: 68600K .......... .......... .......... .......... .......... 93% 185M 0s 2019-11-29T12:51:13.502 INFO:teuthology.orchestra.run.smithi062.stderr: 68650K .......... .......... .......... .......... .......... 93% 178M 0s 2019-11-29T12:51:13.502 INFO:teuthology.orchestra.run.smithi062.stderr: 68700K .......... .......... .......... .......... .......... 93% 270M 0s 2019-11-29T12:51:13.502 INFO:teuthology.orchestra.run.smithi062.stderr: 68750K .......... .......... .......... .......... .......... 93% 168M 0s 2019-11-29T12:51:13.502 INFO:teuthology.orchestra.run.smithi062.stderr: 68800K .......... .......... .......... .......... .......... 93% 162M 0s 2019-11-29T12:51:13.502 INFO:teuthology.orchestra.run.smithi062.stderr: 68850K .......... .......... .......... .......... .......... 93% 254M 0s 2019-11-29T12:51:13.502 INFO:teuthology.orchestra.run.smithi062.stderr: 68900K .......... .......... .......... .......... .......... 93% 197M 0s 2019-11-29T12:51:13.503 INFO:teuthology.orchestra.run.smithi062.stderr: 68950K .......... .......... .......... .......... .......... 93% 210M 0s 2019-11-29T12:51:13.503 INFO:teuthology.orchestra.run.smithi062.stderr: 69000K .......... .......... .......... .......... .......... 93% 186M 0s 2019-11-29T12:51:13.503 INFO:teuthology.orchestra.run.smithi062.stderr: 69050K .......... .......... .......... .......... .......... 93% 216M 0s 2019-11-29T12:51:13.503 INFO:teuthology.orchestra.run.smithi062.stderr: 69100K .......... .......... .......... .......... .......... 94% 223M 0s 2019-11-29T12:51:13.503 INFO:teuthology.orchestra.run.smithi062.stderr: 69150K .......... .......... .......... .......... .......... 94% 182M 0s 2019-11-29T12:51:13.503 INFO:teuthology.orchestra.run.smithi062.stderr: 69200K .......... .......... .......... .......... .......... 94% 246M 0s 2019-11-29T12:51:13.503 INFO:teuthology.orchestra.run.smithi062.stderr: 69250K .......... .......... .......... .......... .......... 94% 227M 0s 2019-11-29T12:51:13.504 INFO:teuthology.orchestra.run.smithi062.stderr: 69300K .......... .......... .......... .......... .......... 94% 205M 0s 2019-11-29T12:51:13.504 INFO:teuthology.orchestra.run.smithi062.stderr: 69350K .......... .......... .......... .......... .......... 94% 182M 0s 2019-11-29T12:51:13.504 INFO:teuthology.orchestra.run.smithi062.stderr: 69400K .......... .......... .......... .......... .......... 94% 243M 0s 2019-11-29T12:51:13.504 INFO:teuthology.orchestra.run.smithi062.stderr: 69450K .......... .......... .......... .......... .......... 94% 187M 0s 2019-11-29T12:51:13.504 INFO:teuthology.orchestra.run.smithi062.stderr: 69500K .......... .......... .......... .......... .......... 94% 250M 0s 2019-11-29T12:51:13.504 INFO:teuthology.orchestra.run.smithi062.stderr: 69550K .......... .......... .......... .......... .......... 94% 199M 0s 2019-11-29T12:51:13.505 INFO:teuthology.orchestra.run.smithi062.stderr: 69600K .......... .......... .......... .......... .......... 94% 201M 0s 2019-11-29T12:51:13.505 INFO:teuthology.orchestra.run.smithi062.stderr: 69650K .......... .......... .......... .......... .......... 94% 195M 0s 2019-11-29T12:51:13.505 INFO:teuthology.orchestra.run.smithi062.stderr: 69700K .......... .......... .......... .......... .......... 94% 258M 0s 2019-11-29T12:51:13.505 INFO:teuthology.orchestra.run.smithi062.stderr: 69750K .......... .......... .......... .......... .......... 94% 208M 0s 2019-11-29T12:51:13.505 INFO:teuthology.orchestra.run.smithi062.stderr: 69800K .......... .......... .......... .......... .......... 94% 191M 0s 2019-11-29T12:51:13.505 INFO:teuthology.orchestra.run.smithi062.stderr: 69850K .......... .......... .......... .......... .......... 95% 190M 0s 2019-11-29T12:51:13.505 INFO:teuthology.orchestra.run.smithi062.stderr: 69900K .......... .......... .......... .......... .......... 95% 265M 0s 2019-11-29T12:51:13.506 INFO:teuthology.orchestra.run.smithi062.stderr: 69950K .......... .......... .......... .......... .......... 95% 189M 0s 2019-11-29T12:51:13.506 INFO:teuthology.orchestra.run.smithi062.stderr: 70000K .......... .......... .......... .......... .......... 95% 206M 0s 2019-11-29T12:51:13.506 INFO:teuthology.orchestra.run.smithi062.stderr: 70050K .......... .......... .......... .......... .......... 95% 204M 0s 2019-11-29T12:51:13.506 INFO:teuthology.orchestra.run.smithi062.stderr: 70100K .......... .......... .......... .......... .......... 95% 207M 0s 2019-11-29T12:51:13.506 INFO:teuthology.orchestra.run.smithi062.stderr: 70150K .......... .......... .......... .......... .......... 95% 168M 0s 2019-11-29T12:51:13.506 INFO:teuthology.orchestra.run.smithi062.stderr: 70200K .......... .......... .......... .......... .......... 95% 229M 0s 2019-11-29T12:51:13.506 INFO:teuthology.orchestra.run.smithi062.stderr: 70250K .......... .......... .......... .......... .......... 95% 267M 0s 2019-11-29T12:51:13.506 INFO:teuthology.orchestra.run.smithi062.stderr: 70300K .......... .......... .......... .......... .......... 95% 216M 0s 2019-11-29T12:51:13.507 INFO:teuthology.orchestra.run.smithi062.stderr: 70350K .......... .......... .......... .......... .......... 95% 193M 0s 2019-11-29T12:51:13.507 INFO:teuthology.orchestra.run.smithi062.stderr: 70400K .......... .......... .......... .......... .......... 95% 268M 0s 2019-11-29T12:51:13.507 INFO:teuthology.orchestra.run.smithi062.stderr: 70450K .......... .......... .......... .......... .......... 95% 263M 0s 2019-11-29T12:51:13.507 INFO:teuthology.orchestra.run.smithi062.stderr: 70500K .......... .......... .......... .......... .......... 95% 269M 0s 2019-11-29T12:51:13.507 INFO:teuthology.orchestra.run.smithi062.stderr: 70550K .......... .......... .......... .......... .......... 95% 214M 0s 2019-11-29T12:51:13.507 INFO:teuthology.orchestra.run.smithi062.stderr: 70600K .......... .......... .......... .......... .......... 96% 273M 0s 2019-11-29T12:51:13.507 INFO:teuthology.orchestra.run.smithi062.stderr: 70650K .......... .......... .......... .......... .......... 96% 262M 0s 2019-11-29T12:51:13.508 INFO:teuthology.orchestra.run.smithi062.stderr: 70700K .......... .......... .......... .......... .......... 96% 258M 0s 2019-11-29T12:51:13.508 INFO:teuthology.orchestra.run.smithi062.stderr: 70750K .......... .......... .......... .......... .......... 96% 213M 0s 2019-11-29T12:51:13.508 INFO:teuthology.orchestra.run.smithi062.stderr: 70800K .......... .......... .......... .......... .......... 96% 256M 0s 2019-11-29T12:51:13.508 INFO:teuthology.orchestra.run.smithi062.stderr: 70850K .......... .......... .......... .......... .......... 96% 247M 0s 2019-11-29T12:51:13.508 INFO:teuthology.orchestra.run.smithi062.stderr: 70900K .......... .......... .......... .......... .......... 96% 234M 0s 2019-11-29T12:51:13.508 INFO:teuthology.orchestra.run.smithi062.stderr: 70950K .......... .......... .......... .......... .......... 96% 210M 0s 2019-11-29T12:51:13.508 INFO:teuthology.orchestra.run.smithi062.stderr: 71000K .......... .......... .......... .......... .......... 96% 264M 0s 2019-11-29T12:51:13.509 INFO:teuthology.orchestra.run.smithi062.stderr: 71050K .......... .......... .......... .......... .......... 96% 237M 0s 2019-11-29T12:51:13.509 INFO:teuthology.orchestra.run.smithi062.stderr: 71100K .......... .......... .......... .......... .......... 96% 267M 0s 2019-11-29T12:51:13.509 INFO:teuthology.orchestra.run.smithi062.stderr: 71150K .......... .......... .......... .......... .......... 96% 209M 0s 2019-11-29T12:51:13.509 INFO:teuthology.orchestra.run.smithi062.stderr: 71200K .......... .......... .......... .......... .......... 96% 268M 0s 2019-11-29T12:51:13.509 INFO:teuthology.orchestra.run.smithi062.stderr: 71250K .......... .......... .......... .......... .......... 96% 261M 0s 2019-11-29T12:51:13.509 INFO:teuthology.orchestra.run.smithi062.stderr: 71300K .......... .......... .......... .......... .......... 96% 194M 0s 2019-11-29T12:51:13.509 INFO:teuthology.orchestra.run.smithi062.stderr: 71350K .......... .......... .......... .......... .......... 97% 233M 0s 2019-11-29T12:51:13.509 INFO:teuthology.orchestra.run.smithi062.stderr: 71400K .......... .......... .......... .......... .......... 97% 268M 0s 2019-11-29T12:51:13.510 INFO:teuthology.orchestra.run.smithi062.stderr: 71450K .......... .......... .......... .......... .......... 97% 267M 0s 2019-11-29T12:51:13.510 INFO:teuthology.orchestra.run.smithi062.stderr: 71500K .......... .......... .......... .......... .......... 97% 254M 0s 2019-11-29T12:51:13.510 INFO:teuthology.orchestra.run.smithi062.stderr: 71550K .......... .......... .......... .......... .......... 97% 208M 0s 2019-11-29T12:51:13.510 INFO:teuthology.orchestra.run.smithi062.stderr: 71600K .......... .......... .......... .......... .......... 97% 204M 0s 2019-11-29T12:51:13.510 INFO:teuthology.orchestra.run.smithi062.stderr: 71650K .......... .......... .......... .......... .......... 97% 187M 0s 2019-11-29T12:51:13.510 INFO:teuthology.orchestra.run.smithi062.stderr: 71700K .......... .......... .......... .......... .......... 97% 204M 0s 2019-11-29T12:51:13.510 INFO:teuthology.orchestra.run.smithi062.stderr: 71750K .......... .......... .......... .......... .......... 97% 172M 0s 2019-11-29T12:51:13.511 INFO:teuthology.orchestra.run.smithi062.stderr: 71800K .......... .......... .......... .......... .......... 97% 200M 0s 2019-11-29T12:51:13.511 INFO:teuthology.orchestra.run.smithi062.stderr: 71850K .......... .......... .......... .......... .......... 97% 180M 0s 2019-11-29T12:51:13.511 INFO:teuthology.orchestra.run.smithi062.stderr: 71900K .......... .......... .......... .......... .......... 97% 220M 0s 2019-11-29T12:51:13.511 INFO:teuthology.orchestra.run.smithi062.stderr: 71950K .......... .......... .......... .......... .......... 97% 141M 0s 2019-11-29T12:51:13.511 INFO:teuthology.orchestra.run.smithi062.stderr: 72000K .......... .......... .......... .......... .......... 97% 200M 0s 2019-11-29T12:51:13.511 INFO:teuthology.orchestra.run.smithi062.stderr: 72050K .......... .......... .......... .......... .......... 98% 182M 0s 2019-11-29T12:51:13.511 INFO:teuthology.orchestra.run.smithi062.stderr: 72100K .......... .......... .......... .......... .......... 98% 196M 0s 2019-11-29T12:51:13.511 INFO:teuthology.orchestra.run.smithi062.stderr: 72150K .......... .......... .......... .......... .......... 98% 169M 0s 2019-11-29T12:51:13.512 INFO:teuthology.orchestra.run.smithi062.stderr: 72200K .......... .......... .......... .......... .......... 98% 218M 0s 2019-11-29T12:51:13.512 INFO:teuthology.orchestra.run.smithi062.stderr: 72250K .......... .......... .......... .......... .......... 98% 221M 0s 2019-11-29T12:51:13.512 INFO:teuthology.orchestra.run.smithi062.stderr: 72300K .......... .......... .......... .......... .......... 98% 199M 0s 2019-11-29T12:51:13.512 INFO:teuthology.orchestra.run.smithi062.stderr: 72350K .......... .......... .......... .......... .......... 98% 182M 0s 2019-11-29T12:51:13.512 INFO:teuthology.orchestra.run.smithi062.stderr: 72400K .......... .......... .......... .......... .......... 98% 222M 0s 2019-11-29T12:51:13.512 INFO:teuthology.orchestra.run.smithi062.stderr: 72450K .......... .......... .......... .......... .......... 98% 215M 0s 2019-11-29T12:51:13.512 INFO:teuthology.orchestra.run.smithi062.stderr: 72500K .......... .......... .......... .......... .......... 98% 255M 0s 2019-11-29T12:51:13.513 INFO:teuthology.orchestra.run.smithi062.stderr: 72550K .......... .......... .......... .......... .......... 98% 233M 0s 2019-11-29T12:51:13.513 INFO:teuthology.orchestra.run.smithi062.stderr: 72600K .......... .......... .......... .......... .......... 98% 265M 0s 2019-11-29T12:51:13.513 INFO:teuthology.orchestra.run.smithi062.stderr: 72650K .......... .......... .......... .......... .......... 98% 262M 0s 2019-11-29T12:51:13.513 INFO:teuthology.orchestra.run.smithi062.stderr: 72700K .......... .......... .......... .......... .......... 98% 266M 0s 2019-11-29T12:51:13.513 INFO:teuthology.orchestra.run.smithi062.stderr: 72750K .......... .......... .......... .......... .......... 98% 225M 0s 2019-11-29T12:51:13.513 INFO:teuthology.orchestra.run.smithi062.stderr: 72800K .......... .......... .......... .......... .......... 99% 259M 0s 2019-11-29T12:51:13.513 INFO:teuthology.orchestra.run.smithi062.stderr: 72850K .......... .......... .......... .......... .......... 99% 273M 0s 2019-11-29T12:51:13.514 INFO:teuthology.orchestra.run.smithi062.stderr: 72900K .......... .......... .......... .......... .......... 99% 269M 0s 2019-11-29T12:51:13.514 INFO:teuthology.orchestra.run.smithi062.stderr: 72950K .......... .......... .......... .......... .......... 99% 234M 0s 2019-11-29T12:51:13.514 INFO:teuthology.orchestra.run.smithi062.stderr: 73000K .......... .......... .......... .......... .......... 99% 271M 0s 2019-11-29T12:51:13.514 INFO:teuthology.orchestra.run.smithi062.stderr: 73050K .......... .......... .......... .......... .......... 99% 245M 0s 2019-11-29T12:51:13.514 INFO:teuthology.orchestra.run.smithi062.stderr: 73100K .......... .......... .......... .......... .......... 99% 267M 0s 2019-11-29T12:51:13.514 INFO:teuthology.orchestra.run.smithi062.stderr: 73150K .......... .......... .......... .......... .......... 99% 239M 0s 2019-11-29T12:51:13.514 INFO:teuthology.orchestra.run.smithi062.stderr: 73200K .......... .......... .......... .......... .......... 99% 268M 0s 2019-11-29T12:51:13.514 INFO:teuthology.orchestra.run.smithi062.stderr: 73250K .......... .......... .......... .......... .......... 99% 270M 0s 2019-11-29T12:51:13.515 INFO:teuthology.orchestra.run.smithi062.stderr: 73300K .......... .......... .......... .......... .......... 99% 259M 0s 2019-11-29T12:51:13.515 INFO:teuthology.orchestra.run.smithi062.stderr: 73350K .......... .......... .......... .......... .......... 99% 216M 0s 2019-11-29T12:51:13.515 INFO:teuthology.orchestra.run.smithi062.stderr: 73400K .......... .......... .......... .......... .......... 99% 258M 0s 2019-11-29T12:51:13.515 INFO:teuthology.orchestra.run.smithi062.stderr: 73450K .......... .......... .......... .......... .......... 99% 252M 0s 2019-11-29T12:51:13.515 INFO:teuthology.orchestra.run.smithi062.stderr: 73500K .......... .......... .......... .......... .......... 99% 262M 0s 2019-11-29T12:51:13.515 INFO:teuthology.orchestra.run.smithi062.stderr: 73550K ........ 100% 319M=0.4s 2019-11-29T12:51:13.515 INFO:teuthology.orchestra.run.smithi062.stderr: 2019-11-29T12:51:13.516 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29 12:51:12 (201 MB/s) - ‘gradle-4.7-bin.zip’ saved [75323957/75323957] 2019-11-29T12:51:13.516 INFO:teuthology.orchestra.run.smithi062.stderr: 2019-11-29T12:51:13.516 INFO:teuthology.orchestra.run.smithi062.stdout:Archive: gradle-4.7-bin.zip 2019-11-29T12:51:13.516 INFO:teuthology.orchestra.run.smithi062.stdout: creating: /opt/gradle/gradle-4.7/ 2019-11-29T12:51:13.516 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/getting-started.html 2019-11-29T12:51:13.516 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/LICENSE 2019-11-29T12:51:13.516 INFO:teuthology.orchestra.run.smithi062.stdout: creating: /opt/gradle/gradle-4.7/media/ 2019-11-29T12:51:13.517 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/media/gradle-icon-64x64.png 2019-11-29T12:51:13.517 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/media/gradle-icon-48x48.png 2019-11-29T12:51:13.517 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/media/gradle.icns 2019-11-29T12:51:13.517 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/media/gradle-icon-24x24.png 2019-11-29T12:51:13.517 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/media/gradle-icon-256x256.png 2019-11-29T12:51:13.517 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/media/gradle-icon-512x512.png 2019-11-29T12:51:13.517 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/media/gradle-icon-16x16.png 2019-11-29T12:51:13.518 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/media/gradle-icon-32x32.png 2019-11-29T12:51:13.518 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/media/gradle-icon-128x128.png 2019-11-29T12:51:13.518 INFO:teuthology.orchestra.run.smithi062.stdout: creating: /opt/gradle/gradle-4.7/init.d/ 2019-11-29T12:51:13.518 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/init.d/readme.txt 2019-11-29T12:51:13.518 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/NOTICE 2019-11-29T12:51:13.518 INFO:teuthology.orchestra.run.smithi062.stdout: creating: /opt/gradle/gradle-4.7/bin/ 2019-11-29T12:51:13.518 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/bin/gradle.bat 2019-11-29T12:51:13.519 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/bin/gradle 2019-11-29T12:51:13.519 INFO:teuthology.orchestra.run.smithi062.stdout: creating: /opt/gradle/gradle-4.7/lib/ 2019-11-29T12:51:13.519 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/annotations-13.0.jar 2019-11-29T12:51:13.519 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-kotlin-dsl-0.16.3.jar 2019-11-29T12:51:13.519 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-kotlin-dsl-tooling-builders-0.16.3.jar 2019-11-29T12:51:13.519 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-kotlin-dsl-tooling-models-0.16.3.jar 2019-11-29T12:51:13.519 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/kotlin-compiler-embeddable-1.2.31.jar 2019-11-29T12:51:13.519 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/kotlin-reflect-1.2.31.jar 2019-11-29T12:51:13.520 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/kotlin-sam-with-receiver-compiler-plugin-1.2.31.jar 2019-11-29T12:51:13.520 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/kotlin-script-runtime-1.2.31.jar 2019-11-29T12:51:13.520 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/kotlin-stdlib-1.2.31.jar 2019-11-29T12:51:13.520 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/kotlin-stdlib-jdk7-1.2.31.jar 2019-11-29T12:51:13.520 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/kotlin-stdlib-jdk8-1.2.31.jar 2019-11-29T12:51:13.520 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-launcher-4.7.jar 2019-11-29T12:51:13.520 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-runtime-api-info-4.7.jar 2019-11-29T12:51:13.521 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-tooling-api-4.7.jar 2019-11-29T12:51:13.521 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-wrapper-4.7.jar 2019-11-29T12:51:13.521 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-installation-beacon-4.7.jar 2019-11-29T12:51:13.521 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-core-4.7.jar 2019-11-29T12:51:13.521 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-jvm-services-4.7.jar 2019-11-29T12:51:13.521 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-core-api-4.7.jar 2019-11-29T12:51:13.521 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-build-cache-4.7.jar 2019-11-29T12:51:13.522 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-logging-4.7.jar 2019-11-29T12:51:13.522 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-process-services-4.7.jar 2019-11-29T12:51:13.522 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-resources-4.7.jar 2019-11-29T12:51:13.522 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-persistent-cache-4.7.jar 2019-11-29T12:51:13.522 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-native-4.7.jar 2019-11-29T12:51:13.522 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-model-groovy-4.7.jar 2019-11-29T12:51:13.522 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-model-core-4.7.jar 2019-11-29T12:51:13.523 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-base-services-groovy-4.7.jar 2019-11-29T12:51:13.523 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-messaging-4.7.jar 2019-11-29T12:51:13.523 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-base-services-4.7.jar 2019-11-29T12:51:13.523 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-build-option-4.7.jar 2019-11-29T12:51:13.523 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-cli-4.7.jar 2019-11-29T12:51:13.523 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-docs-4.7.jar 2019-11-29T12:51:13.523 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/asm-commons-6.1.1.jar 2019-11-29T12:51:13.523 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/asm-analysis-6.1.1.jar 2019-11-29T12:51:13.524 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/asm-tree-6.1.1.jar 2019-11-29T12:51:13.524 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/kryo-2.20.jar 2019-11-29T12:51:13.524 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/reflectasm-1.07-shaded.jar 2019-11-29T12:51:13.524 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/asm-6.1.1.jar 2019-11-29T12:51:13.524 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/commons-io-2.4.jar 2019-11-29T12:51:13.524 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/jcl-over-slf4j-1.7.16.jar 2019-11-29T12:51:13.524 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/jul-to-slf4j-1.7.16.jar 2019-11-29T12:51:13.525 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/log4j-over-slf4j-1.7.16.jar 2019-11-29T12:51:13.525 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/slf4j-api-1.7.16.jar 2019-11-29T12:51:13.525 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/guava-jdk5-17.0.jar 2019-11-29T12:51:13.525 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/jsr305-2.0.1.jar 2019-11-29T12:51:13.525 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/fastutil-7.2.1-min.jar 2019-11-29T12:51:13.525 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/commons-lang-2.6.jar 2019-11-29T12:51:13.525 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/jcip-annotations-1.0.jar 2019-11-29T12:51:13.526 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/groovy-all-2.4.12.jar 2019-11-29T12:51:13.526 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/ant-1.9.9.jar 2019-11-29T12:51:13.526 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/javax.inject-1.jar 2019-11-29T12:51:13.526 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/commons-collections-3.2.2.jar 2019-11-29T12:51:13.526 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-0.14.jar 2019-11-29T12:51:13.526 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/commons-compress-1.14.jar 2019-11-29T12:51:13.526 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/xml-apis-1.4.01.jar 2019-11-29T12:51:13.526 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/jansi-1.14.jar 2019-11-29T12:51:13.527 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/ant-launcher-1.9.9.jar 2019-11-29T12:51:13.527 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-freebsd-amd64-libcpp-0.14.jar 2019-11-29T12:51:13.527 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-freebsd-amd64-libstdcpp-0.14.jar 2019-11-29T12:51:13.527 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-freebsd-i386-libcpp-0.14.jar 2019-11-29T12:51:13.527 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-freebsd-i386-libstdcpp-0.14.jar 2019-11-29T12:51:13.527 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-linux-amd64-0.14.jar 2019-11-29T12:51:13.527 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-linux-i386-0.14.jar 2019-11-29T12:51:13.528 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-osx-amd64-0.14.jar 2019-11-29T12:51:13.528 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-osx-i386-0.14.jar 2019-11-29T12:51:13.528 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-windows-amd64-0.14.jar 2019-11-29T12:51:13.528 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-windows-i386-0.14.jar 2019-11-29T12:51:13.528 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-linux-amd64-ncurses5-0.14.jar 2019-11-29T12:51:13.528 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-linux-amd64-ncurses6-0.14.jar 2019-11-29T12:51:13.528 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-linux-i386-ncurses5-0.14.jar 2019-11-29T12:51:13.528 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-linux-i386-ncurses6-0.14.jar 2019-11-29T12:51:13.529 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/minlog-1.2.jar 2019-11-29T12:51:13.529 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/objenesis-1.2.jar 2019-11-29T12:51:13.529 INFO:teuthology.orchestra.run.smithi062.stdout: creating: /opt/gradle/gradle-4.7/lib/plugins/ 2019-11-29T12:51:13.529 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-announce-4.7.jar 2019-11-29T12:51:13.529 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-antlr-4.7.jar 2019-11-29T12:51:13.529 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-code-quality-4.7.jar 2019-11-29T12:51:13.529 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-osgi-4.7.jar 2019-11-29T12:51:13.530 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-signing-4.7.jar 2019-11-29T12:51:13.530 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-ide-native-4.7.jar 2019-11-29T12:51:13.530 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-testing-native-4.7.jar 2019-11-29T12:51:13.530 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-language-native-4.7.jar 2019-11-29T12:51:13.530 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-plugin-development-4.7.jar 2019-11-29T12:51:13.530 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-maven-4.7.jar 2019-11-29T12:51:13.530 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-ide-play-4.7.jar 2019-11-29T12:51:13.530 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-ide-4.7.jar 2019-11-29T12:51:13.531 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-scala-4.7.jar 2019-11-29T12:51:13.531 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-build-comparison-4.7.jar 2019-11-29T12:51:13.531 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-ear-4.7.jar 2019-11-29T12:51:13.531 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-platform-play-4.7.jar 2019-11-29T12:51:13.531 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-javascript-4.7.jar 2019-11-29T12:51:13.531 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-ivy-4.7.jar 2019-11-29T12:51:13.531 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-jacoco-4.7.jar 2019-11-29T12:51:13.532 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-build-init-4.7.jar 2019-11-29T12:51:13.532 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-plugins-4.7.jar 2019-11-29T12:51:13.532 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-tooling-api-builders-4.7.jar 2019-11-29T12:51:13.532 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-test-kit-4.7.jar 2019-11-29T12:51:13.532 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-composite-builds-4.7.jar 2019-11-29T12:51:13.532 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-language-groovy-4.7.jar 2019-11-29T12:51:13.532 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-language-scala-4.7.jar 2019-11-29T12:51:13.533 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-testing-junit-platform-4.7.jar 2019-11-29T12:51:13.533 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-testing-jvm-4.7.jar 2019-11-29T12:51:13.533 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-language-java-4.7.jar 2019-11-29T12:51:13.533 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-language-jvm-4.7.jar 2019-11-29T12:51:13.533 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-platform-jvm-4.7.jar 2019-11-29T12:51:13.533 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-platform-native-4.7.jar 2019-11-29T12:51:13.533 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-diagnostics-4.7.jar 2019-11-29T12:51:13.534 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-testing-base-4.7.jar 2019-11-29T12:51:13.534 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-reporting-4.7.jar 2019-11-29T12:51:13.534 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-publish-4.7.jar 2019-11-29T12:51:13.534 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-platform-base-4.7.jar 2019-11-29T12:51:13.534 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-plugin-use-4.7.jar 2019-11-29T12:51:13.534 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-resources-s3-4.7.jar 2019-11-29T12:51:13.534 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-resources-gcs-4.7.jar 2019-11-29T12:51:13.535 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-build-cache-http-4.7.jar 2019-11-29T12:51:13.535 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-dependency-management-4.7.jar 2019-11-29T12:51:13.535 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-resources-http-4.7.jar 2019-11-29T12:51:13.535 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-resources-sftp-4.7.jar 2019-11-29T12:51:13.535 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-workers-4.7.jar 2019-11-29T12:51:13.535 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-version-control-4.7.jar 2019-11-29T12:51:13.535 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/aws-java-sdk-s3-1.11.267.jar 2019-11-29T12:51:13.535 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/aws-java-sdk-kms-1.11.267.jar 2019-11-29T12:51:13.536 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/aws-java-sdk-core-1.11.267.jar 2019-11-29T12:51:13.536 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/org.eclipse.jgit-4.5.3.201708160445-r.jar 2019-11-29T12:51:13.536 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/wagon-http-2.4.jar 2019-11-29T12:51:13.536 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/wagon-http-shared4-2.4.jar 2019-11-29T12:51:13.536 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/google-api-services-storage-v1-rev116-1.23.0.jar 2019-11-29T12:51:13.536 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/google-api-client-1.23.0.jar 2019-11-29T12:51:13.536 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/google-oauth-client-1.23.0.jar 2019-11-29T12:51:13.537 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/google-http-client-jackson2-1.23.0.jar 2019-11-29T12:51:13.537 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/google-http-client-1.23.0.jar 2019-11-29T12:51:13.537 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/httpclient-4.5.5.jar 2019-11-29T12:51:13.537 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/commons-codec-1.10.jar 2019-11-29T12:51:13.537 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/plexus-container-default-1.5.5.jar 2019-11-29T12:51:13.537 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/xbean-reflect-3.4.jar 2019-11-29T12:51:13.537 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/asm-util-6.1.1.jar 2019-11-29T12:51:13.538 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/jatl-0.2.2.jar 2019-11-29T12:51:13.538 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/commons-cli-1.2.jar 2019-11-29T12:51:13.538 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/biz.aQute.bndlib-3.4.0.jar 2019-11-29T12:51:13.538 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/ivy-2.2.0.jar 2019-11-29T12:51:13.538 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/maven-compat-3.0.4.jar 2019-11-29T12:51:13.538 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/maven-core-3.0.4.jar 2019-11-29T12:51:13.538 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/pmaven-common-0.8-20100325.jar 2019-11-29T12:51:13.538 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/pmaven-groovy-0.8-20100325.jar 2019-11-29T12:51:13.539 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/wagon-file-2.4.jar 2019-11-29T12:51:13.539 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/aether-connector-wagon-1.13.1.jar 2019-11-29T12:51:13.539 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/bcpg-jdk15on-1.58.jar 2019-11-29T12:51:13.539 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/rhino-1.7R3.jar 2019-11-29T12:51:13.539 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gson-2.7.jar 2019-11-29T12:51:13.539 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/simple-4.1.21.jar 2019-11-29T12:51:13.539 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/maven-plugin-api-3.0.4.jar 2019-11-29T12:51:13.540 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/testng-6.3.1.jar 2019-11-29T12:51:13.540 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/snakeyaml-1.6.jar 2019-11-29T12:51:13.540 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/dd-plist-1.20.jar 2019-11-29T12:51:13.540 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/junit-4.12.jar 2019-11-29T12:51:13.540 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/bsh-2.0b6.jar 2019-11-29T12:51:13.540 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/junit-platform-launcher-1.0.3.jar 2019-11-29T12:51:13.540 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/jcifs-1.3.17.jar 2019-11-29T12:51:13.541 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/nekohtml-1.9.20.jar 2019-11-29T12:51:13.541 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/xercesImpl-2.11.0.jar 2019-11-29T12:51:13.541 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/jsch-0.1.54.jar 2019-11-29T12:51:13.541 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/jmespath-java-1.11.267.jar 2019-11-29T12:51:13.541 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/jackson-databind-2.8.11.jar 2019-11-29T12:51:13.541 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/jackson-core-2.8.11.jar 2019-11-29T12:51:13.541 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/jackson-annotations-2.8.11.jar 2019-11-29T12:51:13.541 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/joda-time-2.8.2.jar 2019-11-29T12:51:13.542 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/bcprov-jdk15on-1.58.jar 2019-11-29T12:51:13.542 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/maven-aether-provider-3.0.4.jar 2019-11-29T12:51:13.542 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/aether-impl-1.13.1.jar 2019-11-29T12:51:13.542 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/aether-spi-1.13.1.jar 2019-11-29T12:51:13.542 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/aether-util-1.13.1.jar 2019-11-29T12:51:13.542 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/aether-api-1.13.1.jar 2019-11-29T12:51:13.542 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/wagon-provider-api-2.4.jar 2019-11-29T12:51:13.543 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/plexus-classworlds-2.4.jar 2019-11-29T12:51:13.543 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/maven-model-builder-3.0.4.jar 2019-11-29T12:51:13.543 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/maven-model-3.0.4.jar 2019-11-29T12:51:13.543 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/maven-settings-builder-3.0.4.jar 2019-11-29T12:51:13.543 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/maven-artifact-3.0.4.jar 2019-11-29T12:51:13.543 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/maven-settings-3.0.4.jar 2019-11-29T12:51:13.543 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/plexus-sec-dispatcher-1.3.jar 2019-11-29T12:51:13.543 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/maven-repository-metadata-3.0.4.jar 2019-11-29T12:51:13.544 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/plexus-utils-3.0.8.jar 2019-11-29T12:51:13.544 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/ion-java-1.0.2.jar 2019-11-29T12:51:13.544 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/httpcore-4.4.9.jar 2019-11-29T12:51:13.544 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/hamcrest-core-1.3.jar 2019-11-29T12:51:13.544 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/junit-platform-engine-1.0.3.jar 2019-11-29T12:51:13.544 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/junit-platform-commons-1.0.3.jar 2019-11-29T12:51:13.544 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/apiguardian-api-1.0.0.jar 2019-11-29T12:51:13.545 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/jcommander-1.47.jar 2019-11-29T12:51:13.545 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/plexus-interpolation-1.14.jar 2019-11-29T12:51:13.545 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/plexus-component-annotations-1.5.5.jar 2019-11-29T12:51:13.545 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/opentest4j-1.0.0.jar 2019-11-29T12:51:13.545 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/plexus-cipher-1.7.jar 2019-11-29T12:51:13.545 INFO:teuthology.orchestra.run.smithi062.stdout:export PATH=/opt/gradle/gradle-4.7/bin:/usr/lib64/qt-3.3/bin:/usr/local/bin:/usr/bin 2019-11-29T12:51:14.354 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:51:14.354 INFO:teuthology.orchestra.run.smithi062.stdout:Welcome to Gradle 4.7! 2019-11-29T12:51:14.354 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:51:14.354 INFO:teuthology.orchestra.run.smithi062.stdout:Here are the highlights of this release: 2019-11-29T12:51:14.355 INFO:teuthology.orchestra.run.smithi062.stdout: - Incremental annotation processing 2019-11-29T12:51:14.355 INFO:teuthology.orchestra.run.smithi062.stdout: - JDK 10 support 2019-11-29T12:51:14.355 INFO:teuthology.orchestra.run.smithi062.stdout: - Grouped non-interactive console logs 2019-11-29T12:51:14.355 INFO:teuthology.orchestra.run.smithi062.stdout: - Failed tests are re-run first for quicker feedback 2019-11-29T12:51:14.355 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:51:14.355 INFO:teuthology.orchestra.run.smithi062.stdout:For more details see https://docs.gradle.org/4.7/release-notes.html 2019-11-29T12:51:14.356 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:51:14.643 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:51:14.643 INFO:teuthology.orchestra.run.smithi062.stdout:------------------------------------------------------------ 2019-11-29T12:51:14.643 INFO:teuthology.orchestra.run.smithi062.stdout:Gradle 4.7 2019-11-29T12:51:14.643 INFO:teuthology.orchestra.run.smithi062.stdout:------------------------------------------------------------ 2019-11-29T12:51:14.643 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:51:14.644 INFO:teuthology.orchestra.run.smithi062.stdout:Build time: 2018-04-18 09:09:12 UTC 2019-11-29T12:51:14.644 INFO:teuthology.orchestra.run.smithi062.stdout:Revision: b9a962bf70638332300e7f810689cb2febbd4a6c 2019-11-29T12:51:14.644 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:51:14.644 INFO:teuthology.orchestra.run.smithi062.stdout:Groovy: 2.4.12 2019-11-29T12:51:14.644 INFO:teuthology.orchestra.run.smithi062.stdout:Ant: Apache Ant(TM) version 1.9.9 compiled on February 2 2017 2019-11-29T12:51:14.644 INFO:teuthology.orchestra.run.smithi062.stdout:JVM: 1.8.0_232 (Oracle Corporation 25.232-b09) 2019-11-29T12:51:14.645 INFO:teuthology.orchestra.run.smithi062.stdout:OS: Linux 3.10.0-1062.4.3.el7.x86_64 amd64 2019-11-29T12:51:14.645 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:51:14.649 INFO:teuthology.orchestra.run.smithi062:> sudo keytool -import -alias smithi062.front.sepia.ceph.com -keystore $(readlink -e $(dirname $(readlink -e $(which keytool)))/../lib/security/cacerts) -file /home/ubuntu/cephtest/ca/rgw.client.0.crt -storepass changeit 2019-11-29T12:51:15.056 INFO:teuthology.orchestra.run.smithi062.stderr:Certificate was added to keystore 2019-11-29T12:51:15.070 DEBUG:tasks.s3tests_java:S3 Tests Java: BEGIN 2019-11-29T12:51:15.070 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1'] 2019-11-29T12:51:15.070 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi022.front.sepia.ceph.com 2019-11-29T12:51:15.070 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2019-11-29T12:51:15.071 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi062.front.sepia.ceph.com 2019-11-29T12:51:15.071 INFO:tasks.s3tests_java:S3 Tests Java: Creating S3 users... 2019-11-29T12:51:15.472 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf is {'bucket_prefix': 'test-', 's3main': {'access_key': None, 's3dir': 'folder', 'endpoint': None, 'display_name': None, 'region': 'mexico', 'port': None, 'access_secret': None, 'SSE': 'AES256', 'is_secure': None, 'email': None, 'dir': '../data'}} 2019-11-29T12:51:15.473 DEBUG:tasks.s3tests_java:S3 Tests Java: Creating user tester.client.0 2019-11-29T12:51:15.473 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf[s3main] is {'access_key': 'QWBSQCKXFJJYCDKBKVXF', 's3dir': 'folder', 'endpoint': 'smithi062.front.sepia.ceph.com:443', 'display_name': 'Ms. tester.client.0', 'user_id': 'tester.client.0', 'region': 'mexico', 'port': 443, 'access_secret': 'lsIXMDJZN1I7XzaBX+Y+tm+s62pcOEqB52dpa3hfffZmStBxDznsEA==', 'host': 'smithi062.front.sepia.ceph.com', 'SSE': 'AES256', 'is_secure': True, 'email': 'tester.client.0_test@test.test', 'dir': '../data'} 2019-11-29T12:51:15.473 DEBUG:tasks.s3tests_java:S3 Tests Java: Setion, User = s3main, tester.client.0 2019-11-29T12:51:15.473 INFO:tasks.s3tests_java:['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '-n', 'client.0', 'user', 'create', '--uid', 'tester.client.0', '--display-name', 'Ms. tester.client.0', '--access-key', 'QWBSQCKXFJJYCDKBKVXF', '--secret', 'lsIXMDJZN1I7XzaBX+Y+tm+s62pcOEqB52dpa3hfffZmStBxDznsEA==', '--email', 'tester.client.0_test@test.test', '--cluster', 'ceph'] 2019-11-29T12:51:15.474 INFO:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid tester.client.0 --display-name 'Ms. tester.client.0' --access-key QWBSQCKXFJJYCDKBKVXF --secret lsIXMDJZN1I7XzaBX+Y+tm+s62pcOEqB52dpa3hfffZmStBxDznsEA== --email tester.client.0_test@test.test --cluster ceph 2019-11-29T12:51:15.476 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:00:25:56.094 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T12:51:15.476 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:00:25:56.098 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T12:51:15.477 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:25:56.069 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T12:51:15.477 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:25:56.091 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T12:51:15.477 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:25:56.080 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T12:51:15.490 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:25:56.108 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T12:51:15.566 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:25:56.185 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T12:51:15.594 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:25:56.212 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T12:51:15.617 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:00:25:56.281 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T12:51:15.729 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:15.737+0000 7f366fddaec0 20 rados->read ofs=0 len=0 2019-11-29T12:51:15.782 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:15.790+0000 7f366fddaec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T12:51:15.782 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:15.790+0000 7f366fddaec0 20 rados->read ofs=0 len=0 2019-11-29T12:51:15.790 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:15.798+0000 7f366fddaec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T12:51:15.790 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:15.798+0000 7f366fddaec0 20 rados->read ofs=0 len=0 2019-11-29T12:51:15.803 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:15.812+0000 7f366fddaec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T12:51:15.804 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:15.812+0000 7f366fddaec0 20 rados->read ofs=0 len=0 2019-11-29T12:51:15.818 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:15.827+0000 7f366fddaec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T12:51:16.062 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:16.070+0000 7f366fddaec0 20 RGWRados::pool_iterate: got zone_info.7f922895-c6d7-4b1b-a19c-be3df5b5a899 2019-11-29T12:51:16.062 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:16.070+0000 7f366fddaec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-29T12:51:16.062 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:16.070+0000 7f366fddaec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-29T12:51:16.062 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:16.070+0000 7f366fddaec0 20 RGWRados::pool_iterate: got zonegroup_info.76ba47ff-1c23-4409-aae0-24fe26589cae 2019-11-29T12:51:16.063 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:16.070+0000 7f366fddaec0 20 rados->read ofs=0 len=0 2019-11-29T12:51:16.074 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:16.082+0000 7f366fddaec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T12:51:16.074 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:16.082+0000 7f366fddaec0 20 rados->read ofs=0 len=0 2019-11-29T12:51:16.084 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:16.092+0000 7f366fddaec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-29T12:51:16.084 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:16.093+0000 7f366fddaec0 20 rados->read ofs=0 len=0 2019-11-29T12:51:16.093 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:16.102+0000 7f366fddaec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T12:51:16.094 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:16.102+0000 7f366fddaec0 20 rados->read ofs=0 len=0 2019-11-29T12:51:16.102 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:16.110+0000 7f366fddaec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-29T12:51:16.102 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:16.111+0000 7f366fddaec0 20 rados->read ofs=0 len=0 2019-11-29T12:51:16.107 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:16.116+0000 7f366fddaec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T12:51:16.108 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:16.116+0000 7f366fddaec0 10 cannot find current period zonegroup using local zonegroup 2019-11-29T12:51:16.108 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:16.116+0000 7f366fddaec0 20 rados->read ofs=0 len=0 2019-11-29T12:51:16.119 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:16.128+0000 7f366fddaec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T12:51:16.120 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:16.128+0000 7f366fddaec0 20 rados->read ofs=0 len=0 2019-11-29T12:51:16.128 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:16.137+0000 7f366fddaec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T12:51:16.128 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:16.137+0000 7f366fddaec0 20 rados->read ofs=0 len=0 2019-11-29T12:51:16.137 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:16.145+0000 7f366fddaec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-29T12:51:16.137 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:16.145+0000 7f366fddaec0 20 zonegroup default 2019-11-29T12:51:16.137 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:16.145+0000 7f366fddaec0 20 rados->read ofs=0 len=0 2019-11-29T12:51:16.155 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:16.164+0000 7f366fddaec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T12:51:16.156 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:16.164+0000 7f366fddaec0 10 Cannot find current period zone using local zone 2019-11-29T12:51:16.156 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:16.164+0000 7f366fddaec0 20 rados->read ofs=0 len=0 2019-11-29T12:51:16.172 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:16.180+0000 7f366fddaec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T12:51:16.172 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:16.180+0000 7f366fddaec0 20 rados->read ofs=0 len=0 2019-11-29T12:51:16.182 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:16.190+0000 7f366fddaec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T12:51:16.182 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:16.190+0000 7f366fddaec0 20 rados->read ofs=0 len=0 2019-11-29T12:51:16.193 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:16.202+0000 7f366fddaec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-29T12:51:16.194 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:16.202+0000 7f366fddaec0 20 zone default found 2019-11-29T12:51:16.194 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:16.202+0000 7f366fddaec0 20 started sync module instance, tier type = 2019-11-29T12:51:16.194 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:16.202+0000 7f366fddaec0 20 started zone id=7f922895-c6d7-4b1b-a19c-be3df5b5a899 (name=default) with tier type = 2019-11-29T12:51:16.521 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:16.530+0000 7f366fddaec0 20 add_watcher() i=0 2019-11-29T12:51:16.521 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:16.530+0000 7f366fddaec0 20 add_watcher() i=1 2019-11-29T12:51:16.521 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:16.530+0000 7f366fddaec0 20 add_watcher() i=2 2019-11-29T12:51:16.522 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:16.530+0000 7f366fddaec0 20 add_watcher() i=3 2019-11-29T12:51:16.522 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:16.530+0000 7f366fddaec0 20 add_watcher() i=4 2019-11-29T12:51:16.522 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:16.530+0000 7f366fddaec0 20 add_watcher() i=5 2019-11-29T12:51:16.522 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:16.530+0000 7f366fddaec0 20 add_watcher() i=6 2019-11-29T12:51:16.575 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:16.583+0000 7f366fddaec0 20 add_watcher() i=7 2019-11-29T12:51:16.575 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:16.583+0000 7f366fddaec0 2 all 8 watchers are set, enabling cache 2019-11-29T12:51:16.576 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:16.584+0000 7f362dfdb700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-29T12:51:16.602 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:16.611+0000 7f365d808700 0 -- >> v2:172.21.15.62:3300/0 conn(0x55c0072d95c0 msgr2=0x55c0072d99d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-29T12:51:16.718 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:16.726+0000 7f365d808700 0 -- 172.21.15.62:0/660198459 >> [v2:172.21.15.22:6803/9262,v1:172.21.15.22:6805/9262] conn(0x55c0072ed8f0 msgr2=0x55c0072efd10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-29T12:51:18.419 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:18.427+0000 7f359ffff700 20 reqs_thread_entry: start 2019-11-29T12:51:18.419 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:18.427+0000 7f359dffb700 20 reqs_thread_entry: start 2019-11-29T12:51:18.419 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:18.427+0000 7f366fddaec0 20 init_complete bucket index max shards: 0 2019-11-29T12:51:18.420 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:18.428+0000 7f358bfff700 20 reqs_thread_entry: start 2019-11-29T12:51:18.420 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:18.428+0000 7f366fddaec0 20 get_system_obj_state: rctx=0x7fff4cee72d8 obj=default.rgw.meta:users.uid:tester.client.0 state=0x55c007354140 s->prefetch_data=0 2019-11-29T12:51:18.420 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:18.428+0000 7f366fddaec0 10 cache get: name=default.rgw.meta+users.uid+tester.client.0 : miss 2019-11-29T12:51:18.430 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:18.439+0000 7f366fddaec0 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x0 2019-11-29T12:51:18.430 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:18.439+0000 7f366fddaec0 10 adding default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2019-11-29T12:51:18.430 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:18.439+0000 7f366fddaec0 20 get_system_obj_state: rctx=0x7fff4cee72e8 obj=default.rgw.meta:users.email:tester.client.0_test@test.test state=0x55c007355ed0 s->prefetch_data=0 2019-11-29T12:51:18.430 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:18.439+0000 7f366fddaec0 10 cache get: name=default.rgw.meta+users.email+tester.client.0_test@test.test : miss 2019-11-29T12:51:18.441 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:18.449+0000 7f366fddaec0 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x0 2019-11-29T12:51:18.441 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:18.449+0000 7f366fddaec0 10 adding default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2019-11-29T12:51:18.441 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:18.449+0000 7f366fddaec0 20 get_system_obj_state: rctx=0x7fff4cee72e8 obj=default.rgw.meta:users.keys:QWBSQCKXFJJYCDKBKVXF state=0x55c007355ed0 s->prefetch_data=0 2019-11-29T12:51:18.441 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:18.449+0000 7f366fddaec0 10 cache get: name=default.rgw.meta+users.keys+QWBSQCKXFJJYCDKBKVXF : miss 2019-11-29T12:51:18.451 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:18.460+0000 7f366fddaec0 10 cache put: name=default.rgw.meta+users.keys+QWBSQCKXFJJYCDKBKVXF info.flags=0x0 2019-11-29T12:51:18.451 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:18.460+0000 7f366fddaec0 10 adding default.rgw.meta+users.keys+QWBSQCKXFJJYCDKBKVXF to cache LRU end 2019-11-29T12:51:18.452 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:18.460+0000 7f366fddaec0 20 get_system_obj_state: rctx=0x7fff4cee6ef8 obj=default.rgw.meta:users.keys:QWBSQCKXFJJYCDKBKVXF state=0x55c007355ed0 s->prefetch_data=0 2019-11-29T12:51:18.452 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:18.460+0000 7f366fddaec0 10 cache get: name=default.rgw.meta+users.keys+QWBSQCKXFJJYCDKBKVXF : type miss (requested=0x6, cached=0x0) 2019-11-29T12:51:18.458 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:18.466+0000 7f366fddaec0 10 cache put: name=default.rgw.meta+users.keys+QWBSQCKXFJJYCDKBKVXF info.flags=0x0 2019-11-29T12:51:18.458 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:18.466+0000 7f366fddaec0 10 moving default.rgw.meta+users.keys+QWBSQCKXFJJYCDKBKVXF to cache LRU end 2019-11-29T12:51:18.458 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:18.467+0000 7f366fddaec0 20 get_system_obj_state: rctx=0x7fff4cee7078 obj=default.rgw.meta:users.keys:QWBSQCKXFJJYCDKBKVXF state=0x55c007355ed0 s->prefetch_data=0 2019-11-29T12:51:18.458 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:18.467+0000 7f366fddaec0 10 cache get: name=default.rgw.meta+users.keys+QWBSQCKXFJJYCDKBKVXF : type miss (requested=0x6, cached=0x0) 2019-11-29T12:51:18.464 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:18.473+0000 7f366fddaec0 10 cache put: name=default.rgw.meta+users.keys+QWBSQCKXFJJYCDKBKVXF info.flags=0x0 2019-11-29T12:51:18.464 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:18.473+0000 7f366fddaec0 10 moving default.rgw.meta+users.keys+QWBSQCKXFJJYCDKBKVXF to cache LRU end 2019-11-29T12:51:18.542 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:18.550+0000 7f366fddaec0 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2019-11-29T12:51:18.542 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:18.550+0000 7f366fddaec0 10 moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2019-11-29T12:51:18.542 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:18.550+0000 7f366fddaec0 10 distributing notification oid=default.rgw.control:notify.6 bl.length()=632 2019-11-29T12:51:18.557 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:18.565+0000 7f363e7fc700 10 RGWWatcher::handle_notify() notify_id 566935683077 cookie 94283242433952 notifier 4726 bl.length()=632 2019-11-29T12:51:18.557 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:18.565+0000 7f363e7fc700 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2019-11-29T12:51:18.557 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:18.565+0000 7f363e7fc700 10 moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2019-11-29T12:51:19.060 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:19.068+0000 7f366fddaec0 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2019-11-29T12:51:19.060 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:19.068+0000 7f366fddaec0 10 moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2019-11-29T12:51:19.060 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:19.068+0000 7f366fddaec0 10 distributing notification oid=default.rgw.control:notify.3 bl.length()=200 2019-11-29T12:51:19.072 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:19.081+0000 7f363e7fc700 10 RGWWatcher::handle_notify() notify_id 566935683076 cookie 94283242427456 notifier 4726 bl.length()=200 2019-11-29T12:51:19.073 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:19.081+0000 7f363e7fc700 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2019-11-29T12:51:19.073 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:19.081+0000 7f363e7fc700 10 moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2019-11-29T12:51:19.246 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:19.255+0000 7f366fddaec0 10 cache put: name=default.rgw.meta+users.keys+QWBSQCKXFJJYCDKBKVXF info.flags=0x7 2019-11-29T12:51:19.247 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:19.255+0000 7f366fddaec0 10 moving default.rgw.meta+users.keys+QWBSQCKXFJJYCDKBKVXF to cache LRU end 2019-11-29T12:51:19.247 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:19.255+0000 7f366fddaec0 10 distributing notification oid=default.rgw.control:notify.7 bl.length()=189 2019-11-29T12:51:19.258 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:19.266+0000 7f363e7fc700 10 RGWWatcher::handle_notify() notify_id 566935683079 cookie 94283242436736 notifier 4726 bl.length()=189 2019-11-29T12:51:19.258 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:19.266+0000 7f363e7fc700 10 cache put: name=default.rgw.meta+users.keys+QWBSQCKXFJJYCDKBKVXF info.flags=0x7 2019-11-29T12:51:19.258 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:19.266+0000 7f363e7fc700 10 moving default.rgw.meta+users.keys+QWBSQCKXFJJYCDKBKVXF to cache LRU end 2019-11-29T12:51:19.536 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2019-11-29T12:51:19.536 INFO:teuthology.orchestra.run.smithi062.stdout: "user_id": "tester.client.0", 2019-11-29T12:51:19.536 INFO:teuthology.orchestra.run.smithi062.stdout: "display_name": "Ms. tester.client.0", 2019-11-29T12:51:19.537 INFO:teuthology.orchestra.run.smithi062.stdout: "email": "tester.client.0_test@test.test", 2019-11-29T12:51:19.537 INFO:teuthology.orchestra.run.smithi062.stdout: "suspended": 0, 2019-11-29T12:51:19.537 INFO:teuthology.orchestra.run.smithi062.stdout: "max_buckets": 1000, 2019-11-29T12:51:19.537 INFO:teuthology.orchestra.run.smithi062.stdout: "subusers": [], 2019-11-29T12:51:19.537 INFO:teuthology.orchestra.run.smithi062.stdout: "keys": [ 2019-11-29T12:51:19.537 INFO:teuthology.orchestra.run.smithi062.stdout: { 2019-11-29T12:51:19.538 INFO:teuthology.orchestra.run.smithi062.stdout: "user": "tester.client.0", 2019-11-29T12:51:19.538 INFO:teuthology.orchestra.run.smithi062.stdout: "access_key": "QWBSQCKXFJJYCDKBKVXF", 2019-11-29T12:51:19.538 INFO:teuthology.orchestra.run.smithi062.stdout: "secret_key": "lsIXMDJZN1I7XzaBX+Y+tm+s62pcOEqB52dpa3hfffZmStBxDznsEA==" 2019-11-29T12:51:19.538 INFO:teuthology.orchestra.run.smithi062.stdout: } 2019-11-29T12:51:19.538 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2019-11-29T12:51:19.538 INFO:teuthology.orchestra.run.smithi062.stdout: "swift_keys": [], 2019-11-29T12:51:19.538 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": [], 2019-11-29T12:51:19.539 INFO:teuthology.orchestra.run.smithi062.stdout: "op_mask": "read, write, delete", 2019-11-29T12:51:19.539 INFO:teuthology.orchestra.run.smithi062.stdout: "default_placement": "", 2019-11-29T12:51:19.539 INFO:teuthology.orchestra.run.smithi062.stdout: "default_storage_class": "", 2019-11-29T12:51:19.539 INFO:teuthology.orchestra.run.smithi062.stdout: "placement_tags": [], 2019-11-29T12:51:19.539 INFO:teuthology.orchestra.run.smithi062.stdout: "bucket_quota": { 2019-11-29T12:51:19.539 INFO:teuthology.orchestra.run.smithi062.stdout: "enabled": false, 2019-11-29T12:51:19.539 INFO:teuthology.orchestra.run.smithi062.stdout: "check_on_raw": false, 2019-11-29T12:51:19.540 INFO:teuthology.orchestra.run.smithi062.stdout: "max_size": -1, 2019-11-29T12:51:19.540 INFO:teuthology.orchestra.run.smithi062.stdout: "max_size_kb": 0, 2019-11-29T12:51:19.540 INFO:teuthology.orchestra.run.smithi062.stdout: "max_objects": -1 2019-11-29T12:51:19.540 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2019-11-29T12:51:19.540 INFO:teuthology.orchestra.run.smithi062.stdout: "user_quota": { 2019-11-29T12:51:19.540 INFO:teuthology.orchestra.run.smithi062.stdout: "enabled": false, 2019-11-29T12:51:19.541 INFO:teuthology.orchestra.run.smithi062.stdout: "check_on_raw": false, 2019-11-29T12:51:19.541 INFO:teuthology.orchestra.run.smithi062.stdout: "max_size": -1, 2019-11-29T12:51:19.541 INFO:teuthology.orchestra.run.smithi062.stdout: "max_size_kb": 0, 2019-11-29T12:51:19.541 INFO:teuthology.orchestra.run.smithi062.stdout: "max_objects": -1 2019-11-29T12:51:19.541 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2019-11-29T12:51:19.541 INFO:teuthology.orchestra.run.smithi062.stdout: "temp_url_keys": [], 2019-11-29T12:51:19.541 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "rgw", 2019-11-29T12:51:19.542 INFO:teuthology.orchestra.run.smithi062.stdout: "mfa_ids": [] 2019-11-29T12:51:19.542 INFO:teuthology.orchestra.run.smithi062.stdout:} 2019-11-29T12:51:19.542 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:51:19.603 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:19.611+0000 7f366fddaec0 20 remove_watcher() i=0 2019-11-29T12:51:19.603 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:19.611+0000 7f366fddaec0 2 removed watcher, disabling cache 2019-11-29T12:51:19.664 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:19.672+0000 7f366fddaec0 20 remove_watcher() i=1 2019-11-29T12:51:19.720 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:19.728+0000 7f366fddaec0 20 remove_watcher() i=2 2019-11-29T12:51:19.780 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:19.789+0000 7f366fddaec0 20 remove_watcher() i=3 2019-11-29T12:51:19.853 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:19.861+0000 7f366fddaec0 20 remove_watcher() i=4 2019-11-29T12:51:19.907 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:19.915+0000 7f366fddaec0 20 remove_watcher() i=5 2019-11-29T12:51:19.962 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:19.971+0000 7f366fddaec0 20 remove_watcher() i=6 2019-11-29T12:51:20.019 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:20.025+0000 7f366fddaec0 20 remove_watcher() i=7 2019-11-29T12:51:20.028 INFO:teuthology.orchestra.run.smithi062:> cat > /home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf 2019-11-29T12:51:20.148 INFO:tasks.s3tests_java:S3 Tests Java: Running tests... 2019-11-29T12:51:20.149 INFO:teuthology.orchestra.run.smithi062:> cp /home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf /home/ubuntu/cephtest/s3-tests-java/config.properties 2019-11-29T12:51:20.288 INFO:teuthology.orchestra.run.smithi062:> radosgw-admin gc process --include-all 2019-11-29T12:51:20.427 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:20.435+0000 7f96f22a8ec0 20 rados->read ofs=0 len=0 2019-11-29T12:51:20.459 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:20.467+0000 7f96f22a8ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T12:51:20.459 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:20.467+0000 7f96f22a8ec0 20 rados->read ofs=0 len=0 2019-11-29T12:51:20.469 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:20.477+0000 7f96f22a8ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T12:51:20.469 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:20.477+0000 7f96f22a8ec0 20 rados->read ofs=0 len=0 2019-11-29T12:51:20.484 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:20.492+0000 7f96f22a8ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T12:51:20.484 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:20.492+0000 7f96f22a8ec0 20 rados->read ofs=0 len=0 2019-11-29T12:51:20.508 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:20.516+0000 7f96f22a8ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T12:51:20.751 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:20.759+0000 7f96f22a8ec0 20 RGWRados::pool_iterate: got zone_info.7f922895-c6d7-4b1b-a19c-be3df5b5a899 2019-11-29T12:51:20.751 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:20.759+0000 7f96f22a8ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-29T12:51:20.751 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:20.759+0000 7f96f22a8ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-29T12:51:20.751 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:20.759+0000 7f96f22a8ec0 20 RGWRados::pool_iterate: got zonegroup_info.76ba47ff-1c23-4409-aae0-24fe26589cae 2019-11-29T12:51:20.751 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:20.759+0000 7f96f22a8ec0 20 rados->read ofs=0 len=0 2019-11-29T12:51:20.760 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:20.769+0000 7f96f22a8ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T12:51:20.760 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:20.769+0000 7f96f22a8ec0 20 rados->read ofs=0 len=0 2019-11-29T12:51:20.777 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:20.785+0000 7f96f22a8ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-29T12:51:20.777 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:20.785+0000 7f96f22a8ec0 20 rados->read ofs=0 len=0 2019-11-29T12:51:20.791 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:20.799+0000 7f96f22a8ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T12:51:20.791 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:20.799+0000 7f96f22a8ec0 20 rados->read ofs=0 len=0 2019-11-29T12:51:20.804 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:20.812+0000 7f96f22a8ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-29T12:51:20.804 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:20.812+0000 7f96f22a8ec0 20 rados->read ofs=0 len=0 2019-11-29T12:51:20.812 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:20.820+0000 7f96f22a8ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T12:51:20.812 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:20.821+0000 7f96f22a8ec0 10 cannot find current period zonegroup using local zonegroup 2019-11-29T12:51:20.813 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:20.821+0000 7f96f22a8ec0 20 rados->read ofs=0 len=0 2019-11-29T12:51:20.820 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:20.829+0000 7f96f22a8ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T12:51:20.821 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:20.829+0000 7f96f22a8ec0 20 rados->read ofs=0 len=0 2019-11-29T12:51:20.834 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:20.843+0000 7f96f22a8ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T12:51:20.835 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:20.843+0000 7f96f22a8ec0 20 rados->read ofs=0 len=0 2019-11-29T12:51:20.846 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:20.854+0000 7f96f22a8ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-29T12:51:20.846 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:20.854+0000 7f96f22a8ec0 20 zonegroup default 2019-11-29T12:51:20.846 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:20.854+0000 7f96f22a8ec0 20 rados->read ofs=0 len=0 2019-11-29T12:51:20.856 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:20.864+0000 7f96f22a8ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T12:51:20.856 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:20.864+0000 7f96f22a8ec0 10 Cannot find current period zone using local zone 2019-11-29T12:51:20.856 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:20.864+0000 7f96f22a8ec0 20 rados->read ofs=0 len=0 2019-11-29T12:51:20.865 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:20.874+0000 7f96f22a8ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T12:51:20.866 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:20.874+0000 7f96f22a8ec0 20 rados->read ofs=0 len=0 2019-11-29T12:51:20.876 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:20.884+0000 7f96f22a8ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T12:51:20.876 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:20.884+0000 7f96f22a8ec0 20 rados->read ofs=0 len=0 2019-11-29T12:51:20.891 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:20.899+0000 7f96f22a8ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-29T12:51:20.892 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:20.899+0000 7f96f22a8ec0 20 zone default found 2019-11-29T12:51:20.892 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:20.899+0000 7f96f22a8ec0 20 started sync module instance, tier type = 2019-11-29T12:51:20.892 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:20.899+0000 7f96f22a8ec0 20 started zone id=7f922895-c6d7-4b1b-a19c-be3df5b5a899 (name=default) with tier type = 2019-11-29T12:51:21.271 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:21.279+0000 7f96f22a8ec0 20 add_watcher() i=0 2019-11-29T12:51:21.271 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:21.279+0000 7f96f22a8ec0 20 add_watcher() i=1 2019-11-29T12:51:21.271 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:21.279+0000 7f96f22a8ec0 20 add_watcher() i=2 2019-11-29T12:51:21.271 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:21.279+0000 7f96f22a8ec0 20 add_watcher() i=3 2019-11-29T12:51:21.271 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:21.279+0000 7f96f22a8ec0 20 add_watcher() i=4 2019-11-29T12:51:21.271 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:21.279+0000 7f96f22a8ec0 20 add_watcher() i=5 2019-11-29T12:51:21.272 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:21.279+0000 7f96f22a8ec0 20 add_watcher() i=6 2019-11-29T12:51:21.319 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:21.327+0000 7f96f22a8ec0 20 add_watcher() i=7 2019-11-29T12:51:21.319 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:21.327+0000 7f96f22a8ec0 2 all 8 watchers are set, enabling cache 2019-11-29T12:51:21.319 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:21.327+0000 7f96affdf700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-29T12:51:21.328 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:21.336+0000 7f96decd4700 0 -- 172.21.15.62:0/2657070206 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x557ea408afe0 msgr2=0x557ea40cba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2019-11-29T12:51:21.365 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:21.374+0000 7f96df4d5700 0 -- 172.21.15.62:0/2168460604 >> [v2:172.21.15.22:6800/8367,v1:172.21.15.22:6801/8367] conn(0x7f9620017580 msgr2=0x7f9620019a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-29T12:51:22.965 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:22.973+0000 7f961e7fc700 20 reqs_thread_entry: start 2019-11-29T12:51:22.965 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:22.973+0000 7f9617fff700 20 reqs_thread_entry: start 2019-11-29T12:51:22.965 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:22.973+0000 7f96f22a8ec0 20 init_complete bucket index max shards: 0 2019-11-29T12:51:22.966 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:22.974+0000 7f96167fc700 20 reqs_thread_entry: start 2019-11-29T12:51:22.966 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:22.974+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2019-11-29T12:51:23.023 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:23.031+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:51:23.049 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:23.058+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T12:51:23.093 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:23.101+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-29T12:51:23.093 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:23.101+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process iterating over entry tag='7f922895-c6d7-4b1b-a19c-be3df5b5a899.4325.55', time=2019-11-29T14:50:41.691502+0000, chain.objs.size()=4 2019-11-29T12:51:23.094 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:23.101+0000 7f96f22a8ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.4__multipart_foo.2~ORCq5DLCtlqevALsNHHRLJgc8_79PIm.1 2019-11-29T12:51:23.094 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:23.101+0000 7f96f22a8ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.4__multipart_foo.2~ORCq5DLCtlqevALsNHHRLJgc8_79PIm.2 2019-11-29T12:51:23.094 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:23.101+0000 7f96f22a8ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.4__multipart_foo.2~ORCq5DLCtlqevALsNHHRLJgc8_79PIm.3 2019-11-29T12:51:23.094 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:23.101+0000 7f96f22a8ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.4__multipart_foo.2~ORCq5DLCtlqevALsNHHRLJgc8_79PIm.4 2019-11-29T12:51:23.180 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:23.189+0000 7f96f22a8ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-29T12:51:23.369 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:23.377+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2019-11-29T12:51:23.443 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:23.451+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:51:23.461 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:23.470+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T12:51:23.491 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:23.499+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-29T12:51:23.491 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:23.499+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process iterating over entry tag='_LaO_918H25Xoxkm998Erz6069cBDDJU', time=2019-11-29T14:50:50.154618+0000, chain.objs.size()=2 2019-11-29T12:51:23.491 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:23.499+0000 7f96f22a8ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.9__shadow_.sdgQFHGth_x5uzc-2gNwSremEuJEJz7_1 2019-11-29T12:51:23.491 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:23.499+0000 7f96f22a8ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.9__shadow_.sdgQFHGth_x5uzc-2gNwSremEuJEJz7_2 2019-11-29T12:51:23.638 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:23.647+0000 7f96f22a8ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-29T12:51:23.814 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:23.823+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2019-11-29T12:51:23.896 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:23.904+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:51:23.934 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:23.942+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T12:51:23.982 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:23.990+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-11-29T12:51:23.982 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:23.990+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process iterating over entry tag='_nQXbyaTAzo7kS2vwAO4o0fEvrIGG5IC', time=2019-11-29T14:50:46.424656+0000, chain.objs.size()=1 2019-11-29T12:51:23.983 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:23.990+0000 7f96f22a8ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.7__shadow_.Riri1LDu4YSrYK5LFSzzRtjjfBVE7Rk_1 2019-11-29T12:51:23.983 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:23.990+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process iterating over entry tag='_sYpNNEyKpmXDgEVB2sQfDGsC7Ct3nyT', time=2019-11-29T14:50:49.806580+0000, chain.objs.size()=3 2019-11-29T12:51:23.983 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:23.990+0000 7f96f22a8ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.9__shadow_.Axd_oSpkq2yJC3lcM6jgwiVfkNb5ZmQ_0 2019-11-29T12:51:23.983 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:23.990+0000 7f96f22a8ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.9__shadow_.Axd_oSpkq2yJC3lcM6jgwiVfkNb5ZmQ_1 2019-11-29T12:51:23.983 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:23.990+0000 7f96f22a8ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.9__shadow_.Axd_oSpkq2yJC3lcM6jgwiVfkNb5ZmQ_2 2019-11-29T12:51:24.306 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:24.315+0000 7f96f22a8ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-29T12:51:24.506 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:24.515+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2019-11-29T12:51:24.594 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:24.602+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:51:24.625 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:24.633+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T12:51:24.655 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:24.663+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-11-29T12:51:24.655 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:24.663+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process iterating over entry tag='_07GC9c-ruIRwiGXU7Yhl-cveDO8rqmz', time=2019-11-29T14:50:51.364415+0000, chain.objs.size()=1 2019-11-29T12:51:24.655 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:24.663+0000 7f96f22a8ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.9__shadow_.G1ZXMNCaQVHVSX1DCbJMqTVp10bgZdX_0 2019-11-29T12:51:24.656 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:24.663+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process iterating over entry tag='7f922895-c6d7-4b1b-a19c-be3df5b5a899.4325.203', time=2019-11-29T14:50:52.899835+0000, chain.objs.size()=5 2019-11-29T12:51:24.656 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:24.663+0000 7f96f22a8ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.8__multipart_foo-LUKEWARM.2~knrLmEHao2_NvEEzRN9r1haNDadqgmw.1 2019-11-29T12:51:24.656 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:24.663+0000 7f96f22a8ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.8__shadow_foo-LUKEWARM.2~knrLmEHao2_NvEEzRN9r1haNDadqgmw.1_1 2019-11-29T12:51:24.656 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:24.663+0000 7f96f22a8ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.8__multipart_foo-LUKEWARM.2~knrLmEHao2_NvEEzRN9r1haNDadqgmw.2 2019-11-29T12:51:24.656 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:24.663+0000 7f96f22a8ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.8__shadow_foo-LUKEWARM.2~knrLmEHao2_NvEEzRN9r1haNDadqgmw.2_1 2019-11-29T12:51:24.656 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:24.663+0000 7f96f22a8ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.8__multipart_foo-LUKEWARM.2~knrLmEHao2_NvEEzRN9r1haNDadqgmw.3 2019-11-29T12:51:24.950 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:24.958+0000 7f96f22a8ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-29T12:51:25.060 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:25.068+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2019-11-29T12:51:25.150 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:25.158+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:51:25.175 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:25.183+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T12:51:25.200 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:25.208+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:51:25.250 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:25.258+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2019-11-29T12:51:25.315 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:25.323+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:51:25.344 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:25.352+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T12:51:25.370 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:25.378+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-29T12:51:25.370 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:25.378+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process iterating over entry tag='7f922895-c6d7-4b1b-a19c-be3df5b5a899.4325.225', time=2019-11-29T14:50:49.638993+0000, chain.objs.size()=5 2019-11-29T12:51:25.370 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:25.378+0000 7f96f22a8ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.9__multipart_foo-FROZEN.2~wCxRn3ZG22Ky6Y45Cgd5lQcey9VI65F.1 2019-11-29T12:51:25.371 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:25.378+0000 7f96f22a8ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.9__shadow_foo-FROZEN.2~wCxRn3ZG22Ky6Y45Cgd5lQcey9VI65F.1_1 2019-11-29T12:51:25.371 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:25.378+0000 7f96f22a8ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.9__multipart_foo-FROZEN.2~wCxRn3ZG22Ky6Y45Cgd5lQcey9VI65F.2 2019-11-29T12:51:25.371 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:25.378+0000 7f96f22a8ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.9__shadow_foo-FROZEN.2~wCxRn3ZG22Ky6Y45Cgd5lQcey9VI65F.2_1 2019-11-29T12:51:25.371 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:25.378+0000 7f96f22a8ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.9__multipart_foo-FROZEN.2~wCxRn3ZG22Ky6Y45Cgd5lQcey9VI65F.3 2019-11-29T12:51:25.473 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:25.482+0000 7f96f22a8ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-29T12:51:25.613 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:25.621+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2019-11-29T12:51:25.694 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:25.703+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:51:25.732 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:25.740+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T12:51:25.752 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:25.760+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-29T12:51:25.752 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:25.760+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process iterating over entry tag='7f922895-c6d7-4b1b-a19c-be3df5b5a899.4325.235', time=2019-11-29T14:50:50.750585+0000, chain.objs.size()=5 2019-11-29T12:51:25.752 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:25.760+0000 7f96f22a8ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.9__multipart_foo-LUKEWARM.2~BdBENjof0PUGgD2VY5fp7QLG0tU-BSo.1 2019-11-29T12:51:25.752 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:25.760+0000 7f96f22a8ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.9__shadow_foo-LUKEWARM.2~BdBENjof0PUGgD2VY5fp7QLG0tU-BSo.1_1 2019-11-29T12:51:25.752 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:25.760+0000 7f96f22a8ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.9__multipart_foo-LUKEWARM.2~BdBENjof0PUGgD2VY5fp7QLG0tU-BSo.2 2019-11-29T12:51:25.753 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:25.760+0000 7f96f22a8ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.9__shadow_foo-LUKEWARM.2~BdBENjof0PUGgD2VY5fp7QLG0tU-BSo.2_1 2019-11-29T12:51:25.753 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:25.760+0000 7f96f22a8ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.9__multipart_foo-LUKEWARM.2~BdBENjof0PUGgD2VY5fp7QLG0tU-BSo.3 2019-11-29T12:51:25.856 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:25.864+0000 7f96f22a8ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-29T12:51:25.957 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:25.965+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2019-11-29T12:51:26.017 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:26.026+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:51:26.045 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:26.054+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T12:51:26.061 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:26.069+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:51:26.111 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:26.119+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2019-11-29T12:51:26.181 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:26.189+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:51:26.213 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:26.221+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T12:51:26.270 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:26.278+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-11-29T12:51:26.271 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:26.278+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process iterating over entry tag='_rQoCuuBVx55cC-M4Fq5-PJ6b4dhmWMx', time=2019-11-29T14:50:47.070838+0000, chain.objs.size()=1 2019-11-29T12:51:26.271 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:26.278+0000 7f96f22a8ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.7__shadow_.5Uc3XLxFyzSFC9Kk12KCk0khY2wkx28_0 2019-11-29T12:51:26.271 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:26.278+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process iterating over entry tag='7f922895-c6d7-4b1b-a19c-be3df5b5a899.4325.85', time=2019-11-29T14:50:54.336307+0000, chain.objs.size()=3 2019-11-29T12:51:26.271 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:26.278+0000 7f96f22a8ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.6__shadow_.pESA_zJpfOxeyWRLTEKsuPDYquHuj6d_0 2019-11-29T12:51:26.271 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:26.278+0000 7f96f22a8ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.6__shadow_.pESA_zJpfOxeyWRLTEKsuPDYquHuj6d_1 2019-11-29T12:51:26.271 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:26.279+0000 7f96f22a8ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.6__shadow_.pESA_zJpfOxeyWRLTEKsuPDYquHuj6d_2 2019-11-29T12:51:26.486 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:26.494+0000 7f96f22a8ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-29T12:51:26.586 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:26.594+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2019-11-29T12:51:26.668 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:26.676+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:51:26.695 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:26.703+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T12:51:26.710 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:26.719+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:51:26.759 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:26.768+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2019-11-29T12:51:26.818 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:26.826+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:51:26.839 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:26.848+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T12:51:26.850 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:26.858+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:51:26.897 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:26.905+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2019-11-29T12:51:26.975 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:26.984+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:51:26.995 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:27.003+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T12:51:27.006 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:27.014+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-29T12:51:27.006 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:27.014+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process iterating over entry tag='7f922895-c6d7-4b1b-a19c-be3df5b5a899.4325.233', time=2019-11-29T14:50:50.332228+0000, chain.objs.size()=5 2019-11-29T12:51:27.006 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:27.014+0000 7f96f22a8ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.9__multipart_foo-LUKEWARM.2~BdBENjof0PUGgD2VY5fp7QLG0tU-BSo.1 2019-11-29T12:51:27.006 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:27.014+0000 7f96f22a8ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.9__shadow_foo-LUKEWARM.2~BdBENjof0PUGgD2VY5fp7QLG0tU-BSo.1_1 2019-11-29T12:51:27.007 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:27.014+0000 7f96f22a8ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.9__multipart_foo-LUKEWARM.2~BdBENjof0PUGgD2VY5fp7QLG0tU-BSo.2 2019-11-29T12:51:27.007 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:27.014+0000 7f96f22a8ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.9__shadow_foo-LUKEWARM.2~BdBENjof0PUGgD2VY5fp7QLG0tU-BSo.2_1 2019-11-29T12:51:27.007 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:27.014+0000 7f96f22a8ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.9__multipart_foo-LUKEWARM.2~BdBENjof0PUGgD2VY5fp7QLG0tU-BSo.3 2019-11-29T12:51:27.224 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:27.232+0000 7f96f22a8ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-29T12:51:27.364 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:27.372+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2019-11-29T12:51:27.411 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:27.420+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:51:27.428 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:27.436+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T12:51:27.471 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:27.478+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2019-11-29T12:51:27.471 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:27.478+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process iterating over entry tag='7f922895-c6d7-4b1b-a19c-be3df5b5a899.4325.71', time=2019-11-29T14:50:43.231877+0000, chain.objs.size()=4 2019-11-29T12:51:27.471 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:27.478+0000 7f96f22a8ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.5__multipart_foo.2~OowFP313yiCWZLRamu60tFz9pNQlSAP.1 2019-11-29T12:51:27.471 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:27.479+0000 7f96f22a8ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.5__multipart_foo.2~OowFP313yiCWZLRamu60tFz9pNQlSAP.2 2019-11-29T12:51:27.471 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:27.479+0000 7f96f22a8ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.5__multipart_foo.2~OowFP313yiCWZLRamu60tFz9pNQlSAP.3 2019-11-29T12:51:27.472 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:27.479+0000 7f96f22a8ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.5__multipart_foo.2~OowFP313yiCWZLRamu60tFz9pNQlSAP.4 2019-11-29T12:51:27.472 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:27.479+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process iterating over entry tag='_1iRteuIrh5aEmSMRkDJVt7LaJN2jhRK', time=2019-11-29T14:50:45.200479+0000, chain.objs.size()=2 2019-11-29T12:51:27.472 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:27.479+0000 7f96f22a8ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.7__shadow_.hvuAegiFGmszAxefl4lbKe1FI7rlu_P_0 2019-11-29T12:51:27.472 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:27.479+0000 7f96f22a8ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.7__shadow_.hvuAegiFGmszAxefl4lbKe1FI7rlu_P_1 2019-11-29T12:51:27.472 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:27.479+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process iterating over entry tag='7f922895-c6d7-4b1b-a19c-be3df5b5a899.4325.245', time=2019-11-29T14:50:51.723382+0000, chain.objs.size()=3 2019-11-29T12:51:27.472 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:27.479+0000 7f96f22a8ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.9__multipart_foo-STANDARD.2~80lbynXCEhpt21iKsowda58hzp9HYYD.1 2019-11-29T12:51:27.473 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:27.479+0000 7f96f22a8ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.9__multipart_foo-STANDARD.2~80lbynXCEhpt21iKsowda58hzp9HYYD.2 2019-11-29T12:51:27.473 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:27.479+0000 7f96f22a8ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.9__multipart_foo-STANDARD.2~80lbynXCEhpt21iKsowda58hzp9HYYD.3 2019-11-29T12:51:27.473 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:27.479+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process iterating over entry tag='7f922895-c6d7-4b1b-a19c-be3df5b5a899.4325.196', time=2019-11-29T14:50:52.660065+0000, chain.objs.size()=5 2019-11-29T12:51:27.473 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:27.479+0000 7f96f22a8ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.8__multipart_foo-FROZEN.2~k9iq1cJ3CyuH9QuLPQ3-yU85syoyWsZ.1 2019-11-29T12:51:27.473 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:27.479+0000 7f96f22a8ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.8__shadow_foo-FROZEN.2~k9iq1cJ3CyuH9QuLPQ3-yU85syoyWsZ.1_1 2019-11-29T12:51:27.473 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:27.479+0000 7f96f22a8ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.8__multipart_foo-FROZEN.2~k9iq1cJ3CyuH9QuLPQ3-yU85syoyWsZ.2 2019-11-29T12:51:27.623 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:27.631+0000 7f96f22a8ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.8__shadow_foo-FROZEN.2~k9iq1cJ3CyuH9QuLPQ3-yU85syoyWsZ.2_1 2019-11-29T12:51:27.623 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:27.631+0000 7f96f22a8ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.8__multipart_foo-FROZEN.2~k9iq1cJ3CyuH9QuLPQ3-yU85syoyWsZ.3 2019-11-29T12:51:27.795 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:27.803+0000 7f96f22a8ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-29T12:51:27.977 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:27.985+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2019-11-29T12:51:28.044 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:28.053+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:51:28.073 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:28.082+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T12:51:28.090 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:28.098+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-29T12:51:28.091 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:28.098+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process iterating over entry tag='_FLYPsxcxPr89DNtl9CNzoPpLOKKL7n-', time=2019-11-29T14:50:46.857002+0000, chain.objs.size()=1 2019-11-29T12:51:28.091 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:28.098+0000 7f96f22a8ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.7__shadow_.xf0Q8xgEh9MyuXSlDijoF4uKYKMs84N_0 2019-11-29T12:51:28.156 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:28.164+0000 7f96f22a8ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-29T12:51:28.253 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:28.261+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2019-11-29T12:51:28.329 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:28.337+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:51:28.356 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:28.365+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T12:51:28.380 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:28.388+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:51:28.427 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:28.435+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2019-11-29T12:51:28.489 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:28.497+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:51:28.508 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:28.516+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T12:51:28.521 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:28.529+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-29T12:51:28.522 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:28.529+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process iterating over entry tag='_iCSiotg6M_NuPdEsV_SSFD1Esd6v-wh', time=2019-11-29T14:50:51.555868+0000, chain.objs.size()=1 2019-11-29T12:51:28.522 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:28.529+0000 7f96f22a8ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.9__shadow_.PSLq7C9HdxCrMNESi7yb5RGn2wpnQYv_0 2019-11-29T12:51:28.609 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:28.617+0000 7f96f22a8ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-29T12:51:28.711 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:28.719+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2019-11-29T12:51:28.768 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:28.776+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:51:28.782 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:28.790+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T12:51:28.792 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:28.800+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:51:28.842 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:28.850+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2019-11-29T12:51:28.904 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:28.912+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:51:28.922 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:28.930+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T12:51:28.932 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:28.940+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:51:28.967 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:28.975+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2019-11-29T12:51:29.016 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:29.024+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:51:29.032 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:29.040+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T12:51:29.045 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:29.052+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-29T12:51:29.045 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:29.052+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process iterating over entry tag='7f922895-c6d7-4b1b-a19c-be3df5b5a899.4325.20', time=2019-11-29T14:50:38.831818+0000, chain.objs.size()=4 2019-11-29T12:51:29.045 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:29.052+0000 7f96f22a8ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.2__multipart_foo.2~BzdHwG7JVWHMhCxsmuHrNg_ydDckXH9.1 2019-11-29T12:51:29.045 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:29.053+0000 7f96f22a8ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.2__multipart_foo.2~BzdHwG7JVWHMhCxsmuHrNg_ydDckXH9.2 2019-11-29T12:51:29.045 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:29.053+0000 7f96f22a8ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.2__multipart_foo.2~BzdHwG7JVWHMhCxsmuHrNg_ydDckXH9.3 2019-11-29T12:51:29.045 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:29.053+0000 7f96f22a8ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.2__multipart_foo.2~BzdHwG7JVWHMhCxsmuHrNg_ydDckXH9.4 2019-11-29T12:51:29.161 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:29.169+0000 7f96f22a8ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-29T12:51:29.252 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:29.261+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2019-11-29T12:51:29.304 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:29.312+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:51:29.322 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:29.330+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T12:51:29.331 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:29.339+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:51:29.374 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:29.382+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2019-11-29T12:51:29.445 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:29.453+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:51:29.472 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:29.480+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T12:51:29.530 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:29.532+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2019-11-29T12:51:29.530 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:29.532+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process iterating over entry tag='7f922895-c6d7-4b1b-a19c-be3df5b5a899.4325.40', time=2019-11-29T14:50:40.052830+0000, chain.objs.size()=4 2019-11-29T12:51:29.530 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:29.532+0000 7f96f22a8ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.3__multipart_foo.2~ZIXK1YWeyjG49xNKBcpVXirUfdzat9A.1 2019-11-29T12:51:29.530 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:29.532+0000 7f96f22a8ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.3__multipart_foo.2~ZIXK1YWeyjG49xNKBcpVXirUfdzat9A.2 2019-11-29T12:51:29.531 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:29.532+0000 7f96f22a8ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.3__multipart_foo.2~ZIXK1YWeyjG49xNKBcpVXirUfdzat9A.3 2019-11-29T12:51:29.531 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:29.533+0000 7f96f22a8ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.3__multipart_foo.2~ZIXK1YWeyjG49xNKBcpVXirUfdzat9A.4 2019-11-29T12:51:29.531 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:29.533+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process iterating over entry tag='7f922895-c6d7-4b1b-a19c-be3df5b5a899.4325.108', time=2019-11-29T14:50:44.767623+0000, chain.objs.size()=2 2019-11-29T12:51:29.531 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:29.533+0000 7f96f22a8ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.7__shadow_.nSRURfC-SPPitHQWcloVnzkrsCgTiNu_0 2019-11-29T12:51:29.531 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:29.533+0000 7f96f22a8ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.7__shadow_.nSRURfC-SPPitHQWcloVnzkrsCgTiNu_1 2019-11-29T12:51:29.531 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:29.533+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process iterating over entry tag='_mgvbyCLDnTPK4thmtS7Lsm_veziNBFM', time=2019-11-29T14:50:50.539023+0000, chain.objs.size()=3 2019-11-29T12:51:29.532 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:29.533+0000 7f96f22a8ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.9__shadow_.k2A-OkL0E98NsrAaqxLua67B4Nu2vLI_0 2019-11-29T12:51:29.532 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:29.533+0000 7f96f22a8ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.9__shadow_.k2A-OkL0E98NsrAaqxLua67B4Nu2vLI_1 2019-11-29T12:51:29.532 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:29.533+0000 7f96f22a8ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.9__shadow_.k2A-OkL0E98NsrAaqxLua67B4Nu2vLI_2 2019-11-29T12:51:29.777 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:29.785+0000 7f96f22a8ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-29T12:51:29.930 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:29.938+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2019-11-29T12:51:30.002 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:30.010+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:51:30.029 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:30.037+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T12:51:30.059 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:30.066+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-11-29T12:51:30.059 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:30.066+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process iterating over entry tag='_LzW7H88kItO3Kk0nxbhhEzQzZGFUDA4', time=2019-11-29T14:50:45.491743+0000, chain.objs.size()=1 2019-11-29T12:51:30.059 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:30.066+0000 7f96f22a8ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.7__shadow_.FrAnT_QZ5dacIYd4LhB_K8lRuRgMDSP_1 2019-11-29T12:51:30.059 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:30.066+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process iterating over entry tag='7f922895-c6d7-4b1b-a19c-be3df5b5a899.4325.224', time=2019-11-29T14:50:49.507756+0000, chain.objs.size()=5 2019-11-29T12:51:30.060 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:30.066+0000 7f96f22a8ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.9__multipart_foo-FROZEN.2~wCxRn3ZG22Ky6Y45Cgd5lQcey9VI65F.1 2019-11-29T12:51:30.060 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:30.066+0000 7f96f22a8ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.9__shadow_foo-FROZEN.2~wCxRn3ZG22Ky6Y45Cgd5lQcey9VI65F.1_1 2019-11-29T12:51:30.060 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:30.066+0000 7f96f22a8ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.9__multipart_foo-FROZEN.2~wCxRn3ZG22Ky6Y45Cgd5lQcey9VI65F.2 2019-11-29T12:51:30.060 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:30.066+0000 7f96f22a8ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.9__shadow_foo-FROZEN.2~wCxRn3ZG22Ky6Y45Cgd5lQcey9VI65F.2_1 2019-11-29T12:51:30.061 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:30.066+0000 7f96f22a8ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.9__multipart_foo-FROZEN.2~wCxRn3ZG22Ky6Y45Cgd5lQcey9VI65F.3 2019-11-29T12:51:30.257 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:30.265+0000 7f96f22a8ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-29T12:51:30.350 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:30.358+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2019-11-29T12:51:30.394 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:30.402+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:51:30.413 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:30.421+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T12:51:30.428 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:30.436+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-29T12:51:30.428 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:30.436+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process iterating over entry tag='_Bc7TZy81FWTgKUxsA2_XmVIk6SDlK04', time=2019-11-29T14:50:51.013939+0000, chain.objs.size()=2 2019-11-29T12:51:30.428 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:30.436+0000 7f96f22a8ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.9__shadow_.DEGhAz7vusYAMJi6KjqiMCxnGLwGD_E_1 2019-11-29T12:51:30.428 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:30.436+0000 7f96f22a8ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.9__shadow_.DEGhAz7vusYAMJi6KjqiMCxnGLwGD_E_2 2019-11-29T12:51:30.578 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:30.586+0000 7f96f22a8ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-29T12:51:30.693 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:30.701+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2019-11-29T12:51:30.746 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:30.754+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:51:30.765 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:30.774+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T12:51:30.777 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:30.785+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:51:30.814 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:30.822+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2019-11-29T12:51:30.882 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:30.890+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:51:30.897 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:30.906+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T12:51:30.912 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:30.920+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-29T12:51:30.913 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:30.920+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process iterating over entry tag='_pPPj6_TvUb_lr5OcE7vWMfZeMqW9y9X', time=2019-11-29T14:50:45.898957+0000, chain.objs.size()=2 2019-11-29T12:51:30.913 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:30.920+0000 7f96f22a8ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.7__shadow_.DNp-PKVbo8jizlfUUyrzrXDyoSjCWqI_0 2019-11-29T12:51:30.913 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:30.920+0000 7f96f22a8ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.7__shadow_.DNp-PKVbo8jizlfUUyrzrXDyoSjCWqI_1 2019-11-29T12:51:31.077 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:31.085+0000 7f96f22a8ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-29T12:51:31.198 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:31.206+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2019-11-29T12:51:31.247 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:31.255+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:51:31.264 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:31.271+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T12:51:31.295 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:31.302+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-29T12:51:31.295 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:31.302+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process iterating over entry tag='7f922895-c6d7-4b1b-a19c-be3df5b5a899.4325.210', time=2019-11-29T14:50:53.112718+0000, chain.objs.size()=3 2019-11-29T12:51:31.295 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:31.302+0000 7f96f22a8ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.8__multipart_foo-STANDARD.2~6FrvvdaGCPbe9DuDUTq7ed9FufTNukS.1 2019-11-29T12:51:31.295 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:31.302+0000 7f96f22a8ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.8__multipart_foo-STANDARD.2~6FrvvdaGCPbe9DuDUTq7ed9FufTNukS.2 2019-11-29T12:51:31.295 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:31.302+0000 7f96f22a8ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.8__multipart_foo-STANDARD.2~6FrvvdaGCPbe9DuDUTq7ed9FufTNukS.3 2019-11-29T12:51:31.376 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:31.384+0000 7f96f22a8ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-29T12:51:31.496 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:31.504+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2019-11-29T12:51:31.612 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:31.620+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:51:31.627 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:31.635+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T12:51:31.640 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:31.648+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-11-29T12:51:31.640 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:31.648+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process iterating over entry tag='7f922895-c6d7-4b1b-a19c-be3df5b5a899.4325.112', time=2019-11-29T14:50:45.685685+0000, chain.objs.size()=2 2019-11-29T12:51:31.640 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:31.648+0000 7f96f22a8ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.7__shadow_.RUc0Tzm24jB_cRZ_UbCF4gekVozCAOu_0 2019-11-29T12:51:31.641 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:31.648+0000 7f96f22a8ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.7__shadow_.RUc0Tzm24jB_cRZ_UbCF4gekVozCAOu_1 2019-11-29T12:51:31.641 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:31.648+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process iterating over entry tag='7f922895-c6d7-4b1b-a19c-be3df5b5a899.4325.114', time=2019-11-29T14:50:46.072073+0000, chain.objs.size()=2 2019-11-29T12:51:31.641 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:31.648+0000 7f96f22a8ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.7__shadow_.RUc0Tzm24jB_cRZ_UbCF4gekVozCAOu_0 2019-11-29T12:51:31.641 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:31.648+0000 7f96f22a8ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.7__shadow_.RUc0Tzm24jB_cRZ_UbCF4gekVozCAOu_1 2019-11-29T12:51:31.866 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:31.874+0000 7f96f22a8ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-29T12:51:32.002 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:32.010+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2019-11-29T12:51:32.072 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:32.080+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:51:32.097 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:32.104+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T12:51:32.105 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:32.113+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:51:32.180 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:32.188+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2019-11-29T12:51:32.253 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:32.261+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:51:32.277 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:32.285+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T12:51:32.302 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:32.310+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-29T12:51:32.302 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:32.310+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process iterating over entry tag='7f922895-c6d7-4b1b-a19c-be3df5b5a899.4325.242', time=2019-11-29T14:50:51.179987+0000, chain.objs.size()=3 2019-11-29T12:51:32.303 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:32.310+0000 7f96f22a8ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.9__multipart_foo-STANDARD.2~80lbynXCEhpt21iKsowda58hzp9HYYD.1 2019-11-29T12:51:32.303 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:32.310+0000 7f96f22a8ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.9__multipart_foo-STANDARD.2~80lbynXCEhpt21iKsowda58hzp9HYYD.2 2019-11-29T12:51:32.303 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:32.310+0000 7f96f22a8ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.9__multipart_foo-STANDARD.2~80lbynXCEhpt21iKsowda58hzp9HYYD.3 2019-11-29T12:51:32.414 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:32.421+0000 7f96f22a8ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-29T12:51:32.561 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:32.568+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2019-11-29T12:51:32.631 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:32.639+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:51:32.663 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:32.671+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T12:51:32.681 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:32.689+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-29T12:51:32.681 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:32.689+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process iterating over entry tag='7f922895-c6d7-4b1b-a19c-be3df5b5a899.4325.84', time=2019-11-29T14:50:54.166721+0000, chain.objs.size()=3 2019-11-29T12:51:32.682 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:32.689+0000 7f96f22a8ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.6__shadow_.AMWKNLvJ0t8RPGc3Svu3EL9ANkX8sbD_0 2019-11-29T12:51:32.682 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:32.689+0000 7f96f22a8ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.6__shadow_.AMWKNLvJ0t8RPGc3Svu3EL9ANkX8sbD_1 2019-11-29T12:51:32.682 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:32.689+0000 7f96f22a8ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.6__shadow_.AMWKNLvJ0t8RPGc3Svu3EL9ANkX8sbD_2 2019-11-29T12:51:32.954 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:32.962+0000 7f96f22a8ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-29T12:51:33.058 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:33.066+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2019-11-29T12:51:33.104 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:33.112+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:51:33.120 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:33.128+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T12:51:33.134 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:33.142+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:51:33.180 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:33.188+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2019-11-29T12:51:33.227 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:33.235+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:51:33.241 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:33.250+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T12:51:33.253 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:33.261+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-29T12:51:33.253 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:33.261+0000 7f96f22a8ec0 20 garbage collection: RGWGC::process iterating over entry tag='7f922895-c6d7-4b1b-a19c-be3df5b5a899.4325.109', time=2019-11-29T14:50:45.014323+0000, chain.objs.size()=2 2019-11-29T12:51:33.254 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:33.261+0000 7f96f22a8ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.7__shadow_.nSRURfC-SPPitHQWcloVnzkrsCgTiNu_0 2019-11-29T12:51:33.254 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:33.261+0000 7f96f22a8ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.7__shadow_.nSRURfC-SPPitHQWcloVnzkrsCgTiNu_1 2019-11-29T12:51:33.433 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:33.441+0000 7f96f22a8ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-29T12:51:33.628 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:33.636+0000 7f96f22a8ec0 20 remove_watcher() i=0 2019-11-29T12:51:33.628 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:33.636+0000 7f96f22a8ec0 2 removed watcher, disabling cache 2019-11-29T12:51:33.673 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:33.681+0000 7f96f22a8ec0 20 remove_watcher() i=1 2019-11-29T12:51:33.721 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:33.729+0000 7f96f22a8ec0 20 remove_watcher() i=2 2019-11-29T12:51:33.784 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:33.792+0000 7f96f22a8ec0 20 remove_watcher() i=3 2019-11-29T12:51:33.820 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:33.828+0000 7f96f22a8ec0 20 remove_watcher() i=4 2019-11-29T12:51:33.859 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:33.867+0000 7f96f22a8ec0 20 remove_watcher() i=5 2019-11-29T12:51:33.922 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:33.929+0000 7f96f22a8ec0 20 remove_watcher() i=6 2019-11-29T12:51:33.973 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:33.980+0000 7f96f22a8ec0 20 remove_watcher() i=7 2019-11-29T12:51:33.983 INFO:teuthology.orchestra.run.smithi062:> radosgw-admin gc process --include-all 2019-11-29T12:51:34.104 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:34.112+0000 7fac4b5c2ec0 20 rados->read ofs=0 len=0 2019-11-29T12:51:34.132 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:34.139+0000 7fac4b5c2ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T12:51:34.133 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:34.139+0000 7fac4b5c2ec0 20 rados->read ofs=0 len=0 2019-11-29T12:51:34.150 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:34.158+0000 7fac4b5c2ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T12:51:34.150 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:34.158+0000 7fac4b5c2ec0 20 rados->read ofs=0 len=0 2019-11-29T12:51:34.158 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:34.166+0000 7fac4b5c2ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T12:51:34.158 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:34.166+0000 7fac4b5c2ec0 20 rados->read ofs=0 len=0 2019-11-29T12:51:34.178 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:34.186+0000 7fac4b5c2ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T12:51:34.644 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:34.651+0000 7fac4b5c2ec0 20 RGWRados::pool_iterate: got zone_info.7f922895-c6d7-4b1b-a19c-be3df5b5a899 2019-11-29T12:51:34.644 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:34.651+0000 7fac4b5c2ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-29T12:51:34.644 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:34.651+0000 7fac4b5c2ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-29T12:51:34.644 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:34.651+0000 7fac4b5c2ec0 20 RGWRados::pool_iterate: got zonegroup_info.76ba47ff-1c23-4409-aae0-24fe26589cae 2019-11-29T12:51:34.644 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:34.651+0000 7fac4b5c2ec0 20 rados->read ofs=0 len=0 2019-11-29T12:51:34.662 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:34.670+0000 7fac4b5c2ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T12:51:34.662 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:34.670+0000 7fac4b5c2ec0 20 rados->read ofs=0 len=0 2019-11-29T12:51:34.683 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:34.691+0000 7fac4b5c2ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-29T12:51:34.684 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:34.691+0000 7fac4b5c2ec0 20 rados->read ofs=0 len=0 2019-11-29T12:51:34.698 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:34.706+0000 7fac4b5c2ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T12:51:34.698 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:34.706+0000 7fac4b5c2ec0 20 rados->read ofs=0 len=0 2019-11-29T12:51:34.714 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:34.722+0000 7fac4b5c2ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-29T12:51:34.714 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:34.722+0000 7fac4b5c2ec0 20 rados->read ofs=0 len=0 2019-11-29T12:51:34.725 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:34.733+0000 7fac4b5c2ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T12:51:34.725 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:34.733+0000 7fac4b5c2ec0 10 cannot find current period zonegroup using local zonegroup 2019-11-29T12:51:34.725 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:34.733+0000 7fac4b5c2ec0 20 rados->read ofs=0 len=0 2019-11-29T12:51:34.737 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:34.745+0000 7fac4b5c2ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T12:51:34.737 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:34.745+0000 7fac4b5c2ec0 20 rados->read ofs=0 len=0 2019-11-29T12:51:34.753 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:34.761+0000 7fac4b5c2ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T12:51:34.753 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:34.761+0000 7fac4b5c2ec0 20 rados->read ofs=0 len=0 2019-11-29T12:51:34.766 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:34.774+0000 7fac4b5c2ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-29T12:51:34.766 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:34.774+0000 7fac4b5c2ec0 20 zonegroup default 2019-11-29T12:51:34.766 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:34.774+0000 7fac4b5c2ec0 20 rados->read ofs=0 len=0 2019-11-29T12:51:34.776 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:34.784+0000 7fac4b5c2ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T12:51:34.776 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:34.784+0000 7fac4b5c2ec0 10 Cannot find current period zone using local zone 2019-11-29T12:51:34.776 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:34.784+0000 7fac4b5c2ec0 20 rados->read ofs=0 len=0 2019-11-29T12:51:34.785 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:34.793+0000 7fac4b5c2ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T12:51:34.785 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:34.793+0000 7fac4b5c2ec0 20 rados->read ofs=0 len=0 2019-11-29T12:51:34.798 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:34.806+0000 7fac4b5c2ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T12:51:34.798 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:34.806+0000 7fac4b5c2ec0 20 rados->read ofs=0 len=0 2019-11-29T12:51:34.813 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:34.821+0000 7fac4b5c2ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-29T12:51:34.814 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:34.821+0000 7fac4b5c2ec0 20 zone default found 2019-11-29T12:51:34.814 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:34.821+0000 7fac4b5c2ec0 20 started sync module instance, tier type = 2019-11-29T12:51:34.814 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:34.821+0000 7fac4b5c2ec0 20 started zone id=7f922895-c6d7-4b1b-a19c-be3df5b5a899 (name=default) with tier type = 2019-11-29T12:51:35.225 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:35.233+0000 7fac4b5c2ec0 20 add_watcher() i=0 2019-11-29T12:51:35.226 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:35.233+0000 7fac4b5c2ec0 20 add_watcher() i=1 2019-11-29T12:51:35.226 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:35.233+0000 7fac4b5c2ec0 20 add_watcher() i=2 2019-11-29T12:51:35.226 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:35.233+0000 7fac4b5c2ec0 20 add_watcher() i=3 2019-11-29T12:51:35.226 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:35.233+0000 7fac4b5c2ec0 20 add_watcher() i=4 2019-11-29T12:51:35.226 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:35.233+0000 7fac4b5c2ec0 20 add_watcher() i=5 2019-11-29T12:51:35.226 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:35.233+0000 7fac4b5c2ec0 20 add_watcher() i=6 2019-11-29T12:51:35.258 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:35.266+0000 7fac4b5c2ec0 20 add_watcher() i=7 2019-11-29T12:51:35.258 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:35.266+0000 7fac4b5c2ec0 2 all 8 watchers are set, enabling cache 2019-11-29T12:51:35.258 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:35.266+0000 7fac08fe1700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-29T12:51:35.264 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:35.272+0000 7fac387ef700 0 -- 172.21.15.62:0/1463072196 >> v2:172.21.15.62:3300/0 conn(0x559247bc6010 msgr2=0x559247b95fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2019-11-29T12:51:35.466 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:35.474+0000 7fac387ef700 0 --2- 172.21.15.62:0/1463072196 >> v2:172.21.15.62:3300/0 conn(0x559247bc6010 0x559247b95fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2019-11-29T12:51:35.548 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:35.556+0000 7fac2ffff700 0 -- 172.21.15.62:0/2001328724 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x559247ba1a40 msgr2=0x559247b9f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-29T12:51:37.023 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:37.031+0000 7fab7affd700 20 reqs_thread_entry: start 2019-11-29T12:51:37.024 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:37.031+0000 7fab78ff9700 20 reqs_thread_entry: start 2019-11-29T12:51:37.024 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:37.031+0000 7fac4b5c2ec0 20 init_complete bucket index max shards: 0 2019-11-29T12:51:37.024 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:37.032+0000 7fab6effd700 20 reqs_thread_entry: start 2019-11-29T12:51:37.024 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:37.032+0000 7fac4b5c2ec0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2019-11-29T12:51:37.112 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:37.120+0000 7fac4b5c2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:51:37.137 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:37.145+0000 7fac4b5c2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T12:51:37.151 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:37.159+0000 7fac4b5c2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:51:37.207 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:37.214+0000 7fac4b5c2ec0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2019-11-29T12:51:37.278 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:37.286+0000 7fac4b5c2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:51:37.299 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:37.307+0000 7fac4b5c2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T12:51:37.310 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:37.318+0000 7fac4b5c2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:51:37.362 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:37.370+0000 7fac4b5c2ec0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2019-11-29T12:51:37.445 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:37.453+0000 7fac4b5c2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:51:37.484 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:37.492+0000 7fac4b5c2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T12:51:37.499 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:37.507+0000 7fac4b5c2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:51:37.551 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:37.559+0000 7fac4b5c2ec0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2019-11-29T12:51:37.628 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:37.632+0000 7fac4b5c2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:51:37.645 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:37.653+0000 7fac4b5c2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T12:51:37.658 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:37.666+0000 7fac4b5c2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:51:37.707 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:37.715+0000 7fac4b5c2ec0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2019-11-29T12:51:37.794 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:37.802+0000 7fac4b5c2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:51:37.818 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:37.826+0000 7fac4b5c2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T12:51:37.840 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:37.848+0000 7fac4b5c2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:51:37.902 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:37.909+0000 7fac4b5c2ec0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2019-11-29T12:51:37.981 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:37.989+0000 7fac4b5c2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:51:38.007 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:38.014+0000 7fac4b5c2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T12:51:38.027 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:38.034+0000 7fac4b5c2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:51:38.074 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:38.082+0000 7fac4b5c2ec0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2019-11-29T12:51:38.140 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:38.147+0000 7fac4b5c2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:51:38.164 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:38.171+0000 7fac4b5c2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T12:51:38.174 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:38.182+0000 7fac4b5c2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:51:38.245 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:38.253+0000 7fac4b5c2ec0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2019-11-29T12:51:38.326 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:38.334+0000 7fac4b5c2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:51:38.358 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:38.366+0000 7fac4b5c2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T12:51:38.396 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:38.404+0000 7fac4b5c2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:51:38.456 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:38.464+0000 7fac4b5c2ec0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2019-11-29T12:51:38.506 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:38.514+0000 7fac4b5c2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:51:38.526 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:38.534+0000 7fac4b5c2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T12:51:38.536 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:38.544+0000 7fac4b5c2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:51:38.582 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:38.590+0000 7fac4b5c2ec0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2019-11-29T12:51:38.648 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:38.656+0000 7fac4b5c2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:51:38.675 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:38.683+0000 7fac4b5c2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T12:51:38.687 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:38.695+0000 7fac4b5c2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:51:38.731 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:38.739+0000 7fac4b5c2ec0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2019-11-29T12:51:38.823 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:38.830+0000 7fac4b5c2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:51:38.842 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:38.850+0000 7fac4b5c2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T12:51:38.855 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:38.863+0000 7fac4b5c2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:51:38.906 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:38.914+0000 7fac4b5c2ec0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2019-11-29T12:51:38.976 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:38.984+0000 7fac4b5c2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:51:39.008 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:39.015+0000 7fac4b5c2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T12:51:39.019 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:39.027+0000 7fac4b5c2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:51:39.079 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:39.086+0000 7fac4b5c2ec0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2019-11-29T12:51:39.141 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:39.149+0000 7fac4b5c2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:51:39.160 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:39.168+0000 7fac4b5c2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T12:51:39.170 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:39.178+0000 7fac4b5c2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:51:39.218 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:39.226+0000 7fac4b5c2ec0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2019-11-29T12:51:39.273 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:39.280+0000 7fac4b5c2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:51:39.290 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:39.297+0000 7fac4b5c2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T12:51:39.300 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:39.307+0000 7fac4b5c2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:51:39.338 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:39.346+0000 7fac4b5c2ec0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2019-11-29T12:51:39.385 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:39.392+0000 7fac4b5c2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:51:39.402 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:39.410+0000 7fac4b5c2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T12:51:39.410 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:39.418+0000 7fac4b5c2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:51:39.449 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:39.457+0000 7fac4b5c2ec0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2019-11-29T12:51:39.497 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:39.505+0000 7fac4b5c2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:51:39.526 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:39.534+0000 7fac4b5c2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T12:51:39.537 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:39.545+0000 7fac4b5c2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:51:39.578 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:39.586+0000 7fac4b5c2ec0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2019-11-29T12:51:39.664 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:39.672+0000 7fac4b5c2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:51:39.689 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:39.697+0000 7fac4b5c2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T12:51:39.702 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:39.710+0000 7fac4b5c2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:51:39.789 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:39.797+0000 7fac4b5c2ec0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2019-11-29T12:51:39.841 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:39.849+0000 7fac4b5c2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:51:39.867 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:39.870+0000 7fac4b5c2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T12:51:39.872 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:39.880+0000 7fac4b5c2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:51:39.917 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:39.925+0000 7fac4b5c2ec0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2019-11-29T12:51:39.999 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:40.007+0000 7fac4b5c2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:51:40.029 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:40.037+0000 7fac4b5c2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T12:51:40.047 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:40.054+0000 7fac4b5c2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:51:40.116 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:40.124+0000 7fac4b5c2ec0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2019-11-29T12:51:40.201 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:40.208+0000 7fac4b5c2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:51:40.225 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:40.233+0000 7fac4b5c2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T12:51:40.238 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:40.246+0000 7fac4b5c2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:51:40.299 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:40.307+0000 7fac4b5c2ec0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2019-11-29T12:51:40.368 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:40.376+0000 7fac4b5c2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:51:40.395 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:40.402+0000 7fac4b5c2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T12:51:40.408 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:40.415+0000 7fac4b5c2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:51:40.448 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:40.455+0000 7fac4b5c2ec0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2019-11-29T12:51:40.511 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:40.519+0000 7fac4b5c2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:51:40.532 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:40.540+0000 7fac4b5c2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T12:51:40.542 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:40.550+0000 7fac4b5c2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:51:40.598 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:40.606+0000 7fac4b5c2ec0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2019-11-29T12:51:40.656 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:40.664+0000 7fac4b5c2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:51:40.674 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:40.682+0000 7fac4b5c2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T12:51:40.711 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:40.718+0000 7fac4b5c2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:51:40.759 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:40.766+0000 7fac4b5c2ec0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2019-11-29T12:51:40.823 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:40.830+0000 7fac4b5c2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:51:40.845 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:40.853+0000 7fac4b5c2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T12:51:40.856 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:40.863+0000 7fac4b5c2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:51:40.928 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:40.936+0000 7fac4b5c2ec0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2019-11-29T12:51:40.983 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:40.991+0000 7fac4b5c2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:51:41.005 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:41.012+0000 7fac4b5c2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T12:51:41.015 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:41.023+0000 7fac4b5c2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:51:41.063 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:41.069+0000 7fac4b5c2ec0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2019-11-29T12:51:41.106 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:41.113+0000 7fac4b5c2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:51:41.123 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:41.131+0000 7fac4b5c2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T12:51:41.133 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:41.141+0000 7fac4b5c2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:51:41.167 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:41.175+0000 7fac4b5c2ec0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2019-11-29T12:51:41.231 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:41.239+0000 7fac4b5c2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:51:41.251 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:41.259+0000 7fac4b5c2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T12:51:41.259 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:41.267+0000 7fac4b5c2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:51:41.315 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:41.322+0000 7fac4b5c2ec0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2019-11-29T12:51:41.385 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:41.393+0000 7fac4b5c2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:51:41.403 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:41.410+0000 7fac4b5c2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T12:51:41.414 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:41.422+0000 7fac4b5c2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:51:41.467 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:41.475+0000 7fac4b5c2ec0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2019-11-29T12:51:41.521 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:41.528+0000 7fac4b5c2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:51:41.538 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:41.546+0000 7fac4b5c2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T12:51:41.547 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:41.555+0000 7fac4b5c2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:51:41.588 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:41.594+0000 7fac4b5c2ec0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2019-11-29T12:51:41.659 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:41.666+0000 7fac4b5c2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:51:41.681 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:41.689+0000 7fac4b5c2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T12:51:41.699 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:41.704+0000 7fac4b5c2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:51:41.790 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:41.798+0000 7fac4b5c2ec0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2019-11-29T12:51:41.865 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:41.866+0000 7fac4b5c2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:51:41.878 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:41.886+0000 7fac4b5c2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T12:51:41.888 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:41.896+0000 7fac4b5c2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:51:41.935 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:41.943+0000 7fac4b5c2ec0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2019-11-29T12:51:42.004 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:42.012+0000 7fac4b5c2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:51:42.026 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:42.034+0000 7fac4b5c2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T12:51:42.036 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:42.044+0000 7fac4b5c2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:51:42.124 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:42.132+0000 7fac4b5c2ec0 20 remove_watcher() i=0 2019-11-29T12:51:42.125 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:42.132+0000 7fac4b5c2ec0 2 removed watcher, disabling cache 2019-11-29T12:51:42.163 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:42.171+0000 7fac4b5c2ec0 20 remove_watcher() i=1 2019-11-29T12:51:42.204 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:42.211+0000 7fac4b5c2ec0 20 remove_watcher() i=2 2019-11-29T12:51:42.237 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:42.245+0000 7fac4b5c2ec0 20 remove_watcher() i=3 2019-11-29T12:51:42.278 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:42.286+0000 7fac4b5c2ec0 20 remove_watcher() i=4 2019-11-29T12:51:42.328 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:42.336+0000 7fac4b5c2ec0 20 remove_watcher() i=5 2019-11-29T12:51:42.362 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:42.369+0000 7fac4b5c2ec0 20 remove_watcher() i=6 2019-11-29T12:51:42.403 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T12:51:42.410+0000 7fac4b5c2ec0 20 remove_watcher() i=7 2019-11-29T12:51:42.411 INFO:teuthology.orchestra.run.smithi062:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle-4.7/bin/gradle clean test --rerun-tasks --no-build-cache --tests AWS4Test 2019-11-29T12:51:42.947 INFO:teuthology.orchestra.run.smithi062.stdout:Starting a Gradle Daemon (subsequent builds will be faster) 2019-11-29T12:51:46.547 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/io/spring/gradle/dependency-management-plugin/1.0.3.RELEASE/dependency-management-plugin-1.0.3.RELEASE.pom 2019-11-29T12:51:46.747 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/io/spring/gradle/dependency-management-plugin/1.0.3.RELEASE/dependency-management-plugin-1.0.3.RELEASE.jar 2019-11-29T12:51:47.949 INFO:teuthology.orchestra.run.smithi062.stdout:> Task :clean UP-TO-DATE 2019-11-29T12:51:47.950 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-bom/1.11.549/aws-java-sdk-bom-1.11.549.pom 2019-11-29T12:51:48.047 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-pom/1.11.549/aws-java-sdk-pom-1.11.549.pom 2019-11-29T12:51:48.248 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-server/2.44.0/selenium-server-2.44.0.pom 2019-11-29T12:51:48.249 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-s3/1.11.549/aws-java-sdk-s3-1.11.549.pom 2019-11-29T12:51:48.249 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk/1.11.549/aws-java-sdk-1.11.549.pom 2019-11-29T12:51:48.250 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/log4j/log4j/1.2.17/log4j-1.2.17.pom 2019-11-29T12:51:48.250 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-core/1.11.549/aws-java-sdk-core-1.11.549.pom 2019-11-29T12:51:48.251 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/org/testng/testng/6.1.1/testng-6.1.1.pom 2019-11-29T12:51:48.251 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-sqs/1.11.549/aws-java-sdk-sqs-1.11.549.pom 2019-11-29T12:51:48.251 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-parent/2.44.0/selenium-parent-2.44.0.pom 2019-11-29T12:51:48.251 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/3/oss-parent-3.pom 2019-11-29T12:51:48.351 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/fasterxml/jackson/dataformat/jackson-dataformat-cbor/2.6.7/jackson-dataformat-cbor-2.6.7.pom 2019-11-29T12:51:48.351 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/joda-time/joda-time/2.8.1/joda-time-2.8.1.pom 2019-11-29T12:51:48.352 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/fasterxml/jackson/core/jackson-databind/2.6.7.2/jackson-databind-2.6.7.2.pom 2019-11-29T12:51:48.352 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/software/amazon/ion/ion-java/1.0.2/ion-java-1.0.2.pom 2019-11-29T12:51:48.352 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.5/httpclient-4.5.5.pom 2019-11-29T12:51:48.352 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/commons-logging/commons-logging/1.1.3/commons-logging-1.1.3.pom 2019-11-29T12:51:48.352 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/fasterxml/jackson/jackson-parent/2.6.2/jackson-parent-2.6.2.pom 2019-11-29T12:51:48.352 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.5.5/httpcomponents-client-4.5.5.pom 2019-11-29T12:51:48.353 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/28/commons-parent-28.pom 2019-11-29T12:51:48.353 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/fasterxml/oss-parent/24/oss-parent-24.pom 2019-11-29T12:51:48.353 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-parent/10/httpcomponents-parent-10.pom 2019-11-29T12:51:48.353 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/org/apache/apache/13/apache-13.pom 2019-11-29T12:51:48.353 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/org/apache/apache/18/apache-18.pom 2019-11-29T12:51:48.449 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-worklink/1.11.549/aws-java-sdk-worklink-1.11.549.pom 2019-11-29T12:51:48.449 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-kafka/1.11.549/aws-java-sdk-kafka-1.11.549.pom 2019-11-29T12:51:48.449 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-docdb/1.11.549/aws-java-sdk-docdb-1.11.549.pom 2019-11-29T12:51:48.449 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-textract/1.11.549/aws-java-sdk-textract-1.11.549.pom 2019-11-29T12:51:48.449 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-backup/1.11.549/aws-java-sdk-backup-1.11.549.pom 2019-11-29T12:51:48.451 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-apigatewaymanagementapi/1.11.549/aws-java-sdk-apigatewaymanagementapi-1.11.549.pom 2019-11-29T12:51:48.451 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-apigatewayv2/1.11.549/aws-java-sdk-apigatewayv2-1.11.549.pom 2019-11-29T12:51:48.451 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-licensemanager/1.11.549/aws-java-sdk-licensemanager-1.11.549.pom 2019-11-29T12:51:48.451 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-managedblockchain/1.11.549/aws-java-sdk-managedblockchain-1.11.549.pom 2019-11-29T12:51:48.452 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-securityhub/1.11.549/aws-java-sdk-securityhub-1.11.549.pom 2019-11-29T12:51:48.548 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-fsx/1.11.549/aws-java-sdk-fsx-1.11.549.pom 2019-11-29T12:51:48.548 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-comprehendmedical/1.11.549/aws-java-sdk-comprehendmedical-1.11.549.pom 2019-11-29T12:51:48.548 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mediaconnect/1.11.549/aws-java-sdk-mediaconnect-1.11.549.pom 2019-11-29T12:51:48.560 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-kinesisanalyticsv2/1.11.549/aws-java-sdk-kinesisanalyticsv2-1.11.549.pom 2019-11-29T12:51:48.561 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-globalaccelerator/1.11.549/aws-java-sdk-globalaccelerator-1.11.549.pom 2019-11-29T12:51:48.561 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-datasync/1.11.549/aws-java-sdk-datasync-1.11.549.pom 2019-11-29T12:51:48.561 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-transfer/1.11.549/aws-java-sdk-transfer-1.11.549.pom 2019-11-29T12:51:48.561 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-amplify/1.11.549/aws-java-sdk-amplify-1.11.549.pom 2019-11-29T12:51:48.562 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-robomaker/1.11.549/aws-java-sdk-robomaker-1.11.549.pom 2019-11-29T12:51:48.562 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-quicksight/1.11.549/aws-java-sdk-quicksight-1.11.549.pom 2019-11-29T12:51:48.562 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-rdsdata/1.11.549/aws-java-sdk-rdsdata-1.11.549.pom 2019-11-29T12:51:48.562 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-route53resolver/1.11.549/aws-java-sdk-route53resolver-1.11.549.pom 2019-11-29T12:51:48.562 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-ram/1.11.549/aws-java-sdk-ram-1.11.549.pom 2019-11-29T12:51:48.563 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-s3control/1.11.549/aws-java-sdk-s3control-1.11.549.pom 2019-11-29T12:51:48.563 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-pinpointemail/1.11.549/aws-java-sdk-pinpointemail-1.11.549.pom 2019-11-29T12:51:48.563 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-pinpointsmsvoice/1.11.549/aws-java-sdk-pinpointsmsvoice-1.11.549.pom 2019-11-29T12:51:48.563 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-signer/1.11.549/aws-java-sdk-signer-1.11.549.pom 2019-11-29T12:51:48.563 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-dlm/1.11.549/aws-java-sdk-dlm-1.11.549.pom 2019-11-29T12:51:48.564 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-chime/1.11.549/aws-java-sdk-chime-1.11.549.pom 2019-11-29T12:51:48.564 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-macie/1.11.549/aws-java-sdk-macie-1.11.549.pom 2019-11-29T12:51:48.571 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-eks/1.11.549/aws-java-sdk-eks-1.11.549.pom 2019-11-29T12:51:48.571 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-neptune/1.11.549/aws-java-sdk-neptune-1.11.549.pom 2019-11-29T12:51:48.571 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-iot1clickprojects/1.11.549/aws-java-sdk-iot1clickprojects-1.11.549.pom 2019-11-29T12:51:48.572 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mediatailor/1.11.549/aws-java-sdk-mediatailor-1.11.549.pom 2019-11-29T12:51:48.572 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-iot1clickdevices/1.11.549/aws-java-sdk-iot1clickdevices-1.11.549.pom 2019-11-29T12:51:48.572 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-pi/1.11.549/aws-java-sdk-pi-1.11.549.pom 2019-11-29T12:51:48.572 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-acmpca/1.11.549/aws-java-sdk-acmpca-1.11.549.pom 2019-11-29T12:51:48.573 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-iotanalytics/1.11.549/aws-java-sdk-iotanalytics-1.11.549.pom 2019-11-29T12:51:48.573 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-connect/1.11.549/aws-java-sdk-connect-1.11.549.pom 2019-11-29T12:51:48.573 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-secretsmanager/1.11.549/aws-java-sdk-secretsmanager-1.11.549.pom 2019-11-29T12:51:48.574 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-fms/1.11.549/aws-java-sdk-fms-1.11.549.pom 2019-11-29T12:51:48.574 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-autoscalingplans/1.11.549/aws-java-sdk-autoscalingplans-1.11.549.pom 2019-11-29T12:51:48.574 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-workmail/1.11.549/aws-java-sdk-workmail-1.11.549.pom 2019-11-29T12:51:48.574 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-transcribe/1.11.549/aws-java-sdk-transcribe-1.11.549.pom 2019-11-29T12:51:48.575 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-servicediscovery/1.11.549/aws-java-sdk-servicediscovery-1.11.549.pom 2019-11-29T12:51:48.575 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloud9/1.11.549/aws-java-sdk-cloud9-1.11.549.pom 2019-11-29T12:51:48.575 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-alexaforbusiness/1.11.549/aws-java-sdk-alexaforbusiness-1.11.549.pom 2019-11-29T12:51:48.575 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-serverlessapplicationrepository/1.11.549/aws-java-sdk-serverlessapplicationrepository-1.11.549.pom 2019-11-29T12:51:48.575 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-comprehend/1.11.549/aws-java-sdk-comprehend-1.11.549.pom 2019-11-29T12:51:48.576 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-resourcegroups/1.11.549/aws-java-sdk-resourcegroups-1.11.549.pom 2019-11-29T12:51:48.576 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-sagemaker/1.11.549/aws-java-sdk-sagemaker-1.11.549.pom 2019-11-29T12:51:48.576 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-iotjobsdataplane/1.11.549/aws-java-sdk-iotjobsdataplane-1.11.549.pom 2019-11-29T12:51:48.576 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-translate/1.11.549/aws-java-sdk-translate-1.11.549.pom 2019-11-29T12:51:48.577 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-sagemakerruntime/1.11.549/aws-java-sdk-sagemakerruntime-1.11.549.pom 2019-11-29T12:51:48.648 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-kinesisvideo/1.11.549/aws-java-sdk-kinesisvideo-1.11.549.pom 2019-11-29T12:51:48.648 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-guardduty/1.11.549/aws-java-sdk-guardduty-1.11.549.pom 2019-11-29T12:51:48.648 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mediaconvert/1.11.549/aws-java-sdk-mediaconvert-1.11.549.pom 2019-11-29T12:51:48.650 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mq/1.11.549/aws-java-sdk-mq-1.11.549.pom 2019-11-29T12:51:48.651 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mediastore/1.11.549/aws-java-sdk-mediastore-1.11.549.pom 2019-11-29T12:51:48.651 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mediastoredata/1.11.549/aws-java-sdk-mediastoredata-1.11.549.pom 2019-11-29T12:51:48.651 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-appsync/1.11.549/aws-java-sdk-appsync-1.11.549.pom 2019-11-29T12:51:48.651 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mediapackage/1.11.549/aws-java-sdk-mediapackage-1.11.549.pom 2019-11-29T12:51:48.651 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-costexplorer/1.11.549/aws-java-sdk-costexplorer-1.11.549.pom 2019-11-29T12:51:48.651 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-medialive/1.11.549/aws-java-sdk-medialive-1.11.549.pom 2019-11-29T12:51:48.651 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-pricing/1.11.549/aws-java-sdk-pricing-1.11.549.pom 2019-11-29T12:51:48.652 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mobile/1.11.549/aws-java-sdk-mobile-1.11.549.pom 2019-11-29T12:51:48.652 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudhsmv2/1.11.549/aws-java-sdk-cloudhsmv2-1.11.549.pom 2019-11-29T12:51:48.652 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-glue/1.11.549/aws-java-sdk-glue-1.11.549.pom 2019-11-29T12:51:48.657 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-greengrass/1.11.549/aws-java-sdk-greengrass-1.11.549.pom 2019-11-29T12:51:48.657 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-dax/1.11.549/aws-java-sdk-dax-1.11.549.pom 2019-11-29T12:51:48.657 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-migrationhub/1.11.549/aws-java-sdk-migrationhub-1.11.549.pom 2019-11-29T12:51:48.658 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-athena/1.11.549/aws-java-sdk-athena-1.11.549.pom 2019-11-29T12:51:48.658 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-marketplaceentitlement/1.11.549/aws-java-sdk-marketplaceentitlement-1.11.549.pom 2019-11-29T12:51:48.658 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-lexmodelbuilding/1.11.549/aws-java-sdk-lexmodelbuilding-1.11.549.pom 2019-11-29T12:51:48.658 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-codestar/1.11.549/aws-java-sdk-codestar-1.11.549.pom 2019-11-29T12:51:48.659 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-resourcegroupstaggingapi/1.11.549/aws-java-sdk-resourcegroupstaggingapi-1.11.549.pom 2019-11-29T12:51:48.659 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-pinpoint/1.11.549/aws-java-sdk-pinpoint-1.11.549.pom 2019-11-29T12:51:48.659 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-xray/1.11.549/aws-java-sdk-xray-1.11.549.pom 2019-11-29T12:51:48.659 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-support/1.11.549/aws-java-sdk-support-1.11.549.pom 2019-11-29T12:51:48.660 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-servicecatalog/1.11.549/aws-java-sdk-servicecatalog-1.11.549.pom 2019-11-29T12:51:48.660 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-simpledb/1.11.549/aws-java-sdk-simpledb-1.11.549.pom 2019-11-29T12:51:48.660 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-opsworkscm/1.11.549/aws-java-sdk-opsworkscm-1.11.549.pom 2019-11-29T12:51:48.660 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-servermigration/1.11.549/aws-java-sdk-servermigration-1.11.549.pom 2019-11-29T12:51:48.661 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-simpleworkflow/1.11.549/aws-java-sdk-simpleworkflow-1.11.549.pom 2019-11-29T12:51:48.661 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-storagegateway/1.11.549/aws-java-sdk-storagegateway-1.11.549.pom 2019-11-29T12:51:48.748 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-route53/1.11.549/aws-java-sdk-route53-1.11.549.pom 2019-11-29T12:51:48.748 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-importexport/1.11.549/aws-java-sdk-importexport-1.11.549.pom 2019-11-29T12:51:48.748 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-rds/1.11.549/aws-java-sdk-rds-1.11.549.pom 2019-11-29T12:51:48.758 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-elasticbeanstalk/1.11.549/aws-java-sdk-elasticbeanstalk-1.11.549.pom 2019-11-29T12:51:48.758 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-glacier/1.11.549/aws-java-sdk-glacier-1.11.549.pom 2019-11-29T12:51:48.759 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-redshift/1.11.549/aws-java-sdk-redshift-1.11.549.pom 2019-11-29T12:51:48.759 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-iam/1.11.549/aws-java-sdk-iam-1.11.549.pom 2019-11-29T12:51:48.759 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-sts/1.11.549/aws-java-sdk-sts-1.11.549.pom 2019-11-29T12:51:48.759 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-datapipeline/1.11.549/aws-java-sdk-datapipeline-1.11.549.pom 2019-11-29T12:51:48.759 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-elasticloadbalancing/1.11.549/aws-java-sdk-elasticloadbalancing-1.11.549.pom 2019-11-29T12:51:48.759 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-emr/1.11.549/aws-java-sdk-emr-1.11.549.pom 2019-11-29T12:51:48.759 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-elasticache/1.11.549/aws-java-sdk-elasticache-1.11.549.pom 2019-11-29T12:51:48.760 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-elastictranscoder/1.11.549/aws-java-sdk-elastictranscoder-1.11.549.pom 2019-11-29T12:51:48.760 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-dynamodb/1.11.549/aws-java-sdk-dynamodb-1.11.549.pom 2019-11-29T12:51:48.760 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-ec2/1.11.549/aws-java-sdk-ec2-1.11.549.pom 2019-11-29T12:51:48.760 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-elasticloadbalancingv2/1.11.549/aws-java-sdk-elasticloadbalancingv2-1.11.549.pom 2019-11-29T12:51:48.761 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-sns/1.11.549/aws-java-sdk-sns-1.11.549.pom 2019-11-29T12:51:48.761 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-budgets/1.11.549/aws-java-sdk-budgets-1.11.549.pom 2019-11-29T12:51:48.761 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudtrail/1.11.549/aws-java-sdk-cloudtrail-1.11.549.pom 2019-11-29T12:51:48.761 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudwatch/1.11.549/aws-java-sdk-cloudwatch-1.11.549.pom 2019-11-29T12:51:48.761 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cognitoidentity/1.11.549/aws-java-sdk-cognitoidentity-1.11.549.pom 2019-11-29T12:51:48.762 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cognitosync/1.11.549/aws-java-sdk-cognitosync-1.11.549.pom 2019-11-29T12:51:48.762 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-directconnect/1.11.549/aws-java-sdk-directconnect-1.11.549.pom 2019-11-29T12:51:48.762 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-logs/1.11.549/aws-java-sdk-logs-1.11.549.pom 2019-11-29T12:51:48.762 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudformation/1.11.549/aws-java-sdk-cloudformation-1.11.549.pom 2019-11-29T12:51:48.762 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudfront/1.11.549/aws-java-sdk-cloudfront-1.11.549.pom 2019-11-29T12:51:48.762 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-clouddirectory/1.11.549/aws-java-sdk-clouddirectory-1.11.549.pom 2019-11-29T12:51:48.762 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-ses/1.11.549/aws-java-sdk-ses-1.11.549.pom 2019-11-29T12:51:48.763 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-events/1.11.549/aws-java-sdk-events-1.11.549.pom 2019-11-29T12:51:48.763 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-opsworks/1.11.549/aws-java-sdk-opsworks-1.11.549.pom 2019-11-29T12:51:48.763 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-kinesis/1.11.549/aws-java-sdk-kinesis-1.11.549.pom 2019-11-29T12:51:48.763 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-autoscaling/1.11.549/aws-java-sdk-autoscaling-1.11.549.pom 2019-11-29T12:51:48.763 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-codepipeline/1.11.549/aws-java-sdk-codepipeline-1.11.549.pom 2019-11-29T12:51:48.763 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudwatchmetrics/1.11.549/aws-java-sdk-cloudwatchmetrics-1.11.549.pom 2019-11-29T12:51:48.763 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudsearch/1.11.549/aws-java-sdk-cloudsearch-1.11.549.pom 2019-11-29T12:51:48.848 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-kms/1.11.549/aws-java-sdk-kms-1.11.549.pom 2019-11-29T12:51:48.848 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-codedeploy/1.11.549/aws-java-sdk-codedeploy-1.11.549.pom 2019-11-29T12:51:48.848 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-config/1.11.549/aws-java-sdk-config-1.11.549.pom 2019-11-29T12:51:48.852 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-ecs/1.11.549/aws-java-sdk-ecs-1.11.549.pom 2019-11-29T12:51:48.852 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudhsm/1.11.549/aws-java-sdk-cloudhsm-1.11.549.pom 2019-11-29T12:51:48.853 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-workspaces/1.11.549/aws-java-sdk-workspaces-1.11.549.pom 2019-11-29T12:51:48.853 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-ecr/1.11.549/aws-java-sdk-ecr-1.11.549.pom 2019-11-29T12:51:48.853 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-lambda/1.11.549/aws-java-sdk-lambda-1.11.549.pom 2019-11-29T12:51:48.853 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-ssm/1.11.549/aws-java-sdk-ssm-1.11.549.pom 2019-11-29T12:51:48.853 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-directory/1.11.549/aws-java-sdk-directory-1.11.549.pom 2019-11-29T12:51:48.853 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-efs/1.11.549/aws-java-sdk-efs-1.11.549.pom 2019-11-29T12:51:48.854 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-codecommit/1.11.549/aws-java-sdk-codecommit-1.11.549.pom 2019-11-29T12:51:48.854 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-elasticsearch/1.11.549/aws-java-sdk-elasticsearch-1.11.549.pom 2019-11-29T12:51:48.854 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-devicefarm/1.11.549/aws-java-sdk-devicefarm-1.11.549.pom 2019-11-29T12:51:48.854 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-waf/1.11.549/aws-java-sdk-waf-1.11.549.pom 2019-11-29T12:51:48.854 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-marketplacecommerceanalytics/1.11.549/aws-java-sdk-marketplacecommerceanalytics-1.11.549.pom 2019-11-29T12:51:48.854 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-machinelearning/1.11.549/aws-java-sdk-machinelearning-1.11.549.pom 2019-11-29T12:51:48.854 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-inspector/1.11.549/aws-java-sdk-inspector-1.11.549.pom 2019-11-29T12:51:48.855 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-iot/1.11.549/aws-java-sdk-iot-1.11.549.pom 2019-11-29T12:51:48.855 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-acm/1.11.549/aws-java-sdk-acm-1.11.549.pom 2019-11-29T12:51:48.855 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-gamelift/1.11.549/aws-java-sdk-gamelift-1.11.549.pom 2019-11-29T12:51:48.855 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-dms/1.11.549/aws-java-sdk-dms-1.11.549.pom 2019-11-29T12:51:48.855 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-marketplacemeteringservice/1.11.549/aws-java-sdk-marketplacemeteringservice-1.11.549.pom 2019-11-29T12:51:48.855 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-api-gateway/1.11.549/aws-java-sdk-api-gateway-1.11.549.pom 2019-11-29T12:51:48.856 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cognitoidp/1.11.549/aws-java-sdk-cognitoidp-1.11.549.pom 2019-11-29T12:51:48.856 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-rekognition/1.11.549/aws-java-sdk-rekognition-1.11.549.pom 2019-11-29T12:51:48.858 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-applicationautoscaling/1.11.549/aws-java-sdk-applicationautoscaling-1.11.549.pom 2019-11-29T12:51:48.858 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-discovery/1.11.549/aws-java-sdk-discovery-1.11.549.pom 2019-11-29T12:51:48.858 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-snowball/1.11.549/aws-java-sdk-snowball-1.11.549.pom 2019-11-29T12:51:48.859 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-polly/1.11.549/aws-java-sdk-polly-1.11.549.pom 2019-11-29T12:51:48.859 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-stepfunctions/1.11.549/aws-java-sdk-stepfunctions-1.11.549.pom 2019-11-29T12:51:48.859 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-health/1.11.549/aws-java-sdk-health-1.11.549.pom 2019-11-29T12:51:48.859 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-lightsail/1.11.549/aws-java-sdk-lightsail-1.11.549.pom 2019-11-29T12:51:48.859 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-appstream/1.11.549/aws-java-sdk-appstream-1.11.549.pom 2019-11-29T12:51:48.948 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-shield/1.11.549/aws-java-sdk-shield-1.11.549.pom 2019-11-29T12:51:48.948 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mechanicalturkrequester/1.11.549/aws-java-sdk-mechanicalturkrequester-1.11.549.pom 2019-11-29T12:51:48.948 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-organizations/1.11.549/aws-java-sdk-organizations-1.11.549.pom 2019-11-29T12:51:48.948 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-costandusagereport/1.11.549/aws-java-sdk-costandusagereport-1.11.549.pom 2019-11-29T12:51:48.949 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-codebuild/1.11.549/aws-java-sdk-codebuild-1.11.549.pom 2019-11-29T12:51:48.949 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-lex/1.11.549/aws-java-sdk-lex-1.11.549.pom 2019-11-29T12:51:48.949 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-batch/1.11.549/aws-java-sdk-batch-1.11.549.pom 2019-11-29T12:51:48.949 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-workdocs/1.11.549/aws-java-sdk-workdocs-1.11.549.pom 2019-11-29T12:51:48.949 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-models/1.11.549/aws-java-sdk-models-1.11.549.pom 2019-11-29T12:51:48.950 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-swf-libraries/1.11.22/aws-java-sdk-swf-libraries-1.11.22.pom 2019-11-29T12:51:48.950 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-appmesh/1.11.549/aws-java-sdk-appmesh-1.11.549.pom 2019-11-29T12:51:48.950 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-pom/1.11.22/aws-java-sdk-pom-1.11.22.pom 2019-11-29T12:51:48.950 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/jmespath-java/1.11.549/jmespath-java-1.11.549.pom 2019-11-29T12:51:48.950 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/org/bouncycastle/bcpkix-jdk15on/1.48/bcpkix-jdk15on-1.48.pom 2019-11-29T12:51:48.950 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/mx4j/mx4j-tools/3.0.1/mx4j-tools-3.0.1.pom 2019-11-29T12:51:48.950 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/net/jcip/jcip-annotations/1.0/jcip-annotations-1.0.pom 2019-11-29T12:51:48.951 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/org/mortbay/jetty/servlet-api-2.5/6.1.9/servlet-api-2.5-6.1.9.pom 2019-11-29T12:51:48.951 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/jetty-repacked/7.6.1/jetty-repacked-7.6.1.pom 2019-11-29T12:51:48.951 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/jetty-rc-repacked/5/jetty-rc-repacked-5.pom 2019-11-29T12:51:48.951 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/org/bouncycastle/bcprov-jdk15on/1.48/bcprov-jdk15on-1.48.pom 2019-11-29T12:51:48.951 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-java/2.44.0/selenium-java-2.44.0.pom 2019-11-29T12:51:48.951 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.9/commons-codec-1.9.pom 2019-11-29T12:51:48.952 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/org/mortbay/jetty/project/6.1.9/project-6.1.9.pom 2019-11-29T12:51:48.952 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/org/yaml/snakeyaml/1.8/snakeyaml-1.8.pom 2019-11-29T12:51:48.952 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/32/commons-parent-32.pom 2019-11-29T12:51:49.048 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/junit/junit/3.8.1/junit-3.8.1.pom 2019-11-29T12:51:49.048 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/org/beanshell/bsh/2.0b4/bsh-2.0b4.pom 2019-11-29T12:51:49.048 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/beust/jcommander/1.12/jcommander-1.12.pom 2019-11-29T12:51:49.049 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/org/beanshell/beanshell/2.0b4/beanshell-2.0b4.pom 2019-11-29T12:51:49.049 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/commons-logging/commons-logging/1.2/commons-logging-1.2.pom 2019-11-29T12:51:49.049 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/34/commons-parent-34.pom 2019-11-29T12:51:49.147 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.10/commons-codec-1.10.pom 2019-11-29T12:51:49.147 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/35/commons-parent-35.pom 2019-11-29T12:51:49.148 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/org/apache/apache/15/apache-15.pom 2019-11-29T12:51:49.148 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.9/httpcore-4.4.9.pom 2019-11-29T12:51:49.148 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-core/4.4.9/httpcomponents-core-4.4.9.pom 2019-11-29T12:51:49.148 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-parent/9/httpcomponents-parent-9.pom 2019-11-29T12:51:49.148 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/fasterxml/jackson/core/jackson-annotations/2.6.0/jackson-annotations-2.6.0.pom 2019-11-29T12:51:49.247 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/fasterxml/jackson/core/jackson-core/2.6.7/jackson-core-2.6.7.pom 2019-11-29T12:51:49.248 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/fasterxml/jackson/jackson-parent/2.6.1/jackson-parent-2.6.1.pom 2019-11-29T12:51:49.248 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/fasterxml/oss-parent/23/oss-parent-23.pom 2019-11-29T12:51:49.248 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-codec-http/4.1.17.Final/netty-codec-http-4.1.17.Final.pom 2019-11-29T12:51:49.248 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-handler/4.1.17.Final/netty-handler-4.1.17.Final.pom 2019-11-29T12:51:49.248 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-parent/4.1.17.Final/netty-parent-4.1.17.Final.pom 2019-11-29T12:51:49.248 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom 2019-11-29T12:51:49.249 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-support/2.44.0/selenium-support-2.44.0.pom 2019-11-29T12:51:49.249 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-ie-driver/2.44.0/selenium-ie-driver-2.44.0.pom 2019-11-29T12:51:49.249 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-firefox-driver/2.44.0/selenium-firefox-driver-2.44.0.pom 2019-11-29T12:51:49.249 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-htmlunit-driver/2.44.0/selenium-htmlunit-driver-2.44.0.pom 2019-11-29T12:51:49.249 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/org/webbitserver/webbit/0.4.14/webbit-0.4.14.pom 2019-11-29T12:51:49.249 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-safari-driver/2.44.0/selenium-safari-driver-2.44.0.pom 2019-11-29T12:51:49.249 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-chrome-driver/2.44.0/selenium-chrome-driver-2.44.0.pom 2019-11-29T12:51:49.348 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/6/oss-parent-6.pom 2019-11-29T12:51:49.348 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-codec/4.1.17.Final/netty-codec-4.1.17.Final.pom 2019-11-29T12:51:49.349 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-buffer/4.1.17.Final/netty-buffer-4.1.17.Final.pom 2019-11-29T12:51:49.349 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-transport/4.1.17.Final/netty-transport-4.1.17.Final.pom 2019-11-29T12:51:49.349 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-remote-driver/2.44.0/selenium-remote-driver-2.44.0.pom 2019-11-29T12:51:49.349 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/net/sourceforge/htmlunit/htmlunit/2.15/htmlunit-2.15.pom 2019-11-29T12:51:49.349 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/commons-io/commons-io/2.4/commons-io-2.4.pom 2019-11-29T12:51:49.349 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/org/apache/commons/commons-exec/1.1/commons-exec-1.1.pom 2019-11-29T12:51:49.350 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/17/commons-parent-17.pom 2019-11-29T12:51:49.350 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/25/commons-parent-25.pom 2019-11-29T12:51:49.350 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/org/apache/apache/7/apache-7.pom 2019-11-29T12:51:49.350 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/org/apache/apache/9/apache-9.pom 2019-11-29T12:51:49.448 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/net/java/dev/jna/platform/3.4.0/platform-3.4.0.pom 2019-11-29T12:51:49.448 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/net/java/dev/jna/jna/3.4.0/jna-3.4.0.pom 2019-11-29T12:51:49.448 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty/3.5.2.Final/netty-3.5.2.Final.pom 2019-11-29T12:51:49.449 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/7/oss-parent-7.pom 2019-11-29T12:51:49.449 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-common/4.1.17.Final/netty-common-4.1.17.Final.pom 2019-11-29T12:51:49.451 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-resolver/4.1.17.Final/netty-resolver-4.1.17.Final.pom 2019-11-29T12:51:49.451 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/cglib/cglib-nodep/2.1_3/cglib-nodep-2.1_3.pom 2019-11-29T12:51:49.451 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/google/code/gson/gson/2.3/gson-2.3.pom 2019-11-29T12:51:49.451 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-api/2.44.0/selenium-api-2.44.0.pom 2019-11-29T12:51:49.452 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/google/guava/guava/18.0/guava-18.0.pom 2019-11-29T12:51:49.547 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/google/guava/guava-parent/18.0/guava-parent-18.0.pom 2019-11-29T12:51:49.548 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.3.2/commons-lang3-3.3.2.pom 2019-11-29T12:51:49.548 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpmime/4.3.3/httpmime-4.3.3.pom 2019-11-29T12:51:49.548 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/commons-collections/commons-collections/3.2.1/commons-collections-3.2.1.pom 2019-11-29T12:51:49.549 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/net/sourceforge/nekohtml/nekohtml/1.9.21/nekohtml-1.9.21.pom 2019-11-29T12:51:49.550 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/net/sourceforge/cssparser/cssparser/0.9.14/cssparser-0.9.14.pom 2019-11-29T12:51:49.550 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/net/sourceforge/htmlunit/htmlunit-core-js/2.15/htmlunit-core-js-2.15.pom 2019-11-29T12:51:49.550 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/org/eclipse/jetty/jetty-websocket/8.1.15.v20140411/jetty-websocket-8.1.15.v20140411.pom 2019-11-29T12:51:49.550 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/xalan/xalan/2.7.1/xalan-2.7.1.pom 2019-11-29T12:51:49.550 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.3.3/httpcomponents-client-4.3.3.pom 2019-11-29T12:51:49.550 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/9/commons-parent-9.pom 2019-11-29T12:51:49.550 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/xerces/xercesImpl/2.11.0/xercesImpl-2.11.0.pom 2019-11-29T12:51:49.551 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/33/commons-parent-33.pom 2019-11-29T12:51:49.551 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/org/apache/apache/4/apache-4.pom 2019-11-29T12:51:49.551 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/org/eclipse/jetty/jetty-project/8.1.15.v20140411/jetty-project-8.1.15.v20140411.pom 2019-11-29T12:51:49.552 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/org/apache/httpcomponents/project/7/project-7.pom 2019-11-29T12:51:49.552 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/org/eclipse/jetty/jetty-parent/20/jetty-parent-20.pom 2019-11-29T12:51:49.552 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/xalan/serializer/2.7.1/serializer-2.7.1.pom 2019-11-29T12:51:49.552 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/xml-apis/xml-apis/1.4.01/xml-apis-1.4.01.pom 2019-11-29T12:51:49.552 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/org/w3c/css/sac/1.3/sac-1.3.pom 2019-11-29T12:51:49.647 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/org/eclipse/jetty/jetty-util/8.1.15.v20140411/jetty-util-8.1.15.v20140411.pom 2019-11-29T12:51:49.647 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/org/eclipse/jetty/jetty-http/8.1.15.v20140411/jetty-http-8.1.15.v20140411.pom 2019-11-29T12:51:49.648 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/org/eclipse/jetty/jetty-io/8.1.15.v20140411/jetty-io-8.1.15.v20140411.pom 2019-11-29T12:51:50.447 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudwatchmetrics/1.11.549/aws-java-sdk-cloudwatchmetrics-1.11.549.jar 2019-11-29T12:51:50.448 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk/1.11.549/aws-java-sdk-1.11.549.jar 2019-11-29T12:51:50.448 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-glacier/1.11.549/aws-java-sdk-glacier-1.11.549.jar 2019-11-29T12:51:50.448 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-s3control/1.11.549/aws-java-sdk-s3control-1.11.549.jar 2019-11-29T12:51:50.448 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-sns/1.11.549/aws-java-sdk-sns-1.11.549.jar 2019-11-29T12:51:50.448 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-dynamodb/1.11.549/aws-java-sdk-dynamodb-1.11.549.jar 2019-11-29T12:51:50.448 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-sqs/1.11.549/aws-java-sdk-sqs-1.11.549.jar 2019-11-29T12:51:50.449 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-managedblockchain/1.11.549/aws-java-sdk-managedblockchain-1.11.549.jar 2019-11-29T12:51:50.449 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-textract/1.11.549/aws-java-sdk-textract-1.11.549.jar 2019-11-29T12:51:50.449 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-s3/1.11.549/aws-java-sdk-s3-1.11.549.jar 2019-11-29T12:51:50.449 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-backup/1.11.549/aws-java-sdk-backup-1.11.549.jar 2019-11-29T12:51:50.449 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-worklink/1.11.549/aws-java-sdk-worklink-1.11.549.jar 2019-11-29T12:51:50.449 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-apigatewaymanagementapi/1.11.549/aws-java-sdk-apigatewaymanagementapi-1.11.549.jar 2019-11-29T12:51:50.449 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-apigatewayv2/1.11.549/aws-java-sdk-apigatewayv2-1.11.549.jar 2019-11-29T12:51:50.450 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-docdb/1.11.549/aws-java-sdk-docdb-1.11.549.jar 2019-11-29T12:51:50.450 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-kafka/1.11.549/aws-java-sdk-kafka-1.11.549.jar 2019-11-29T12:51:50.548 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-appmesh/1.11.549/aws-java-sdk-appmesh-1.11.549.jar 2019-11-29T12:51:50.548 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-licensemanager/1.11.549/aws-java-sdk-licensemanager-1.11.549.jar 2019-11-29T12:51:50.548 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-securityhub/1.11.549/aws-java-sdk-securityhub-1.11.549.jar 2019-11-29T12:51:50.548 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-kinesisanalyticsv2/1.11.549/aws-java-sdk-kinesisanalyticsv2-1.11.549.jar 2019-11-29T12:51:50.548 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mediaconnect/1.11.549/aws-java-sdk-mediaconnect-1.11.549.jar 2019-11-29T12:51:50.548 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-comprehendmedical/1.11.549/aws-java-sdk-comprehendmedical-1.11.549.jar 2019-11-29T12:51:50.549 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-fsx/1.11.549/aws-java-sdk-fsx-1.11.549.jar 2019-11-29T12:51:50.549 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-globalaccelerator/1.11.549/aws-java-sdk-globalaccelerator-1.11.549.jar 2019-11-29T12:51:50.549 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-transfer/1.11.549/aws-java-sdk-transfer-1.11.549.jar 2019-11-29T12:51:50.549 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-datasync/1.11.549/aws-java-sdk-datasync-1.11.549.jar 2019-11-29T12:51:50.549 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-robomaker/1.11.549/aws-java-sdk-robomaker-1.11.549.jar 2019-11-29T12:51:50.549 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-amplify/1.11.549/aws-java-sdk-amplify-1.11.549.jar 2019-11-29T12:51:50.549 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-rdsdata/1.11.549/aws-java-sdk-rdsdata-1.11.549.jar 2019-11-29T12:51:50.550 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-quicksight/1.11.549/aws-java-sdk-quicksight-1.11.549.jar 2019-11-29T12:51:50.550 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-route53resolver/1.11.549/aws-java-sdk-route53resolver-1.11.549.jar 2019-11-29T12:51:50.550 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-ram/1.11.549/aws-java-sdk-ram-1.11.549.jar 2019-11-29T12:51:50.550 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-pinpointsmsvoice/1.11.549/aws-java-sdk-pinpointsmsvoice-1.11.549.jar 2019-11-29T12:51:50.648 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-pinpointemail/1.11.549/aws-java-sdk-pinpointemail-1.11.549.jar 2019-11-29T12:51:50.648 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-signer/1.11.549/aws-java-sdk-signer-1.11.549.jar 2019-11-29T12:51:50.648 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-dlm/1.11.549/aws-java-sdk-dlm-1.11.549.jar 2019-11-29T12:51:50.648 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-eks/1.11.549/aws-java-sdk-eks-1.11.549.jar 2019-11-29T12:51:50.648 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-chime/1.11.549/aws-java-sdk-chime-1.11.549.jar 2019-11-29T12:51:50.649 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-macie/1.11.549/aws-java-sdk-macie-1.11.549.jar 2019-11-29T12:51:50.649 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mediatailor/1.11.549/aws-java-sdk-mediatailor-1.11.549.jar 2019-11-29T12:51:50.649 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-pi/1.11.549/aws-java-sdk-pi-1.11.549.jar 2019-11-29T12:51:50.649 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-neptune/1.11.549/aws-java-sdk-neptune-1.11.549.jar 2019-11-29T12:51:50.649 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-iot1clickprojects/1.11.549/aws-java-sdk-iot1clickprojects-1.11.549.jar 2019-11-29T12:51:50.649 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-iotanalytics/1.11.549/aws-java-sdk-iotanalytics-1.11.549.jar 2019-11-29T12:51:50.649 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-acmpca/1.11.549/aws-java-sdk-acmpca-1.11.549.jar 2019-11-29T12:51:50.650 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-iot1clickdevices/1.11.549/aws-java-sdk-iot1clickdevices-1.11.549.jar 2019-11-29T12:51:50.650 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-secretsmanager/1.11.549/aws-java-sdk-secretsmanager-1.11.549.jar 2019-11-29T12:51:50.650 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-fms/1.11.549/aws-java-sdk-fms-1.11.549.jar 2019-11-29T12:51:50.650 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-connect/1.11.549/aws-java-sdk-connect-1.11.549.jar 2019-11-29T12:51:50.650 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-transcribe/1.11.549/aws-java-sdk-transcribe-1.11.549.jar 2019-11-29T12:51:50.650 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-autoscalingplans/1.11.549/aws-java-sdk-autoscalingplans-1.11.549.jar 2019-11-29T12:51:50.650 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-servicediscovery/1.11.549/aws-java-sdk-servicediscovery-1.11.549.jar 2019-11-29T12:51:50.651 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-workmail/1.11.549/aws-java-sdk-workmail-1.11.549.jar 2019-11-29T12:51:50.651 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloud9/1.11.549/aws-java-sdk-cloud9-1.11.549.jar 2019-11-29T12:51:50.651 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-resourcegroups/1.11.549/aws-java-sdk-resourcegroups-1.11.549.jar 2019-11-29T12:51:50.651 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-comprehend/1.11.549/aws-java-sdk-comprehend-1.11.549.jar 2019-11-29T12:51:50.651 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-serverlessapplicationrepository/1.11.549/aws-java-sdk-serverlessapplicationrepository-1.11.549.jar 2019-11-29T12:51:50.651 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-alexaforbusiness/1.11.549/aws-java-sdk-alexaforbusiness-1.11.549.jar 2019-11-29T12:51:50.651 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-translate/1.11.549/aws-java-sdk-translate-1.11.549.jar 2019-11-29T12:51:50.748 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-sagemaker/1.11.549/aws-java-sdk-sagemaker-1.11.549.jar 2019-11-29T12:51:50.748 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-iotjobsdataplane/1.11.549/aws-java-sdk-iotjobsdataplane-1.11.549.jar 2019-11-29T12:51:50.748 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-sagemakerruntime/1.11.549/aws-java-sdk-sagemakerruntime-1.11.549.jar 2019-11-29T12:51:50.748 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-kinesisvideo/1.11.549/aws-java-sdk-kinesisvideo-1.11.549.jar 2019-11-29T12:51:50.748 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-appsync/1.11.549/aws-java-sdk-appsync-1.11.549.jar 2019-11-29T12:51:50.748 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-guardduty/1.11.549/aws-java-sdk-guardduty-1.11.549.jar 2019-11-29T12:51:50.749 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mq/1.11.549/aws-java-sdk-mq-1.11.549.jar 2019-11-29T12:51:50.749 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mediaconvert/1.11.549/aws-java-sdk-mediaconvert-1.11.549.jar 2019-11-29T12:51:50.749 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mediastore/1.11.549/aws-java-sdk-mediastore-1.11.549.jar 2019-11-29T12:51:50.749 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mediastoredata/1.11.549/aws-java-sdk-mediastoredata-1.11.549.jar 2019-11-29T12:51:50.749 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-medialive/1.11.549/aws-java-sdk-medialive-1.11.549.jar 2019-11-29T12:51:50.749 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-costexplorer/1.11.549/aws-java-sdk-costexplorer-1.11.549.jar 2019-11-29T12:51:50.749 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-pricing/1.11.549/aws-java-sdk-pricing-1.11.549.jar 2019-11-29T12:51:50.750 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mediapackage/1.11.549/aws-java-sdk-mediapackage-1.11.549.jar 2019-11-29T12:51:50.750 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mobile/1.11.549/aws-java-sdk-mobile-1.11.549.jar 2019-11-29T12:51:50.750 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-dax/1.11.549/aws-java-sdk-dax-1.11.549.jar 2019-11-29T12:51:50.750 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-migrationhub/1.11.549/aws-java-sdk-migrationhub-1.11.549.jar 2019-11-29T12:51:50.750 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-greengrass/1.11.549/aws-java-sdk-greengrass-1.11.549.jar 2019-11-29T12:51:50.750 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-athena/1.11.549/aws-java-sdk-athena-1.11.549.jar 2019-11-29T12:51:50.750 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudhsmv2/1.11.549/aws-java-sdk-cloudhsmv2-1.11.549.jar 2019-11-29T12:51:50.854 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-glue/1.11.549/aws-java-sdk-glue-1.11.549.jar 2019-11-29T12:51:50.855 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-marketplaceentitlement/1.11.549/aws-java-sdk-marketplaceentitlement-1.11.549.jar 2019-11-29T12:51:50.855 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-codestar/1.11.549/aws-java-sdk-codestar-1.11.549.jar 2019-11-29T12:51:50.855 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-lexmodelbuilding/1.11.549/aws-java-sdk-lexmodelbuilding-1.11.549.jar 2019-11-29T12:51:50.855 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-resourcegroupstaggingapi/1.11.549/aws-java-sdk-resourcegroupstaggingapi-1.11.549.jar 2019-11-29T12:51:50.855 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-xray/1.11.549/aws-java-sdk-xray-1.11.549.jar 2019-11-29T12:51:50.856 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-support/1.11.549/aws-java-sdk-support-1.11.549.jar 2019-11-29T12:51:50.856 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-opsworkscm/1.11.549/aws-java-sdk-opsworkscm-1.11.549.jar 2019-11-29T12:51:50.856 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-servermigration/1.11.549/aws-java-sdk-servermigration-1.11.549.jar 2019-11-29T12:51:50.856 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-simpledb/1.11.549/aws-java-sdk-simpledb-1.11.549.jar 2019-11-29T12:51:50.856 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-servicecatalog/1.11.549/aws-java-sdk-servicecatalog-1.11.549.jar 2019-11-29T12:51:50.857 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-pinpoint/1.11.549/aws-java-sdk-pinpoint-1.11.549.jar 2019-11-29T12:51:50.857 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-swf-libraries/1.11.22/aws-java-sdk-swf-libraries-1.11.22.jar 2019-11-29T12:51:50.949 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-simpleworkflow/1.11.549/aws-java-sdk-simpleworkflow-1.11.549.jar 2019-11-29T12:51:50.949 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-importexport/1.11.549/aws-java-sdk-importexport-1.11.549.jar 2019-11-29T12:51:50.949 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-storagegateway/1.11.549/aws-java-sdk-storagegateway-1.11.549.jar 2019-11-29T12:51:50.950 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-sts/1.11.549/aws-java-sdk-sts-1.11.549.jar 2019-11-29T12:51:50.950 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-route53/1.11.549/aws-java-sdk-route53-1.11.549.jar 2019-11-29T12:51:50.950 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-rds/1.11.549/aws-java-sdk-rds-1.11.549.jar 2019-11-29T12:51:50.950 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-redshift/1.11.549/aws-java-sdk-redshift-1.11.549.jar 2019-11-29T12:51:50.950 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-elasticbeanstalk/1.11.549/aws-java-sdk-elasticbeanstalk-1.11.549.jar 2019-11-29T12:51:50.951 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-iam/1.11.549/aws-java-sdk-iam-1.11.549.jar 2019-11-29T12:51:50.951 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-datapipeline/1.11.549/aws-java-sdk-datapipeline-1.11.549.jar 2019-11-29T12:51:50.951 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-elasticloadbalancing/1.11.549/aws-java-sdk-elasticloadbalancing-1.11.549.jar 2019-11-29T12:51:50.951 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-elasticache/1.11.549/aws-java-sdk-elasticache-1.11.549.jar 2019-11-29T12:51:51.047 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-emr/1.11.549/aws-java-sdk-emr-1.11.549.jar 2019-11-29T12:51:51.048 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-elastictranscoder/1.11.549/aws-java-sdk-elastictranscoder-1.11.549.jar 2019-11-29T12:51:51.048 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-elasticloadbalancingv2/1.11.549/aws-java-sdk-elasticloadbalancingv2-1.11.549.jar 2019-11-29T12:51:51.048 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-budgets/1.11.549/aws-java-sdk-budgets-1.11.549.jar 2019-11-29T12:51:51.048 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudtrail/1.11.549/aws-java-sdk-cloudtrail-1.11.549.jar 2019-11-29T12:51:51.048 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudwatch/1.11.549/aws-java-sdk-cloudwatch-1.11.549.jar 2019-11-29T12:51:51.048 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-logs/1.11.549/aws-java-sdk-logs-1.11.549.jar 2019-11-29T12:51:51.048 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-ec2/1.11.549/aws-java-sdk-ec2-1.11.549.jar 2019-11-29T12:51:51.049 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-events/1.11.549/aws-java-sdk-events-1.11.549.jar 2019-11-29T12:51:51.049 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cognitosync/1.11.549/aws-java-sdk-cognitosync-1.11.549.jar 2019-11-29T12:51:51.049 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-directconnect/1.11.549/aws-java-sdk-directconnect-1.11.549.jar 2019-11-29T12:51:51.049 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudformation/1.11.549/aws-java-sdk-cloudformation-1.11.549.jar 2019-11-29T12:51:51.049 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cognitoidentity/1.11.549/aws-java-sdk-cognitoidentity-1.11.549.jar 2019-11-29T12:51:51.049 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudfront/1.11.549/aws-java-sdk-cloudfront-1.11.549.jar 2019-11-29T12:51:51.049 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-kinesis/1.11.549/aws-java-sdk-kinesis-1.11.549.jar 2019-11-29T12:51:51.147 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-clouddirectory/1.11.549/aws-java-sdk-clouddirectory-1.11.549.jar 2019-11-29T12:51:51.148 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-opsworks/1.11.549/aws-java-sdk-opsworks-1.11.549.jar 2019-11-29T12:51:51.148 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-ses/1.11.549/aws-java-sdk-ses-1.11.549.jar 2019-11-29T12:51:51.148 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-autoscaling/1.11.549/aws-java-sdk-autoscaling-1.11.549.jar 2019-11-29T12:51:51.148 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudsearch/1.11.549/aws-java-sdk-cloudsearch-1.11.549.jar 2019-11-29T12:51:51.148 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-codedeploy/1.11.549/aws-java-sdk-codedeploy-1.11.549.jar 2019-11-29T12:51:51.149 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-codepipeline/1.11.549/aws-java-sdk-codepipeline-1.11.549.jar 2019-11-29T12:51:51.149 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-kms/1.11.549/aws-java-sdk-kms-1.11.549.jar 2019-11-29T12:51:51.149 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-config/1.11.549/aws-java-sdk-config-1.11.549.jar 2019-11-29T12:51:51.149 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-ecr/1.11.549/aws-java-sdk-ecr-1.11.549.jar 2019-11-29T12:51:51.149 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-lambda/1.11.549/aws-java-sdk-lambda-1.11.549.jar 2019-11-29T12:51:51.150 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudhsm/1.11.549/aws-java-sdk-cloudhsm-1.11.549.jar 2019-11-29T12:51:51.150 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-workspaces/1.11.549/aws-java-sdk-workspaces-1.11.549.jar 2019-11-29T12:51:51.150 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-ssm/1.11.549/aws-java-sdk-ssm-1.11.549.jar 2019-11-29T12:51:51.247 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-ecs/1.11.549/aws-java-sdk-ecs-1.11.549.jar 2019-11-29T12:51:51.247 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-directory/1.11.549/aws-java-sdk-directory-1.11.549.jar 2019-11-29T12:51:51.248 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-efs/1.11.549/aws-java-sdk-efs-1.11.549.jar 2019-11-29T12:51:51.248 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-machinelearning/1.11.549/aws-java-sdk-machinelearning-1.11.549.jar 2019-11-29T12:51:51.248 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-codecommit/1.11.549/aws-java-sdk-codecommit-1.11.549.jar 2019-11-29T12:51:51.248 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-marketplacecommerceanalytics/1.11.549/aws-java-sdk-marketplacecommerceanalytics-1.11.549.jar 2019-11-29T12:51:51.248 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-devicefarm/1.11.549/aws-java-sdk-devicefarm-1.11.549.jar 2019-11-29T12:51:51.248 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-iot/1.11.549/aws-java-sdk-iot-1.11.549.jar 2019-11-29T12:51:51.249 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-acm/1.11.549/aws-java-sdk-acm-1.11.549.jar 2019-11-29T12:51:51.249 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-api-gateway/1.11.549/aws-java-sdk-api-gateway-1.11.549.jar 2019-11-29T12:51:51.249 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-inspector/1.11.549/aws-java-sdk-inspector-1.11.549.jar 2019-11-29T12:51:51.249 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-gamelift/1.11.549/aws-java-sdk-gamelift-1.11.549.jar 2019-11-29T12:51:51.249 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-waf/1.11.549/aws-java-sdk-waf-1.11.549.jar 2019-11-29T12:51:51.348 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-elasticsearch/1.11.549/aws-java-sdk-elasticsearch-1.11.549.jar 2019-11-29T12:51:51.348 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-marketplacemeteringservice/1.11.549/aws-java-sdk-marketplacemeteringservice-1.11.549.jar 2019-11-29T12:51:51.348 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-dms/1.11.549/aws-java-sdk-dms-1.11.549.jar 2019-11-29T12:51:51.348 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-discovery/1.11.549/aws-java-sdk-discovery-1.11.549.jar 2019-11-29T12:51:51.348 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cognitoidp/1.11.549/aws-java-sdk-cognitoidp-1.11.549.jar 2019-11-29T12:51:51.348 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-applicationautoscaling/1.11.549/aws-java-sdk-applicationautoscaling-1.11.549.jar 2019-11-29T12:51:51.349 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-snowball/1.11.549/aws-java-sdk-snowball-1.11.549.jar 2019-11-29T12:51:51.349 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-polly/1.11.549/aws-java-sdk-polly-1.11.549.jar 2019-11-29T12:51:51.349 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-rekognition/1.11.549/aws-java-sdk-rekognition-1.11.549.jar 2019-11-29T12:51:51.448 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-costandusagereport/1.11.549/aws-java-sdk-costandusagereport-1.11.549.jar 2019-11-29T12:51:51.448 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-health/1.11.549/aws-java-sdk-health-1.11.549.jar 2019-11-29T12:51:51.448 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-codebuild/1.11.549/aws-java-sdk-codebuild-1.11.549.jar 2019-11-29T12:51:51.448 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-appstream/1.11.549/aws-java-sdk-appstream-1.11.549.jar 2019-11-29T12:51:51.448 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-lightsail/1.11.549/aws-java-sdk-lightsail-1.11.549.jar 2019-11-29T12:51:51.449 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-batch/1.11.549/aws-java-sdk-batch-1.11.549.jar 2019-11-29T12:51:51.449 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-stepfunctions/1.11.549/aws-java-sdk-stepfunctions-1.11.549.jar 2019-11-29T12:51:51.449 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-lex/1.11.549/aws-java-sdk-lex-1.11.549.jar 2019-11-29T12:51:51.449 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mechanicalturkrequester/1.11.549/aws-java-sdk-mechanicalturkrequester-1.11.549.jar 2019-11-29T12:51:51.449 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-shield/1.11.549/aws-java-sdk-shield-1.11.549.jar 2019-11-29T12:51:51.449 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-organizations/1.11.549/aws-java-sdk-organizations-1.11.549.jar 2019-11-29T12:51:51.449 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-workdocs/1.11.549/aws-java-sdk-workdocs-1.11.549.jar 2019-11-29T12:51:51.450 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-core/1.11.549/aws-java-sdk-core-1.11.549.jar 2019-11-29T12:51:51.450 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/log4j/log4j/1.2.17/log4j-1.2.17.jar 2019-11-29T12:51:51.450 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/org/testng/testng/6.1.1/testng-6.1.1.jar 2019-11-29T12:51:51.450 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-java/2.44.0/selenium-java-2.44.0.jar 2019-11-29T12:51:51.450 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-server/2.44.0/selenium-server-2.44.0.jar 2019-11-29T12:51:51.450 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-chrome-driver/2.44.0/selenium-chrome-driver-2.44.0.jar 2019-11-29T12:51:51.450 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-htmlunit-driver/2.44.0/selenium-htmlunit-driver-2.44.0.jar 2019-11-29T12:51:51.450 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-safari-driver/2.44.0/selenium-safari-driver-2.44.0.jar 2019-11-29T12:51:51.451 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-ie-driver/2.44.0/selenium-ie-driver-2.44.0.jar 2019-11-29T12:51:51.451 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-remote-driver/2.44.0/selenium-remote-driver-2.44.0.jar 2019-11-29T12:51:51.451 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-support/2.44.0/selenium-support-2.44.0.jar 2019-11-29T12:51:51.451 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpmime/4.3.3/httpmime-4.3.3.jar 2019-11-29T12:51:51.451 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-firefox-driver/2.44.0/selenium-firefox-driver-2.44.0.jar 2019-11-29T12:51:51.451 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/net/sourceforge/htmlunit/htmlunit/2.15/htmlunit-2.15.jar 2019-11-29T12:51:51.451 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.5/httpclient-4.5.5.jar 2019-11-29T12:51:51.452 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/commons-logging/commons-logging/1.2/commons-logging-1.2.jar 2019-11-29T12:51:51.547 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/software/amazon/ion/ion-java/1.0.2/ion-java-1.0.2.jar 2019-11-29T12:51:51.547 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/jmespath-java/1.11.549/jmespath-java-1.11.549.jar 2019-11-29T12:51:51.548 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/fasterxml/jackson/core/jackson-databind/2.6.7.2/jackson-databind-2.6.7.2.jar 2019-11-29T12:51:51.548 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/fasterxml/jackson/dataformat/jackson-dataformat-cbor/2.6.7/jackson-dataformat-cbor-2.6.7.jar 2019-11-29T12:51:51.548 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/joda-time/joda-time/2.8.1/joda-time-2.8.1.jar 2019-11-29T12:51:51.548 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-models/1.11.549/aws-java-sdk-models-1.11.549.jar 2019-11-29T12:51:51.548 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/org/mortbay/jetty/servlet-api-2.5/6.1.9/servlet-api-2.5-6.1.9.jar 2019-11-29T12:51:51.548 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/mx4j/mx4j-tools/3.0.1/mx4j-tools-3.0.1.jar 2019-11-29T12:51:51.549 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/org/bouncycastle/bcpkix-jdk15on/1.48/bcpkix-jdk15on-1.48.jar 2019-11-29T12:51:51.549 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/org/bouncycastle/bcprov-jdk15on/1.48/bcprov-jdk15on-1.48.jar 2019-11-29T12:51:51.549 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/jetty-rc-repacked/5/jetty-rc-repacked-5.jar 2019-11-29T12:51:51.549 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/jetty-repacked/7.6.1/jetty-repacked-7.6.1.jar 2019-11-29T12:51:51.549 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/net/jcip/jcip-annotations/1.0/jcip-annotations-1.0.jar 2019-11-29T12:51:51.549 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/org/yaml/snakeyaml/1.8/snakeyaml-1.8.jar 2019-11-29T12:51:51.647 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.10/commons-codec-1.10.jar 2019-11-29T12:51:51.648 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/junit/junit/3.8.1/junit-3.8.1.jar 2019-11-29T12:51:51.648 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/org/beanshell/bsh/2.0b4/bsh-2.0b4.jar 2019-11-29T12:51:51.648 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.9/httpcore-4.4.9.jar 2019-11-29T12:51:51.648 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/fasterxml/jackson/core/jackson-annotations/2.6.0/jackson-annotations-2.6.0.jar 2019-11-29T12:51:51.648 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/beust/jcommander/1.12/jcommander-1.12.jar 2019-11-29T12:51:51.648 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/fasterxml/jackson/core/jackson-core/2.6.7/jackson-core-2.6.7.jar 2019-11-29T12:51:51.649 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/org/webbitserver/webbit/0.4.14/webbit-0.4.14.jar 2019-11-29T12:51:51.649 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-handler/4.1.17.Final/netty-handler-4.1.17.Final.jar 2019-11-29T12:51:51.649 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-codec-http/4.1.17.Final/netty-codec-http-4.1.17.Final.jar 2019-11-29T12:51:51.649 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-transport/4.1.17.Final/netty-transport-4.1.17.Final.jar 2019-11-29T12:51:51.649 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-buffer/4.1.17.Final/netty-buffer-4.1.17.Final.jar 2019-11-29T12:51:51.649 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-codec/4.1.17.Final/netty-codec-4.1.17.Final.jar 2019-11-29T12:51:51.649 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/org/apache/commons/commons-exec/1.1/commons-exec-1.1.jar 2019-11-29T12:51:51.650 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/commons-io/commons-io/2.4/commons-io-2.4.jar 2019-11-29T12:51:51.650 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/net/java/dev/jna/jna/3.4.0/jna-3.4.0.jar 2019-11-29T12:51:51.748 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/net/java/dev/jna/platform/3.4.0/platform-3.4.0.jar 2019-11-29T12:51:51.748 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-resolver/4.1.17.Final/netty-resolver-4.1.17.Final.jar 2019-11-29T12:51:51.748 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty/3.5.2.Final/netty-3.5.2.Final.jar 2019-11-29T12:51:51.748 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-common/4.1.17.Final/netty-common-4.1.17.Final.jar 2019-11-29T12:51:51.748 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-api/2.44.0/selenium-api-2.44.0.jar 2019-11-29T12:51:51.749 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/cglib/cglib-nodep/2.1_3/cglib-nodep-2.1_3.jar 2019-11-29T12:51:51.749 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/google/code/gson/gson/2.3/gson-2.3.jar 2019-11-29T12:51:51.749 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/com/google/guava/guava/18.0/guava-18.0.jar 2019-11-29T12:51:51.749 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/commons-collections/commons-collections/3.2.1/commons-collections-3.2.1.jar 2019-11-29T12:51:51.749 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.3.2/commons-lang3-3.3.2.jar 2019-11-29T12:51:51.749 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/net/sourceforge/htmlunit/htmlunit-core-js/2.15/htmlunit-core-js-2.15.jar 2019-11-29T12:51:51.749 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/xerces/xercesImpl/2.11.0/xercesImpl-2.11.0.jar 2019-11-29T12:51:51.750 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/xalan/xalan/2.7.1/xalan-2.7.1.jar 2019-11-29T12:51:51.750 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/net/sourceforge/nekohtml/nekohtml/1.9.21/nekohtml-1.9.21.jar 2019-11-29T12:51:51.750 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/net/sourceforge/cssparser/cssparser/0.9.14/cssparser-0.9.14.jar 2019-11-29T12:51:51.750 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/org/eclipse/jetty/jetty-websocket/8.1.15.v20140411/jetty-websocket-8.1.15.v20140411.jar 2019-11-29T12:51:51.750 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/xalan/serializer/2.7.1/serializer-2.7.1.jar 2019-11-29T12:51:51.847 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/org/w3c/css/sac/1.3/sac-1.3.jar 2019-11-29T12:51:51.848 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/xml-apis/xml-apis/1.4.01/xml-apis-1.4.01.jar 2019-11-29T12:51:51.848 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/org/eclipse/jetty/jetty-http/8.1.15.v20140411/jetty-http-8.1.15.v20140411.jar 2019-11-29T12:51:51.848 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/org/eclipse/jetty/jetty-io/8.1.15.v20140411/jetty-io-8.1.15.v20140411.jar 2019-11-29T12:51:51.848 INFO:teuthology.orchestra.run.smithi062.stdout:Download https://repo.maven.apache.org/maven2/org/eclipse/jetty/jetty-util/8.1.15.v20140411/jetty-util-8.1.15.v20140411.jar 2019-11-29T12:52:01.148 INFO:teuthology.orchestra.run.smithi062.stdout:> Task :compileJava 2019-11-29T12:52:01.148 INFO:teuthology.orchestra.run.smithi062.stdout:> Task :processResources 2019-11-29T12:52:01.148 INFO:teuthology.orchestra.run.smithi062.stdout:> Task :classes 2019-11-29T12:52:01.648 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:52:01.648 INFO:teuthology.orchestra.run.smithi062.stdout:> Task :compileTestJava 2019-11-29T12:52:01.648 INFO:teuthology.orchestra.run.smithi062.stdout:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2019-11-29T12:52:01.648 INFO:teuthology.orchestra.run.smithi062.stdout:Note: Recompile with -Xlint:deprecation for details. 2019-11-29T12:52:01.649 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:52:01.649 INFO:teuthology.orchestra.run.smithi062.stdout:> Task :processTestResources NO-SOURCE 2019-11-29T12:52:01.649 INFO:teuthology.orchestra.run.smithi062.stdout:> Task :testClasses 2019-11-29T12:52:09.547 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:52:09.548 INFO:teuthology.orchestra.run.smithi062.stdout:> Task :test 2019-11-29T12:52:09.548 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:52:09.548 INFO:teuthology.orchestra.run.smithi062.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 STARTED 2019-11-29T12:53:18.350 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:53:18.350 INFO:teuthology.orchestra.run.smithi062.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 PASSED 2019-11-29T12:53:25.052 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:53:25.052 INFO:teuthology.orchestra.run.smithi062.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 STARTED 2019-11-29T12:53:28.351 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:53:28.351 INFO:teuthology.orchestra.run.smithi062.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 PASSED 2019-11-29T12:53:37.551 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:53:37.552 INFO:teuthology.orchestra.run.smithi062.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 STARTED 2019-11-29T12:54:50.155 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:54:50.156 INFO:teuthology.orchestra.run.smithi062.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 PASSED 2019-11-29T12:54:59.456 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:55:00.091 INFO:teuthology.orchestra.run.smithi062.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 STARTED 2019-11-29T12:55:00.091 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:55:00.092 INFO:teuthology.orchestra.run.smithi062.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 PASSED 2019-11-29T12:55:01.156 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:55:01.156 INFO:teuthology.orchestra.run.smithi062.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 STARTED 2019-11-29T12:55:04.156 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:55:04.156 INFO:teuthology.orchestra.run.smithi062.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 PASSED 2019-11-29T12:55:12.557 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:55:12.557 INFO:teuthology.orchestra.run.smithi062.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 STARTED 2019-11-29T12:56:02.459 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:56:02.460 INFO:teuthology.orchestra.run.smithi062.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 PASSED 2019-11-29T12:56:19.460 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T12:56:19.460 INFO:teuthology.orchestra.run.smithi062.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 STARTED 2019-11-29T12:57:41.970 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:00:32:22.630 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T12:57:41.980 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:00:32:22.639 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T12:57:41.989 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:32:22.590 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T12:57:41.992 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:32:22.593 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T12:57:41.996 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:32:22.597 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T12:57:41.999 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:32:22.600 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T12:57:42.232 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:32:22.833 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T12:57:42.250 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:00:32:22.910 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T12:57:42.267 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:32:22.868 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T13:00:07.665 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T13:00:07.666 INFO:teuthology.orchestra.run.smithi062.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 PASSED 2019-11-29T13:00:24.364 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T13:00:24.364 INFO:teuthology.orchestra.run.smithi062.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 STARTED 2019-11-29T13:00:27.664 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T13:00:27.664 INFO:teuthology.orchestra.run.smithi062.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 PASSED 2019-11-29T13:00:33.964 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T13:00:33.965 INFO:teuthology.orchestra.run.smithi062.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 STARTED 2019-11-29T13:00:39.266 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T13:00:39.266 INFO:teuthology.orchestra.run.smithi062.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 PASSED 2019-11-29T13:00:53.364 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T13:00:53.364 INFO:teuthology.orchestra.run.smithi062.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 STARTED 2019-11-29T13:01:35.764 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T13:01:35.764 INFO:teuthology.orchestra.run.smithi062.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 PASSED 2019-11-29T13:01:45.764 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T13:01:45.764 INFO:teuthology.orchestra.run.smithi062.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 STARTED 2019-11-29T13:01:46.464 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T13:01:46.464 INFO:teuthology.orchestra.run.smithi062.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 PASSED 2019-11-29T13:01:47.864 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T13:01:47.864 INFO:teuthology.orchestra.run.smithi062.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 STARTED 2019-11-29T13:02:34.027 INFO:tasks.rgw.client.0.smithi062.stdout:2019-11-29T13:02:33.962+0000 8a30b700 -1 handle_data failed with exit code -104 2019-11-29T13:02:35.664 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T13:02:35.664 INFO:teuthology.orchestra.run.smithi062.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 PASSED 2019-11-29T13:02:44.164 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T13:02:44.164 INFO:teuthology.orchestra.run.smithi062.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 STARTED 2019-11-29T13:02:53.152 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:00:37:33.811 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T13:02:53.160 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:00:37:33.819 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T13:02:53.164 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:37:33.764 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T13:02:53.166 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:37:33.767 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T13:02:53.170 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:37:33.771 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T13:02:53.173 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:37:33.774 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T13:02:53.352 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:37:33.953 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T13:02:53.355 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:00:37:34.014 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T13:02:53.365 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:37:33.965 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T13:03:35.964 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T13:03:35.964 INFO:teuthology.orchestra.run.smithi062.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 PASSED 2019-11-29T13:03:48.964 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T13:03:48.964 INFO:teuthology.orchestra.run.smithi062.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 STARTED 2019-11-29T13:04:34.664 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T13:04:34.664 INFO:teuthology.orchestra.run.smithi062.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 PASSED 2019-11-29T13:04:46.564 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T13:04:46.564 INFO:teuthology.orchestra.run.smithi062.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 STARTED 2019-11-29T13:07:59.192 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:00:42:39.850 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T13:07:59.197 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:00:42:39.856 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T13:07:59.227 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:42:39.827 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T13:07:59.230 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:42:39.830 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T13:07:59.249 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:42:39.849 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T13:07:59.252 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:42:39.852 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T13:07:59.382 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:00:42:40.040 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T13:07:59.393 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:42:39.992 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T13:07:59.458 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:42:40.057 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T13:08:04.299 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:00:42:44.957 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T13:08:04.312 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:00:42:44.968 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T13:08:04.316 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:42:44.914 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T13:08:04.320 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:42:44.918 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T13:08:04.325 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:42:44.925 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T13:08:04.329 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:42:44.929 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T13:08:04.339 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:42:44.939 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T13:08:04.346 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:00:42:45.005 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T13:08:04.356 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:42:44.956 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T13:13:16.314 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:00:47:56.972 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T13:13:16.325 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:00:47:56.984 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T13:13:16.345 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:47:56.946 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T13:13:16.350 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:47:56.951 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T13:13:16.397 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:47:56.998 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T13:13:16.401 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:47:57.002 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T13:13:16.563 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:00:47:57.221 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T13:13:16.572 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:47:57.174 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T13:13:16.589 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:47:57.191 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T13:16:20.898 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:00:51:01.556 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T13:16:20.913 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:00:51:01.571 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T13:16:20.961 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:51:01.563 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T13:16:20.964 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:51:01.567 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T13:16:20.979 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:51:01.582 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T13:16:20.982 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:51:01.584 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T13:16:21.064 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:51:01.667 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T13:16:21.065 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:00:51:01.723 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T13:16:21.073 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:51:01.676 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T13:17:36.161 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T13:17:36.162 INFO:teuthology.orchestra.run.smithi062.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 PASSED 2019-11-29T13:17:46.961 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T13:17:46.961 INFO:teuthology.orchestra.run.smithi062.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 STARTED 2019-11-29T13:18:28.449 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:00:53:09.107 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T13:18:28.454 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:00:53:09.112 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T13:18:28.465 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:53:09.068 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T13:18:28.466 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:53:09.069 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T13:18:28.470 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:53:09.073 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T13:18:28.473 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:53:09.077 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T13:18:28.553 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:00:53:09.211 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T13:18:28.584 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:53:09.188 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T13:18:28.605 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:53:09.209 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T13:19:36.161 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T13:19:36.161 INFO:teuthology.orchestra.run.smithi062.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 PASSED 2019-11-29T13:19:45.261 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T13:19:45.261 INFO:teuthology.orchestra.run.smithi062.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 STARTED 2019-11-29T13:20:51.761 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T13:20:51.762 INFO:teuthology.orchestra.run.smithi062.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 PASSED 2019-11-29T13:21:00.667 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T13:21:00.667 INFO:teuthology.orchestra.run.smithi062.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 STARTED 2019-11-29T13:21:21.560 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T13:21:21.561 INFO:teuthology.orchestra.run.smithi062.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 PASSED 2019-11-29T13:21:43.860 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T13:21:43.860 INFO:teuthology.orchestra.run.smithi062.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 STARTED 2019-11-29T13:21:48.660 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T13:21:48.660 INFO:teuthology.orchestra.run.smithi062.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 PASSED 2019-11-29T13:22:10.460 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T13:22:10.460 INFO:teuthology.orchestra.run.smithi062.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 STARTED 2019-11-29T13:22:16.660 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T13:22:16.660 INFO:teuthology.orchestra.run.smithi062.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 PASSED 2019-11-29T13:22:35.960 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T13:22:35.960 INFO:teuthology.orchestra.run.smithi062.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 STARTED 2019-11-29T13:22:41.060 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T13:22:41.061 INFO:teuthology.orchestra.run.smithi062.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 PASSED 2019-11-29T13:23:01.760 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T13:23:01.760 INFO:teuthology.orchestra.run.smithi062.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 STARTED 2019-11-29T13:23:09.360 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T13:23:09.360 INFO:teuthology.orchestra.run.smithi062.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 PASSED 2019-11-29T13:23:40.733 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:00:58:21.391 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T13:23:40.742 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:00:58:21.400 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T13:23:40.743 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:58:21.348 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T13:23:40.746 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:58:21.351 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T13:23:40.753 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:58:21.358 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T13:23:40.759 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:58:21.363 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T13:23:40.987 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:00:58:21.646 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T13:23:41.002 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:58:21.607 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T13:23:41.015 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:58:21.619 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T13:23:41.960 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T13:23:41.960 INFO:teuthology.orchestra.run.smithi062.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 STARTED 2019-11-29T13:23:49.760 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T13:23:49.760 INFO:teuthology.orchestra.run.smithi062.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 PASSED 2019-11-29T13:24:42.744 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:00:59:23.402 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T13:24:42.749 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:00:59:23.407 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T13:24:42.763 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:59:23.368 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T13:24:42.785 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:59:23.390 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T13:24:42.787 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:59:23.392 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T13:24:42.806 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:59:23.410 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T13:24:42.823 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:00:59:23.481 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T13:24:42.885 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:00:59:23.489 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T13:24:42.889 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:00:59:23.494 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T13:24:47.360 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T13:24:47.360 INFO:teuthology.orchestra.run.smithi062.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 STARTED 2019-11-29T13:24:54.460 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T13:24:54.460 INFO:teuthology.orchestra.run.smithi062.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 PASSED 2019-11-29T13:25:57.060 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T13:25:57.060 INFO:teuthology.orchestra.run.smithi062.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 STARTED 2019-11-29T13:26:02.760 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T13:26:02.760 INFO:teuthology.orchestra.run.smithi062.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 PASSED 2019-11-29T13:27:23.960 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T13:27:23.986 INFO:teuthology.orchestra.run.smithi062.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 STARTED 2019-11-29T13:28:52.925 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:01:03:33.583 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T13:28:52.931 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:01:03:33.589 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T13:28:52.940 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:01:03:33.544 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T13:28:52.940 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:01:03:33.545 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T13:28:52.945 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:01:03:33.549 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T13:28:52.947 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:01:03:33.552 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T13:28:53.112 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:01:03:33.717 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T13:28:53.121 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:01:03:33.726 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T13:28:53.146 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:01:03:33.804 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T13:33:04.471 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:01:07:45.129 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T13:33:04.497 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:01:07:45.151 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T13:33:04.508 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:01:07:45.113 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T13:33:04.528 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:01:07:45.133 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T13:33:04.534 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:01:07:45.139 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T13:33:04.540 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:01:07:45.145 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T13:33:04.611 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:01:07:45.270 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T13:33:04.656 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:01:07:45.260 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T13:33:04.667 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:01:07:45.272 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T13:33:59.784 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:01:08:40.442 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T13:33:59.800 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:01:08:40.458 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T13:33:59.811 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:01:08:40.415 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T13:33:59.815 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:01:08:40.420 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T13:33:59.815 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:01:08:40.420 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T13:33:59.821 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:01:08:40.426 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T13:33:59.888 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:01:08:40.493 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T13:33:59.890 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:01:08:40.495 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T13:33:59.896 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:01:08:40.554 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T13:35:53.459 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T13:35:53.459 INFO:teuthology.orchestra.run.smithi062.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 PASSED 2019-11-29T13:37:17.759 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T13:37:17.759 INFO:teuthology.orchestra.run.smithi062.stdout:---------------------------------------------------------------------- 2019-11-29T13:37:17.759 INFO:teuthology.orchestra.run.smithi062.stdout:| Results: SUCCESS (26 tests, 26 successes, 0 failures, 0 skipped) | 2019-11-29T13:37:17.759 INFO:teuthology.orchestra.run.smithi062.stdout:---------------------------------------------------------------------- 2019-11-29T13:37:17.897 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T13:37:17.897 INFO:teuthology.orchestra.run.smithi062.stdout:BUILD SUCCESSFUL in 45m 35s 2019-11-29T13:37:17.898 INFO:teuthology.orchestra.run.smithi062.stdout:5 actionable tasks: 4 executed, 1 up-to-date 2019-11-29T13:37:18.218 INFO:teuthology.orchestra.run.smithi062:> radosgw-admin gc process --include-all 2019-11-29T13:37:18.392 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:18.387+0000 7f445038aec0 20 rados->read ofs=0 len=0 2019-11-29T13:37:18.425 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:18.421+0000 7f445038aec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T13:37:18.426 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:18.421+0000 7f445038aec0 20 rados->read ofs=0 len=0 2019-11-29T13:37:18.440 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:18.436+0000 7f445038aec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T13:37:18.441 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:18.436+0000 7f445038aec0 20 rados->read ofs=0 len=0 2019-11-29T13:37:18.452 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:18.447+0000 7f445038aec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T13:37:18.452 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:18.447+0000 7f445038aec0 20 rados->read ofs=0 len=0 2019-11-29T13:37:18.475 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:18.471+0000 7f445038aec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T13:37:18.730 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:18.726+0000 7f445038aec0 20 RGWRados::pool_iterate: got zone_info.7f922895-c6d7-4b1b-a19c-be3df5b5a899 2019-11-29T13:37:18.731 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:18.726+0000 7f445038aec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-29T13:37:18.731 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:18.726+0000 7f445038aec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-29T13:37:18.731 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:18.726+0000 7f445038aec0 20 RGWRados::pool_iterate: got zonegroup_info.76ba47ff-1c23-4409-aae0-24fe26589cae 2019-11-29T13:37:18.731 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:18.726+0000 7f445038aec0 20 rados->read ofs=0 len=0 2019-11-29T13:37:18.749 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:18.745+0000 7f445038aec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T13:37:18.750 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:18.745+0000 7f445038aec0 20 rados->read ofs=0 len=0 2019-11-29T13:37:18.768 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:18.763+0000 7f445038aec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-29T13:37:18.768 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:18.763+0000 7f445038aec0 20 rados->read ofs=0 len=0 2019-11-29T13:37:18.785 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:18.780+0000 7f445038aec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T13:37:18.785 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:18.780+0000 7f445038aec0 20 rados->read ofs=0 len=0 2019-11-29T13:37:18.803 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:18.799+0000 7f445038aec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-29T13:37:18.803 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:18.799+0000 7f445038aec0 20 rados->read ofs=0 len=0 2019-11-29T13:37:18.814 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:18.809+0000 7f445038aec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T13:37:18.814 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:18.809+0000 7f445038aec0 10 cannot find current period zonegroup using local zonegroup 2019-11-29T13:37:18.814 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:18.809+0000 7f445038aec0 20 rados->read ofs=0 len=0 2019-11-29T13:37:18.829 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:18.824+0000 7f445038aec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T13:37:18.829 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:18.824+0000 7f445038aec0 20 rados->read ofs=0 len=0 2019-11-29T13:37:18.846 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:18.842+0000 7f445038aec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T13:37:18.846 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:18.842+0000 7f445038aec0 20 rados->read ofs=0 len=0 2019-11-29T13:37:18.860 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:18.855+0000 7f445038aec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-29T13:37:18.860 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:18.855+0000 7f445038aec0 20 zonegroup default 2019-11-29T13:37:18.860 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:18.855+0000 7f445038aec0 20 rados->read ofs=0 len=0 2019-11-29T13:37:18.871 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:18.866+0000 7f445038aec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T13:37:18.871 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:18.866+0000 7f445038aec0 10 Cannot find current period zone using local zone 2019-11-29T13:37:18.871 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:18.866+0000 7f445038aec0 20 rados->read ofs=0 len=0 2019-11-29T13:37:18.888 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:18.884+0000 7f445038aec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T13:37:18.889 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:18.884+0000 7f445038aec0 20 rados->read ofs=0 len=0 2019-11-29T13:37:18.915 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:18.910+0000 7f445038aec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T13:37:18.915 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:18.910+0000 7f445038aec0 20 rados->read ofs=0 len=0 2019-11-29T13:37:18.926 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:18.922+0000 7f445038aec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-29T13:37:18.927 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:18.922+0000 7f445038aec0 20 zone default found 2019-11-29T13:37:18.927 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:18.922+0000 7f445038aec0 20 started sync module instance, tier type = 2019-11-29T13:37:18.927 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:18.922+0000 7f445038aec0 20 started zone id=7f922895-c6d7-4b1b-a19c-be3df5b5a899 (name=default) with tier type = 2019-11-29T13:37:19.320 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:19.316+0000 7f445038aec0 20 add_watcher() i=0 2019-11-29T13:37:19.321 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:19.316+0000 7f445038aec0 20 add_watcher() i=1 2019-11-29T13:37:19.321 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:19.316+0000 7f445038aec0 20 add_watcher() i=2 2019-11-29T13:37:19.321 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:19.316+0000 7f445038aec0 20 add_watcher() i=3 2019-11-29T13:37:19.321 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:19.316+0000 7f445038aec0 20 add_watcher() i=4 2019-11-29T13:37:19.321 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:19.316+0000 7f445038aec0 20 add_watcher() i=5 2019-11-29T13:37:19.321 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:19.316+0000 7f445038aec0 20 add_watcher() i=6 2019-11-29T13:37:19.351 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:19.347+0000 7f445038aec0 20 add_watcher() i=7 2019-11-29T13:37:19.352 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:19.347+0000 7f445038aec0 2 all 8 watchers are set, enabling cache 2019-11-29T13:37:19.352 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:19.347+0000 7f440dfdb700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-29T13:37:19.355 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:19.351+0000 7f443d5b7700 0 -- 172.21.15.62:0/3904736180 >> v1:172.21.15.62:6789/0 conn(0x55afac8b8530 legacy=0x55afac8b5670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-29T13:37:19.411 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:19.406+0000 7f4434db6700 0 -- 172.21.15.62:0/1970683328 >> [v2:172.21.15.22:6818/9264,v1:172.21.15.22:6819/9264] conn(0x55afac8e4250 msgr2=0x55afac8e6670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2019-11-29T13:37:21.182 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:21.176+0000 7f437ffff700 20 reqs_thread_entry: start 2019-11-29T13:37:21.182 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:21.176+0000 7f437dffb700 20 reqs_thread_entry: start 2019-11-29T13:37:21.183 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:21.176+0000 7f445038aec0 20 init_complete bucket index max shards: 0 2019-11-29T13:37:21.183 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:21.177+0000 7f436bfff700 20 reqs_thread_entry: start 2019-11-29T13:37:21.183 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:21.177+0000 7f445038aec0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2019-11-29T13:37:21.332 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:21.327+0000 7f445038aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:21.350 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:21.346+0000 7f445038aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:37:21.368 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:21.362+0000 7f445038aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-29T13:37:21.368 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:21.362+0000 7f445038aec0 20 garbage collection: RGWGC::process iterating over entry tag='7f922895-c6d7-4b1b-a19c-be3df5b5a899.4325.446', time=2019-11-29T14:58:52.091922+0000, chain.objs.size()=9 2019-11-29T13:37:21.368 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:21.362+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.20__multipart_key1.2~xT7izX1CR_cbVy0ThD3mJHdqhn5vxYd.1 2019-11-29T13:37:21.368 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:21.362+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.20__shadow_key1.2~xT7izX1CR_cbVy0ThD3mJHdqhn5vxYd.1_1 2019-11-29T13:37:21.368 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:21.362+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.20__multipart_key1.2~xT7izX1CR_cbVy0ThD3mJHdqhn5vxYd.2 2019-11-29T13:37:21.369 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:21.362+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.20__shadow_key1.2~xT7izX1CR_cbVy0ThD3mJHdqhn5vxYd.2_1 2019-11-29T13:37:21.369 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:21.363+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.20__multipart_key1.2~xT7izX1CR_cbVy0ThD3mJHdqhn5vxYd.3 2019-11-29T13:37:21.369 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:21.363+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.20__shadow_key1.2~xT7izX1CR_cbVy0ThD3mJHdqhn5vxYd.3_1 2019-11-29T13:37:21.369 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:21.363+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.20__multipart_key1.2~xT7izX1CR_cbVy0ThD3mJHdqhn5vxYd.4 2019-11-29T13:37:21.369 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:21.363+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.20__shadow_key1.2~xT7izX1CR_cbVy0ThD3mJHdqhn5vxYd.4_1 2019-11-29T13:37:21.369 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:21.363+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.20__multipart_key1.2~xT7izX1CR_cbVy0ThD3mJHdqhn5vxYd.5 2019-11-29T13:37:21.765 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:21.760+0000 7f445038aec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-29T13:37:21.868 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:21.864+0000 7f445038aec0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2019-11-29T13:37:21.923 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:21.919+0000 7f445038aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:21.940 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:21.936+0000 7f445038aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:37:21.950 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:21.946+0000 7f445038aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:21.986 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:21.982+0000 7f445038aec0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2019-11-29T13:37:22.026 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:22.022+0000 7f445038aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:22.051 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:22.046+0000 7f445038aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:37:22.063 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:22.059+0000 7f445038aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:22.125 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:22.120+0000 7f445038aec0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2019-11-29T13:37:22.186 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:22.182+0000 7f445038aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:22.204 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:22.199+0000 7f445038aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:37:22.212 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:22.208+0000 7f445038aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:22.254 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:22.250+0000 7f445038aec0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2019-11-29T13:37:22.308 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:22.303+0000 7f445038aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:22.328 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:22.324+0000 7f445038aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:37:22.344 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:22.339+0000 7f445038aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-29T13:37:22.344 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:22.339+0000 7f445038aec0 20 garbage collection: RGWGC::process iterating over entry tag='7f922895-c6d7-4b1b-a19c-be3df5b5a899.4325.430', time=2019-11-29T15:00:17.824006+0000, chain.objs.size()=5 2019-11-29T13:37:22.344 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:22.339+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.19__shadow_.zJG6gFVnDKm6D8aXdPohuw7ZzxULz_b_1 2019-11-29T13:37:22.344 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:22.339+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.19__shadow_.zJG6gFVnDKm6D8aXdPohuw7ZzxULz_b_2 2019-11-29T13:37:22.345 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:22.339+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.19__shadow_.zJG6gFVnDKm6D8aXdPohuw7ZzxULz_b_3 2019-11-29T13:37:22.345 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:22.339+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.19__shadow_.zJG6gFVnDKm6D8aXdPohuw7ZzxULz_b_4 2019-11-29T13:37:22.345 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:22.339+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.19__shadow_.zJG6gFVnDKm6D8aXdPohuw7ZzxULz_b_5 2019-11-29T13:37:22.572 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:22.567+0000 7f445038aec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-29T13:37:22.720 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:22.716+0000 7f445038aec0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2019-11-29T13:37:22.808 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:22.804+0000 7f445038aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:22.837 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:22.833+0000 7f445038aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:37:22.858 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:22.853+0000 7f445038aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:22.910 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:22.905+0000 7f445038aec0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2019-11-29T13:37:22.967 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:22.962+0000 7f445038aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:22.987 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:22.982+0000 7f445038aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:37:23.011 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:23.006+0000 7f445038aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-29T13:37:23.011 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:23.006+0000 7f445038aec0 20 garbage collection: RGWGC::process iterating over entry tag='7f922895-c6d7-4b1b-a19c-be3df5b5a899.4325.454', time=2019-11-29T14:59:14.955486+0000, chain.objs.size()=9 2019-11-29T13:37:23.012 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:23.006+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.20__multipart_key1.2~8t56ap92xNXNRqESxZwuX7WnsfmLsbL.1 2019-11-29T13:37:23.012 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:23.006+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.20__shadow_key1.2~8t56ap92xNXNRqESxZwuX7WnsfmLsbL.1_1 2019-11-29T13:37:23.012 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:23.006+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.20__multipart_key1.2~8t56ap92xNXNRqESxZwuX7WnsfmLsbL.2 2019-11-29T13:37:23.012 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:23.006+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.20__shadow_key1.2~8t56ap92xNXNRqESxZwuX7WnsfmLsbL.2_1 2019-11-29T13:37:23.012 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:23.006+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.20__multipart_key1.2~8t56ap92xNXNRqESxZwuX7WnsfmLsbL.3 2019-11-29T13:37:23.012 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:23.006+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.20__shadow_key1.2~8t56ap92xNXNRqESxZwuX7WnsfmLsbL.3_1 2019-11-29T13:37:23.012 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:23.006+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.20__multipart_key1.2~8t56ap92xNXNRqESxZwuX7WnsfmLsbL.4 2019-11-29T13:37:23.013 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:23.006+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.20__shadow_key1.2~8t56ap92xNXNRqESxZwuX7WnsfmLsbL.4_1 2019-11-29T13:37:23.013 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:23.006+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.20__multipart_key1.2~8t56ap92xNXNRqESxZwuX7WnsfmLsbL.5 2019-11-29T13:37:23.397 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:23.393+0000 7f445038aec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-29T13:37:23.509 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:23.505+0000 7f445038aec0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2019-11-29T13:37:23.558 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:23.553+0000 7f445038aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:23.574 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:23.570+0000 7f445038aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:37:23.591 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:23.586+0000 7f445038aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-29T13:37:23.591 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:23.586+0000 7f445038aec0 20 garbage collection: RGWGC::process iterating over entry tag='7f922895-c6d7-4b1b-a19c-be3df5b5a899.4325.466', time=2019-11-29T15:00:05.630591+0000, chain.objs.size()=7 2019-11-29T13:37:23.591 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:23.586+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.20__multipart_key1.2~TA9R3VyI4IlFlIQC8nlJvZzFpVZkC9c.1 2019-11-29T13:37:23.591 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:23.586+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.20__shadow_key1.2~TA9R3VyI4IlFlIQC8nlJvZzFpVZkC9c.1_1 2019-11-29T13:37:23.591 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:23.586+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.20__shadow_key1.2~TA9R3VyI4IlFlIQC8nlJvZzFpVZkC9c.1_2 2019-11-29T13:37:23.591 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:23.586+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.20__multipart_key1.2~TA9R3VyI4IlFlIQC8nlJvZzFpVZkC9c.2 2019-11-29T13:37:23.592 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:23.586+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.20__shadow_key1.2~TA9R3VyI4IlFlIQC8nlJvZzFpVZkC9c.2_1 2019-11-29T13:37:23.592 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:23.586+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.20__shadow_key1.2~TA9R3VyI4IlFlIQC8nlJvZzFpVZkC9c.2_2 2019-11-29T13:37:23.592 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:23.586+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.20__multipart_key1.2~TA9R3VyI4IlFlIQC8nlJvZzFpVZkC9c.3 2019-11-29T13:37:23.930 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:23.925+0000 7f445038aec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-29T13:37:24.072 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:24.067+0000 7f445038aec0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2019-11-29T13:37:24.120 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:24.116+0000 7f445038aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:24.138 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:24.134+0000 7f445038aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:37:24.156 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:24.150+0000 7f445038aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-11-29T13:37:24.156 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:24.150+0000 7f445038aec0 20 garbage collection: RGWGC::process iterating over entry tag='7f922895-c6d7-4b1b-a19c-be3df5b5a899.4325.415', time=2019-11-29T14:56:05.336916+0000, chain.objs.size()=9 2019-11-29T13:37:24.156 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:24.151+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.17__multipart_key1.2~dazxA0YIvawDLl0l8G9XHIylryne9eE.1 2019-11-29T13:37:24.157 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:24.151+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.17__shadow_key1.2~dazxA0YIvawDLl0l8G9XHIylryne9eE.1_1 2019-11-29T13:37:24.157 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:24.151+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.17__multipart_key1.2~dazxA0YIvawDLl0l8G9XHIylryne9eE.2 2019-11-29T13:37:24.157 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:24.151+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.17__shadow_key1.2~dazxA0YIvawDLl0l8G9XHIylryne9eE.2_1 2019-11-29T13:37:24.157 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:24.151+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.17__multipart_key1.2~dazxA0YIvawDLl0l8G9XHIylryne9eE.3 2019-11-29T13:37:24.157 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:24.151+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.17__shadow_key1.2~dazxA0YIvawDLl0l8G9XHIylryne9eE.3_1 2019-11-29T13:37:24.157 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:24.151+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.17__multipart_key1.2~dazxA0YIvawDLl0l8G9XHIylryne9eE.4 2019-11-29T13:37:24.157 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:24.151+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.17__shadow_key1.2~dazxA0YIvawDLl0l8G9XHIylryne9eE.4_1 2019-11-29T13:37:24.158 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:24.151+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.17__multipart_key1.2~dazxA0YIvawDLl0l8G9XHIylryne9eE.5 2019-11-29T13:37:24.158 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:24.151+0000 7f445038aec0 20 garbage collection: RGWGC::process iterating over entry tag='7f922895-c6d7-4b1b-a19c-be3df5b5a899.4325.417', time=2019-11-29T14:56:13.493515+0000, chain.objs.size()=9 2019-11-29T13:37:24.158 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:24.151+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.17__multipart_key1.2~dazxA0YIvawDLl0l8G9XHIylryne9eE.1 2019-11-29T13:37:24.158 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:24.151+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.17__shadow_key1.2~dazxA0YIvawDLl0l8G9XHIylryne9eE.1_1 2019-11-29T13:37:24.158 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:24.151+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.17__multipart_key1.2~dazxA0YIvawDLl0l8G9XHIylryne9eE.2 2019-11-29T13:37:24.322 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:24.309+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.17__shadow_key1.2~dazxA0YIvawDLl0l8G9XHIylryne9eE.2_1 2019-11-29T13:37:24.323 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:24.309+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.17__multipart_key1.2~dazxA0YIvawDLl0l8G9XHIylryne9eE.3 2019-11-29T13:37:24.323 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:24.309+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.17__shadow_key1.2~dazxA0YIvawDLl0l8G9XHIylryne9eE.3_1 2019-11-29T13:37:24.323 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:24.309+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.17__multipart_key1.2~dazxA0YIvawDLl0l8G9XHIylryne9eE.4 2019-11-29T13:37:24.323 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:24.309+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.17__shadow_key1.2~dazxA0YIvawDLl0l8G9XHIylryne9eE.4_1 2019-11-29T13:37:24.324 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:24.309+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.17__multipart_key1.2~dazxA0YIvawDLl0l8G9XHIylryne9eE.5 2019-11-29T13:37:24.669 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:24.665+0000 7f445038aec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-29T13:37:24.794 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:24.790+0000 7f445038aec0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2019-11-29T13:37:24.848 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:24.844+0000 7f445038aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:24.867 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:24.863+0000 7f445038aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:37:24.876 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:24.871+0000 7f445038aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:24.921 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:24.917+0000 7f445038aec0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2019-11-29T13:37:24.977 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:24.972+0000 7f445038aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:24.997 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:24.992+0000 7f445038aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:37:25.008 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:25.003+0000 7f445038aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:25.045 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:25.040+0000 7f445038aec0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2019-11-29T13:37:25.101 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:25.096+0000 7f445038aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:25.117 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:25.112+0000 7f445038aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:37:25.125 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:25.121+0000 7f445038aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:25.173 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:25.168+0000 7f445038aec0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2019-11-29T13:37:25.222 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:25.218+0000 7f445038aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:25.248 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:25.244+0000 7f445038aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:37:25.279 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:25.274+0000 7f445038aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-29T13:37:25.279 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:25.274+0000 7f445038aec0 20 garbage collection: RGWGC::process iterating over entry tag='7f922895-c6d7-4b1b-a19c-be3df5b5a899.4325.460', time=2019-11-29T14:59:41.801388+0000, chain.objs.size()=7 2019-11-29T13:37:25.280 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:25.274+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.20__multipart_key1.2~rUG6HCOQRkFzAr2I4HfkoQoUIwmUr7M.1 2019-11-29T13:37:25.280 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:25.274+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.20__shadow_key1.2~rUG6HCOQRkFzAr2I4HfkoQoUIwmUr7M.1_1 2019-11-29T13:37:25.280 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:25.274+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.20__shadow_key1.2~rUG6HCOQRkFzAr2I4HfkoQoUIwmUr7M.1_2 2019-11-29T13:37:25.280 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:25.274+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.20__multipart_key1.2~rUG6HCOQRkFzAr2I4HfkoQoUIwmUr7M.2 2019-11-29T13:37:25.280 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:25.274+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.20__shadow_key1.2~rUG6HCOQRkFzAr2I4HfkoQoUIwmUr7M.2_1 2019-11-29T13:37:25.280 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:25.274+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.20__shadow_key1.2~rUG6HCOQRkFzAr2I4HfkoQoUIwmUr7M.2_2 2019-11-29T13:37:25.281 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:25.274+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.20__multipart_key1.2~rUG6HCOQRkFzAr2I4HfkoQoUIwmUr7M.3 2019-11-29T13:37:25.572 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:25.568+0000 7f445038aec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-29T13:37:25.672 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:25.667+0000 7f445038aec0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2019-11-29T13:37:25.754 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:25.749+0000 7f445038aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:25.807 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:25.796+0000 7f445038aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:37:25.823 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:25.818+0000 7f445038aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-11-29T13:37:25.823 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:25.818+0000 7f445038aec0 20 garbage collection: RGWGC::process iterating over entry tag='7f922895-c6d7-4b1b-a19c-be3df5b5a899.4325.472', time=2019-11-29T15:00:10.094984+0000, chain.objs.size()=7 2019-11-29T13:37:25.824 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:25.818+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.20__multipart_key1.2~eLemFaYiBtCmcXFtu8qKa38AcOHvEwC.1 2019-11-29T13:37:25.824 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:25.818+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.20__shadow_key1.2~eLemFaYiBtCmcXFtu8qKa38AcOHvEwC.1_1 2019-11-29T13:37:25.824 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:25.818+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.20__shadow_key1.2~eLemFaYiBtCmcXFtu8qKa38AcOHvEwC.1_2 2019-11-29T13:37:25.824 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:25.818+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.20__multipart_key1.2~eLemFaYiBtCmcXFtu8qKa38AcOHvEwC.2 2019-11-29T13:37:25.825 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:25.818+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.20__shadow_key1.2~eLemFaYiBtCmcXFtu8qKa38AcOHvEwC.2_1 2019-11-29T13:37:25.825 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:25.818+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.20__shadow_key1.2~eLemFaYiBtCmcXFtu8qKa38AcOHvEwC.2_2 2019-11-29T13:37:25.825 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:25.818+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.20__multipart_key1.2~eLemFaYiBtCmcXFtu8qKa38AcOHvEwC.3 2019-11-29T13:37:25.825 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:25.818+0000 7f445038aec0 20 garbage collection: RGWGC::process iterating over entry tag='7f922895-c6d7-4b1b-a19c-be3df5b5a899.4325.628', time=2019-11-29T15:17:34.733269+0000, chain.objs.size()=16 2019-11-29T13:37:25.826 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:25.818+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.28__multipart_key1.2~z9htYRBOs8osPpYlvjAslCdbsHFkPan.1 2019-11-29T13:37:25.826 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:25.818+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.28__shadow_key1.2~z9htYRBOs8osPpYlvjAslCdbsHFkPan.1_1 2019-11-29T13:37:25.826 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:25.818+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.28__shadow_key1.2~z9htYRBOs8osPpYlvjAslCdbsHFkPan.1_2 2019-11-29T13:37:25.826 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:25.818+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.28__multipart_key1.2~z9htYRBOs8osPpYlvjAslCdbsHFkPan.2 2019-11-29T13:37:25.827 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:25.818+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.28__shadow_key1.2~z9htYRBOs8osPpYlvjAslCdbsHFkPan.2_1 2019-11-29T13:37:26.112 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:26.107+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.28__shadow_key1.2~z9htYRBOs8osPpYlvjAslCdbsHFkPan.2_2 2019-11-29T13:37:26.334 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:26.330+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.28__multipart_key1.2~z9htYRBOs8osPpYlvjAslCdbsHFkPan.3 2019-11-29T13:37:26.334 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:26.330+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.28__shadow_key1.2~z9htYRBOs8osPpYlvjAslCdbsHFkPan.3_1 2019-11-29T13:37:26.354 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:26.350+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.28__shadow_key1.2~z9htYRBOs8osPpYlvjAslCdbsHFkPan.3_2 2019-11-29T13:37:26.354 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:26.350+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.28__multipart_key1.2~z9htYRBOs8osPpYlvjAslCdbsHFkPan.4 2019-11-29T13:37:26.355 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:26.350+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.28__shadow_key1.2~z9htYRBOs8osPpYlvjAslCdbsHFkPan.4_1 2019-11-29T13:37:26.355 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:26.350+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.28__shadow_key1.2~z9htYRBOs8osPpYlvjAslCdbsHFkPan.4_2 2019-11-29T13:37:26.358 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:26.353+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.28__multipart_key1.2~z9htYRBOs8osPpYlvjAslCdbsHFkPan.5 2019-11-29T13:37:26.358 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:26.353+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.28__shadow_key1.2~z9htYRBOs8osPpYlvjAslCdbsHFkPan.5_1 2019-11-29T13:37:26.358 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:26.353+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.28__shadow_key1.2~z9htYRBOs8osPpYlvjAslCdbsHFkPan.5_2 2019-11-29T13:37:26.358 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:26.353+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.28__multipart_key1.2~z9htYRBOs8osPpYlvjAslCdbsHFkPan.6 2019-11-29T13:37:26.836 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:26.832+0000 7f445038aec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-29T13:37:26.956 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:26.951+0000 7f445038aec0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2019-11-29T13:37:26.996 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:26.991+0000 7f445038aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:27.043 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:27.007+0000 7f445038aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:37:27.043 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:27.016+0000 7f445038aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:27.054 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:27.050+0000 7f445038aec0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2019-11-29T13:37:27.097 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:27.092+0000 7f445038aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:27.112 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:27.108+0000 7f445038aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:37:27.133 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:27.127+0000 7f445038aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-11-29T13:37:27.133 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:27.127+0000 7f445038aec0 20 garbage collection: RGWGC::process iterating over entry tag='7f922895-c6d7-4b1b-a19c-be3df5b5a899.4325.386', time=2019-11-29T14:54:53.667614+0000, chain.objs.size()=9 2019-11-29T13:37:27.133 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:27.127+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.15__multipart_key1.2~TY7yJapvcNl6lcDcglmucwa-cSYUIU2.1 2019-11-29T13:37:27.133 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:27.127+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.15__shadow_key1.2~TY7yJapvcNl6lcDcglmucwa-cSYUIU2.1_1 2019-11-29T13:37:27.133 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:27.127+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.15__multipart_key1.2~TY7yJapvcNl6lcDcglmucwa-cSYUIU2.2 2019-11-29T13:37:27.134 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:27.127+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.15__shadow_key1.2~TY7yJapvcNl6lcDcglmucwa-cSYUIU2.2_1 2019-11-29T13:37:27.134 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:27.127+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.15__multipart_key1.2~TY7yJapvcNl6lcDcglmucwa-cSYUIU2.3 2019-11-29T13:37:27.134 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:27.127+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.15__shadow_key1.2~TY7yJapvcNl6lcDcglmucwa-cSYUIU2.3_1 2019-11-29T13:37:27.134 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:27.127+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.15__multipart_key1.2~TY7yJapvcNl6lcDcglmucwa-cSYUIU2.4 2019-11-29T13:37:27.134 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:27.127+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.15__shadow_key1.2~TY7yJapvcNl6lcDcglmucwa-cSYUIU2.4_1 2019-11-29T13:37:27.134 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:27.127+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.15__multipart_key1.2~TY7yJapvcNl6lcDcglmucwa-cSYUIU2.5 2019-11-29T13:37:27.134 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:27.127+0000 7f445038aec0 20 garbage collection: RGWGC::process iterating over entry tag='7f922895-c6d7-4b1b-a19c-be3df5b5a899.4325.651', time=2019-11-29T15:19:38.862411+0000, chain.objs.size()=9 2019-11-29T13:37:27.135 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:27.127+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.29__multipart_key1.2~gN9RYfaAylJXWiE8zuK7rZir33ObyIF.1 2019-11-29T13:37:27.135 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:27.127+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.29__shadow_key1.2~gN9RYfaAylJXWiE8zuK7rZir33ObyIF.1_1 2019-11-29T13:37:27.135 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:27.127+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.29__multipart_key1.2~gN9RYfaAylJXWiE8zuK7rZir33ObyIF.2 2019-11-29T13:37:27.310 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:27.305+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.29__shadow_key1.2~gN9RYfaAylJXWiE8zuK7rZir33ObyIF.2_1 2019-11-29T13:37:27.341 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:27.336+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.29__multipart_key1.2~gN9RYfaAylJXWiE8zuK7rZir33ObyIF.3 2019-11-29T13:37:27.524 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:27.519+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.29__shadow_key1.2~gN9RYfaAylJXWiE8zuK7rZir33ObyIF.3_1 2019-11-29T13:37:27.524 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:27.519+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.29__multipart_key1.2~gN9RYfaAylJXWiE8zuK7rZir33ObyIF.4 2019-11-29T13:37:27.695 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:27.690+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.29__shadow_key1.2~gN9RYfaAylJXWiE8zuK7rZir33ObyIF.4_1 2019-11-29T13:37:27.695 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:27.690+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.29__multipart_key1.2~gN9RYfaAylJXWiE8zuK7rZir33ObyIF.5 2019-11-29T13:37:27.878 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:27.874+0000 7f445038aec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-29T13:37:28.011 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:28.006+0000 7f445038aec0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2019-11-29T13:37:28.055 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:28.051+0000 7f445038aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:28.096 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:28.092+0000 7f445038aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:37:28.123 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:28.118+0000 7f445038aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-11-29T13:37:28.123 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:28.118+0000 7f445038aec0 20 garbage collection: RGWGC::process iterating over entry tag='7f922895-c6d7-4b1b-a19c-be3df5b5a899.4325.553', time=2019-11-29T15:03:38.891713+0000, chain.objs.size()=9 2019-11-29T13:37:28.123 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:28.118+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.26__multipart_file.mpg.2~NRZE-wBQs_UH8mYQgbc9J8IWBNcjPvL.1 2019-11-29T13:37:28.123 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:28.118+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.26__shadow_file.mpg.2~NRZE-wBQs_UH8mYQgbc9J8IWBNcjPvL.1_1 2019-11-29T13:37:28.124 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:28.118+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.26__multipart_file.mpg.2~NRZE-wBQs_UH8mYQgbc9J8IWBNcjPvL.2 2019-11-29T13:37:28.124 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:28.118+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.26__shadow_file.mpg.2~NRZE-wBQs_UH8mYQgbc9J8IWBNcjPvL.2_1 2019-11-29T13:37:28.124 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:28.118+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.26__multipart_file.mpg.2~NRZE-wBQs_UH8mYQgbc9J8IWBNcjPvL.3 2019-11-29T13:37:28.124 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:28.118+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.26__shadow_file.mpg.2~NRZE-wBQs_UH8mYQgbc9J8IWBNcjPvL.3_1 2019-11-29T13:37:28.125 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:28.118+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.26__multipart_file.mpg.2~NRZE-wBQs_UH8mYQgbc9J8IWBNcjPvL.4 2019-11-29T13:37:28.125 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:28.118+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.26__shadow_file.mpg.2~NRZE-wBQs_UH8mYQgbc9J8IWBNcjPvL.4_1 2019-11-29T13:37:28.125 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:28.118+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.26__multipart_file.mpg.2~NRZE-wBQs_UH8mYQgbc9J8IWBNcjPvL.5 2019-11-29T13:37:28.125 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:28.118+0000 7f445038aec0 20 garbage collection: RGWGC::process iterating over entry tag='2~d2i39GgrtkmxnBQkLE4qq60bNo65qif', time=2019-11-29T15:21:37.852113+0000, chain.objs.size()=29 2019-11-29T13:37:28.125 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:28.118+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.31__multipart_key1.2~d2i39GgrtkmxnBQkLE4qq60bNo65qif.1 2019-11-29T13:37:28.125 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:28.118+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.31__multipart_key1.2~d2i39GgrtkmxnBQkLE4qq60bNo65qif.2 2019-11-29T13:37:28.125 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:28.118+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.31__multipart_key1.2~d2i39GgrtkmxnBQkLE4qq60bNo65qif.3 2019-11-29T13:37:28.341 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:28.336+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.31__multipart_key1.2~d2i39GgrtkmxnBQkLE4qq60bNo65qif.4 2019-11-29T13:37:28.341 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:28.336+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.31__multipart_key1.2~d2i39GgrtkmxnBQkLE4qq60bNo65qif.5 2019-11-29T13:37:28.341 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:28.336+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.31__multipart_key1.2~d2i39GgrtkmxnBQkLE4qq60bNo65qif.6 2019-11-29T13:37:28.352 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:28.347+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.31__multipart_key1.2~d2i39GgrtkmxnBQkLE4qq60bNo65qif.7 2019-11-29T13:37:28.352 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:28.347+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.31__multipart_key1.2~d2i39GgrtkmxnBQkLE4qq60bNo65qif.8 2019-11-29T13:37:28.352 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:28.347+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.31__multipart_key1.2~d2i39GgrtkmxnBQkLE4qq60bNo65qif.9 2019-11-29T13:37:28.357 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:28.353+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.31__multipart_key1.2~d2i39GgrtkmxnBQkLE4qq60bNo65qif.10 2019-11-29T13:37:28.357 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:28.353+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.31__multipart_key1.2~d2i39GgrtkmxnBQkLE4qq60bNo65qif.11 2019-11-29T13:37:28.385 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:28.381+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.31__multipart_key1.2~d2i39GgrtkmxnBQkLE4qq60bNo65qif.12 2019-11-29T13:37:28.385 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:28.381+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.31__multipart_key1.2~d2i39GgrtkmxnBQkLE4qq60bNo65qif.13 2019-11-29T13:37:28.386 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:28.381+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.31__multipart_key1.2~d2i39GgrtkmxnBQkLE4qq60bNo65qif.14 2019-11-29T13:37:28.405 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:28.400+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.31__multipart_key1.2~d2i39GgrtkmxnBQkLE4qq60bNo65qif.15 2019-11-29T13:37:28.455 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:28.451+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.31__multipart_key1.3to_6yXS5CTvGV6qfdURdvCFeswyU0m.16 2019-11-29T13:37:28.460 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:28.456+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.31__multipart_key1.2~d2i39GgrtkmxnBQkLE4qq60bNo65qif.17 2019-11-29T13:37:28.475 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:28.470+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.31__multipart_key1.2~d2i39GgrtkmxnBQkLE4qq60bNo65qif.18 2019-11-29T13:37:28.475 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:28.470+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.31__multipart_key1.xo-Hs2hU5QpACbhOIjbpJ7BSrk8UvtT.19 2019-11-29T13:37:28.476 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:28.470+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.31__multipart_key1.fho84P1HyXETSSSzeOm9ri5SbJjQ8Es.20 2019-11-29T13:37:28.476 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:28.470+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.31__multipart_key1.E_P2UbQmF5bbs6ZfRsyujP-yH07ROQ_.21 2019-11-29T13:37:28.476 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:28.470+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.31__multipart_key1.2~d2i39GgrtkmxnBQkLE4qq60bNo65qif.22 2019-11-29T13:37:28.476 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:28.470+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.31__multipart_key1.2~d2i39GgrtkmxnBQkLE4qq60bNo65qif.23 2019-11-29T13:37:28.476 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:28.470+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.31__multipart_key1.2~d2i39GgrtkmxnBQkLE4qq60bNo65qif.24 2019-11-29T13:37:28.476 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:28.470+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.31__multipart_key1.2~d2i39GgrtkmxnBQkLE4qq60bNo65qif.25 2019-11-29T13:37:28.558 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:28.553+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.31__multipart_key1.2~d2i39GgrtkmxnBQkLE4qq60bNo65qif.26 2019-11-29T13:37:28.633 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:28.628+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.31__multipart_key1.2~d2i39GgrtkmxnBQkLE4qq60bNo65qif.27 2019-11-29T13:37:28.645 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:28.641+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.31__multipart_key1.2~d2i39GgrtkmxnBQkLE4qq60bNo65qif.28 2019-11-29T13:37:28.645 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:28.641+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.31__multipart_key1.2~d2i39GgrtkmxnBQkLE4qq60bNo65qif.29 2019-11-29T13:37:28.695 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:28.691+0000 7f445038aec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-29T13:37:28.806 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:28.801+0000 7f445038aec0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2019-11-29T13:37:28.847 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:28.842+0000 7f445038aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:28.863 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:28.859+0000 7f445038aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:37:28.872 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:28.867+0000 7f445038aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:28.906 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:28.902+0000 7f445038aec0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2019-11-29T13:37:28.945 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:28.941+0000 7f445038aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:28.960 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:28.956+0000 7f445038aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:37:28.969 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:28.965+0000 7f445038aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:29.034 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:29.029+0000 7f445038aec0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2019-11-29T13:37:29.086 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:29.082+0000 7f445038aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:29.103 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:29.098+0000 7f445038aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:37:29.139 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:29.133+0000 7f445038aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2019-11-29T13:37:29.139 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:29.133+0000 7f445038aec0 20 garbage collection: RGWGC::process iterating over entry tag='7f922895-c6d7-4b1b-a19c-be3df5b5a899.4325.528', time=2019-11-29T15:02:38.259890+0000, chain.objs.size()=9 2019-11-29T13:37:29.139 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:29.133+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.25__multipart_key1.2~gMp5dm11hfWI05KlbRx22F9DK5ZiPiq.1 2019-11-29T13:37:29.139 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:29.133+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.25__shadow_key1.2~gMp5dm11hfWI05KlbRx22F9DK5ZiPiq.1_1 2019-11-29T13:37:29.139 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:29.133+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.25__multipart_key1.2~gMp5dm11hfWI05KlbRx22F9DK5ZiPiq.2 2019-11-29T13:37:29.140 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:29.133+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.25__shadow_key1.2~gMp5dm11hfWI05KlbRx22F9DK5ZiPiq.2_1 2019-11-29T13:37:29.140 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:29.133+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.25__multipart_key1.2~gMp5dm11hfWI05KlbRx22F9DK5ZiPiq.3 2019-11-29T13:37:29.140 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:29.133+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.25__shadow_key1.2~gMp5dm11hfWI05KlbRx22F9DK5ZiPiq.3_1 2019-11-29T13:37:29.140 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:29.133+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.25__multipart_key1.2~gMp5dm11hfWI05KlbRx22F9DK5ZiPiq.4 2019-11-29T13:37:29.141 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:29.133+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.25__shadow_key1.2~gMp5dm11hfWI05KlbRx22F9DK5ZiPiq.4_1 2019-11-29T13:37:29.141 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:29.133+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.25__multipart_key1.2~gMp5dm11hfWI05KlbRx22F9DK5ZiPiq.5 2019-11-29T13:37:29.141 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:29.133+0000 7f445038aec0 20 garbage collection: RGWGC::process iterating over entry tag='7f922895-c6d7-4b1b-a19c-be3df5b5a899.4325.587', time=2019-11-29T15:08:57.074157+0000, chain.objs.size()=21 2019-11-29T13:37:29.141 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:29.133+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.28__multipart_key1.2~sulHUHTjFwx5ZtjMbG-U-w1pTCP29DN.1 2019-11-29T13:37:29.141 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:29.133+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.28__shadow_key1.2~sulHUHTjFwx5ZtjMbG-U-w1pTCP29DN.1_1 2019-11-29T13:37:29.142 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:29.133+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.28__multipart_key1.2~sulHUHTjFwx5ZtjMbG-U-w1pTCP29DN.2 2019-11-29T13:37:29.377 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:29.373+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.28__shadow_key1.2~sulHUHTjFwx5ZtjMbG-U-w1pTCP29DN.2_1 2019-11-29T13:37:29.488 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:29.484+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.28__multipart_key1.2~sulHUHTjFwx5ZtjMbG-U-w1pTCP29DN.3 2019-11-29T13:37:29.489 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:29.484+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.28__shadow_key1.2~sulHUHTjFwx5ZtjMbG-U-w1pTCP29DN.3_1 2019-11-29T13:37:29.489 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:29.484+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.28__multipart_key1.2~sulHUHTjFwx5ZtjMbG-U-w1pTCP29DN.4 2019-11-29T13:37:29.563 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:29.559+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.28__shadow_key1.2~sulHUHTjFwx5ZtjMbG-U-w1pTCP29DN.4_1 2019-11-29T13:37:29.564 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:29.559+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.28__multipart_key1.2~sulHUHTjFwx5ZtjMbG-U-w1pTCP29DN.5 2019-11-29T13:37:29.564 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:29.559+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.28__shadow_key1.2~sulHUHTjFwx5ZtjMbG-U-w1pTCP29DN.5_1 2019-11-29T13:37:29.564 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:29.559+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.28__multipart_key1.2~sulHUHTjFwx5ZtjMbG-U-w1pTCP29DN.6 2019-11-29T13:37:29.564 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:29.559+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.28__shadow_key1.2~sulHUHTjFwx5ZtjMbG-U-w1pTCP29DN.6_1 2019-11-29T13:37:29.564 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:29.559+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.28__multipart_key1.2~sulHUHTjFwx5ZtjMbG-U-w1pTCP29DN.7 2019-11-29T13:37:29.564 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:29.559+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.28__shadow_key1.2~sulHUHTjFwx5ZtjMbG-U-w1pTCP29DN.7_1 2019-11-29T13:37:29.564 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:29.559+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.28__multipart_key1.2~sulHUHTjFwx5ZtjMbG-U-w1pTCP29DN.8 2019-11-29T13:37:29.584 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:29.580+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.28__shadow_key1.2~sulHUHTjFwx5ZtjMbG-U-w1pTCP29DN.8_1 2019-11-29T13:37:29.637 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:29.633+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.28__multipart_key1.2~sulHUHTjFwx5ZtjMbG-U-w1pTCP29DN.9 2019-11-29T13:37:29.638 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:29.633+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.28__shadow_key1.2~sulHUHTjFwx5ZtjMbG-U-w1pTCP29DN.9_1 2019-11-29T13:37:29.730 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:29.726+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.28__multipart_key1.2~sulHUHTjFwx5ZtjMbG-U-w1pTCP29DN.10 2019-11-29T13:37:29.890 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:29.886+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.28__shadow_key1.2~sulHUHTjFwx5ZtjMbG-U-w1pTCP29DN.10_1 2019-11-29T13:37:29.891 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:29.886+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.28__multipart_key1.2~sulHUHTjFwx5ZtjMbG-U-w1pTCP29DN.11 2019-11-29T13:37:29.891 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:29.886+0000 7f445038aec0 20 garbage collection: RGWGC::process iterating over entry tag='7f922895-c6d7-4b1b-a19c-be3df5b5a899.4325.636', time=2019-11-29T15:17:39.232336+0000, chain.objs.size()=16 2019-11-29T13:37:29.891 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:29.886+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.28__multipart_key1.2~NbVb5GO9nSvUKfOTzXvDuOs9WE-Roy0.1 2019-11-29T13:37:29.895 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:29.891+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.28__shadow_key1.2~NbVb5GO9nSvUKfOTzXvDuOs9WE-Roy0.1_1 2019-11-29T13:37:29.896 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:29.891+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.28__shadow_key1.2~NbVb5GO9nSvUKfOTzXvDuOs9WE-Roy0.1_2 2019-11-29T13:37:29.961 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:29.956+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.28__multipart_key1.2~NbVb5GO9nSvUKfOTzXvDuOs9WE-Roy0.2 2019-11-29T13:37:29.961 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:29.956+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.28__shadow_key1.2~NbVb5GO9nSvUKfOTzXvDuOs9WE-Roy0.2_1 2019-11-29T13:37:29.961 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:29.956+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.28__shadow_key1.2~NbVb5GO9nSvUKfOTzXvDuOs9WE-Roy0.2_2 2019-11-29T13:37:29.961 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:29.956+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.28__multipart_key1.2~NbVb5GO9nSvUKfOTzXvDuOs9WE-Roy0.3 2019-11-29T13:37:29.962 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:29.956+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.28__shadow_key1.2~NbVb5GO9nSvUKfOTzXvDuOs9WE-Roy0.3_1 2019-11-29T13:37:29.962 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:29.956+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.28__shadow_key1.2~NbVb5GO9nSvUKfOTzXvDuOs9WE-Roy0.3_2 2019-11-29T13:37:30.129 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:30.125+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.28__multipart_key1.2~NbVb5GO9nSvUKfOTzXvDuOs9WE-Roy0.4 2019-11-29T13:37:30.187 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:30.182+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.28__shadow_key1.2~NbVb5GO9nSvUKfOTzXvDuOs9WE-Roy0.4_1 2019-11-29T13:37:30.187 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:30.182+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.28__shadow_key1.2~NbVb5GO9nSvUKfOTzXvDuOs9WE-Roy0.4_2 2019-11-29T13:37:30.187 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:30.182+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.28__multipart_key1.2~NbVb5GO9nSvUKfOTzXvDuOs9WE-Roy0.5 2019-11-29T13:37:30.199 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:30.194+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.28__shadow_key1.2~NbVb5GO9nSvUKfOTzXvDuOs9WE-Roy0.5_1 2019-11-29T13:37:30.199 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:30.194+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.28__shadow_key1.2~NbVb5GO9nSvUKfOTzXvDuOs9WE-Roy0.5_2 2019-11-29T13:37:30.303 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:30.298+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.28__multipart_key1.2~NbVb5GO9nSvUKfOTzXvDuOs9WE-Roy0.6 2019-11-29T13:37:30.433 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:30.429+0000 7f445038aec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-29T13:37:30.548 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:30.544+0000 7f445038aec0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2019-11-29T13:37:30.617 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:30.612+0000 7f445038aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:30.646 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:30.641+0000 7f445038aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:37:30.653 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:30.649+0000 7f445038aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:30.803 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:30.799+0000 7f445038aec0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2019-11-29T13:37:30.894 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:30.890+0000 7f445038aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:30.929 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:30.924+0000 7f445038aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:37:30.959 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:30.953+0000 7f445038aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-29T13:37:30.959 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:30.953+0000 7f445038aec0 20 garbage collection: RGWGC::process iterating over entry tag='7f922895-c6d7-4b1b-a19c-be3df5b5a899.4325.600', time=2019-11-29T15:11:17.147658+0000, chain.objs.size()=21 2019-11-29T13:37:30.959 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:30.953+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.28__multipart_key1.2~7zh762Tqvn5pYHYNTovWHoK0-I2yZlI.1 2019-11-29T13:37:30.959 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:30.953+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.28__shadow_key1.2~7zh762Tqvn5pYHYNTovWHoK0-I2yZlI.1_1 2019-11-29T13:37:30.959 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:30.953+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.28__multipart_key1.2~7zh762Tqvn5pYHYNTovWHoK0-I2yZlI.2 2019-11-29T13:37:30.959 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:30.953+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.28__shadow_key1.2~7zh762Tqvn5pYHYNTovWHoK0-I2yZlI.2_1 2019-11-29T13:37:30.960 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:30.953+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.28__multipart_key1.2~7zh762Tqvn5pYHYNTovWHoK0-I2yZlI.3 2019-11-29T13:37:30.960 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:30.953+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.28__shadow_key1.2~7zh762Tqvn5pYHYNTovWHoK0-I2yZlI.3_1 2019-11-29T13:37:30.960 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:30.953+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.28__multipart_key1.2~7zh762Tqvn5pYHYNTovWHoK0-I2yZlI.4 2019-11-29T13:37:30.960 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:30.953+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.28__shadow_key1.2~7zh762Tqvn5pYHYNTovWHoK0-I2yZlI.4_1 2019-11-29T13:37:30.960 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:30.953+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.28__multipart_key1.2~7zh762Tqvn5pYHYNTovWHoK0-I2yZlI.5 2019-11-29T13:37:30.960 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:30.953+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.28__shadow_key1.2~7zh762Tqvn5pYHYNTovWHoK0-I2yZlI.5_1 2019-11-29T13:37:30.960 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:30.953+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.28__multipart_key1.2~7zh762Tqvn5pYHYNTovWHoK0-I2yZlI.6 2019-11-29T13:37:30.961 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:30.953+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.28__shadow_key1.2~7zh762Tqvn5pYHYNTovWHoK0-I2yZlI.6_1 2019-11-29T13:37:31.227 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:31.222+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.28__multipart_key1.2~7zh762Tqvn5pYHYNTovWHoK0-I2yZlI.7 2019-11-29T13:37:31.227 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:31.222+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.28__shadow_key1.2~7zh762Tqvn5pYHYNTovWHoK0-I2yZlI.7_1 2019-11-29T13:37:31.271 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:31.266+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.28__multipart_key1.2~7zh762Tqvn5pYHYNTovWHoK0-I2yZlI.8 2019-11-29T13:37:31.271 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:31.266+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.28__shadow_key1.2~7zh762Tqvn5pYHYNTovWHoK0-I2yZlI.8_1 2019-11-29T13:37:31.271 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:31.266+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.28__multipart_key1.2~7zh762Tqvn5pYHYNTovWHoK0-I2yZlI.9 2019-11-29T13:37:31.271 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:31.266+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.28__shadow_key1.2~7zh762Tqvn5pYHYNTovWHoK0-I2yZlI.9_1 2019-11-29T13:37:31.407 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:31.403+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.28__multipart_key1.2~7zh762Tqvn5pYHYNTovWHoK0-I2yZlI.10 2019-11-29T13:37:31.408 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:31.403+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.28__shadow_key1.2~7zh762Tqvn5pYHYNTovWHoK0-I2yZlI.10_1 2019-11-29T13:37:31.408 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:31.403+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.28__multipart_key1.2~7zh762Tqvn5pYHYNTovWHoK0-I2yZlI.11 2019-11-29T13:37:31.591 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:31.586+0000 7f445038aec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-29T13:37:31.710 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:31.706+0000 7f445038aec0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2019-11-29T13:37:31.747 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:31.743+0000 7f445038aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:31.763 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:31.759+0000 7f445038aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:37:31.779 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:31.775+0000 7f445038aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-11-29T13:37:31.779 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:31.775+0000 7f445038aec0 20 garbage collection: RGWGC::process iterating over entry tag='7f922895-c6d7-4b1b-a19c-be3df5b5a899.4325.612', time=2019-11-29T15:13:12.325084+0000, chain.objs.size()=19 2019-11-29T13:37:31.779 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:31.775+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.28__multipart_key1.2~fhttJRFMmEuhsq06O5CdfLJcI3Nt-NY.1 2019-11-29T13:37:31.780 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:31.775+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.28__shadow_key1.2~fhttJRFMmEuhsq06O5CdfLJcI3Nt-NY.1_1 2019-11-29T13:37:31.780 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:31.775+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.28__multipart_key1.2~fhttJRFMmEuhsq06O5CdfLJcI3Nt-NY.2 2019-11-29T13:37:31.780 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:31.775+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.28__shadow_key1.2~fhttJRFMmEuhsq06O5CdfLJcI3Nt-NY.2_1 2019-11-29T13:37:31.780 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:31.775+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.28__multipart_key1.2~fhttJRFMmEuhsq06O5CdfLJcI3Nt-NY.3 2019-11-29T13:37:31.780 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:31.775+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.28__shadow_key1.2~fhttJRFMmEuhsq06O5CdfLJcI3Nt-NY.3_1 2019-11-29T13:37:31.781 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:31.775+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.28__multipart_key1.2~fhttJRFMmEuhsq06O5CdfLJcI3Nt-NY.4 2019-11-29T13:37:31.781 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:31.775+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.28__shadow_key1.2~fhttJRFMmEuhsq06O5CdfLJcI3Nt-NY.4_1 2019-11-29T13:37:31.781 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:31.775+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.28__multipart_key1.2~fhttJRFMmEuhsq06O5CdfLJcI3Nt-NY.5 2019-11-29T13:37:31.781 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:31.775+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.28__shadow_key1.2~fhttJRFMmEuhsq06O5CdfLJcI3Nt-NY.5_1 2019-11-29T13:37:31.781 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:31.775+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.28__multipart_key1.2~fhttJRFMmEuhsq06O5CdfLJcI3Nt-NY.6 2019-11-29T13:37:31.781 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:31.775+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.28__shadow_key1.2~fhttJRFMmEuhsq06O5CdfLJcI3Nt-NY.6_1 2019-11-29T13:37:31.993 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:31.989+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.28__multipart_key1.2~fhttJRFMmEuhsq06O5CdfLJcI3Nt-NY.7 2019-11-29T13:37:31.995 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:31.991+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.28__shadow_key1.2~fhttJRFMmEuhsq06O5CdfLJcI3Nt-NY.7_1 2019-11-29T13:37:32.122 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:32.118+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.28__multipart_key1.2~fhttJRFMmEuhsq06O5CdfLJcI3Nt-NY.8 2019-11-29T13:37:32.123 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:32.118+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.28__shadow_key1.2~fhttJRFMmEuhsq06O5CdfLJcI3Nt-NY.8_1 2019-11-29T13:37:32.123 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:32.118+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.28__multipart_key1.2~fhttJRFMmEuhsq06O5CdfLJcI3Nt-NY.9 2019-11-29T13:37:32.123 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:32.118+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.28__shadow_key1.2~fhttJRFMmEuhsq06O5CdfLJcI3Nt-NY.9_1 2019-11-29T13:37:32.123 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:32.118+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.28__multipart_key1.2~fhttJRFMmEuhsq06O5CdfLJcI3Nt-NY.10 2019-11-29T13:37:32.148 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:32.144+0000 7f445038aec0 20 garbage collection: RGWGC::process iterating over entry tag='2~Pef1FuxlqP9wd97AxWcMcHE7xa3mAW8', time=2019-11-29T15:37:01.796736+0000, chain.objs.size()=0 2019-11-29T13:37:32.422 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:32.418+0000 7f445038aec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-29T13:37:32.523 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:32.519+0000 7f445038aec0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2019-11-29T13:37:32.568 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:32.564+0000 7f445038aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:32.589 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:32.584+0000 7f445038aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:37:32.604 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:32.600+0000 7f445038aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-29T13:37:32.605 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:32.600+0000 7f445038aec0 20 garbage collection: RGWGC::process iterating over entry tag='7f922895-c6d7-4b1b-a19c-be3df5b5a899.4325.620', time=2019-11-29T15:15:05.962074+0000, chain.objs.size()=16 2019-11-29T13:37:32.605 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:32.600+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.28__multipart_key1.2~Rkq0Qva6B4OEZD4Vv-X7LHBQnXGrFP6.1 2019-11-29T13:37:32.605 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:32.600+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.28__shadow_key1.2~Rkq0Qva6B4OEZD4Vv-X7LHBQnXGrFP6.1_1 2019-11-29T13:37:32.605 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:32.600+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.28__shadow_key1.2~Rkq0Qva6B4OEZD4Vv-X7LHBQnXGrFP6.1_2 2019-11-29T13:37:32.605 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:32.600+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.28__multipart_key1.2~Rkq0Qva6B4OEZD4Vv-X7LHBQnXGrFP6.2 2019-11-29T13:37:32.605 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:32.600+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.28__shadow_key1.2~Rkq0Qva6B4OEZD4Vv-X7LHBQnXGrFP6.2_1 2019-11-29T13:37:32.606 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:32.600+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.28__shadow_key1.2~Rkq0Qva6B4OEZD4Vv-X7LHBQnXGrFP6.2_2 2019-11-29T13:37:32.606 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:32.600+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.28__multipart_key1.2~Rkq0Qva6B4OEZD4Vv-X7LHBQnXGrFP6.3 2019-11-29T13:37:32.606 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:32.600+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.28__shadow_key1.2~Rkq0Qva6B4OEZD4Vv-X7LHBQnXGrFP6.3_1 2019-11-29T13:37:32.606 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:32.600+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.28__shadow_key1.2~Rkq0Qva6B4OEZD4Vv-X7LHBQnXGrFP6.3_2 2019-11-29T13:37:32.606 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:32.600+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.28__multipart_key1.2~Rkq0Qva6B4OEZD4Vv-X7LHBQnXGrFP6.4 2019-11-29T13:37:32.606 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:32.600+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.28__shadow_key1.2~Rkq0Qva6B4OEZD4Vv-X7LHBQnXGrFP6.4_1 2019-11-29T13:37:32.606 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:32.600+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.28__shadow_key1.2~Rkq0Qva6B4OEZD4Vv-X7LHBQnXGrFP6.4_2 2019-11-29T13:37:32.998 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:32.994+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.28__multipart_key1.2~Rkq0Qva6B4OEZD4Vv-X7LHBQnXGrFP6.5 2019-11-29T13:37:32.999 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:32.994+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.28__shadow_key1.2~Rkq0Qva6B4OEZD4Vv-X7LHBQnXGrFP6.5_1 2019-11-29T13:37:33.000 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:32.996+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.28__shadow_key1.2~Rkq0Qva6B4OEZD4Vv-X7LHBQnXGrFP6.5_2 2019-11-29T13:37:33.024 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:33.019+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.28__multipart_key1.2~Rkq0Qva6B4OEZD4Vv-X7LHBQnXGrFP6.6 2019-11-29T13:37:33.200 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:33.196+0000 7f445038aec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-29T13:37:33.300 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:33.296+0000 7f445038aec0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2019-11-29T13:37:33.367 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:33.362+0000 7f445038aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:33.406 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:33.401+0000 7f445038aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:37:33.418 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:33.414+0000 7f445038aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:33.449 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:33.445+0000 7f445038aec0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2019-11-29T13:37:33.530 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:33.526+0000 7f445038aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:33.563 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:33.559+0000 7f445038aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:37:33.575 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:33.570+0000 7f445038aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:33.613 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:33.609+0000 7f445038aec0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2019-11-29T13:37:33.669 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:33.664+0000 7f445038aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:33.694 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:33.690+0000 7f445038aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:37:33.716 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:33.712+0000 7f445038aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-29T13:37:33.717 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:33.712+0000 7f445038aec0 20 garbage collection: RGWGC::process iterating over entry tag='7f922895-c6d7-4b1b-a19c-be3df5b5a899.4325.438', time=2019-11-29T14:58:18.195006+0000, chain.objs.size()=9 2019-11-29T13:37:33.717 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:33.712+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.20__multipart_key1.2~7_lC8kdKgvVq1f7ldbiTT2_3GYOZQCR.1 2019-11-29T13:37:33.717 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:33.712+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.20__shadow_key1.2~7_lC8kdKgvVq1f7ldbiTT2_3GYOZQCR.1_1 2019-11-29T13:37:33.717 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:33.712+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.20__multipart_key1.2~7_lC8kdKgvVq1f7ldbiTT2_3GYOZQCR.2 2019-11-29T13:37:33.717 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:33.712+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.20__shadow_key1.2~7_lC8kdKgvVq1f7ldbiTT2_3GYOZQCR.2_1 2019-11-29T13:37:33.717 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:33.712+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.20__multipart_key1.2~7_lC8kdKgvVq1f7ldbiTT2_3GYOZQCR.3 2019-11-29T13:37:33.717 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:33.712+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.20__shadow_key1.2~7_lC8kdKgvVq1f7ldbiTT2_3GYOZQCR.3_1 2019-11-29T13:37:33.718 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:33.712+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.20__multipart_key1.2~7_lC8kdKgvVq1f7ldbiTT2_3GYOZQCR.4 2019-11-29T13:37:33.718 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:33.712+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.20__shadow_key1.2~7_lC8kdKgvVq1f7ldbiTT2_3GYOZQCR.4_1 2019-11-29T13:37:33.718 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:33.712+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.20__multipart_key1.2~7_lC8kdKgvVq1f7ldbiTT2_3GYOZQCR.5 2019-11-29T13:37:33.962 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:33.957+0000 7f445038aec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-29T13:37:34.047 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:34.043+0000 7f445038aec0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2019-11-29T13:37:34.095 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:34.091+0000 7f445038aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:34.113 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:34.109+0000 7f445038aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:37:34.131 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:34.126+0000 7f445038aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-29T13:37:34.131 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:34.126+0000 7f445038aec0 20 garbage collection: RGWGC::process iterating over entry tag='7f922895-c6d7-4b1b-a19c-be3df5b5a899.4325.666', time=2019-11-29T15:20:54.177812+0000, chain.objs.size()=9 2019-11-29T13:37:34.131 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:34.126+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.30__multipart_key1.2~ZH1U-UR2JltK5AJB2GAxz611sJm2SAf.1 2019-11-29T13:37:34.131 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:34.126+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.30__shadow_key1.2~ZH1U-UR2JltK5AJB2GAxz611sJm2SAf.1_1 2019-11-29T13:37:34.131 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:34.126+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.30__multipart_key1.2~ZH1U-UR2JltK5AJB2GAxz611sJm2SAf.2 2019-11-29T13:37:34.131 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:34.126+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.30__shadow_key1.2~ZH1U-UR2JltK5AJB2GAxz611sJm2SAf.2_1 2019-11-29T13:37:34.132 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:34.126+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.30__multipart_key1.2~ZH1U-UR2JltK5AJB2GAxz611sJm2SAf.3 2019-11-29T13:37:34.132 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:34.126+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.30__shadow_key1.2~ZH1U-UR2JltK5AJB2GAxz611sJm2SAf.3_1 2019-11-29T13:37:34.132 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:34.126+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.30__multipart_key1.2~ZH1U-UR2JltK5AJB2GAxz611sJm2SAf.4 2019-11-29T13:37:34.132 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:34.126+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.30__shadow_key1.2~ZH1U-UR2JltK5AJB2GAxz611sJm2SAf.4_1 2019-11-29T13:37:34.132 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:34.126+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.30__multipart_key1.2~ZH1U-UR2JltK5AJB2GAxz611sJm2SAf.5 2019-11-29T13:37:34.440 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:34.435+0000 7f445038aec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-29T13:37:34.545 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:34.540+0000 7f445038aec0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2019-11-29T13:37:34.591 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:34.586+0000 7f445038aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:34.612 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:34.608+0000 7f445038aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:37:34.652 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:34.647+0000 7f445038aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-11-29T13:37:34.652 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:34.647+0000 7f445038aec0 20 garbage collection: RGWGC::process iterating over entry tag='2~R0u9PFjbvQy3XTP56091Xb198Zj22xa', time=2019-11-29T14:53:17.406563+0000, chain.objs.size()=9 2019-11-29T13:37:34.652 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:34.647+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.13__multipart_key1.2~R0u9PFjbvQy3XTP56091Xb198Zj22xa.1 2019-11-29T13:37:34.652 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:34.647+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.13__shadow_key1.2~R0u9PFjbvQy3XTP56091Xb198Zj22xa.1_1 2019-11-29T13:37:34.652 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:34.647+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.13__multipart_key1.2~R0u9PFjbvQy3XTP56091Xb198Zj22xa.2 2019-11-29T13:37:34.653 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:34.647+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.13__shadow_key1.2~R0u9PFjbvQy3XTP56091Xb198Zj22xa.2_1 2019-11-29T13:37:34.653 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:34.647+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.13__multipart_key1.2~R0u9PFjbvQy3XTP56091Xb198Zj22xa.3 2019-11-29T13:37:34.653 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:34.647+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.13__shadow_key1.2~R0u9PFjbvQy3XTP56091Xb198Zj22xa.3_1 2019-11-29T13:37:34.653 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:34.647+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.13__multipart_key1.2~R0u9PFjbvQy3XTP56091Xb198Zj22xa.4 2019-11-29T13:37:34.653 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:34.647+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.13__shadow_key1.2~R0u9PFjbvQy3XTP56091Xb198Zj22xa.4_1 2019-11-29T13:37:34.653 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:34.647+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.13__multipart_key1.2~R0u9PFjbvQy3XTP56091Xb198Zj22xa.5 2019-11-29T13:37:34.653 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:34.647+0000 7f445038aec0 20 garbage collection: RGWGC::process iterating over entry tag='7f922895-c6d7-4b1b-a19c-be3df5b5a899.4325.509', time=2019-11-29T15:01:38.782497+0000, chain.objs.size()=9 2019-11-29T13:37:34.654 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:34.647+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.24__multipart_key1.2~nCThNLcjWxOGVeND_dUFWdh5A5Zd1XQ.1 2019-11-29T13:37:34.654 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:34.647+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.24__shadow_key1.2~nCThNLcjWxOGVeND_dUFWdh5A5Zd1XQ.1_1 2019-11-29T13:37:34.654 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:34.647+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.24__multipart_key1.2~nCThNLcjWxOGVeND_dUFWdh5A5Zd1XQ.2 2019-11-29T13:37:34.812 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:34.808+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.24__shadow_key1.2~nCThNLcjWxOGVeND_dUFWdh5A5Zd1XQ.2_1 2019-11-29T13:37:34.903 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:34.898+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.24__multipart_key1.2~nCThNLcjWxOGVeND_dUFWdh5A5Zd1XQ.3 2019-11-29T13:37:34.962 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:34.957+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.24__shadow_key1.2~nCThNLcjWxOGVeND_dUFWdh5A5Zd1XQ.3_1 2019-11-29T13:37:34.962 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:34.957+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.24__multipart_key1.2~nCThNLcjWxOGVeND_dUFWdh5A5Zd1XQ.4 2019-11-29T13:37:34.962 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:34.957+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.24__shadow_key1.2~nCThNLcjWxOGVeND_dUFWdh5A5Zd1XQ.4_1 2019-11-29T13:37:34.962 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:34.957+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.24__multipart_key1.2~nCThNLcjWxOGVeND_dUFWdh5A5Zd1XQ.5 2019-11-29T13:37:35.261 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:35.257+0000 7f445038aec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-29T13:37:35.347 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:35.343+0000 7f445038aec0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2019-11-29T13:37:35.395 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:35.391+0000 7f445038aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:35.410 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:35.406+0000 7f445038aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:37:35.424 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:35.419+0000 7f445038aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-29T13:37:35.424 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:35.419+0000 7f445038aec0 20 garbage collection: RGWGC::process iterating over entry tag='2~plwJB4VQQvvzOv9xw4U23X7aiFlynzp', time=2019-11-29T15:04:40.281496+0000, chain.objs.size()=5 2019-11-29T13:37:35.424 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:35.419+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.27__multipart_key1.2~plwJB4VQQvvzOv9xw4U23X7aiFlynzp.7 2019-11-29T13:37:35.424 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:35.419+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.27__shadow_key1.2~plwJB4VQQvvzOv9xw4U23X7aiFlynzp.7_1 2019-11-29T13:37:35.425 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:35.419+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.27__multipart_key1.2~plwJB4VQQvvzOv9xw4U23X7aiFlynzp.10 2019-11-29T13:37:35.425 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:35.419+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.27__shadow_key1.2~plwJB4VQQvvzOv9xw4U23X7aiFlynzp.10_1 2019-11-29T13:37:35.425 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:35.419+0000 7f445038aec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.27__multipart_key1.2~plwJB4VQQvvzOv9xw4U23X7aiFlynzp.13 2019-11-29T13:37:35.561 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:35.556+0000 7f445038aec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-29T13:37:35.643 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:35.638+0000 7f445038aec0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2019-11-29T13:37:35.700 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:35.695+0000 7f445038aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:35.723 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:35.719+0000 7f445038aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:37:35.736 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:35.731+0000 7f445038aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:35.782 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:35.778+0000 7f445038aec0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2019-11-29T13:37:35.847 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:35.843+0000 7f445038aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:35.865 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:35.861+0000 7f445038aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:37:35.874 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:35.870+0000 7f445038aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:35.978 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:35.973+0000 7f445038aec0 20 remove_watcher() i=0 2019-11-29T13:37:35.978 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:35.973+0000 7f445038aec0 2 removed watcher, disabling cache 2019-11-29T13:37:36.049 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:36.044+0000 7f445038aec0 20 remove_watcher() i=1 2019-11-29T13:37:36.111 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:36.107+0000 7f445038aec0 20 remove_watcher() i=2 2019-11-29T13:37:36.191 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:36.186+0000 7f445038aec0 20 remove_watcher() i=3 2019-11-29T13:37:36.237 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:36.233+0000 7f445038aec0 20 remove_watcher() i=4 2019-11-29T13:37:36.280 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:36.276+0000 7f445038aec0 20 remove_watcher() i=5 2019-11-29T13:37:36.341 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:36.336+0000 7f445038aec0 20 remove_watcher() i=6 2019-11-29T13:37:36.404 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:36.399+0000 7f445038aec0 20 remove_watcher() i=7 2019-11-29T13:37:36.412 INFO:teuthology.orchestra.run.smithi062:> radosgw-admin gc process --include-all 2019-11-29T13:37:36.534 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:36.529+0000 7fcd9b68dec0 20 rados->read ofs=0 len=0 2019-11-29T13:37:36.584 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:36.579+0000 7fcd9b68dec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T13:37:36.584 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:36.579+0000 7fcd9b68dec0 20 rados->read ofs=0 len=0 2019-11-29T13:37:36.593 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:36.588+0000 7fcd9b68dec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T13:37:36.593 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:36.588+0000 7fcd9b68dec0 20 rados->read ofs=0 len=0 2019-11-29T13:37:36.601 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:36.597+0000 7fcd9b68dec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T13:37:36.601 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:36.597+0000 7fcd9b68dec0 20 rados->read ofs=0 len=0 2019-11-29T13:37:36.627 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:36.623+0000 7fcd9b68dec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T13:37:37.008 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:37.004+0000 7fcd9b68dec0 20 RGWRados::pool_iterate: got zone_info.7f922895-c6d7-4b1b-a19c-be3df5b5a899 2019-11-29T13:37:37.009 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:37.004+0000 7fcd9b68dec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-29T13:37:37.009 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:37.004+0000 7fcd9b68dec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-29T13:37:37.009 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:37.004+0000 7fcd9b68dec0 20 RGWRados::pool_iterate: got zonegroup_info.76ba47ff-1c23-4409-aae0-24fe26589cae 2019-11-29T13:37:37.009 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:37.004+0000 7fcd9b68dec0 20 rados->read ofs=0 len=0 2019-11-29T13:37:37.019 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:37.014+0000 7fcd9b68dec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T13:37:37.019 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:37.014+0000 7fcd9b68dec0 20 rados->read ofs=0 len=0 2019-11-29T13:37:37.030 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:37.025+0000 7fcd9b68dec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-29T13:37:37.030 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:37.025+0000 7fcd9b68dec0 20 rados->read ofs=0 len=0 2019-11-29T13:37:37.039 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:37.035+0000 7fcd9b68dec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T13:37:37.040 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:37.035+0000 7fcd9b68dec0 20 rados->read ofs=0 len=0 2019-11-29T13:37:37.049 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:37.045+0000 7fcd9b68dec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-29T13:37:37.049 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:37.045+0000 7fcd9b68dec0 20 rados->read ofs=0 len=0 2019-11-29T13:37:37.056 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:37.052+0000 7fcd9b68dec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T13:37:37.057 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:37.052+0000 7fcd9b68dec0 10 cannot find current period zonegroup using local zonegroup 2019-11-29T13:37:37.057 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:37.052+0000 7fcd9b68dec0 20 rados->read ofs=0 len=0 2019-11-29T13:37:37.063 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:37.059+0000 7fcd9b68dec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T13:37:37.063 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:37.059+0000 7fcd9b68dec0 20 rados->read ofs=0 len=0 2019-11-29T13:37:37.079 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:37.075+0000 7fcd9b68dec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T13:37:37.079 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:37.075+0000 7fcd9b68dec0 20 rados->read ofs=0 len=0 2019-11-29T13:37:37.099 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:37.094+0000 7fcd9b68dec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-29T13:37:37.099 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:37.094+0000 7fcd9b68dec0 20 zonegroup default 2019-11-29T13:37:37.099 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:37.094+0000 7fcd9b68dec0 20 rados->read ofs=0 len=0 2019-11-29T13:37:37.111 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:37.107+0000 7fcd9b68dec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T13:37:37.111 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:37.107+0000 7fcd9b68dec0 10 Cannot find current period zone using local zone 2019-11-29T13:37:37.111 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:37.107+0000 7fcd9b68dec0 20 rados->read ofs=0 len=0 2019-11-29T13:37:37.119 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:37.114+0000 7fcd9b68dec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T13:37:37.119 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:37.114+0000 7fcd9b68dec0 20 rados->read ofs=0 len=0 2019-11-29T13:37:37.133 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:37.129+0000 7fcd9b68dec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T13:37:37.133 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:37.129+0000 7fcd9b68dec0 20 rados->read ofs=0 len=0 2019-11-29T13:37:37.146 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:37.141+0000 7fcd9b68dec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-29T13:37:37.146 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:37.141+0000 7fcd9b68dec0 20 zone default found 2019-11-29T13:37:37.147 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:37.141+0000 7fcd9b68dec0 20 started sync module instance, tier type = 2019-11-29T13:37:37.147 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:37.141+0000 7fcd9b68dec0 20 started zone id=7f922895-c6d7-4b1b-a19c-be3df5b5a899 (name=default) with tier type = 2019-11-29T13:37:37.524 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:37.520+0000 7fcd888ba700 0 -- 172.21.15.62:0/4208762895 >> [v2:172.21.15.62:6800/10370,v1:172.21.15.62:6801/10370] conn(0x7fcd7400f040 msgr2=0x7fcd74011460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-29T13:37:37.525 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:37.520+0000 7fcd9b68dec0 20 add_watcher() i=0 2019-11-29T13:37:37.525 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:37.520+0000 7fcd9b68dec0 20 add_watcher() i=1 2019-11-29T13:37:37.525 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:37.520+0000 7fcd9b68dec0 20 add_watcher() i=2 2019-11-29T13:37:37.525 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:37.520+0000 7fcd9b68dec0 20 add_watcher() i=3 2019-11-29T13:37:37.525 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:37.520+0000 7fcd9b68dec0 20 add_watcher() i=4 2019-11-29T13:37:37.525 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:37.520+0000 7fcd9b68dec0 20 add_watcher() i=5 2019-11-29T13:37:37.526 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:37.520+0000 7fcd9b68dec0 20 add_watcher() i=6 2019-11-29T13:37:37.614 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:37.609+0000 7fcd9b68dec0 20 add_watcher() i=7 2019-11-29T13:37:37.614 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:37.609+0000 7fcd9b68dec0 2 all 8 watchers are set, enabling cache 2019-11-29T13:37:37.614 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:37.609+0000 7fcd58fe1700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-29T13:37:37.630 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:37.626+0000 7fcd890bb700 0 -- 172.21.15.62:0/3282443597 >> v1:172.21.15.22:6789/0 conn(0x55cee8d6f9f0 legacy=0x55cee8d6ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2019-11-29T13:37:38.964 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:38.959+0000 7fcccaffd700 20 reqs_thread_entry: start 2019-11-29T13:37:38.964 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:38.959+0000 7fccc8ff9700 20 reqs_thread_entry: start 2019-11-29T13:37:38.964 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:38.959+0000 7fcd9b68dec0 20 init_complete bucket index max shards: 0 2019-11-29T13:37:38.965 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:38.960+0000 7fccbeffd700 20 reqs_thread_entry: start 2019-11-29T13:37:38.965 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:38.960+0000 7fcd9b68dec0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2019-11-29T13:37:39.012 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:39.007+0000 7fcd9b68dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:39.030 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:39.026+0000 7fcd9b68dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:37:39.039 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:39.035+0000 7fcd9b68dec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:39.078 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:39.073+0000 7fcd9b68dec0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2019-11-29T13:37:39.127 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:39.123+0000 7fcd9b68dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:39.171 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:39.167+0000 7fcd9b68dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:37:39.182 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:39.178+0000 7fcd9b68dec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:39.223 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:39.219+0000 7fcd9b68dec0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2019-11-29T13:37:39.276 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:39.271+0000 7fcd9b68dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:39.293 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:39.289+0000 7fcd9b68dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:37:39.303 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:39.298+0000 7fcd9b68dec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:39.344 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:39.340+0000 7fcd9b68dec0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2019-11-29T13:37:39.409 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:39.405+0000 7fcd9b68dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:39.430 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:39.426+0000 7fcd9b68dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:37:39.443 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:39.438+0000 7fcd9b68dec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:39.493 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:39.488+0000 7fcd9b68dec0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2019-11-29T13:37:39.538 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:39.533+0000 7fcd9b68dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:39.555 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:39.551+0000 7fcd9b68dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:37:39.566 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:39.561+0000 7fcd9b68dec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:39.613 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:39.609+0000 7fcd9b68dec0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2019-11-29T13:37:39.706 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:39.702+0000 7fcd9b68dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:39.731 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:39.726+0000 7fcd9b68dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:37:39.750 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:39.746+0000 7fcd9b68dec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:39.806 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:39.802+0000 7fcd9b68dec0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2019-11-29T13:37:39.879 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:39.875+0000 7fcd9b68dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:39.897 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:39.893+0000 7fcd9b68dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:37:39.909 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:39.905+0000 7fcd9b68dec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:39.953 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:39.948+0000 7fcd9b68dec0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2019-11-29T13:37:39.996 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:39.991+0000 7fcd9b68dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:40.011 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:40.007+0000 7fcd9b68dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:37:40.020 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:40.015+0000 7fcd9b68dec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:40.087 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:40.083+0000 7fcd9b68dec0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2019-11-29T13:37:40.156 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:40.151+0000 7fcd9b68dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:40.194 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:40.190+0000 7fcd9b68dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:37:40.213 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:40.209+0000 7fcd9b68dec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:40.249 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:40.245+0000 7fcd9b68dec0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2019-11-29T13:37:40.337 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:40.332+0000 7fcd9b68dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:40.371 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:40.366+0000 7fcd9b68dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:37:40.386 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:40.382+0000 7fcd9b68dec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:40.420 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:40.416+0000 7fcd9b68dec0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2019-11-29T13:37:40.491 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:40.486+0000 7fcd9b68dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:40.511 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:40.507+0000 7fcd9b68dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:37:40.522 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:40.517+0000 7fcd9b68dec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:40.566 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:40.561+0000 7fcd9b68dec0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2019-11-29T13:37:40.735 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:40.731+0000 7fcd9b68dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:40.768 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:40.763+0000 7fcd9b68dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:37:40.792 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:40.788+0000 7fcd9b68dec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:40.867 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:40.862+0000 7fcd9b68dec0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2019-11-29T13:37:40.949 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:40.945+0000 7fcd9b68dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:40.975 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:40.970+0000 7fcd9b68dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:37:40.987 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:40.982+0000 7fcd9b68dec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:41.038 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:41.033+0000 7fcd9b68dec0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2019-11-29T13:37:41.091 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:41.086+0000 7fcd9b68dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:41.111 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:41.107+0000 7fcd9b68dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:37:41.119 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:41.114+0000 7fcd9b68dec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:41.179 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:41.175+0000 7fcd9b68dec0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2019-11-29T13:37:41.233 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:41.228+0000 7fcd9b68dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:41.253 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:41.249+0000 7fcd9b68dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:37:41.266 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:41.262+0000 7fcd9b68dec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:41.306 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:41.301+0000 7fcd9b68dec0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2019-11-29T13:37:41.358 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:41.353+0000 7fcd9b68dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:41.393 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:41.389+0000 7fcd9b68dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:37:41.410 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:41.406+0000 7fcd9b68dec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:41.451 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:41.446+0000 7fcd9b68dec0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2019-11-29T13:37:41.499 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:41.494+0000 7fcd9b68dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:41.515 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:41.510+0000 7fcd9b68dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:37:41.524 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:41.519+0000 7fcd9b68dec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:41.562 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:41.557+0000 7fcd9b68dec0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2019-11-29T13:37:41.614 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:41.609+0000 7fcd9b68dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:41.643 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:41.639+0000 7fcd9b68dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:37:41.652 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:41.648+0000 7fcd9b68dec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:41.736 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:41.731+0000 7fcd9b68dec0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2019-11-29T13:37:41.792 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:41.787+0000 7fcd9b68dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:41.813 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:41.808+0000 7fcd9b68dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:37:41.823 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:41.819+0000 7fcd9b68dec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:41.855 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:41.851+0000 7fcd9b68dec0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2019-11-29T13:37:41.919 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:41.915+0000 7fcd9b68dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:41.951 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:41.947+0000 7fcd9b68dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:37:41.960 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:41.956+0000 7fcd9b68dec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:42.009 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:41.999+0000 7fcd9b68dec0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2019-11-29T13:37:42.109 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:42.105+0000 7fcd9b68dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:42.157 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:42.153+0000 7fcd9b68dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:37:42.169 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:42.164+0000 7fcd9b68dec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:42.210 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:42.205+0000 7fcd9b68dec0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2019-11-29T13:37:42.253 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:42.249+0000 7fcd9b68dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:42.274 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:42.270+0000 7fcd9b68dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:37:42.286 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:42.282+0000 7fcd9b68dec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:42.333 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:42.328+0000 7fcd9b68dec0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2019-11-29T13:37:42.380 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:42.376+0000 7fcd9b68dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:42.400 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:42.396+0000 7fcd9b68dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:37:42.412 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:42.408+0000 7fcd9b68dec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:42.452 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:42.448+0000 7fcd9b68dec0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2019-11-29T13:37:42.510 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:42.505+0000 7fcd9b68dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:42.533 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:42.528+0000 7fcd9b68dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:37:42.547 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:42.543+0000 7fcd9b68dec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:42.597 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:42.592+0000 7fcd9b68dec0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2019-11-29T13:37:42.651 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:42.647+0000 7fcd9b68dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:42.680 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:42.676+0000 7fcd9b68dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:37:42.694 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:42.689+0000 7fcd9b68dec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:42.746 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:42.742+0000 7fcd9b68dec0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2019-11-29T13:37:42.808 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:42.804+0000 7fcd9b68dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:42.833 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:42.828+0000 7fcd9b68dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:37:42.845 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:42.841+0000 7fcd9b68dec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:43.081 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:43.077+0000 7fcd9b68dec0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2019-11-29T13:37:43.138 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:43.134+0000 7fcd9b68dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:43.154 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:43.150+0000 7fcd9b68dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:37:43.163 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:43.159+0000 7fcd9b68dec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:43.201 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:43.196+0000 7fcd9b68dec0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2019-11-29T13:37:43.251 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:43.246+0000 7fcd9b68dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:43.268 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:43.263+0000 7fcd9b68dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:37:43.279 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:43.275+0000 7fcd9b68dec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:43.310 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:43.306+0000 7fcd9b68dec0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2019-11-29T13:37:43.359 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:43.355+0000 7fcd9b68dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:43.390 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:43.385+0000 7fcd9b68dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:37:43.398 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:43.394+0000 7fcd9b68dec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:43.458 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:43.454+0000 7fcd9b68dec0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2019-11-29T13:37:43.522 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:43.517+0000 7fcd9b68dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:43.548 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:43.544+0000 7fcd9b68dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:37:43.568 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:43.564+0000 7fcd9b68dec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:43.623 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:43.619+0000 7fcd9b68dec0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2019-11-29T13:37:43.688 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:43.683+0000 7fcd9b68dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:43.726 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:43.721+0000 7fcd9b68dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:37:43.745 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:43.741+0000 7fcd9b68dec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:43.806 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:43.802+0000 7fcd9b68dec0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2019-11-29T13:37:43.854 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:43.849+0000 7fcd9b68dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:43.870 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:43.865+0000 7fcd9b68dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:37:43.878 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:43.874+0000 7fcd9b68dec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:43.957 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:43.953+0000 7fcd9b68dec0 20 remove_watcher() i=0 2019-11-29T13:37:43.957 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:43.953+0000 7fcd9b68dec0 2 removed watcher, disabling cache 2019-11-29T13:37:44.000 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:43.995+0000 7fcd9b68dec0 20 remove_watcher() i=1 2019-11-29T13:37:44.041 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:44.036+0000 7fcd9b68dec0 20 remove_watcher() i=2 2019-11-29T13:37:44.076 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:44.072+0000 7fcd9b68dec0 20 remove_watcher() i=3 2019-11-29T13:37:44.116 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:44.111+0000 7fcd9b68dec0 20 remove_watcher() i=4 2019-11-29T13:37:44.155 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:44.150+0000 7fcd9b68dec0 20 remove_watcher() i=5 2019-11-29T13:37:44.183 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:44.179+0000 7fcd9b68dec0 20 remove_watcher() i=6 2019-11-29T13:37:44.218 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:44.213+0000 7fcd9b68dec0 20 remove_watcher() i=7 2019-11-29T13:37:44.224 INFO:teuthology.orchestra.run.smithi062:> radosgw-admin gc process --include-all 2019-11-29T13:37:44.331 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:44.326+0000 7f0456242ec0 20 rados->read ofs=0 len=0 2019-11-29T13:37:44.360 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:44.356+0000 7f0456242ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T13:37:44.360 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:44.356+0000 7f0456242ec0 20 rados->read ofs=0 len=0 2019-11-29T13:37:44.369 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:44.365+0000 7f0456242ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T13:37:44.369 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:44.365+0000 7f0456242ec0 20 rados->read ofs=0 len=0 2019-11-29T13:37:44.380 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:44.376+0000 7f0456242ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T13:37:44.381 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:44.376+0000 7f0456242ec0 20 rados->read ofs=0 len=0 2019-11-29T13:37:44.406 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:44.402+0000 7f0456242ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T13:37:44.636 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:44.631+0000 7f0456242ec0 20 RGWRados::pool_iterate: got zone_info.7f922895-c6d7-4b1b-a19c-be3df5b5a899 2019-11-29T13:37:44.636 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:44.631+0000 7f0456242ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-29T13:37:44.636 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:44.631+0000 7f0456242ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-29T13:37:44.636 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:44.631+0000 7f0456242ec0 20 RGWRados::pool_iterate: got zonegroup_info.76ba47ff-1c23-4409-aae0-24fe26589cae 2019-11-29T13:37:44.636 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:44.631+0000 7f0456242ec0 20 rados->read ofs=0 len=0 2019-11-29T13:37:44.654 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:44.650+0000 7f0456242ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T13:37:44.654 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:44.650+0000 7f0456242ec0 20 rados->read ofs=0 len=0 2019-11-29T13:37:44.685 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:44.681+0000 7f0456242ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-29T13:37:44.685 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:44.681+0000 7f0456242ec0 20 rados->read ofs=0 len=0 2019-11-29T13:37:44.696 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:44.692+0000 7f0456242ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T13:37:44.696 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:44.692+0000 7f0456242ec0 20 rados->read ofs=0 len=0 2019-11-29T13:37:44.707 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:44.702+0000 7f0456242ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-29T13:37:44.707 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:44.702+0000 7f0456242ec0 20 rados->read ofs=0 len=0 2019-11-29T13:37:44.718 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:44.713+0000 7f0456242ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T13:37:44.718 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:44.713+0000 7f0456242ec0 10 cannot find current period zonegroup using local zonegroup 2019-11-29T13:37:44.718 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:44.713+0000 7f0456242ec0 20 rados->read ofs=0 len=0 2019-11-29T13:37:44.726 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:44.722+0000 7f0456242ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T13:37:44.727 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:44.722+0000 7f0456242ec0 20 rados->read ofs=0 len=0 2019-11-29T13:37:44.736 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:44.732+0000 7f0456242ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T13:37:44.736 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:44.732+0000 7f0456242ec0 20 rados->read ofs=0 len=0 2019-11-29T13:37:44.750 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:44.745+0000 7f0456242ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-29T13:37:44.750 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:44.745+0000 7f0456242ec0 20 zonegroup default 2019-11-29T13:37:44.750 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:44.745+0000 7f0456242ec0 20 rados->read ofs=0 len=0 2019-11-29T13:37:44.758 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:44.754+0000 7f0456242ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T13:37:44.758 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:44.754+0000 7f0456242ec0 10 Cannot find current period zone using local zone 2019-11-29T13:37:44.759 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:44.754+0000 7f0456242ec0 20 rados->read ofs=0 len=0 2019-11-29T13:37:44.771 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:44.766+0000 7f0456242ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T13:37:44.771 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:44.766+0000 7f0456242ec0 20 rados->read ofs=0 len=0 2019-11-29T13:37:44.779 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:44.775+0000 7f0456242ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T13:37:44.780 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:44.775+0000 7f0456242ec0 20 rados->read ofs=0 len=0 2019-11-29T13:37:44.789 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:44.785+0000 7f0456242ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-29T13:37:44.790 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:44.785+0000 7f0456242ec0 20 zone default found 2019-11-29T13:37:44.790 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:44.785+0000 7f0456242ec0 20 started sync module instance, tier type = 2019-11-29T13:37:44.790 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:44.785+0000 7f0456242ec0 20 started zone id=7f922895-c6d7-4b1b-a19c-be3df5b5a899 (name=default) with tier type = 2019-11-29T13:37:45.129 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:45.125+0000 7f0456242ec0 20 add_watcher() i=0 2019-11-29T13:37:45.130 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:45.125+0000 7f0456242ec0 20 add_watcher() i=1 2019-11-29T13:37:45.130 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:45.125+0000 7f0456242ec0 20 add_watcher() i=2 2019-11-29T13:37:45.130 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:45.125+0000 7f0456242ec0 20 add_watcher() i=3 2019-11-29T13:37:45.130 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:45.125+0000 7f0456242ec0 20 add_watcher() i=4 2019-11-29T13:37:45.130 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:45.125+0000 7f0456242ec0 20 add_watcher() i=5 2019-11-29T13:37:45.130 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:45.125+0000 7f0456242ec0 20 add_watcher() i=6 2019-11-29T13:37:45.183 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:45.179+0000 7f0456242ec0 20 add_watcher() i=7 2019-11-29T13:37:45.183 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:45.179+0000 7f0456242ec0 2 all 8 watchers are set, enabling cache 2019-11-29T13:37:45.184 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:45.179+0000 7f0413fdf700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-29T13:37:45.190 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:45.186+0000 7f0443c70700 0 -- 172.21.15.62:0/1299135 >> v2:172.21.15.22:3300/0 conn(0x55eb6f983c00 msgr2=0x55eb6f99e5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=0)._try_send injecting socket failure 2019-11-29T13:37:45.393 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:45.388+0000 7f0443c70700 0 --2- 172.21.15.62:0/1299135 >> v2:172.21.15.22:3300/0 conn(0x55eb6f983c00 0x55eb6f99e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2019-11-29T13:37:45.449 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:45.444+0000 7f0442c6e700 0 -- 172.21.15.62:0/1935181851 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55eb6f97cff0 msgr2=0x55eb6f9aee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-29T13:37:46.813 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:46.808+0000 7f03827fc700 20 reqs_thread_entry: start 2019-11-29T13:37:46.814 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:46.809+0000 7f037bfff700 20 reqs_thread_entry: start 2019-11-29T13:37:46.814 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:46.809+0000 7f0456242ec0 20 init_complete bucket index max shards: 0 2019-11-29T13:37:46.814 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:46.809+0000 7f037a7fc700 20 reqs_thread_entry: start 2019-11-29T13:37:46.814 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:46.809+0000 7f0456242ec0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2019-11-29T13:37:46.888 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:46.884+0000 7f0456242ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:46.934 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:46.930+0000 7f0456242ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:37:46.943 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:46.939+0000 7f0456242ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:46.983 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:46.976+0000 7f0456242ec0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2019-11-29T13:37:47.028 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:47.024+0000 7f0456242ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:47.044 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:47.040+0000 7f0456242ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:37:47.053 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:47.049+0000 7f0456242ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:47.098 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:47.094+0000 7f0456242ec0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2019-11-29T13:37:47.155 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:47.151+0000 7f0456242ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:47.181 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:47.177+0000 7f0456242ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:37:47.195 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:47.189+0000 7f0456242ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:47.246 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:47.242+0000 7f0456242ec0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2019-11-29T13:37:47.316 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:47.311+0000 7f0456242ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:47.342 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:47.337+0000 7f0456242ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:37:47.354 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:47.350+0000 7f0456242ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:47.398 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:47.394+0000 7f0456242ec0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2019-11-29T13:37:47.468 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:47.463+0000 7f0456242ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:47.485 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:47.481+0000 7f0456242ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:37:47.496 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:47.492+0000 7f0456242ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:47.550 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:47.545+0000 7f0456242ec0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2019-11-29T13:37:47.597 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:47.593+0000 7f0456242ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:47.614 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:47.610+0000 7f0456242ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:37:47.623 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:47.619+0000 7f0456242ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:47.671 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:47.667+0000 7f0456242ec0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2019-11-29T13:37:47.730 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:47.725+0000 7f0456242ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:47.779 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:47.775+0000 7f0456242ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:37:47.794 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:47.789+0000 7f0456242ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:47.847 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:47.842+0000 7f0456242ec0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2019-11-29T13:37:47.915 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:47.910+0000 7f0456242ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:47.938 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:47.934+0000 7f0456242ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:37:47.950 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:47.945+0000 7f0456242ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:48.019 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:48.014+0000 7f0456242ec0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2019-11-29T13:37:48.099 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:48.095+0000 7f0456242ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:48.123 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:48.119+0000 7f0456242ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:37:48.140 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:48.136+0000 7f0456242ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:48.206 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:48.202+0000 7f0456242ec0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2019-11-29T13:37:48.245 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:48.240+0000 7f0456242ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:48.261 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:48.257+0000 7f0456242ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:37:48.270 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:48.266+0000 7f0456242ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:48.311 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:48.306+0000 7f0456242ec0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2019-11-29T13:37:48.374 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:48.370+0000 7f0456242ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:48.412 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:48.408+0000 7f0456242ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:37:48.422 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:48.418+0000 7f0456242ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:48.467 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:48.463+0000 7f0456242ec0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2019-11-29T13:37:48.516 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:48.512+0000 7f0456242ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:48.533 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:48.529+0000 7f0456242ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:37:48.542 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:48.538+0000 7f0456242ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:48.583 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:48.579+0000 7f0456242ec0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2019-11-29T13:37:48.659 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:48.655+0000 7f0456242ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:48.675 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:48.671+0000 7f0456242ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:37:48.685 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:48.680+0000 7f0456242ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:48.730 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:48.725+0000 7f0456242ec0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2019-11-29T13:37:48.777 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:48.772+0000 7f0456242ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:48.792 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:48.788+0000 7f0456242ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:37:48.800 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:48.796+0000 7f0456242ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:48.845 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:48.841+0000 7f0456242ec0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2019-11-29T13:37:48.912 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:48.907+0000 7f0456242ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:48.931 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:48.927+0000 7f0456242ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:37:48.941 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:48.936+0000 7f0456242ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:48.986 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:48.982+0000 7f0456242ec0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2019-11-29T13:37:49.078 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:49.073+0000 7f0456242ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:49.100 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:49.096+0000 7f0456242ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:37:49.111 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:49.107+0000 7f0456242ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:49.150 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:49.146+0000 7f0456242ec0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2019-11-29T13:37:49.199 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:49.195+0000 7f0456242ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:49.216 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:49.212+0000 7f0456242ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:37:49.224 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:49.220+0000 7f0456242ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:49.261 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:49.257+0000 7f0456242ec0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2019-11-29T13:37:49.311 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:49.305+0000 7f0456242ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:49.327 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:49.323+0000 7f0456242ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:37:49.339 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:49.335+0000 7f0456242ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:49.376 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:49.367+0000 7f0456242ec0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2019-11-29T13:37:49.414 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:49.410+0000 7f0456242ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:49.429 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:49.425+0000 7f0456242ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:37:49.438 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:49.434+0000 7f0456242ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:49.488 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:49.484+0000 7f0456242ec0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2019-11-29T13:37:49.576 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:49.571+0000 7f0456242ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:49.607 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:49.602+0000 7f0456242ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:37:49.630 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:49.626+0000 7f0456242ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:49.691 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:49.686+0000 7f0456242ec0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2019-11-29T13:37:49.771 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:49.767+0000 7f0456242ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:49.797 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:49.793+0000 7f0456242ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:37:49.807 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:49.803+0000 7f0456242ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:49.853 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:49.849+0000 7f0456242ec0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2019-11-29T13:37:49.915 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:49.910+0000 7f0456242ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:49.937 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:49.933+0000 7f0456242ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:37:49.949 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:49.945+0000 7f0456242ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:49.989 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:49.985+0000 7f0456242ec0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2019-11-29T13:37:50.035 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:50.031+0000 7f0456242ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:50.056 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:50.052+0000 7f0456242ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:37:50.069 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:50.064+0000 7f0456242ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:50.101 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:50.097+0000 7f0456242ec0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2019-11-29T13:37:50.166 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:50.162+0000 7f0456242ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:50.185 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:50.181+0000 7f0456242ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:37:50.195 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:50.191+0000 7f0456242ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:50.257 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:50.252+0000 7f0456242ec0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2019-11-29T13:37:50.312 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:50.308+0000 7f0456242ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:50.341 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:50.337+0000 7f0456242ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:37:50.355 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:50.351+0000 7f0456242ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:50.410 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:50.405+0000 7f0456242ec0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2019-11-29T13:37:50.454 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:50.450+0000 7f0456242ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:50.470 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:50.466+0000 7f0456242ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:37:50.480 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:50.475+0000 7f0456242ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:50.515 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:50.510+0000 7f0456242ec0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2019-11-29T13:37:50.556 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:50.552+0000 7f0456242ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:50.624 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:50.567+0000 7f0456242ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:37:50.625 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:50.577+0000 7f0456242ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:50.627 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:50.606+0000 7f0456242ec0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2019-11-29T13:37:50.653 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:50.648+0000 7f0456242ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:50.672 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:50.668+0000 7f0456242ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:37:50.682 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:50.678+0000 7f0456242ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:50.728 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:50.723+0000 7f0456242ec0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2019-11-29T13:37:50.783 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:50.779+0000 7f0456242ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:50.804 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:50.800+0000 7f0456242ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:37:50.816 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:50.811+0000 7f0456242ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:50.865 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:50.861+0000 7f0456242ec0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2019-11-29T13:37:50.918 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:50.914+0000 7f0456242ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:50.941 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:50.936+0000 7f0456242ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:37:50.954 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:50.950+0000 7f0456242ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:50.988 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:50.983+0000 7f0456242ec0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2019-11-29T13:37:51.043 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:51.038+0000 7f0456242ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:51.065 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:51.061+0000 7f0456242ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:37:51.078 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:51.073+0000 7f0456242ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:51.124 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:51.120+0000 7f0456242ec0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2019-11-29T13:37:51.174 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:51.170+0000 7f0456242ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:51.192 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:51.188+0000 7f0456242ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:37:51.201 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:51.197+0000 7f0456242ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:51.280 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:51.276+0000 7f0456242ec0 20 remove_watcher() i=0 2019-11-29T13:37:51.280 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:51.276+0000 7f0456242ec0 2 removed watcher, disabling cache 2019-11-29T13:37:51.334 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:51.330+0000 7f0456242ec0 20 remove_watcher() i=1 2019-11-29T13:37:51.375 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:51.371+0000 7f0456242ec0 20 remove_watcher() i=2 2019-11-29T13:37:51.422 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:51.418+0000 7f0456242ec0 20 remove_watcher() i=3 2019-11-29T13:37:51.462 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:51.458+0000 7f0456242ec0 20 remove_watcher() i=4 2019-11-29T13:37:51.511 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:51.506+0000 7f0456242ec0 20 remove_watcher() i=5 2019-11-29T13:37:51.546 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:51.542+0000 7f0456242ec0 20 remove_watcher() i=6 2019-11-29T13:37:51.575 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:51.571+0000 7f0456242ec0 20 remove_watcher() i=7 2019-11-29T13:37:51.583 INFO:teuthology.orchestra.run.smithi062:> radosgw-admin gc process --include-all 2019-11-29T13:37:51.699 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:51.694+0000 7fd3847a1ec0 20 rados->read ofs=0 len=0 2019-11-29T13:37:51.738 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:51.733+0000 7fd3847a1ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T13:37:51.738 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:51.733+0000 7fd3847a1ec0 20 rados->read ofs=0 len=0 2019-11-29T13:37:51.750 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:51.746+0000 7fd3847a1ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T13:37:51.750 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:51.746+0000 7fd3847a1ec0 20 rados->read ofs=0 len=0 2019-11-29T13:37:51.757 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:51.753+0000 7fd3847a1ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T13:37:51.757 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:51.753+0000 7fd3847a1ec0 20 rados->read ofs=0 len=0 2019-11-29T13:37:51.774 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:51.770+0000 7fd3847a1ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T13:37:51.973 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:51.969+0000 7fd3847a1ec0 20 RGWRados::pool_iterate: got zone_info.7f922895-c6d7-4b1b-a19c-be3df5b5a899 2019-11-29T13:37:51.973 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:51.969+0000 7fd3847a1ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-29T13:37:51.973 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:51.969+0000 7fd3847a1ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-29T13:37:51.974 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:51.969+0000 7fd3847a1ec0 20 RGWRados::pool_iterate: got zonegroup_info.76ba47ff-1c23-4409-aae0-24fe26589cae 2019-11-29T13:37:51.974 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:51.969+0000 7fd3847a1ec0 20 rados->read ofs=0 len=0 2019-11-29T13:37:51.989 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:51.984+0000 7fd3847a1ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T13:37:51.989 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:51.984+0000 7fd3847a1ec0 20 rados->read ofs=0 len=0 2019-11-29T13:37:52.006 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:52.002+0000 7fd3847a1ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-29T13:37:52.006 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:52.002+0000 7fd3847a1ec0 20 rados->read ofs=0 len=0 2019-11-29T13:37:52.025 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:52.021+0000 7fd3847a1ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T13:37:52.025 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:52.021+0000 7fd3847a1ec0 20 rados->read ofs=0 len=0 2019-11-29T13:37:52.039 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:52.035+0000 7fd3847a1ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-29T13:37:52.039 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:52.035+0000 7fd3847a1ec0 20 rados->read ofs=0 len=0 2019-11-29T13:37:52.051 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:52.047+0000 7fd3847a1ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T13:37:52.051 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:52.047+0000 7fd3847a1ec0 10 cannot find current period zonegroup using local zonegroup 2019-11-29T13:37:52.051 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:52.047+0000 7fd3847a1ec0 20 rados->read ofs=0 len=0 2019-11-29T13:37:52.061 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:52.057+0000 7fd3847a1ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T13:37:52.061 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:52.057+0000 7fd3847a1ec0 20 rados->read ofs=0 len=0 2019-11-29T13:37:52.072 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:52.068+0000 7fd3847a1ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T13:37:52.072 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:52.068+0000 7fd3847a1ec0 20 rados->read ofs=0 len=0 2019-11-29T13:37:52.093 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:52.088+0000 7fd3847a1ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-29T13:37:52.093 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:52.088+0000 7fd3847a1ec0 20 zonegroup default 2019-11-29T13:37:52.093 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:52.088+0000 7fd3847a1ec0 20 rados->read ofs=0 len=0 2019-11-29T13:37:52.102 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:52.098+0000 7fd3847a1ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T13:37:52.102 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:52.098+0000 7fd3847a1ec0 10 Cannot find current period zone using local zone 2019-11-29T13:37:52.102 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:52.098+0000 7fd3847a1ec0 20 rados->read ofs=0 len=0 2019-11-29T13:37:52.114 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:52.110+0000 7fd3847a1ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T13:37:52.114 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:52.110+0000 7fd3847a1ec0 20 rados->read ofs=0 len=0 2019-11-29T13:37:52.127 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:52.122+0000 7fd3847a1ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T13:37:52.127 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:52.122+0000 7fd3847a1ec0 20 rados->read ofs=0 len=0 2019-11-29T13:37:52.140 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:52.136+0000 7fd3847a1ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-29T13:37:52.141 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:52.136+0000 7fd3847a1ec0 20 zone default found 2019-11-29T13:37:52.141 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:52.136+0000 7fd3847a1ec0 20 started sync module instance, tier type = 2019-11-29T13:37:52.141 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:52.136+0000 7fd3847a1ec0 20 started zone id=7f922895-c6d7-4b1b-a19c-be3df5b5a899 (name=default) with tier type = 2019-11-29T13:37:52.528 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:52.523+0000 7fd3847a1ec0 20 add_watcher() i=0 2019-11-29T13:37:52.528 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:52.523+0000 7fd3847a1ec0 20 add_watcher() i=1 2019-11-29T13:37:52.528 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:52.523+0000 7fd3847a1ec0 20 add_watcher() i=2 2019-11-29T13:37:52.528 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:52.523+0000 7fd3847a1ec0 20 add_watcher() i=3 2019-11-29T13:37:52.528 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:52.523+0000 7fd3847a1ec0 20 add_watcher() i=4 2019-11-29T13:37:52.529 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:52.523+0000 7fd3847a1ec0 20 add_watcher() i=5 2019-11-29T13:37:52.537 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:52.533+0000 7fd3847a1ec0 20 add_watcher() i=6 2019-11-29T13:37:52.562 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:52.558+0000 7fd3847a1ec0 20 add_watcher() i=7 2019-11-29T13:37:52.562 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:52.558+0000 7fd3847a1ec0 2 all 8 watchers are set, enabling cache 2019-11-29T13:37:52.563 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:52.558+0000 7fd3427dc700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-29T13:37:52.568 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:52.563+0000 7fd3721cf700 0 -- 172.21.15.62:0/4148918109 >> v2:172.21.15.22:3300/0 conn(0x55742450fe00 msgr2=0x55742453ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2019-11-29T13:37:52.613 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:52.608+0000 7fd3721cf700 0 -- 172.21.15.62:0/1050831828 >> [v2:172.21.15.22:6800/8367,v1:172.21.15.22:6801/8367] conn(0x7fd2b40175a0 msgr2=0x7fd2b4019a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2019-11-29T13:37:54.007 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:54.003+0000 7fd2b8ff9700 20 reqs_thread_entry: start 2019-11-29T13:37:54.007 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:54.003+0000 7fd2b27fc700 20 reqs_thread_entry: start 2019-11-29T13:37:54.008 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:54.003+0000 7fd3847a1ec0 20 init_complete bucket index max shards: 0 2019-11-29T13:37:54.008 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:54.004+0000 7fd2b0ff9700 20 reqs_thread_entry: start 2019-11-29T13:37:54.008 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:54.004+0000 7fd3847a1ec0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2019-11-29T13:37:54.053 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:54.049+0000 7fd3847a1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:54.071 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:54.067+0000 7fd3847a1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:37:54.081 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:54.077+0000 7fd3847a1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:54.112 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:54.107+0000 7fd3847a1ec0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2019-11-29T13:37:54.156 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:54.152+0000 7fd3847a1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:54.172 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:54.168+0000 7fd3847a1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:37:54.184 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:54.180+0000 7fd3847a1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:54.220 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:54.216+0000 7fd3847a1ec0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2019-11-29T13:37:54.280 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:54.276+0000 7fd3847a1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:54.300 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:54.295+0000 7fd3847a1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:37:54.312 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:54.308+0000 7fd3847a1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:54.373 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:54.369+0000 7fd3847a1ec0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2019-11-29T13:37:54.429 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:54.425+0000 7fd3847a1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:54.447 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:54.443+0000 7fd3847a1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:37:54.460 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:54.455+0000 7fd3847a1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:54.510 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:54.506+0000 7fd3847a1ec0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2019-11-29T13:37:54.571 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:54.566+0000 7fd3847a1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:54.591 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:54.587+0000 7fd3847a1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:37:54.601 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:54.596+0000 7fd3847a1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:54.663 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:54.659+0000 7fd3847a1ec0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2019-11-29T13:37:54.718 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:54.713+0000 7fd3847a1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:54.744 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:54.739+0000 7fd3847a1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:37:54.754 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:54.750+0000 7fd3847a1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:54.812 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:54.807+0000 7fd3847a1ec0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2019-11-29T13:37:54.864 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:54.859+0000 7fd3847a1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:54.883 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:54.879+0000 7fd3847a1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:37:54.897 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:54.893+0000 7fd3847a1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:54.935 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:54.931+0000 7fd3847a1ec0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2019-11-29T13:37:54.987 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:54.983+0000 7fd3847a1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:55.004 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:55.000+0000 7fd3847a1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:37:55.012 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:55.008+0000 7fd3847a1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:55.046 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:55.042+0000 7fd3847a1ec0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2019-11-29T13:37:55.094 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:55.089+0000 7fd3847a1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:55.113 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:55.109+0000 7fd3847a1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:37:55.122 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:55.118+0000 7fd3847a1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:55.188 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:55.183+0000 7fd3847a1ec0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2019-11-29T13:37:55.273 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:55.269+0000 7fd3847a1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:55.296 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:55.292+0000 7fd3847a1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:37:55.308 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:55.304+0000 7fd3847a1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:55.353 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:55.348+0000 7fd3847a1ec0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2019-11-29T13:37:55.423 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:55.418+0000 7fd3847a1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:55.459 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:55.454+0000 7fd3847a1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:37:55.472 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:55.468+0000 7fd3847a1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:55.511 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:55.507+0000 7fd3847a1ec0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2019-11-29T13:37:55.585 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:55.581+0000 7fd3847a1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:55.607 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:55.603+0000 7fd3847a1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:37:55.617 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:55.612+0000 7fd3847a1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:55.653 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:55.648+0000 7fd3847a1ec0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2019-11-29T13:37:55.695 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:55.691+0000 7fd3847a1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:55.714 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:55.709+0000 7fd3847a1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:37:55.723 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:55.719+0000 7fd3847a1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:55.762 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:55.753+0000 7fd3847a1ec0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2019-11-29T13:37:55.796 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:55.791+0000 7fd3847a1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:55.816 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:55.809+0000 7fd3847a1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:37:55.822 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:55.817+0000 7fd3847a1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:55.858 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:55.854+0000 7fd3847a1ec0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2019-11-29T13:37:55.905 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:55.901+0000 7fd3847a1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:55.934 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:55.930+0000 7fd3847a1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:37:55.944 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:55.940+0000 7fd3847a1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:56.000 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:55.996+0000 7fd3847a1ec0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2019-11-29T13:37:56.088 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:56.080+0000 7fd3847a1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:56.122 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:56.118+0000 7fd3847a1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:37:56.132 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:56.128+0000 7fd3847a1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:56.178 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:56.174+0000 7fd3847a1ec0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2019-11-29T13:37:56.238 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:56.233+0000 7fd3847a1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:56.259 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:56.254+0000 7fd3847a1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:37:56.267 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:56.263+0000 7fd3847a1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:56.310 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:56.305+0000 7fd3847a1ec0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2019-11-29T13:37:56.373 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:56.369+0000 7fd3847a1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:56.396 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:56.392+0000 7fd3847a1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:37:56.411 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:56.406+0000 7fd3847a1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:56.450 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:56.446+0000 7fd3847a1ec0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2019-11-29T13:37:56.497 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:56.492+0000 7fd3847a1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:56.515 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:56.511+0000 7fd3847a1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:37:56.535 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:56.531+0000 7fd3847a1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:56.586 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:56.581+0000 7fd3847a1ec0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2019-11-29T13:37:56.634 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:56.630+0000 7fd3847a1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:56.659 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:56.655+0000 7fd3847a1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:37:56.674 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:56.666+0000 7fd3847a1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:56.763 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:56.759+0000 7fd3847a1ec0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2019-11-29T13:37:56.820 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:56.816+0000 7fd3847a1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:56.840 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:56.836+0000 7fd3847a1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:37:56.851 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:56.846+0000 7fd3847a1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:56.892 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:56.887+0000 7fd3847a1ec0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2019-11-29T13:37:56.943 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:56.938+0000 7fd3847a1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:56.959 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:56.955+0000 7fd3847a1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:37:56.969 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:56.965+0000 7fd3847a1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:57.008 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:57.002+0000 7fd3847a1ec0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2019-11-29T13:37:57.050 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:57.046+0000 7fd3847a1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:57.104 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:57.099+0000 7fd3847a1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:37:57.114 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:57.110+0000 7fd3847a1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:57.159 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:57.155+0000 7fd3847a1ec0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2019-11-29T13:37:57.232 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:57.228+0000 7fd3847a1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:57.253 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:57.249+0000 7fd3847a1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:37:57.266 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:57.262+0000 7fd3847a1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:57.300 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:57.296+0000 7fd3847a1ec0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2019-11-29T13:37:57.427 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:57.423+0000 7fd3847a1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:57.457 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:57.453+0000 7fd3847a1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:37:57.475 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:57.471+0000 7fd3847a1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:57.517 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:57.513+0000 7fd3847a1ec0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2019-11-29T13:37:57.574 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:57.570+0000 7fd3847a1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:57.590 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:57.586+0000 7fd3847a1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:37:57.600 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:57.595+0000 7fd3847a1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:57.638 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:57.634+0000 7fd3847a1ec0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2019-11-29T13:37:57.697 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:57.692+0000 7fd3847a1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:57.722 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:57.718+0000 7fd3847a1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:37:57.736 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:57.731+0000 7fd3847a1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:57.781 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:57.777+0000 7fd3847a1ec0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2019-11-29T13:37:57.869 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:57.865+0000 7fd3847a1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:57.888 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:57.883+0000 7fd3847a1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:37:57.899 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:57.895+0000 7fd3847a1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:57.971 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:57.967+0000 7fd3847a1ec0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2019-11-29T13:37:58.013 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:58.009+0000 7fd3847a1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:58.029 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:58.025+0000 7fd3847a1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:37:58.039 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:58.034+0000 7fd3847a1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:58.072 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:58.068+0000 7fd3847a1ec0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2019-11-29T13:37:58.146 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:58.142+0000 7fd3847a1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:58.179 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:58.175+0000 7fd3847a1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:37:58.198 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:58.194+0000 7fd3847a1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:58.269 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:58.264+0000 7fd3847a1ec0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2019-11-29T13:37:58.314 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:58.309+0000 7fd3847a1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:58.330 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:58.326+0000 7fd3847a1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:37:58.340 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:58.336+0000 7fd3847a1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:58.374 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:58.370+0000 7fd3847a1ec0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2019-11-29T13:37:58.423 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:58.418+0000 7fd3847a1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:58.439 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:58.434+0000 7fd3847a1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:37:58.447 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:58.443+0000 7fd3847a1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:37:58.587 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:58.583+0000 7fd3847a1ec0 20 remove_watcher() i=0 2019-11-29T13:37:58.588 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:58.583+0000 7fd3847a1ec0 2 removed watcher, disabling cache 2019-11-29T13:37:58.651 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:58.647+0000 7fd3847a1ec0 20 remove_watcher() i=1 2019-11-29T13:37:58.696 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:58.692+0000 7fd3847a1ec0 20 remove_watcher() i=2 2019-11-29T13:37:58.809 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:58.797+0000 7fd3847a1ec0 20 remove_watcher() i=3 2019-11-29T13:37:58.858 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:58.845+0000 7fd3847a1ec0 20 remove_watcher() i=4 2019-11-29T13:37:58.911 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:58.896+0000 7fd3847a1ec0 20 remove_watcher() i=5 2019-11-29T13:37:58.959 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:58.945+0000 7fd3847a1ec0 20 remove_watcher() i=6 2019-11-29T13:37:59.000 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:37:58.990+0000 7fd3847a1ec0 20 remove_watcher() i=7 2019-11-29T13:37:59.007 INFO:teuthology.orchestra.run.smithi062:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle-4.7/bin/gradle clean test --rerun-tasks --no-build-cache --tests BucketTest 2019-11-29T13:37:59.697 INFO:teuthology.orchestra.run.smithi062.stdout:> Task :clean 2019-11-29T13:38:00.394 INFO:teuthology.orchestra.run.smithi062.stdout:> Task :compileJava 2019-11-29T13:38:00.395 INFO:teuthology.orchestra.run.smithi062.stdout:> Task :processResources 2019-11-29T13:38:00.395 INFO:teuthology.orchestra.run.smithi062.stdout:> Task :classes 2019-11-29T13:38:00.695 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T13:38:00.696 INFO:teuthology.orchestra.run.smithi062.stdout:> Task :compileTestJava 2019-11-29T13:38:00.696 INFO:teuthology.orchestra.run.smithi062.stdout:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2019-11-29T13:38:00.696 INFO:teuthology.orchestra.run.smithi062.stdout:Note: Recompile with -Xlint:deprecation for details. 2019-11-29T13:38:00.696 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T13:38:00.696 INFO:teuthology.orchestra.run.smithi062.stdout:> Task :processTestResources NO-SOURCE 2019-11-29T13:38:00.697 INFO:teuthology.orchestra.run.smithi062.stdout:> Task :testClasses 2019-11-29T13:38:03.294 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T13:38:03.294 INFO:teuthology.orchestra.run.smithi062.stdout:> Task :test 2019-11-29T13:38:03.294 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T13:38:03.295 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty STARTED 2019-11-29T13:38:05.494 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T13:38:05.494 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty PASSED 2019-11-29T13:38:10.694 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T13:38:10.694 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch STARTED 2019-11-29T13:38:12.094 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T13:38:12.094 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch PASSED 2019-11-29T13:38:18.794 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T13:38:18.794 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable STARTED 2019-11-29T13:38:21.494 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T13:38:21.494 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable PASSED 2019-11-29T13:38:27.294 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T13:38:27.294 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete STARTED 2019-11-29T13:38:36.694 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T13:38:36.694 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete PASSED 2019-11-29T13:38:37.694 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T13:38:37.694 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty STARTED 2019-11-29T13:38:41.694 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T13:38:41.694 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty PASSED 2019-11-29T13:38:52.494 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T13:38:52.494 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist STARTED 2019-11-29T13:38:52.994 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T13:38:52.994 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist PASSED 2019-11-29T13:38:53.994 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T13:38:53.994 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct STARTED 2019-11-29T13:38:59.894 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T13:38:59.894 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct PASSED 2019-11-29T13:39:13.227 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:01:13:53.887 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T13:39:13.234 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:01:13:53.894 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T13:39:13.246 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:01:13:53.852 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T13:39:13.250 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:01:13:53.856 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T13:39:13.252 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:01:13:53.858 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T13:39:13.254 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:01:13:53.860 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T13:39:13.427 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:01:13:54.086 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T13:39:13.432 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:01:13:54.038 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T13:39:13.489 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:01:13:54.095 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T13:39:14.393 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T13:39:14.394 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty STARTED 2019-11-29T13:39:16.794 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T13:39:16.794 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty PASSED 2019-11-29T13:39:23.994 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T13:39:23.994 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Bucket tests > BucketTest.testBucketNotExist STARTED 2019-11-29T13:39:24.294 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T13:39:24.294 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Bucket tests > BucketTest.testBucketNotExist PASSED 2019-11-29T13:39:25.442 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T13:39:25.442 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------- 2019-11-29T13:39:25.442 INFO:teuthology.orchestra.run.smithi062.stdout:| Results: SUCCESS (9 tests, 9 successes, 0 failures, 0 skipped) | 2019-11-29T13:39:25.443 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------- 2019-11-29T13:39:25.443 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T13:39:25.443 INFO:teuthology.orchestra.run.smithi062.stdout:BUILD SUCCESSFUL in 1m 26s 2019-11-29T13:39:25.443 INFO:teuthology.orchestra.run.smithi062.stdout:5 actionable tasks: 5 executed 2019-11-29T13:39:25.458 INFO:teuthology.orchestra.run.smithi062:> radosgw-admin gc process --include-all 2019-11-29T13:39:25.593 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:25.589+0000 7f462df6dec0 20 rados->read ofs=0 len=0 2019-11-29T13:39:25.628 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:25.624+0000 7f462df6dec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T13:39:25.628 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:25.624+0000 7f462df6dec0 20 rados->read ofs=0 len=0 2019-11-29T13:39:25.640 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:25.636+0000 7f462df6dec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T13:39:25.640 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:25.636+0000 7f462df6dec0 20 rados->read ofs=0 len=0 2019-11-29T13:39:25.653 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:25.649+0000 7f462df6dec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T13:39:25.653 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:25.649+0000 7f462df6dec0 20 rados->read ofs=0 len=0 2019-11-29T13:39:25.682 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:25.678+0000 7f462df6dec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T13:39:25.927 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:25.923+0000 7f462df6dec0 20 RGWRados::pool_iterate: got zone_info.7f922895-c6d7-4b1b-a19c-be3df5b5a899 2019-11-29T13:39:25.927 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:25.923+0000 7f462df6dec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-29T13:39:25.928 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:25.923+0000 7f462df6dec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-29T13:39:25.928 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:25.923+0000 7f462df6dec0 20 RGWRados::pool_iterate: got zonegroup_info.76ba47ff-1c23-4409-aae0-24fe26589cae 2019-11-29T13:39:25.928 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:25.923+0000 7f462df6dec0 20 rados->read ofs=0 len=0 2019-11-29T13:39:25.944 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:25.940+0000 7f462df6dec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T13:39:25.944 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:25.940+0000 7f462df6dec0 20 rados->read ofs=0 len=0 2019-11-29T13:39:25.957 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:25.953+0000 7f462df6dec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-29T13:39:25.957 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:25.953+0000 7f462df6dec0 20 rados->read ofs=0 len=0 2019-11-29T13:39:25.971 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:25.967+0000 7f462df6dec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T13:39:25.971 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:25.967+0000 7f462df6dec0 20 rados->read ofs=0 len=0 2019-11-29T13:39:25.987 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:25.983+0000 7f462df6dec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-29T13:39:25.987 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:25.983+0000 7f462df6dec0 20 rados->read ofs=0 len=0 2019-11-29T13:39:26.002 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:25.998+0000 7f462df6dec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T13:39:26.002 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:25.998+0000 7f462df6dec0 10 cannot find current period zonegroup using local zonegroup 2019-11-29T13:39:26.002 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:25.998+0000 7f462df6dec0 20 rados->read ofs=0 len=0 2019-11-29T13:39:26.009 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:26.005+0000 7f462df6dec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T13:39:26.009 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:26.005+0000 7f462df6dec0 20 rados->read ofs=0 len=0 2019-11-29T13:39:26.025 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:26.021+0000 7f462df6dec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T13:39:26.025 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:26.021+0000 7f462df6dec0 20 rados->read ofs=0 len=0 2019-11-29T13:39:26.040 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:26.036+0000 7f462df6dec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-29T13:39:26.040 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:26.036+0000 7f462df6dec0 20 zonegroup default 2019-11-29T13:39:26.041 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:26.036+0000 7f462df6dec0 20 rados->read ofs=0 len=0 2019-11-29T13:39:26.055 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:26.051+0000 7f462df6dec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T13:39:26.055 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:26.051+0000 7f462df6dec0 10 Cannot find current period zone using local zone 2019-11-29T13:39:26.055 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:26.051+0000 7f462df6dec0 20 rados->read ofs=0 len=0 2019-11-29T13:39:26.063 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:26.059+0000 7f462df6dec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T13:39:26.064 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:26.059+0000 7f462df6dec0 20 rados->read ofs=0 len=0 2019-11-29T13:39:26.082 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:26.078+0000 7f462df6dec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T13:39:26.082 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:26.078+0000 7f462df6dec0 20 rados->read ofs=0 len=0 2019-11-29T13:39:26.095 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:26.091+0000 7f462df6dec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-29T13:39:26.095 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:26.091+0000 7f462df6dec0 20 zone default found 2019-11-29T13:39:26.095 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:26.091+0000 7f462df6dec0 20 started sync module instance, tier type = 2019-11-29T13:39:26.095 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:26.091+0000 7f462df6dec0 20 started zone id=7f922895-c6d7-4b1b-a19c-be3df5b5a899 (name=default) with tier type = 2019-11-29T13:39:26.523 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:26.519+0000 7f462df6dec0 20 add_watcher() i=0 2019-11-29T13:39:26.523 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:26.519+0000 7f462df6dec0 20 add_watcher() i=1 2019-11-29T13:39:26.523 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:26.519+0000 7f462df6dec0 20 add_watcher() i=2 2019-11-29T13:39:26.524 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:26.519+0000 7f462df6dec0 20 add_watcher() i=3 2019-11-29T13:39:26.524 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:26.519+0000 7f462df6dec0 20 add_watcher() i=4 2019-11-29T13:39:26.524 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:26.519+0000 7f462df6dec0 20 add_watcher() i=5 2019-11-29T13:39:26.528 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:26.525+0000 7f462df6dec0 20 add_watcher() i=6 2019-11-29T13:39:26.565 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:26.561+0000 7f462df6dec0 20 add_watcher() i=7 2019-11-29T13:39:26.565 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:26.561+0000 7f462df6dec0 2 all 8 watchers are set, enabling cache 2019-11-29T13:39:26.565 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:26.561+0000 7f45ebfdf700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-29T13:39:26.577 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:26.573+0000 7f461b19a700 0 -- 172.21.15.62:0/4196221035 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x558c403302c0 msgr2=0x558c4031a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-29T13:39:26.605 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:26.601+0000 7f461b99b700 0 -- 172.21.15.62:0/1758082518 >> v1:172.21.15.22:6789/0 conn(0x558c4033da60 legacy=0x558c4033cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2019-11-29T13:39:28.004 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:28.000+0000 7f455a7fc700 20 reqs_thread_entry: start 2019-11-29T13:39:28.005 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:28.000+0000 7f4553fff700 20 reqs_thread_entry: start 2019-11-29T13:39:28.005 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:28.001+0000 7f462df6dec0 20 init_complete bucket index max shards: 0 2019-11-29T13:39:28.005 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:28.001+0000 7f45527fc700 20 reqs_thread_entry: start 2019-11-29T13:39:28.006 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:28.002+0000 7f462df6dec0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2019-11-29T13:39:28.089 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:28.085+0000 7f462df6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:28.113 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:28.109+0000 7f462df6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:39:28.128 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:28.124+0000 7f462df6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:28.187 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:28.183+0000 7f462df6dec0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2019-11-29T13:39:28.259 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:28.255+0000 7f462df6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:28.281 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:28.277+0000 7f462df6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:39:28.294 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:28.290+0000 7f462df6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:28.351 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:28.346+0000 7f462df6dec0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2019-11-29T13:39:28.423 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:28.419+0000 7f462df6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:28.447 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:28.443+0000 7f462df6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:39:28.460 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:28.456+0000 7f462df6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:28.507 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:28.503+0000 7f462df6dec0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2019-11-29T13:39:28.561 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:28.557+0000 7f462df6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:28.587 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:28.583+0000 7f462df6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:39:28.598 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:28.594+0000 7f462df6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:28.653 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:28.648+0000 7f462df6dec0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2019-11-29T13:39:28.723 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:28.719+0000 7f462df6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:28.740 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:28.736+0000 7f462df6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:39:28.748 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:28.744+0000 7f462df6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:28.803 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:28.798+0000 7f462df6dec0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2019-11-29T13:39:28.872 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:28.868+0000 7f462df6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:28.902 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:28.898+0000 7f462df6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:39:28.915 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:28.911+0000 7f462df6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:28.974 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:28.969+0000 7f462df6dec0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2019-11-29T13:39:29.030 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:29.026+0000 7f462df6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:29.048 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:29.044+0000 7f462df6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:39:29.058 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:29.054+0000 7f462df6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:29.106 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:29.102+0000 7f462df6dec0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2019-11-29T13:39:29.169 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:29.165+0000 7f462df6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:29.198 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:29.194+0000 7f462df6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:39:29.209 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:29.205+0000 7f462df6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:29.254 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:29.250+0000 7f462df6dec0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2019-11-29T13:39:29.304 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:29.300+0000 7f462df6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:29.325 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:29.321+0000 7f462df6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:39:29.340 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:29.336+0000 7f462df6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:29.377 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:29.373+0000 7f462df6dec0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2019-11-29T13:39:29.436 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:29.432+0000 7f462df6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:29.457 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:29.453+0000 7f462df6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:39:29.471 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:29.467+0000 7f462df6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:29.685 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:29.681+0000 7f462df6dec0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2019-11-29T13:39:29.733 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:29.729+0000 7f462df6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:29.753 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:29.749+0000 7f462df6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:39:29.766 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:29.762+0000 7f462df6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:29.810 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:29.806+0000 7f462df6dec0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2019-11-29T13:39:29.856 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:29.852+0000 7f462df6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:29.872 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:29.868+0000 7f462df6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:39:29.881 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:29.877+0000 7f462df6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:29.920 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:29.916+0000 7f462df6dec0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2019-11-29T13:39:29.968 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:29.964+0000 7f462df6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:29.984 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:29.980+0000 7f462df6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:39:29.993 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:29.989+0000 7f462df6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:30.028 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:30.024+0000 7f462df6dec0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2019-11-29T13:39:30.076 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:30.072+0000 7f462df6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:30.097 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:30.093+0000 7f462df6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:39:30.106 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:30.101+0000 7f462df6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:30.149 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:30.145+0000 7f462df6dec0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2019-11-29T13:39:30.219 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:30.215+0000 7f462df6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:30.240 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:30.236+0000 7f462df6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:39:30.251 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:30.247+0000 7f462df6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:30.295 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:30.291+0000 7f462df6dec0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2019-11-29T13:39:30.351 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:30.348+0000 7f462df6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:30.377 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:30.374+0000 7f462df6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:39:30.387 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:30.383+0000 7f462df6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:30.436 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:30.433+0000 7f462df6dec0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2019-11-29T13:39:30.487 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:30.484+0000 7f462df6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:30.503 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:30.500+0000 7f462df6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:39:30.511 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:30.508+0000 7f462df6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:30.577 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:30.574+0000 7f462df6dec0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2019-11-29T13:39:30.695 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:30.691+0000 7f462df6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:30.718 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:30.714+0000 7f462df6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:39:30.728 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:30.724+0000 7f462df6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:30.770 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:30.766+0000 7f462df6dec0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2019-11-29T13:39:30.828 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:30.824+0000 7f462df6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:30.849 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:30.845+0000 7f462df6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:39:30.862 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:30.858+0000 7f462df6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:30.907 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:30.903+0000 7f462df6dec0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2019-11-29T13:39:30.975 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:30.971+0000 7f462df6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:31.011 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:31.007+0000 7f462df6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:39:31.021 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:31.017+0000 7f462df6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:31.067 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:31.063+0000 7f462df6dec0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2019-11-29T13:39:31.129 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:31.113+0000 7f462df6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:31.134 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:31.130+0000 7f462df6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:39:31.144 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:31.138+0000 7f462df6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:31.174 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:31.170+0000 7f462df6dec0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2019-11-29T13:39:31.241 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:31.236+0000 7f462df6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:31.258 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:31.254+0000 7f462df6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:39:31.268 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:31.263+0000 7f462df6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:31.305 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:31.301+0000 7f462df6dec0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2019-11-29T13:39:31.574 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:31.570+0000 7f462df6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:31.614 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:31.609+0000 7f462df6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:39:31.630 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:31.626+0000 7f462df6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:31.693 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:31.689+0000 7f462df6dec0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2019-11-29T13:39:31.758 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:31.754+0000 7f462df6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:31.776 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:31.772+0000 7f462df6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:39:31.785 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:31.781+0000 7f462df6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:31.824 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:31.820+0000 7f462df6dec0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2019-11-29T13:39:31.875 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:31.871+0000 7f462df6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:31.895 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:31.891+0000 7f462df6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:39:31.906 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:31.902+0000 7f462df6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:31.959 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:31.955+0000 7f462df6dec0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2019-11-29T13:39:32.007 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:32.003+0000 7f462df6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:32.023 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:32.020+0000 7f462df6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:39:32.034 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:32.030+0000 7f462df6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:32.094 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:32.090+0000 7f462df6dec0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2019-11-29T13:39:32.171 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:32.167+0000 7f462df6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:32.197 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:32.193+0000 7f462df6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:39:32.211 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:32.207+0000 7f462df6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:32.264 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:32.259+0000 7f462df6dec0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2019-11-29T13:39:32.348 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:32.343+0000 7f462df6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:32.374 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:32.370+0000 7f462df6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:39:32.387 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:32.383+0000 7f462df6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:32.432 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:32.428+0000 7f462df6dec0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2019-11-29T13:39:32.519 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:32.515+0000 7f462df6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:32.552 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:32.548+0000 7f462df6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:39:32.567 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:32.563+0000 7f462df6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:32.625 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:32.620+0000 7f462df6dec0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2019-11-29T13:39:32.700 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:32.694+0000 7f462df6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:32.722 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:32.718+0000 7f462df6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:39:32.740 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:32.736+0000 7f462df6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:32.787 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:32.783+0000 7f462df6dec0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2019-11-29T13:39:32.859 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:32.855+0000 7f462df6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:32.889 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:32.885+0000 7f462df6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:39:32.904 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:32.900+0000 7f462df6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:32.945 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:32.941+0000 7f462df6dec0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2019-11-29T13:39:33.003 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:32.999+0000 7f462df6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:33.029 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:33.025+0000 7f462df6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:39:33.047 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:33.043+0000 7f462df6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:33.131 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:33.127+0000 7f462df6dec0 20 remove_watcher() i=0 2019-11-29T13:39:33.132 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:33.127+0000 7f462df6dec0 2 removed watcher, disabling cache 2019-11-29T13:39:33.179 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:33.175+0000 7f462df6dec0 20 remove_watcher() i=1 2019-11-29T13:39:33.245 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:33.240+0000 7f462df6dec0 20 remove_watcher() i=2 2019-11-29T13:39:33.289 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:33.285+0000 7f462df6dec0 20 remove_watcher() i=3 2019-11-29T13:39:33.350 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:33.346+0000 7f462df6dec0 20 remove_watcher() i=4 2019-11-29T13:39:33.404 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:33.400+0000 7f462df6dec0 20 remove_watcher() i=5 2019-11-29T13:39:33.464 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:33.460+0000 7f462df6dec0 20 remove_watcher() i=6 2019-11-29T13:39:33.526 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:33.522+0000 7f462df6dec0 20 remove_watcher() i=7 2019-11-29T13:39:33.535 INFO:teuthology.orchestra.run.smithi062:> radosgw-admin gc process --include-all 2019-11-29T13:39:33.656 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:33.652+0000 7fd675468ec0 20 rados->read ofs=0 len=0 2019-11-29T13:39:33.685 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:33.681+0000 7fd675468ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T13:39:33.685 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:33.681+0000 7fd675468ec0 20 rados->read ofs=0 len=0 2019-11-29T13:39:33.697 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:33.693+0000 7fd675468ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T13:39:33.697 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:33.693+0000 7fd675468ec0 20 rados->read ofs=0 len=0 2019-11-29T13:39:33.705 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:33.701+0000 7fd675468ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T13:39:33.706 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:33.701+0000 7fd675468ec0 20 rados->read ofs=0 len=0 2019-11-29T13:39:33.733 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:33.729+0000 7fd675468ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T13:39:33.939 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:33.934+0000 7fd675468ec0 20 RGWRados::pool_iterate: got zone_info.7f922895-c6d7-4b1b-a19c-be3df5b5a899 2019-11-29T13:39:33.939 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:33.934+0000 7fd675468ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-29T13:39:33.939 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:33.934+0000 7fd675468ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-29T13:39:33.939 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:33.934+0000 7fd675468ec0 20 RGWRados::pool_iterate: got zonegroup_info.76ba47ff-1c23-4409-aae0-24fe26589cae 2019-11-29T13:39:33.939 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:33.934+0000 7fd675468ec0 20 rados->read ofs=0 len=0 2019-11-29T13:39:33.953 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:33.949+0000 7fd675468ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T13:39:33.953 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:33.949+0000 7fd675468ec0 20 rados->read ofs=0 len=0 2019-11-29T13:39:33.977 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:33.973+0000 7fd675468ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-29T13:39:33.977 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:33.973+0000 7fd675468ec0 20 rados->read ofs=0 len=0 2019-11-29T13:39:33.991 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:33.987+0000 7fd675468ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T13:39:33.991 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:33.987+0000 7fd675468ec0 20 rados->read ofs=0 len=0 2019-11-29T13:39:34.005 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:34.001+0000 7fd675468ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-29T13:39:34.005 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:34.001+0000 7fd675468ec0 20 rados->read ofs=0 len=0 2019-11-29T13:39:34.016 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:34.012+0000 7fd675468ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T13:39:34.016 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:34.012+0000 7fd675468ec0 10 cannot find current period zonegroup using local zonegroup 2019-11-29T13:39:34.017 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:34.012+0000 7fd675468ec0 20 rados->read ofs=0 len=0 2019-11-29T13:39:34.027 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:34.023+0000 7fd675468ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T13:39:34.028 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:34.023+0000 7fd675468ec0 20 rados->read ofs=0 len=0 2019-11-29T13:39:34.040 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:34.037+0000 7fd675468ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T13:39:34.041 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:34.037+0000 7fd675468ec0 20 rados->read ofs=0 len=0 2019-11-29T13:39:34.058 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:34.054+0000 7fd675468ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-29T13:39:34.058 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:34.054+0000 7fd675468ec0 20 zonegroup default 2019-11-29T13:39:34.059 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:34.054+0000 7fd675468ec0 20 rados->read ofs=0 len=0 2019-11-29T13:39:34.067 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:34.063+0000 7fd675468ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T13:39:34.067 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:34.063+0000 7fd675468ec0 10 Cannot find current period zone using local zone 2019-11-29T13:39:34.067 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:34.063+0000 7fd675468ec0 20 rados->read ofs=0 len=0 2019-11-29T13:39:34.077 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:34.073+0000 7fd675468ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T13:39:34.077 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:34.073+0000 7fd675468ec0 20 rados->read ofs=0 len=0 2019-11-29T13:39:34.086 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:34.082+0000 7fd675468ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T13:39:34.086 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:34.082+0000 7fd675468ec0 20 rados->read ofs=0 len=0 2019-11-29T13:39:34.097 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:34.093+0000 7fd675468ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-29T13:39:34.098 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:34.093+0000 7fd675468ec0 20 zone default found 2019-11-29T13:39:34.098 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:34.093+0000 7fd675468ec0 20 started sync module instance, tier type = 2019-11-29T13:39:34.098 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:34.093+0000 7fd675468ec0 20 started zone id=7f922895-c6d7-4b1b-a19c-be3df5b5a899 (name=default) with tier type = 2019-11-29T13:39:34.511 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:34.506+0000 7fd675468ec0 20 add_watcher() i=0 2019-11-29T13:39:34.511 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:34.506+0000 7fd675468ec0 20 add_watcher() i=1 2019-11-29T13:39:34.511 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:34.506+0000 7fd675468ec0 20 add_watcher() i=2 2019-11-29T13:39:34.511 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:34.506+0000 7fd675468ec0 20 add_watcher() i=3 2019-11-29T13:39:34.511 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:34.506+0000 7fd675468ec0 20 add_watcher() i=4 2019-11-29T13:39:34.511 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:34.506+0000 7fd675468ec0 20 add_watcher() i=5 2019-11-29T13:39:34.512 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:34.506+0000 7fd675468ec0 20 add_watcher() i=6 2019-11-29T13:39:34.547 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:34.543+0000 7fd675468ec0 20 add_watcher() i=7 2019-11-29T13:39:34.547 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:34.543+0000 7fd675468ec0 2 all 8 watchers are set, enabling cache 2019-11-29T13:39:34.547 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:34.543+0000 7fd632fdd700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-29T13:39:34.559 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:34.555+0000 7fd659e94700 0 -- 172.21.15.62:0/2032983843 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x563a444ad1e0 msgr2=0x563a444ad5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-29T13:39:34.588 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:34.584+0000 7fd662e96700 0 -- 172.21.15.62:0/2948993303 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563a444b2010 msgr2=0x563a444b13a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-29T13:39:36.128 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:36.121+0000 7fd5a17fa700 20 reqs_thread_entry: start 2019-11-29T13:39:36.128 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:36.122+0000 7fd59affd700 20 reqs_thread_entry: start 2019-11-29T13:39:36.128 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:36.122+0000 7fd675468ec0 20 init_complete bucket index max shards: 0 2019-11-29T13:39:36.129 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:36.123+0000 7fd5997fa700 20 reqs_thread_entry: start 2019-11-29T13:39:36.130 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:36.123+0000 7fd675468ec0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2019-11-29T13:39:36.200 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:36.196+0000 7fd675468ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:36.233 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:36.227+0000 7fd675468ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:39:36.259 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:36.248+0000 7fd675468ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:36.351 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:36.343+0000 7fd675468ec0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2019-11-29T13:39:36.432 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:36.426+0000 7fd675468ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:36.458 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:36.453+0000 7fd675468ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:39:36.473 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:36.468+0000 7fd675468ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:36.520 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:36.516+0000 7fd675468ec0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2019-11-29T13:39:36.607 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:36.602+0000 7fd675468ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:36.629 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:36.625+0000 7fd675468ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:39:36.642 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:36.637+0000 7fd675468ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:36.701 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:36.697+0000 7fd675468ec0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2019-11-29T13:39:36.808 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:36.804+0000 7fd675468ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:36.838 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:36.834+0000 7fd675468ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:39:36.853 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:36.850+0000 7fd675468ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:36.906 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:36.902+0000 7fd675468ec0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2019-11-29T13:39:36.980 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:36.976+0000 7fd675468ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:37.000 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:36.996+0000 7fd675468ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:39:37.020 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:37.016+0000 7fd675468ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:37.054 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:37.050+0000 7fd675468ec0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2019-11-29T13:39:37.145 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:37.141+0000 7fd675468ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:37.180 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:37.176+0000 7fd675468ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:39:37.212 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:37.208+0000 7fd675468ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:37.284 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:37.279+0000 7fd675468ec0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2019-11-29T13:39:37.359 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:37.355+0000 7fd675468ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:37.421 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:37.417+0000 7fd675468ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:39:37.433 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:37.429+0000 7fd675468ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:37.487 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:37.483+0000 7fd675468ec0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2019-11-29T13:39:37.561 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:37.557+0000 7fd675468ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:37.587 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:37.583+0000 7fd675468ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:39:37.598 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:37.594+0000 7fd675468ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:37.647 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:37.643+0000 7fd675468ec0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2019-11-29T13:39:37.725 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:37.721+0000 7fd675468ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:37.747 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:37.743+0000 7fd675468ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:39:37.760 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:37.756+0000 7fd675468ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:37.797 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:37.793+0000 7fd675468ec0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2019-11-29T13:39:37.841 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:37.836+0000 7fd675468ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:37.858 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:37.854+0000 7fd675468ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:39:37.867 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:37.863+0000 7fd675468ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:37.902 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:37.898+0000 7fd675468ec0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2019-11-29T13:39:37.999 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:37.995+0000 7fd675468ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:38.021 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:38.017+0000 7fd675468ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:39:38.032 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:38.028+0000 7fd675468ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:38.083 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:38.079+0000 7fd675468ec0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2019-11-29T13:39:38.250 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:38.246+0000 7fd675468ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:38.276 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:38.270+0000 7fd675468ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:39:38.290 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:38.286+0000 7fd675468ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:38.337 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:38.333+0000 7fd675468ec0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2019-11-29T13:39:38.407 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:38.403+0000 7fd675468ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:38.429 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:38.425+0000 7fd675468ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:39:38.447 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:38.443+0000 7fd675468ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:38.497 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:38.493+0000 7fd675468ec0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2019-11-29T13:39:38.562 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:38.558+0000 7fd675468ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:38.584 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:38.580+0000 7fd675468ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:39:38.598 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:38.594+0000 7fd675468ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:38.639 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:38.635+0000 7fd675468ec0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2019-11-29T13:39:38.696 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:38.692+0000 7fd675468ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:38.712 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:38.709+0000 7fd675468ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:39:38.721 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:38.718+0000 7fd675468ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:38.754 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:38.750+0000 7fd675468ec0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2019-11-29T13:39:38.831 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:38.827+0000 7fd675468ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:38.849 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:38.845+0000 7fd675468ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:39:38.858 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:38.855+0000 7fd675468ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:38.905 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:38.901+0000 7fd675468ec0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2019-11-29T13:39:38.970 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:38.965+0000 7fd675468ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:38.990 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:38.986+0000 7fd675468ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:39:38.999 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:38.995+0000 7fd675468ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:39.033 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:39.029+0000 7fd675468ec0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2019-11-29T13:39:39.086 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:39.081+0000 7fd675468ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:39.127 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:39.123+0000 7fd675468ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:39:39.143 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:39.139+0000 7fd675468ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:39.174 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:39.169+0000 7fd675468ec0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2019-11-29T13:39:39.218 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:39.214+0000 7fd675468ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:39.236 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:39.232+0000 7fd675468ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:39:39.252 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:39.248+0000 7fd675468ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:39.299 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:39.295+0000 7fd675468ec0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2019-11-29T13:39:39.368 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:39.364+0000 7fd675468ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:39.391 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:39.387+0000 7fd675468ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:39:39.405 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:39.401+0000 7fd675468ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:39.450 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:39.446+0000 7fd675468ec0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2019-11-29T13:39:39.518 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:39.514+0000 7fd675468ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:39.543 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:39.539+0000 7fd675468ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:39:39.555 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:39.551+0000 7fd675468ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:39.618 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:39.614+0000 7fd675468ec0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2019-11-29T13:39:39.697 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:39.693+0000 7fd675468ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:39.722 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:39.718+0000 7fd675468ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:39:39.734 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:39.730+0000 7fd675468ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:39.793 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:39.789+0000 7fd675468ec0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2019-11-29T13:39:39.865 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:39.861+0000 7fd675468ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:39.889 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:39.885+0000 7fd675468ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:39:39.904 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:39.900+0000 7fd675468ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:39.951 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:39.947+0000 7fd675468ec0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2019-11-29T13:39:40.216 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:40.211+0000 7fd675468ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:40.245 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:40.241+0000 7fd675468ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:39:40.259 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:40.255+0000 7fd675468ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:40.319 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:40.315+0000 7fd675468ec0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2019-11-29T13:39:40.404 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:40.400+0000 7fd675468ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:40.442 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:40.438+0000 7fd675468ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:39:40.457 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:40.454+0000 7fd675468ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:40.521 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:40.517+0000 7fd675468ec0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2019-11-29T13:39:40.606 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:40.602+0000 7fd675468ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:40.635 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:40.631+0000 7fd675468ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:39:40.650 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:40.646+0000 7fd675468ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:40.692 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:40.687+0000 7fd675468ec0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2019-11-29T13:39:40.749 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:40.745+0000 7fd675468ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:40.771 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:40.767+0000 7fd675468ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:39:40.780 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:40.776+0000 7fd675468ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:40.818 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:40.814+0000 7fd675468ec0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2019-11-29T13:39:40.878 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:40.874+0000 7fd675468ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:40.896 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:40.892+0000 7fd675468ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:39:40.906 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:40.902+0000 7fd675468ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:40.952 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:40.948+0000 7fd675468ec0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2019-11-29T13:39:41.014 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:41.010+0000 7fd675468ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:41.034 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:41.030+0000 7fd675468ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:39:41.044 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:41.040+0000 7fd675468ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:41.095 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:41.091+0000 7fd675468ec0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2019-11-29T13:39:41.164 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:41.160+0000 7fd675468ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:41.204 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:41.200+0000 7fd675468ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:39:41.221 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:41.217+0000 7fd675468ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:41.264 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:41.260+0000 7fd675468ec0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2019-11-29T13:39:41.348 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:41.344+0000 7fd675468ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:41.384 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:41.379+0000 7fd675468ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:39:41.398 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:41.395+0000 7fd675468ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:41.467 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:41.462+0000 7fd675468ec0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2019-11-29T13:39:41.541 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:41.537+0000 7fd675468ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:41.565 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:41.561+0000 7fd675468ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:39:41.576 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:41.572+0000 7fd675468ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:41.687 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:41.683+0000 7fd675468ec0 20 remove_watcher() i=0 2019-11-29T13:39:41.688 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:41.683+0000 7fd675468ec0 2 removed watcher, disabling cache 2019-11-29T13:39:41.742 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:41.738+0000 7fd675468ec0 20 remove_watcher() i=1 2019-11-29T13:39:41.795 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:41.791+0000 7fd675468ec0 20 remove_watcher() i=2 2019-11-29T13:39:41.840 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:41.836+0000 7fd675468ec0 20 remove_watcher() i=3 2019-11-29T13:39:41.875 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:41.871+0000 7fd675468ec0 20 remove_watcher() i=4 2019-11-29T13:39:41.920 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:41.916+0000 7fd675468ec0 20 remove_watcher() i=5 2019-11-29T13:39:41.984 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:41.980+0000 7fd675468ec0 20 remove_watcher() i=6 2019-11-29T13:39:42.033 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:42.029+0000 7fd675468ec0 20 remove_watcher() i=7 2019-11-29T13:39:42.043 INFO:teuthology.orchestra.run.smithi062:> radosgw-admin gc process --include-all 2019-11-29T13:39:42.176 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:42.172+0000 7f1d625f9ec0 20 rados->read ofs=0 len=0 2019-11-29T13:39:42.204 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:42.200+0000 7f1d625f9ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T13:39:42.204 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:42.200+0000 7f1d625f9ec0 20 rados->read ofs=0 len=0 2019-11-29T13:39:42.215 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:42.211+0000 7f1d625f9ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T13:39:42.215 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:42.211+0000 7f1d625f9ec0 20 rados->read ofs=0 len=0 2019-11-29T13:39:42.229 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:42.225+0000 7f1d625f9ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T13:39:42.229 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:42.225+0000 7f1d625f9ec0 20 rados->read ofs=0 len=0 2019-11-29T13:39:42.247 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:42.243+0000 7f1d625f9ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T13:39:42.566 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:42.562+0000 7f1d625f9ec0 20 RGWRados::pool_iterate: got zone_info.7f922895-c6d7-4b1b-a19c-be3df5b5a899 2019-11-29T13:39:42.566 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:42.562+0000 7f1d625f9ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-29T13:39:42.567 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:42.562+0000 7f1d625f9ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-29T13:39:42.567 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:42.562+0000 7f1d625f9ec0 20 RGWRados::pool_iterate: got zonegroup_info.76ba47ff-1c23-4409-aae0-24fe26589cae 2019-11-29T13:39:42.567 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:42.562+0000 7f1d625f9ec0 20 rados->read ofs=0 len=0 2019-11-29T13:39:42.575 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:42.571+0000 7f1d625f9ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T13:39:42.575 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:42.571+0000 7f1d625f9ec0 20 rados->read ofs=0 len=0 2019-11-29T13:39:42.590 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:42.586+0000 7f1d625f9ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-29T13:39:42.590 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:42.586+0000 7f1d625f9ec0 20 rados->read ofs=0 len=0 2019-11-29T13:39:42.605 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:42.601+0000 7f1d625f9ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T13:39:42.606 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:42.601+0000 7f1d625f9ec0 20 rados->read ofs=0 len=0 2019-11-29T13:39:42.619 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:42.615+0000 7f1d625f9ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-29T13:39:42.620 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:42.615+0000 7f1d625f9ec0 20 rados->read ofs=0 len=0 2019-11-29T13:39:42.632 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:42.628+0000 7f1d625f9ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T13:39:42.632 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:42.628+0000 7f1d625f9ec0 10 cannot find current period zonegroup using local zonegroup 2019-11-29T13:39:42.633 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:42.628+0000 7f1d625f9ec0 20 rados->read ofs=0 len=0 2019-11-29T13:39:42.641 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:42.637+0000 7f1d625f9ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T13:39:42.641 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:42.637+0000 7f1d625f9ec0 20 rados->read ofs=0 len=0 2019-11-29T13:39:42.650 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:42.646+0000 7f1d625f9ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T13:39:42.650 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:42.646+0000 7f1d625f9ec0 20 rados->read ofs=0 len=0 2019-11-29T13:39:42.662 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:42.658+0000 7f1d625f9ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-29T13:39:42.663 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:42.658+0000 7f1d625f9ec0 20 zonegroup default 2019-11-29T13:39:42.663 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:42.658+0000 7f1d625f9ec0 20 rados->read ofs=0 len=0 2019-11-29T13:39:42.669 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:42.665+0000 7f1d625f9ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T13:39:42.669 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:42.665+0000 7f1d625f9ec0 10 Cannot find current period zone using local zone 2019-11-29T13:39:42.669 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:42.665+0000 7f1d625f9ec0 20 rados->read ofs=0 len=0 2019-11-29T13:39:42.677 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:42.673+0000 7f1d625f9ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T13:39:42.677 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:42.673+0000 7f1d625f9ec0 20 rados->read ofs=0 len=0 2019-11-29T13:39:42.689 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:42.685+0000 7f1d625f9ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T13:39:42.690 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:42.685+0000 7f1d625f9ec0 20 rados->read ofs=0 len=0 2019-11-29T13:39:42.698 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:42.694+0000 7f1d625f9ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-29T13:39:42.698 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:42.694+0000 7f1d625f9ec0 20 zone default found 2019-11-29T13:39:42.698 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:42.694+0000 7f1d625f9ec0 20 started sync module instance, tier type = 2019-11-29T13:39:42.699 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:42.694+0000 7f1d625f9ec0 20 started zone id=7f922895-c6d7-4b1b-a19c-be3df5b5a899 (name=default) with tier type = 2019-11-29T13:39:43.053 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:43.049+0000 7f1d625f9ec0 20 add_watcher() i=0 2019-11-29T13:39:43.053 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:43.049+0000 7f1d625f9ec0 20 add_watcher() i=1 2019-11-29T13:39:43.053 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:43.049+0000 7f1d625f9ec0 20 add_watcher() i=2 2019-11-29T13:39:43.054 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:43.049+0000 7f1d625f9ec0 20 add_watcher() i=3 2019-11-29T13:39:43.054 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:43.049+0000 7f1d625f9ec0 20 add_watcher() i=4 2019-11-29T13:39:43.054 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:43.049+0000 7f1d625f9ec0 20 add_watcher() i=5 2019-11-29T13:39:43.061 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:43.058+0000 7f1d625f9ec0 20 add_watcher() i=6 2019-11-29T13:39:43.103 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:43.098+0000 7f1d625f9ec0 20 add_watcher() i=7 2019-11-29T13:39:43.103 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:43.098+0000 7f1d625f9ec0 2 all 8 watchers are set, enabling cache 2019-11-29T13:39:43.103 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:43.099+0000 7f1ca3fff700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-29T13:39:43.112 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:43.108+0000 7f1d4f826700 0 -- 172.21.15.62:0/3376068823 >> v2:172.21.15.62:3300/0 conn(0x55a3166a65b0 msgr2=0x55a316687800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2019-11-29T13:39:43.144 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:43.140+0000 7f1d50027700 0 -- 172.21.15.62:0/3721804593 >> v1:172.21.15.62:6789/0 conn(0x55a31668d040 legacy=0x55a31669b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-29T13:39:44.749 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:44.744+0000 7f1c8e7fc700 20 reqs_thread_entry: start 2019-11-29T13:39:44.749 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:44.745+0000 7f1c87fff700 20 reqs_thread_entry: start 2019-11-29T13:39:44.749 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:44.745+0000 7f1d625f9ec0 20 init_complete bucket index max shards: 0 2019-11-29T13:39:44.749 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:44.745+0000 7f1c867fc700 20 reqs_thread_entry: start 2019-11-29T13:39:44.750 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:44.745+0000 7f1d625f9ec0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2019-11-29T13:39:44.800 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:44.795+0000 7f1d625f9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:44.825 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:44.821+0000 7f1d625f9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:39:44.834 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:44.830+0000 7f1d625f9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:44.877 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:44.873+0000 7f1d625f9ec0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2019-11-29T13:39:44.975 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:44.971+0000 7f1d625f9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:45.003 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:44.999+0000 7f1d625f9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:39:45.017 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:45.013+0000 7f1d625f9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:45.059 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:45.055+0000 7f1d625f9ec0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2019-11-29T13:39:45.118 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:45.113+0000 7f1d625f9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:45.134 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:45.130+0000 7f1d625f9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:39:45.146 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:45.142+0000 7f1d625f9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:45.203 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:45.199+0000 7f1d625f9ec0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2019-11-29T13:39:45.270 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:45.266+0000 7f1d625f9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:45.287 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:45.283+0000 7f1d625f9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:39:45.300 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:45.296+0000 7f1d625f9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:45.345 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:45.341+0000 7f1d625f9ec0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2019-11-29T13:39:45.431 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:45.427+0000 7f1d625f9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:45.462 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:45.459+0000 7f1d625f9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:39:45.478 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:45.474+0000 7f1d625f9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:45.528 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:45.524+0000 7f1d625f9ec0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2019-11-29T13:39:45.606 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:45.602+0000 7f1d625f9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:45.633 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:45.629+0000 7f1d625f9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:39:45.644 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:45.641+0000 7f1d625f9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:45.697 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:45.693+0000 7f1d625f9ec0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2019-11-29T13:39:45.758 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:45.754+0000 7f1d625f9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:45.778 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:45.773+0000 7f1d625f9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:39:45.790 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:45.786+0000 7f1d625f9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:45.825 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:45.821+0000 7f1d625f9ec0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2019-11-29T13:39:45.869 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:45.865+0000 7f1d625f9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:45.886 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:45.883+0000 7f1d625f9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:39:45.896 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:45.892+0000 7f1d625f9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:45.934 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:45.930+0000 7f1d625f9ec0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2019-11-29T13:39:45.977 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:45.972+0000 7f1d625f9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:45.992 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:45.988+0000 7f1d625f9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:39:46.001 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:45.998+0000 7f1d625f9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:46.062 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:46.057+0000 7f1d625f9ec0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2019-11-29T13:39:46.128 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:46.123+0000 7f1d625f9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:46.189 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:46.185+0000 7f1d625f9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:39:46.208 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:46.204+0000 7f1d625f9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:46.257 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:46.253+0000 7f1d625f9ec0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2019-11-29T13:39:46.319 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:46.315+0000 7f1d625f9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:46.344 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:46.339+0000 7f1d625f9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:39:46.359 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:46.355+0000 7f1d625f9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:46.413 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:46.409+0000 7f1d625f9ec0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2019-11-29T13:39:46.489 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:46.485+0000 7f1d625f9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:46.509 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:46.505+0000 7f1d625f9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:39:46.518 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:46.514+0000 7f1d625f9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:46.570 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:46.566+0000 7f1d625f9ec0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2019-11-29T13:39:46.674 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:46.670+0000 7f1d625f9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:46.697 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:46.693+0000 7f1d625f9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:39:46.704 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:46.701+0000 7f1d625f9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:46.756 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:46.752+0000 7f1d625f9ec0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2019-11-29T13:39:46.818 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:46.814+0000 7f1d625f9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:46.840 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:46.836+0000 7f1d625f9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:39:46.850 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:46.846+0000 7f1d625f9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:46.894 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:46.890+0000 7f1d625f9ec0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2019-11-29T13:39:46.936 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:46.932+0000 7f1d625f9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:46.963 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:46.951+0000 7f1d625f9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:39:46.966 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:46.962+0000 7f1d625f9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:47.000 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:46.996+0000 7f1d625f9ec0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2019-11-29T13:39:47.038 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:47.034+0000 7f1d625f9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:47.054 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:47.050+0000 7f1d625f9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:39:47.063 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:47.059+0000 7f1d625f9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:47.098 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:47.094+0000 7f1d625f9ec0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2019-11-29T13:39:47.149 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:47.145+0000 7f1d625f9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:47.171 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:47.167+0000 7f1d625f9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:39:47.188 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:47.184+0000 7f1d625f9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:47.219 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:47.215+0000 7f1d625f9ec0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2019-11-29T13:39:47.269 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:47.265+0000 7f1d625f9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:47.289 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:47.285+0000 7f1d625f9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:39:47.300 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:47.296+0000 7f1d625f9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:47.381 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:47.374+0000 7f1d625f9ec0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2019-11-29T13:39:47.506 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:47.502+0000 7f1d625f9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:47.541 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:47.537+0000 7f1d625f9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:39:47.559 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:47.555+0000 7f1d625f9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:47.622 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:47.618+0000 7f1d625f9ec0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2019-11-29T13:39:47.678 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:47.674+0000 7f1d625f9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:47.697 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:47.693+0000 7f1d625f9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:39:47.705 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:47.701+0000 7f1d625f9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:47.746 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:47.742+0000 7f1d625f9ec0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2019-11-29T13:39:47.795 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:47.791+0000 7f1d625f9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:47.811 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:47.807+0000 7f1d625f9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:39:47.820 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:47.816+0000 7f1d625f9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:47.862 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:47.858+0000 7f1d625f9ec0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2019-11-29T13:39:47.942 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:47.938+0000 7f1d625f9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:47.977 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:47.973+0000 7f1d625f9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:39:47.999 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:47.995+0000 7f1d625f9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:48.043 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:48.039+0000 7f1d625f9ec0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2019-11-29T13:39:48.107 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:48.103+0000 7f1d625f9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:48.125 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:48.122+0000 7f1d625f9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:39:48.135 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:48.131+0000 7f1d625f9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:48.177 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:48.173+0000 7f1d625f9ec0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2019-11-29T13:39:48.230 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:48.226+0000 7f1d625f9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:48.250 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:48.246+0000 7f1d625f9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:39:48.265 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:48.261+0000 7f1d625f9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:48.315 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:48.311+0000 7f1d625f9ec0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2019-11-29T13:39:48.405 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:48.401+0000 7f1d625f9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:48.433 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:48.429+0000 7f1d625f9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:39:48.445 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:48.441+0000 7f1d625f9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:48.495 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:48.491+0000 7f1d625f9ec0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2019-11-29T13:39:48.580 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:48.576+0000 7f1d625f9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:48.609 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:48.605+0000 7f1d625f9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:39:48.624 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:48.620+0000 7f1d625f9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:48.688 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:48.684+0000 7f1d625f9ec0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2019-11-29T13:39:48.780 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:48.776+0000 7f1d625f9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:48.823 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:48.819+0000 7f1d625f9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:39:48.845 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:48.841+0000 7f1d625f9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:48.908 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:48.904+0000 7f1d625f9ec0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2019-11-29T13:39:48.971 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:48.967+0000 7f1d625f9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:48.993 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:48.990+0000 7f1d625f9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:39:49.007 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:49.003+0000 7f1d625f9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:49.050 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:49.046+0000 7f1d625f9ec0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2019-11-29T13:39:49.144 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:49.140+0000 7f1d625f9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:49.170 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:49.166+0000 7f1d625f9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:39:49.182 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:49.178+0000 7f1d625f9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:49.239 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:49.234+0000 7f1d625f9ec0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2019-11-29T13:39:49.302 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:49.298+0000 7f1d625f9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:49.327 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:49.323+0000 7f1d625f9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:39:49.338 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:49.334+0000 7f1d625f9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:49.372 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:49.368+0000 7f1d625f9ec0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2019-11-29T13:39:49.431 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:49.427+0000 7f1d625f9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:49.450 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:49.446+0000 7f1d625f9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:39:49.461 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:49.457+0000 7f1d625f9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:49.512 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:49.507+0000 7f1d625f9ec0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2019-11-29T13:39:49.563 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:49.559+0000 7f1d625f9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:49.582 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:49.578+0000 7f1d625f9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:39:49.592 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:49.588+0000 7f1d625f9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:49.671 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:49.667+0000 7f1d625f9ec0 20 remove_watcher() i=0 2019-11-29T13:39:49.671 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:49.667+0000 7f1d625f9ec0 2 removed watcher, disabling cache 2019-11-29T13:39:49.765 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:49.761+0000 7f1d625f9ec0 20 remove_watcher() i=1 2019-11-29T13:39:49.829 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:49.825+0000 7f1d625f9ec0 20 remove_watcher() i=2 2019-11-29T13:39:49.869 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:49.865+0000 7f1d625f9ec0 20 remove_watcher() i=3 2019-11-29T13:39:49.915 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:49.911+0000 7f1d625f9ec0 20 remove_watcher() i=4 2019-11-29T13:39:49.971 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:49.966+0000 7f1d625f9ec0 20 remove_watcher() i=5 2019-11-29T13:39:50.018 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:50.014+0000 7f1d625f9ec0 20 remove_watcher() i=6 2019-11-29T13:39:50.065 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:50.061+0000 7f1d625f9ec0 20 remove_watcher() i=7 2019-11-29T13:39:50.074 INFO:teuthology.orchestra.run.smithi062:> radosgw-admin gc process --include-all 2019-11-29T13:39:50.231 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:50.227+0000 7fcd66500ec0 20 rados->read ofs=0 len=0 2019-11-29T13:39:50.275 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:50.271+0000 7fcd66500ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T13:39:50.276 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:50.271+0000 7fcd66500ec0 20 rados->read ofs=0 len=0 2019-11-29T13:39:50.286 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:50.282+0000 7fcd66500ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T13:39:50.286 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:50.282+0000 7fcd66500ec0 20 rados->read ofs=0 len=0 2019-11-29T13:39:50.296 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:50.292+0000 7fcd66500ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T13:39:50.296 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:50.292+0000 7fcd66500ec0 20 rados->read ofs=0 len=0 2019-11-29T13:39:50.315 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:50.311+0000 7fcd66500ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T13:39:50.589 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:50.584+0000 7fcd66500ec0 20 RGWRados::pool_iterate: got zone_info.7f922895-c6d7-4b1b-a19c-be3df5b5a899 2019-11-29T13:39:50.589 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:50.584+0000 7fcd66500ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-29T13:39:50.589 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:50.584+0000 7fcd66500ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-29T13:39:50.589 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:50.584+0000 7fcd66500ec0 20 RGWRados::pool_iterate: got zonegroup_info.76ba47ff-1c23-4409-aae0-24fe26589cae 2019-11-29T13:39:50.589 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:50.584+0000 7fcd66500ec0 20 rados->read ofs=0 len=0 2019-11-29T13:39:50.607 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:50.603+0000 7fcd66500ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T13:39:50.607 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:50.603+0000 7fcd66500ec0 20 rados->read ofs=0 len=0 2019-11-29T13:39:50.627 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:50.623+0000 7fcd66500ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-29T13:39:50.627 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:50.623+0000 7fcd66500ec0 20 rados->read ofs=0 len=0 2019-11-29T13:39:50.643 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:50.639+0000 7fcd66500ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T13:39:50.643 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:50.639+0000 7fcd66500ec0 20 rados->read ofs=0 len=0 2019-11-29T13:39:50.664 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:50.660+0000 7fcd66500ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-29T13:39:50.665 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:50.660+0000 7fcd66500ec0 20 rados->read ofs=0 len=0 2019-11-29T13:39:50.677 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:50.673+0000 7fcd66500ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T13:39:50.677 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:50.673+0000 7fcd66500ec0 10 cannot find current period zonegroup using local zonegroup 2019-11-29T13:39:50.677 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:50.673+0000 7fcd66500ec0 20 rados->read ofs=0 len=0 2019-11-29T13:39:50.690 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:50.687+0000 7fcd66500ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T13:39:50.691 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:50.687+0000 7fcd66500ec0 20 rados->read ofs=0 len=0 2019-11-29T13:39:50.708 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:50.704+0000 7fcd66500ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T13:39:50.708 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:50.704+0000 7fcd66500ec0 20 rados->read ofs=0 len=0 2019-11-29T13:39:50.726 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:50.722+0000 7fcd66500ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-29T13:39:50.727 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:50.722+0000 7fcd66500ec0 20 zonegroup default 2019-11-29T13:39:50.727 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:50.722+0000 7fcd66500ec0 20 rados->read ofs=0 len=0 2019-11-29T13:39:50.742 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:50.738+0000 7fcd66500ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T13:39:50.742 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:50.738+0000 7fcd66500ec0 10 Cannot find current period zone using local zone 2019-11-29T13:39:50.743 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:50.738+0000 7fcd66500ec0 20 rados->read ofs=0 len=0 2019-11-29T13:39:50.753 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:50.749+0000 7fcd66500ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T13:39:50.754 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:50.749+0000 7fcd66500ec0 20 rados->read ofs=0 len=0 2019-11-29T13:39:50.770 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:50.766+0000 7fcd66500ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T13:39:50.770 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:50.766+0000 7fcd66500ec0 20 rados->read ofs=0 len=0 2019-11-29T13:39:50.783 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:50.779+0000 7fcd66500ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-29T13:39:50.783 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:50.779+0000 7fcd66500ec0 20 zone default found 2019-11-29T13:39:50.783 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:50.779+0000 7fcd66500ec0 20 started sync module instance, tier type = 2019-11-29T13:39:50.783 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:50.779+0000 7fcd66500ec0 20 started zone id=7f922895-c6d7-4b1b-a19c-be3df5b5a899 (name=default) with tier type = 2019-11-29T13:39:51.189 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:51.184+0000 7fcd66500ec0 20 add_watcher() i=0 2019-11-29T13:39:51.189 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:51.184+0000 7fcd66500ec0 20 add_watcher() i=1 2019-11-29T13:39:51.189 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:51.184+0000 7fcd66500ec0 20 add_watcher() i=2 2019-11-29T13:39:51.189 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:51.184+0000 7fcd66500ec0 20 add_watcher() i=3 2019-11-29T13:39:51.189 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:51.184+0000 7fcd66500ec0 20 add_watcher() i=4 2019-11-29T13:39:51.189 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:51.184+0000 7fcd66500ec0 20 add_watcher() i=5 2019-11-29T13:39:51.190 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:51.184+0000 7fcd66500ec0 20 add_watcher() i=6 2019-11-29T13:39:51.229 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:51.225+0000 7fcd66500ec0 20 add_watcher() i=7 2019-11-29T13:39:51.229 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:51.225+0000 7fcd66500ec0 2 all 8 watchers are set, enabling cache 2019-11-29T13:39:51.229 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:51.225+0000 7fcd23fdf700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-29T13:39:51.245 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:51.241+0000 7fcd53f2e700 0 -- >> v2:172.21.15.62:3300/0 conn(0x55dd572c5380 msgr2=0x55dd572c4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-29T13:39:51.282 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:51.278+0000 7fcd52f2c700 0 -- 172.21.15.62:0/2120219840 >> [v2:172.21.15.22:6818/9264,v1:172.21.15.22:6819/9264] conn(0x55dd572eaed0 msgr2=0x55dd572eb2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-29T13:39:53.251 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:53.247+0000 7fcc927fc700 20 reqs_thread_entry: start 2019-11-29T13:39:53.251 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:53.247+0000 7fcc8bfff700 20 reqs_thread_entry: start 2019-11-29T13:39:53.251 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:53.247+0000 7fcd66500ec0 20 init_complete bucket index max shards: 0 2019-11-29T13:39:53.252 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:53.247+0000 7fcc8a7fc700 20 reqs_thread_entry: start 2019-11-29T13:39:53.252 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:53.247+0000 7fcd66500ec0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2019-11-29T13:39:53.312 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:53.307+0000 7fcd66500ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:53.331 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:53.327+0000 7fcd66500ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:39:53.341 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:53.338+0000 7fcd66500ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:53.393 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:53.389+0000 7fcd66500ec0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2019-11-29T13:39:53.499 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:53.495+0000 7fcd66500ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:53.527 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:53.523+0000 7fcd66500ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:39:53.543 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:53.540+0000 7fcd66500ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:53.604 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:53.600+0000 7fcd66500ec0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2019-11-29T13:39:53.673 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:53.669+0000 7fcd66500ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:53.694 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:53.690+0000 7fcd66500ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:39:53.727 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:53.723+0000 7fcd66500ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:53.787 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:53.783+0000 7fcd66500ec0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2019-11-29T13:39:53.857 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:53.853+0000 7fcd66500ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:53.887 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:53.883+0000 7fcd66500ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:39:53.907 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:53.903+0000 7fcd66500ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:53.959 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:53.955+0000 7fcd66500ec0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2019-11-29T13:39:54.041 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:54.037+0000 7fcd66500ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:54.064 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:54.060+0000 7fcd66500ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:39:54.077 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:54.073+0000 7fcd66500ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:54.134 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:54.130+0000 7fcd66500ec0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2019-11-29T13:39:54.208 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:54.204+0000 7fcd66500ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:54.236 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:54.232+0000 7fcd66500ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:39:54.252 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:54.248+0000 7fcd66500ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:54.305 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:54.301+0000 7fcd66500ec0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2019-11-29T13:39:54.363 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:54.359+0000 7fcd66500ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:54.381 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:54.377+0000 7fcd66500ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:39:54.388 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:54.384+0000 7fcd66500ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:54.440 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:54.433+0000 7fcd66500ec0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2019-11-29T13:39:54.523 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:54.518+0000 7fcd66500ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:54.544 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:54.540+0000 7fcd66500ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:39:54.560 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:54.556+0000 7fcd66500ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:54.608 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:54.604+0000 7fcd66500ec0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2019-11-29T13:39:54.679 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:54.675+0000 7fcd66500ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:54.706 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:54.702+0000 7fcd66500ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:39:54.720 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:54.716+0000 7fcd66500ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:54.779 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:54.775+0000 7fcd66500ec0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2019-11-29T13:39:54.878 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:54.874+0000 7fcd66500ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:54.904 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:54.900+0000 7fcd66500ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:39:54.913 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:54.909+0000 7fcd66500ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:54.954 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:54.950+0000 7fcd66500ec0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2019-11-29T13:39:55.050 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:55.046+0000 7fcd66500ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:55.075 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:55.071+0000 7fcd66500ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:39:55.087 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:55.083+0000 7fcd66500ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:55.137 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:55.133+0000 7fcd66500ec0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2019-11-29T13:39:55.206 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:55.202+0000 7fcd66500ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:55.229 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:55.225+0000 7fcd66500ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:39:55.244 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:55.240+0000 7fcd66500ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:55.300 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:55.296+0000 7fcd66500ec0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2019-11-29T13:39:55.350 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:55.346+0000 7fcd66500ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:55.366 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:55.363+0000 7fcd66500ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:39:55.376 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:55.372+0000 7fcd66500ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:55.419 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:55.415+0000 7fcd66500ec0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2019-11-29T13:39:55.477 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:55.473+0000 7fcd66500ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:55.514 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:55.510+0000 7fcd66500ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:39:55.532 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:55.528+0000 7fcd66500ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:55.586 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:55.582+0000 7fcd66500ec0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2019-11-29T13:39:55.645 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:55.641+0000 7fcd66500ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:55.697 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:55.693+0000 7fcd66500ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:39:55.711 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:55.707+0000 7fcd66500ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:55.758 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:55.754+0000 7fcd66500ec0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2019-11-29T13:39:55.825 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:55.821+0000 7fcd66500ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:55.848 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:55.844+0000 7fcd66500ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:39:55.858 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:55.854+0000 7fcd66500ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:55.913 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:55.909+0000 7fcd66500ec0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2019-11-29T13:39:56.001 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:55.997+0000 7fcd66500ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:56.035 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:56.031+0000 7fcd66500ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:39:56.053 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:56.050+0000 7fcd66500ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:56.108 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:56.104+0000 7fcd66500ec0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2019-11-29T13:39:56.173 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:56.169+0000 7fcd66500ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:56.193 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:56.190+0000 7fcd66500ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:39:56.210 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:56.206+0000 7fcd66500ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:56.270 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:56.266+0000 7fcd66500ec0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2019-11-29T13:39:56.350 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:56.346+0000 7fcd66500ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:56.376 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:56.372+0000 7fcd66500ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:39:56.392 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:56.388+0000 7fcd66500ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:56.445 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:56.441+0000 7fcd66500ec0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2019-11-29T13:39:56.530 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:56.526+0000 7fcd66500ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:56.564 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:56.560+0000 7fcd66500ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:39:56.582 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:56.578+0000 7fcd66500ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:56.630 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:56.626+0000 7fcd66500ec0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2019-11-29T13:39:56.722 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:56.718+0000 7fcd66500ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:56.750 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:56.746+0000 7fcd66500ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:39:56.770 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:56.766+0000 7fcd66500ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:56.828 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:56.824+0000 7fcd66500ec0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2019-11-29T13:39:56.880 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:56.876+0000 7fcd66500ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:56.896 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:56.892+0000 7fcd66500ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:39:56.914 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:56.910+0000 7fcd66500ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:56.956 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:56.952+0000 7fcd66500ec0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2019-11-29T13:39:57.001 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:56.997+0000 7fcd66500ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:57.020 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:57.016+0000 7fcd66500ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:39:57.028 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:57.024+0000 7fcd66500ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:57.063 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:57.059+0000 7fcd66500ec0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2019-11-29T13:39:57.113 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:57.109+0000 7fcd66500ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:57.133 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:57.129+0000 7fcd66500ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:39:57.147 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:57.143+0000 7fcd66500ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:57.189 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:57.184+0000 7fcd66500ec0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2019-11-29T13:39:57.240 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:57.236+0000 7fcd66500ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:57.257 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:57.253+0000 7fcd66500ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:39:57.268 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:57.264+0000 7fcd66500ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:57.313 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:57.309+0000 7fcd66500ec0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2019-11-29T13:39:57.373 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:57.369+0000 7fcd66500ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:57.398 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:57.394+0000 7fcd66500ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:39:57.413 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:57.410+0000 7fcd66500ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:57.476 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:57.472+0000 7fcd66500ec0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2019-11-29T13:39:57.538 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:57.534+0000 7fcd66500ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:57.554 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:57.551+0000 7fcd66500ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:39:57.563 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:57.559+0000 7fcd66500ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:57.600 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:57.596+0000 7fcd66500ec0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2019-11-29T13:39:57.655 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:57.651+0000 7fcd66500ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:57.679 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:57.675+0000 7fcd66500ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:39:57.692 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:57.688+0000 7fcd66500ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:57.844 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:57.840+0000 7fcd66500ec0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2019-11-29T13:39:57.896 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:57.892+0000 7fcd66500ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:57.916 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:57.912+0000 7fcd66500ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:39:57.926 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:57.923+0000 7fcd66500ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:57.968 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:57.964+0000 7fcd66500ec0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2019-11-29T13:39:58.018 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:58.014+0000 7fcd66500ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:58.037 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:58.033+0000 7fcd66500ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:39:58.050 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:58.046+0000 7fcd66500ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:58.099 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:58.095+0000 7fcd66500ec0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2019-11-29T13:39:58.161 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:58.157+0000 7fcd66500ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:58.178 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:58.175+0000 7fcd66500ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:39:58.189 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:58.185+0000 7fcd66500ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:58.236 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:58.232+0000 7fcd66500ec0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2019-11-29T13:39:58.295 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:58.291+0000 7fcd66500ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:58.314 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:58.310+0000 7fcd66500ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T13:39:58.334 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:58.330+0000 7fcd66500ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T13:39:58.437 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:58.433+0000 7fcd66500ec0 20 remove_watcher() i=0 2019-11-29T13:39:58.437 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:58.433+0000 7fcd66500ec0 2 removed watcher, disabling cache 2019-11-29T13:39:58.504 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:58.500+0000 7fcd66500ec0 20 remove_watcher() i=1 2019-11-29T13:39:58.556 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:58.552+0000 7fcd66500ec0 20 remove_watcher() i=2 2019-11-29T13:39:58.618 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:58.614+0000 7fcd66500ec0 20 remove_watcher() i=3 2019-11-29T13:39:58.673 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:58.669+0000 7fcd66500ec0 20 remove_watcher() i=4 2019-11-29T13:39:58.714 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:58.710+0000 7fcd66500ec0 20 remove_watcher() i=5 2019-11-29T13:39:58.763 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:58.759+0000 7fcd66500ec0 20 remove_watcher() i=6 2019-11-29T13:39:58.819 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T13:39:58.815+0000 7fcd66500ec0 20 remove_watcher() i=7 2019-11-29T13:39:58.829 INFO:teuthology.orchestra.run.smithi062:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle-4.7/bin/gradle clean test --rerun-tasks --no-build-cache --tests ObjectTest 2019-11-29T13:39:59.418 INFO:teuthology.orchestra.run.smithi062.stdout:> Task :clean 2019-11-29T13:40:00.114 INFO:teuthology.orchestra.run.smithi062.stdout:> Task :compileJava 2019-11-29T13:40:00.114 INFO:teuthology.orchestra.run.smithi062.stdout:> Task :processResources 2019-11-29T13:40:00.114 INFO:teuthology.orchestra.run.smithi062.stdout:> Task :classes 2019-11-29T13:40:00.315 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T13:40:00.315 INFO:teuthology.orchestra.run.smithi062.stdout:> Task :compileTestJava 2019-11-29T13:40:00.315 INFO:teuthology.orchestra.run.smithi062.stdout:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2019-11-29T13:40:00.316 INFO:teuthology.orchestra.run.smithi062.stdout:Note: Recompile with -Xlint:deprecation for details. 2019-11-29T13:40:00.316 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T13:40:00.316 INFO:teuthology.orchestra.run.smithi062.stdout:> Task :processTestResources NO-SOURCE 2019-11-29T13:40:00.316 INFO:teuthology.orchestra.run.smithi062.stdout:> Task :testClasses 2019-11-29T13:40:03.715 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T13:40:03.715 INFO:teuthology.orchestra.run.smithi062.stdout:> Task :test 2019-11-29T13:40:03.715 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T13:40:03.715 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound STARTED 2019-11-29T13:40:09.014 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T13:40:09.014 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound PASSED 2019-11-29T13:40:22.314 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T13:40:22.314 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone STARTED 2019-11-29T13:40:27.514 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T13:40:27.514 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone PASSED 2019-11-29T13:40:35.414 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T13:40:35.414 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty STARTED 2019-11-29T13:40:38.214 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T13:40:38.214 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty PASSED 2019-11-29T13:40:48.913 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T13:40:48.914 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI STARTED 2019-11-29T13:41:26.135 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:01:16:06.794 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T13:41:26.140 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:01:16:06.799 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T13:41:26.182 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:01:16:06.788 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T13:41:26.185 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:01:16:06.792 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T13:41:26.280 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:01:16:06.886 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T13:41:26.291 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:01:16:06.951 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T13:41:26.321 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:01:16:06.928 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T13:41:26.325 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:01:16:06.932 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T13:41:26.395 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:01:16:07.002 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T13:41:45.914 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T13:41:45.914 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI PASSED 2019-11-29T13:41:53.314 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T13:41:53.314 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI STARTED 2019-11-29T13:41:56.213 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T13:41:56.214 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI PASSED 2019-11-29T13:42:03.313 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T13:42:03.314 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI STARTED 2019-11-29T13:42:07.313 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T13:42:07.314 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI PASSED 2019-11-29T13:42:17.013 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T13:42:17.013 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI STARTED 2019-11-29T13:42:17.513 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T13:42:17.514 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI PASSED 2019-11-29T13:42:18.913 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T13:42:18.914 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI STARTED 2019-11-29T13:42:23.216 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T13:42:23.217 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI PASSED 2019-11-29T13:42:29.813 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T13:42:29.814 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB STARTED 2019-11-29T13:43:08.513 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T13:43:08.514 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB PASSED 2019-11-29T13:43:17.313 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T13:43:17.314 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b STARTED 2019-11-29T13:43:22.713 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T13:43:22.713 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b PASSED 2019-11-29T13:43:32.013 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T13:43:32.014 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb STARTED 2019-11-29T13:43:37.513 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T13:43:37.514 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb PASSED 2019-11-29T13:43:45.313 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T13:43:45.314 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC STARTED 2019-11-29T13:43:47.713 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T13:43:47.714 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC PASSED 2019-11-29T13:43:55.913 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T13:43:55.914 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 STARTED 2019-11-29T13:43:58.713 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T13:43:58.714 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 PASSED 2019-11-29T13:44:06.713 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T13:44:06.714 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey STARTED 2019-11-29T13:44:11.713 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T13:44:11.713 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey PASSED 2019-11-29T13:44:18.213 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T13:44:18.214 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 STARTED 2019-11-29T13:44:21.015 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T13:44:21.016 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 PASSED 2019-11-29T13:44:26.458 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:01:19:07.118 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T13:44:26.467 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:01:19:07.126 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T13:44:26.472 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:01:19:07.078 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T13:44:26.477 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:01:19:07.084 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T13:44:26.478 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:01:19:07.084 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T13:44:26.484 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:01:19:07.091 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T13:44:26.594 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:01:19:07.253 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T13:44:26.627 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:01:19:07.233 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T13:44:26.637 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:01:19:07.243 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T13:44:26.913 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T13:44:26.913 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete STARTED 2019-11-29T13:44:35.417 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T13:44:35.417 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete PASSED 2019-11-29T13:44:43.413 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T13:44:43.413 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA STARTED 2019-11-29T13:45:36.313 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T13:45:36.314 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA PASSED 2019-11-29T13:45:54.514 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T13:45:54.514 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI STARTED 2019-11-29T13:49:38.224 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:01:24:18.883 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T13:49:38.231 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:01:24:18.890 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T13:49:38.243 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:01:24:18.850 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T13:49:38.244 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:01:24:18.850 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T13:49:38.246 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:01:24:18.852 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T13:49:38.246 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:01:24:18.853 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T13:49:38.457 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:01:24:19.116 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T13:49:38.464 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:01:24:19.071 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T13:49:38.486 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:01:24:19.091 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T13:49:53.311 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:01:24:33.970 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T13:49:53.320 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:01:24:33.979 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T13:49:53.344 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:01:24:34.003 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T13:49:53.356 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:01:24:33.962 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T13:49:53.370 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:01:24:33.976 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T13:49:53.383 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:01:24:33.990 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T13:49:53.388 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:01:24:33.994 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T13:49:53.394 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:01:24:33.999 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T13:49:53.410 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:01:24:34.016 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T13:50:41.214 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T13:50:41.214 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI PASSED 2019-11-29T13:50:59.713 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T13:50:59.714 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI STARTED 2019-11-29T13:51:03.014 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T13:51:03.014 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI PASSED 2019-11-29T13:51:10.913 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T13:51:10.913 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI STARTED 2019-11-29T13:51:16.913 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T13:51:16.914 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI PASSED 2019-11-29T13:51:30.313 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T13:51:30.314 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI STARTED 2019-11-29T13:52:16.414 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T13:52:16.414 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI PASSED 2019-11-29T13:52:26.313 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T13:52:26.313 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI STARTED 2019-11-29T13:52:26.713 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T13:52:26.714 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI PASSED 2019-11-29T13:52:28.013 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T13:52:28.014 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI STARTED 2019-11-29T13:53:18.795 INFO:tasks.rgw.client.0.smithi062.stdout:2019-11-29T13:53:18.684+0000 11241b700 -1 handle_data failed with exit code -104 2019-11-29T13:53:19.813 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T13:53:19.814 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI PASSED 2019-11-29T13:53:27.413 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T13:53:27.414 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 STARTED 2019-11-29T13:54:50.471 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:01:29:31.129 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T13:54:50.483 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:01:29:31.142 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T13:54:50.488 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:01:29:31.095 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T13:54:50.491 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:01:29:31.098 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T13:54:50.498 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:01:29:31.104 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T13:54:50.505 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:01:29:31.111 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T13:54:50.677 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:01:29:31.335 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T13:54:50.686 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:01:29:31.292 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T13:54:50.733 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:01:29:31.339 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T13:54:54.413 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T13:54:54.413 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 PASSED 2019-11-29T13:55:05.813 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T13:55:05.813 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI STARTED 2019-11-29T13:56:02.513 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T13:56:02.514 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI PASSED 2019-11-29T13:56:13.813 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T13:56:13.813 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI STARTED 2019-11-29T13:58:15.184 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:01:32:55.843 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T13:58:15.207 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:01:32:55.814 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T13:58:15.209 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:01:32:55.868 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T13:58:15.234 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:01:32:55.841 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T13:58:15.284 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:01:32:55.891 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T13:58:15.286 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:01:32:55.893 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T13:58:15.328 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:01:32:55.987 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T13:58:15.372 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:01:32:55.979 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T13:58:15.380 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:01:32:55.987 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T14:00:01.115 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:01:34:41.774 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T14:00:01.123 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:01:34:41.781 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T14:00:01.130 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:01:34:41.737 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T14:00:01.132 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:01:34:41.739 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T14:00:01.134 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:01:34:41.741 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T14:00:01.136 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:01:34:41.744 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T14:00:01.214 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:01:34:41.873 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T14:00:01.223 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:01:34:41.826 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T14:00:01.241 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:01:34:41.848 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T14:02:11.013 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T14:02:11.014 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI PASSED 2019-11-29T14:02:20.513 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T14:02:20.513 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI STARTED 2019-11-29T14:03:56.813 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T14:03:56.813 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI PASSED 2019-11-29T14:04:05.412 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T14:04:05.412 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI STARTED 2019-11-29T14:05:10.343 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:01:39:51.001 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T14:05:10.352 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:01:39:51.010 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T14:05:10.359 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:01:39:50.967 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T14:05:10.360 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:01:39:50.967 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T14:05:10.364 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:01:39:50.972 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T14:05:10.366 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:01:39:50.974 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T14:05:10.571 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:01:39:51.178 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T14:05:10.572 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:01:39:51.230 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T14:05:10.581 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:01:39:51.188 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T14:05:12.812 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T14:05:12.813 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI PASSED 2019-11-29T14:05:21.912 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T14:05:21.913 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause STARTED 2019-11-29T14:05:40.112 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T14:05:40.113 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause PASSED 2019-11-29T14:06:01.912 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T14:06:01.913 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound STARTED 2019-11-29T14:06:06.213 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T14:06:06.213 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound PASSED 2019-11-29T14:06:12.413 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T14:06:12.413 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectCreateBadContentlengthNegative STARTED 2019-11-29T14:06:16.012 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T14:06:16.013 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectCreateBadContentlengthNegative PASSED 2019-11-29T14:06:42.184 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:01:41:22.842 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T14:06:42.195 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:01:41:22.802 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T14:06:42.201 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:01:41:22.859 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T14:06:42.227 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:01:41:22.835 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T14:06:42.234 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:01:41:22.841 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T14:06:42.236 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:01:41:22.844 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T14:06:42.267 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:01:41:22.925 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T14:06:42.306 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:01:41:22.913 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T14:06:42.308 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:01:41:22.915 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T14:06:42.812 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T14:06:42.813 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch STARTED 2019-11-29T14:06:47.367 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:01:41:28.025 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T14:06:47.377 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:01:41:28.035 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T14:06:47.413 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T14:06:47.413 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch PASSED 2019-11-29T14:06:47.419 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:01:41:28.026 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T14:06:47.423 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:01:41:28.081 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T14:06:47.427 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:01:41:28.034 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T14:06:47.450 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:01:41:28.055 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T14:06:47.461 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:01:41:28.068 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T14:06:47.469 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:01:41:28.076 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T14:06:47.480 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:01:41:28.087 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T14:07:23.212 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T14:07:23.213 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort STARTED 2019-11-29T14:07:29.712 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T14:07:29.713 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort PASSED 2019-11-29T14:08:02.112 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T14:08:02.113 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid STARTED 2019-11-29T14:08:12.112 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T14:08:12.113 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid PASSED 2019-11-29T14:08:52.112 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T14:08:52.113 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None STARTED 2019-11-29T14:09:07.912 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T14:09:07.913 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None PASSED 2019-11-29T14:10:09.612 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T14:10:09.613 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable STARTED 2019-11-29T14:10:20.483 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:01:45:01.140 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T14:10:20.500 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:01:45:01.107 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T14:10:20.501 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:01:45:01.108 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T14:10:20.506 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:01:45:01.113 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T14:10:20.508 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:01:45:01.166 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T14:10:20.510 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:01:45:01.118 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T14:10:20.512 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T14:10:20.513 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable PASSED 2019-11-29T14:10:20.678 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:01:45:01.285 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T14:10:20.701 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:01:45:01.308 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T14:10:20.704 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:01:45:01.361 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T14:12:00.413 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T14:12:00.413 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes STARTED 2019-11-29T14:12:25.313 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T14:12:25.313 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes PASSED 2019-11-29T14:13:44.313 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T14:13:44.313 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot STARTED 2019-11-29T14:15:04.082 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:01:49:44.740 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T14:15:04.124 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:01:49:44.782 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T14:15:04.172 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:01:49:44.780 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T14:15:04.177 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:01:49:44.785 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T14:15:04.186 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:01:49:44.793 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T14:15:04.194 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:01:49:44.801 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T14:15:04.255 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:01:49:44.913 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T14:15:04.315 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:01:49:44.922 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T14:15:04.368 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:01:49:44.975 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T14:15:17.713 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T14:15:17.713 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot PASSED 2019-11-29T14:15:32.682 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:01:50:13.340 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T14:15:32.697 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:01:50:13.355 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T14:15:32.700 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:01:50:13.308 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T14:15:32.703 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:01:50:13.310 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T14:15:32.704 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:01:50:13.311 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T14:15:32.707 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:01:50:13.314 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T14:15:32.745 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:01:50:13.352 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T14:15:32.752 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:01:50:13.359 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T14:15:32.756 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:01:50:13.414 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T14:17:58.913 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T14:17:58.913 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist STARTED 2019-11-29T14:20:45.093 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:01:55:25.751 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T14:20:45.104 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:01:55:25.762 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T14:20:45.110 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:01:55:25.717 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T14:20:45.111 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:01:55:25.717 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T14:20:45.115 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:01:55:25.722 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T14:20:45.115 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:01:55:25.722 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T14:20:45.315 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:01:55:25.921 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T14:20:45.329 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:01:55:25.987 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T14:20:45.344 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:01:55:25.950 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T14:21:13.713 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T14:21:13.713 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist PASSED 2019-11-29T14:23:26.385 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:01:58:07.043 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T14:23:26.393 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:01:58:07.051 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T14:23:26.434 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:01:58:07.040 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T14:23:26.436 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:01:58:07.043 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T14:23:26.442 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:01:58:07.048 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T14:23:26.454 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:01:58:07.061 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T14:23:26.521 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:01:58:07.127 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T14:23:26.527 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:01:58:07.185 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T14:23:26.546 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:01:58:07.152 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T14:25:55.246 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:02:00:35.904 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T14:25:55.259 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:02:00:35.917 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T14:25:55.265 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:02:00:35.872 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T14:25:55.268 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:02:00:35.875 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T14:25:55.270 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:02:00:35.877 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T14:25:55.275 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:02:00:35.882 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T14:25:55.368 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:02:00:36.026 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T14:25:55.398 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:02:00:36.005 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T14:25:55.402 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:02:00:36.008 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T14:31:07.564 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:02:05:48.222 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T14:31:07.571 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:02:05:48.229 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T14:31:07.575 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:02:05:48.181 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T14:31:07.578 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:02:05:48.184 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T14:31:07.579 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:02:05:48.185 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T14:31:07.587 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:02:05:48.193 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T14:31:07.770 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:02:05:48.377 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T14:31:07.855 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:02:05:48.513 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T14:31:07.888 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:02:05:48.495 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T14:31:48.536 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:02:06:29.194 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T14:31:48.578 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:02:06:29.237 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T14:31:48.579 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:02:06:29.186 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T14:31:48.580 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:02:06:29.186 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T14:31:48.582 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:02:06:29.189 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T14:31:48.583 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:02:06:29.190 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T14:31:48.618 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:02:06:29.225 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T14:31:48.628 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:02:06:29.234 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T14:31:48.632 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:02:06:29.290 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T14:32:54.613 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T14:32:54.613 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage STARTED 2019-11-29T14:35:44.313 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T14:35:44.313 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage PASSED 2019-11-29T14:36:18.036 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:02:10:58.695 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T14:36:18.042 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:02:10:58.700 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T14:36:18.045 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:02:10:58.652 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T14:36:18.047 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:02:10:58.654 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T14:36:18.049 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:02:10:58.656 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T14:36:18.055 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:02:10:58.661 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T14:36:18.221 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:02:10:58.879 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T14:36:18.226 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:02:10:58.833 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T14:36:18.257 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:02:10:58.864 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T14:40:10.526 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:02:14:51.184 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T14:40:10.545 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:02:14:51.204 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T14:40:10.547 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:02:14:51.153 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T14:40:10.550 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:02:14:51.156 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T14:40:10.562 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:02:14:51.168 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T14:40:10.564 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:02:14:51.171 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T14:40:10.667 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:02:14:51.274 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T14:40:10.668 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:02:14:51.275 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T14:40:10.694 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:02:14:51.353 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T14:40:31.213 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T14:40:31.214 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList STARTED 2019-11-29T14:41:30.297 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:02:16:10.955 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T14:41:30.301 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:02:16:10.907 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T14:41:30.304 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:02:16:10.911 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T14:41:30.306 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:02:16:10.912 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T14:41:30.307 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:02:16:10.966 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T14:41:30.316 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:02:16:10.923 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T14:41:30.379 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:02:16:10.986 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T14:41:30.380 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:02:16:10.987 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T14:41:30.434 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:02:16:11.092 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T14:42:57.313 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T14:42:57.313 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList PASSED 2019-11-29T14:46:16.513 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T14:46:16.513 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList STARTED 2019-11-29T14:46:42.979 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:02:21:23.637 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T14:46:42.982 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:02:21:23.640 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T14:46:42.999 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:02:21:23.606 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T14:46:43.010 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:02:21:23.617 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T14:46:43.096 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:02:21:23.703 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T14:46:43.101 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:02:21:23.708 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T14:46:43.190 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:02:21:23.848 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T14:46:43.201 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:02:21:23.808 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T14:46:43.312 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:02:21:23.919 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T14:47:47.204 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:02:22:27.863 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T14:47:47.253 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:02:22:27.911 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T14:47:47.273 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:02:22:27.879 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T14:47:47.299 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:02:22:27.906 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T14:47:47.303 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:02:22:27.910 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T14:47:47.309 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:02:22:27.968 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T14:47:47.317 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:02:22:27.924 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T14:47:47.359 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:02:22:27.966 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T14:47:47.378 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:02:22:27.985 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T14:48:04.813 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T14:48:04.813 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList PASSED 2019-11-29T14:48:37.530 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:02:23:18.188 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T14:48:37.533 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:02:23:18.192 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T14:48:37.574 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:02:23:18.181 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T14:48:37.579 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:02:23:18.186 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T14:48:37.580 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:02:23:18.239 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T14:48:37.581 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:02:23:18.187 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T14:48:37.585 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:02:23:18.192 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T14:48:37.617 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:02:23:18.224 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T14:48:37.628 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:02:23:18.235 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T14:49:32.413 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T14:49:32.413 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList STARTED 2019-11-29T14:49:56.413 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T14:49:56.413 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList PASSED 2019-11-29T14:50:10.313 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T14:50:10.313 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable STARTED 2019-11-29T14:50:18.113 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T14:50:18.113 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable PASSED 2019-11-29T14:50:28.613 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T14:50:28.613 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative STARTED 2019-11-29T14:50:37.513 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T14:50:37.513 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative PASSED 2019-11-29T14:50:50.613 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T14:50:50.613 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone STARTED 2019-11-29T14:50:58.713 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T14:50:58.714 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone PASSED 2019-11-29T14:51:11.313 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T14:51:11.313 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne STARTED 2019-11-29T14:51:18.013 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T14:51:18.014 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne PASSED 2019-11-29T14:51:31.913 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T14:51:31.913 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero STARTED 2019-11-29T14:51:40.713 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T14:51:40.713 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero PASSED 2019-11-29T14:51:53.174 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:02:26:33.833 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T14:51:53.180 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:02:26:33.839 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T14:51:53.190 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:02:26:33.797 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T14:51:53.192 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:02:26:33.799 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T14:51:53.196 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:02:26:33.803 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T14:51:53.198 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:02:26:33.805 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T14:51:53.320 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:02:26:33.926 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T14:51:53.335 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:02:26:33.942 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T14:51:53.383 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:02:26:34.041 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T14:51:53.413 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T14:51:53.413 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt STARTED 2019-11-29T14:52:00.613 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T14:52:00.613 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt PASSED 2019-11-29T14:52:13.213 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T14:52:13.213 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic STARTED 2019-11-29T14:52:18.013 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T14:52:18.013 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic PASSED 2019-11-29T14:52:32.013 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T14:52:32.013 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt STARTED 2019-11-29T14:52:42.013 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T14:52:42.013 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt PASSED 2019-11-29T14:52:55.213 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T14:52:55.213 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic STARTED 2019-11-29T14:53:04.913 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T14:53:04.913 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic PASSED 2019-11-29T14:53:18.813 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T14:53:18.813 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist STARTED 2019-11-29T14:53:28.213 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T14:53:28.213 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist PASSED 2019-11-29T14:53:42.413 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T14:53:42.413 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist STARTED 2019-11-29T14:53:51.013 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T14:53:51.013 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist PASSED 2019-11-29T14:54:05.413 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T14:54:05.413 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist STARTED 2019-11-29T14:54:11.413 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T14:54:11.413 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist PASSED 2019-11-29T14:54:22.013 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T14:54:22.013 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty STARTED 2019-11-29T14:54:31.313 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T14:54:31.313 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty PASSED 2019-11-29T14:54:42.913 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T14:54:42.913 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone STARTED 2019-11-29T14:54:51.117 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T14:54:51.117 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone PASSED 2019-11-29T14:55:01.213 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T14:55:01.213 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist STARTED 2019-11-29T14:55:10.013 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T14:55:10.013 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist PASSED 2019-11-29T14:55:21.213 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T14:55:21.213 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable STARTED 2019-11-29T14:55:28.613 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T14:55:28.613 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable PASSED 2019-11-29T14:55:38.813 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T14:55:38.813 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket STARTED 2019-11-29T14:55:42.213 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T14:55:42.213 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket PASSED 2019-11-29T14:55:47.613 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T14:55:47.613 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist STARTED 2019-11-29T14:55:50.113 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T14:55:50.113 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist PASSED 2019-11-29T14:55:57.413 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T14:55:57.413 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl STARTED 2019-11-29T14:56:02.113 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T14:56:02.113 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl PASSED 2019-11-29T14:56:11.713 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T14:56:11.713 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag STARTED 2019-11-29T14:56:15.113 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T14:56:15.113 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag PASSED 2019-11-29T14:56:22.713 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T14:56:22.713 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete STARTED 2019-11-29T14:56:32.013 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T14:56:32.013 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete PASSED 2019-11-29T14:56:37.214 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T14:56:37.214 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket STARTED 2019-11-29T14:56:37.813 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T14:56:37.813 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket PASSED 2019-11-29T14:56:39.113 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T14:56:39.113 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode STARTED 2019-11-29T14:56:43.213 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T14:56:43.213 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode PASSED 2019-11-29T14:56:52.213 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T14:56:52.213 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode STARTED 2019-11-29T14:56:56.113 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T14:56:56.113 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode PASSED 2019-11-29T14:56:59.277 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:02:31:39.935 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T14:56:59.332 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:02:31:39.990 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T14:56:59.372 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:02:31:39.975 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T14:56:59.372 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:02:31:39.976 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T14:56:59.373 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:02:31:39.979 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T14:56:59.374 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:02:31:39.981 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T14:56:59.507 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:02:31:40.165 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T14:56:59.544 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:02:31:40.150 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T14:56:59.593 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:02:31:40.199 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T14:57:03.713 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T14:57:03.713 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey STARTED 2019-11-29T14:57:05.443 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:02:31:46.102 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T14:57:05.467 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:02:31:46.074 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T14:57:05.473 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:02:31:46.080 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T14:57:05.473 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:02:31:46.080 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T14:57:05.479 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:02:31:46.086 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T14:57:05.480 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:02:31:46.139 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T14:57:05.507 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:02:31:46.113 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T14:57:05.525 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:02:31:46.183 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T14:57:05.534 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:02:31:46.141 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T14:57:06.213 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T14:57:06.213 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey PASSED 2019-11-29T14:57:13.913 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T14:57:13.913 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared STARTED 2019-11-29T14:57:17.613 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T14:57:17.613 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared PASSED 2019-11-29T14:57:24.813 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T14:57:24.813 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testSSEKMSPresent STARTED 2019-11-29T14:57:29.013 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T14:57:29.013 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testSSEKMSPresent PASSED 2019-11-29T14:57:35.413 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T14:57:35.413 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile STARTED 2019-11-29T14:58:25.813 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T14:58:25.813 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile PASSED 2019-11-29T14:58:33.613 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T14:58:33.613 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testUploadFileListHLAPI STARTED 2019-11-29T14:59:12.113 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T14:59:12.113 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testUploadFileListHLAPI PASSED 2019-11-29T14:59:21.013 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T14:59:21.013 INFO:teuthology.orchestra.run.smithi062.stdout:---------------------------------------------------------------------- 2019-11-29T14:59:21.014 INFO:teuthology.orchestra.run.smithi062.stdout:| Results: SUCCESS (72 tests, 72 successes, 0 failures, 0 skipped) | 2019-11-29T14:59:21.014 INFO:teuthology.orchestra.run.smithi062.stdout:---------------------------------------------------------------------- 2019-11-29T14:59:21.014 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T14:59:21.014 INFO:teuthology.orchestra.run.smithi062.stdout:BUILD SUCCESSFUL in 1h 19m 22s 2019-11-29T14:59:21.014 INFO:teuthology.orchestra.run.smithi062.stdout:5 actionable tasks: 5 executed 2019-11-29T14:59:21.027 INFO:teuthology.orchestra.run.smithi062:> radosgw-admin gc process --include-all 2019-11-29T14:59:21.162 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:21.159+0000 7f82f1b41ec0 20 rados->read ofs=0 len=0 2019-11-29T14:59:21.401 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:21.397+0000 7f82f1b41ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T14:59:21.401 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:21.397+0000 7f82f1b41ec0 20 rados->read ofs=0 len=0 2019-11-29T14:59:21.416 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:21.413+0000 7f82f1b41ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T14:59:21.416 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:21.413+0000 7f82f1b41ec0 20 rados->read ofs=0 len=0 2019-11-29T14:59:21.430 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:21.427+0000 7f82f1b41ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T14:59:21.430 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:21.427+0000 7f82f1b41ec0 20 rados->read ofs=0 len=0 2019-11-29T14:59:21.457 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:21.454+0000 7f82f1b41ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T14:59:21.709 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:21.706+0000 7f82f1b41ec0 20 RGWRados::pool_iterate: got zone_info.7f922895-c6d7-4b1b-a19c-be3df5b5a899 2019-11-29T14:59:21.709 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:21.706+0000 7f82f1b41ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-29T14:59:21.710 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:21.706+0000 7f82f1b41ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-29T14:59:21.710 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:21.706+0000 7f82f1b41ec0 20 RGWRados::pool_iterate: got zonegroup_info.76ba47ff-1c23-4409-aae0-24fe26589cae 2019-11-29T14:59:21.710 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:21.706+0000 7f82f1b41ec0 20 rados->read ofs=0 len=0 2019-11-29T14:59:21.723 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:21.720+0000 7f82f1b41ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T14:59:21.724 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:21.720+0000 7f82f1b41ec0 20 rados->read ofs=0 len=0 2019-11-29T14:59:21.737 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:21.734+0000 7f82f1b41ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-29T14:59:21.737 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:21.734+0000 7f82f1b41ec0 20 rados->read ofs=0 len=0 2019-11-29T14:59:21.746 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:21.743+0000 7f82f1b41ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T14:59:21.746 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:21.743+0000 7f82f1b41ec0 20 rados->read ofs=0 len=0 2019-11-29T14:59:21.759 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:21.755+0000 7f82f1b41ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-29T14:59:21.759 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:21.755+0000 7f82f1b41ec0 20 rados->read ofs=0 len=0 2019-11-29T14:59:21.767 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:21.764+0000 7f82f1b41ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T14:59:21.768 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:21.764+0000 7f82f1b41ec0 10 cannot find current period zonegroup using local zonegroup 2019-11-29T14:59:21.768 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:21.764+0000 7f82f1b41ec0 20 rados->read ofs=0 len=0 2019-11-29T14:59:21.776 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:21.773+0000 7f82f1b41ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T14:59:21.776 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:21.773+0000 7f82f1b41ec0 20 rados->read ofs=0 len=0 2019-11-29T14:59:21.784 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:21.781+0000 7f82f1b41ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T14:59:21.785 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:21.781+0000 7f82f1b41ec0 20 rados->read ofs=0 len=0 2019-11-29T14:59:21.796 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:21.792+0000 7f82f1b41ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-29T14:59:21.796 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:21.792+0000 7f82f1b41ec0 20 zonegroup default 2019-11-29T14:59:21.796 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:21.792+0000 7f82f1b41ec0 20 rados->read ofs=0 len=0 2019-11-29T14:59:21.804 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:21.801+0000 7f82f1b41ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T14:59:21.804 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:21.801+0000 7f82f1b41ec0 10 Cannot find current period zone using local zone 2019-11-29T14:59:21.804 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:21.801+0000 7f82f1b41ec0 20 rados->read ofs=0 len=0 2019-11-29T14:59:21.812 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:21.809+0000 7f82f1b41ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T14:59:21.812 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:21.809+0000 7f82f1b41ec0 20 rados->read ofs=0 len=0 2019-11-29T14:59:21.821 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:21.818+0000 7f82f1b41ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T14:59:21.821 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:21.818+0000 7f82f1b41ec0 20 rados->read ofs=0 len=0 2019-11-29T14:59:21.834 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:21.831+0000 7f82f1b41ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-29T14:59:21.835 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:21.831+0000 7f82f1b41ec0 20 zone default found 2019-11-29T14:59:21.835 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:21.831+0000 7f82f1b41ec0 20 started sync module instance, tier type = 2019-11-29T14:59:21.835 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:21.831+0000 7f82f1b41ec0 20 started zone id=7f922895-c6d7-4b1b-a19c-be3df5b5a899 (name=default) with tier type = 2019-11-29T14:59:22.165 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:22.162+0000 7f82f1b41ec0 20 add_watcher() i=0 2019-11-29T14:59:22.165 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:22.162+0000 7f82f1b41ec0 20 add_watcher() i=1 2019-11-29T14:59:22.165 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:22.162+0000 7f82f1b41ec0 20 add_watcher() i=2 2019-11-29T14:59:22.165 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:22.162+0000 7f82f1b41ec0 20 add_watcher() i=3 2019-11-29T14:59:22.166 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:22.162+0000 7f82f1b41ec0 20 add_watcher() i=4 2019-11-29T14:59:22.166 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:22.162+0000 7f82f1b41ec0 20 add_watcher() i=5 2019-11-29T14:59:22.166 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:22.162+0000 7f82f1b41ec0 20 add_watcher() i=6 2019-11-29T14:59:22.204 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:22.201+0000 7f82f1b41ec0 20 add_watcher() i=7 2019-11-29T14:59:22.204 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:22.201+0000 7f82f1b41ec0 2 all 8 watchers are set, enabling cache 2019-11-29T14:59:22.205 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:22.201+0000 7f82af7de700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-29T14:59:22.207 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:22.204+0000 7f82df56f700 0 -- 172.21.15.62:0/1080267702 >> v2:172.21.15.62:3300/0 conn(0x5586e6a0d990 msgr2=0x5586e6a21ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2019-11-29T14:59:22.253 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:22.250+0000 7f82d7fff700 0 -- 172.21.15.62:0/1280536521 >> [v2:172.21.15.22:6818/9264,v1:172.21.15.22:6819/9264] conn(0x5586e6a56be0 msgr2=0x5586e6a59000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-29T14:59:23.921 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:23.917+0000 7f821dffb700 20 reqs_thread_entry: start 2019-11-29T14:59:23.921 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:23.917+0000 7f82177fe700 20 reqs_thread_entry: start 2019-11-29T14:59:23.921 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:23.917+0000 7f82f1b41ec0 20 init_complete bucket index max shards: 0 2019-11-29T14:59:23.922 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:23.918+0000 7f8215ffb700 20 reqs_thread_entry: start 2019-11-29T14:59:23.922 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:23.918+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2019-11-29T14:59:23.970 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:23.966+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T14:59:23.985 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:23.982+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T14:59:23.997 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:23.993+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T14:59:24.039 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:24.036+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2019-11-29T14:59:24.104 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:24.100+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T14:59:24.127 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:24.124+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T14:59:24.136 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:24.132+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T14:59:24.192 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:24.188+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2019-11-29T14:59:24.272 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:24.269+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T14:59:24.290 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:24.287+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T14:59:24.304 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:24.300+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-11-29T14:59:24.305 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:24.300+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process iterating over entry tag='7f922895-c6d7-4b1b-a19c-be3df5b5a899.4325.1160', time=2019-11-29T15:50:43.793397+0000, chain.objs.size()=5 2019-11-29T14:59:24.305 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:24.300+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.66__shadow_.a2FMj_GH9kbBnx5Avn3db0qlhpPoi8Z_1 2019-11-29T14:59:24.305 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:24.300+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.66__shadow_.a2FMj_GH9kbBnx5Avn3db0qlhpPoi8Z_2 2019-11-29T14:59:24.305 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:24.300+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.66__shadow_.a2FMj_GH9kbBnx5Avn3db0qlhpPoi8Z_3 2019-11-29T14:59:24.305 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:24.300+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.66__shadow_.a2FMj_GH9kbBnx5Avn3db0qlhpPoi8Z_4 2019-11-29T14:59:24.305 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:24.300+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.66__shadow_.a2FMj_GH9kbBnx5Avn3db0qlhpPoi8Z_5 2019-11-29T14:59:24.305 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:24.300+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process iterating over entry tag='7f922895-c6d7-4b1b-a19c-be3df5b5a899.4325.1321', time=2019-11-29T15:59:09.147337+0000, chain.objs.size()=9 2019-11-29T14:59:24.306 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:24.300+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.75__multipart_key1.2~ttpItIDhIdmljHE_O9wfi9vf8TeDj5l.1 2019-11-29T14:59:24.306 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:24.300+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.75__shadow_key1.2~ttpItIDhIdmljHE_O9wfi9vf8TeDj5l.1_1 2019-11-29T14:59:24.306 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:24.300+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.75__multipart_key1.2~ttpItIDhIdmljHE_O9wfi9vf8TeDj5l.2 2019-11-29T14:59:24.306 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:24.300+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.75__shadow_key1.2~ttpItIDhIdmljHE_O9wfi9vf8TeDj5l.2_1 2019-11-29T14:59:24.306 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:24.300+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.75__multipart_key1.2~ttpItIDhIdmljHE_O9wfi9vf8TeDj5l.3 2019-11-29T14:59:24.306 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:24.300+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.75__shadow_key1.2~ttpItIDhIdmljHE_O9wfi9vf8TeDj5l.3_1 2019-11-29T14:59:24.307 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:24.300+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.75__multipart_key1.2~ttpItIDhIdmljHE_O9wfi9vf8TeDj5l.4 2019-11-29T14:59:24.688 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:24.685+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.75__shadow_key1.2~ttpItIDhIdmljHE_O9wfi9vf8TeDj5l.4_1 2019-11-29T14:59:24.707 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:24.704+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.75__multipart_key1.2~ttpItIDhIdmljHE_O9wfi9vf8TeDj5l.5 2019-11-29T14:59:24.858 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:24.855+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-29T14:59:24.975 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:24.971+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2019-11-29T14:59:25.036 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:25.033+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T14:59:25.063 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:25.060+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T14:59:25.094 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:25.091+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T14:59:25.141 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:25.138+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2019-11-29T14:59:25.244 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:25.241+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T14:59:25.261 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:25.257+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T14:59:25.279 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:25.275+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-11-29T14:59:25.279 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:25.275+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process iterating over entry tag='7f922895-c6d7-4b1b-a19c-be3df5b5a899.4325.1184', time=2019-11-29T15:49:35.275718+0000, chain.objs.size()=9 2019-11-29T14:59:25.279 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:25.275+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.67__multipart_key1.2~_RAnaTHbPkWNWtg5lLvN6PRd4sFQ4Pn.1 2019-11-29T14:59:25.280 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:25.275+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.67__shadow_key1.2~_RAnaTHbPkWNWtg5lLvN6PRd4sFQ4Pn.1_1 2019-11-29T14:59:25.280 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:25.275+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.67__multipart_key1.2~_RAnaTHbPkWNWtg5lLvN6PRd4sFQ4Pn.2 2019-11-29T14:59:25.280 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:25.275+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.67__shadow_key1.2~_RAnaTHbPkWNWtg5lLvN6PRd4sFQ4Pn.2_1 2019-11-29T14:59:25.280 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:25.275+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.67__multipart_key1.2~_RAnaTHbPkWNWtg5lLvN6PRd4sFQ4Pn.3 2019-11-29T14:59:25.280 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:25.275+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.67__shadow_key1.2~_RAnaTHbPkWNWtg5lLvN6PRd4sFQ4Pn.3_1 2019-11-29T14:59:25.280 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:25.275+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.67__multipart_key1.2~_RAnaTHbPkWNWtg5lLvN6PRd4sFQ4Pn.4 2019-11-29T14:59:25.280 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:25.275+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.67__shadow_key1.2~_RAnaTHbPkWNWtg5lLvN6PRd4sFQ4Pn.4_1 2019-11-29T14:59:25.281 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:25.275+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.67__multipart_key1.2~_RAnaTHbPkWNWtg5lLvN6PRd4sFQ4Pn.5 2019-11-29T14:59:25.281 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:25.275+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process iterating over entry tag='7f922895-c6d7-4b1b-a19c-be3df5b5a899.4325.1343', time=2019-11-29T16:02:13.923021+0000, chain.objs.size()=7 2019-11-29T14:59:25.281 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:25.275+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.75__multipart_key1.2~jztnagEU5Gn54kMmhHAaluiKusg7Rza.1 2019-11-29T14:59:25.281 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:25.275+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.75__shadow_key1.2~jztnagEU5Gn54kMmhHAaluiKusg7Rza.1_1 2019-11-29T14:59:25.281 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:25.275+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.75__shadow_key1.2~jztnagEU5Gn54kMmhHAaluiKusg7Rza.1_2 2019-11-29T14:59:25.608 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:25.605+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.75__multipart_key1.2~jztnagEU5Gn54kMmhHAaluiKusg7Rza.2 2019-11-29T14:59:25.625 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:25.620+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.75__shadow_key1.2~jztnagEU5Gn54kMmhHAaluiKusg7Rza.2_1 2019-11-29T14:59:25.625 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:25.620+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.75__shadow_key1.2~jztnagEU5Gn54kMmhHAaluiKusg7Rza.2_2 2019-11-29T14:59:25.680 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:25.677+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.75__multipart_key1.2~jztnagEU5Gn54kMmhHAaluiKusg7Rza.3 2019-11-29T14:59:25.815 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:25.812+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-29T14:59:25.915 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:25.911+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2019-11-29T14:59:25.981 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:25.977+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T14:59:26.004 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:26.001+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T14:59:26.016 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:26.013+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-29T14:59:26.017 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:26.013+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process iterating over entry tag='7f922895-c6d7-4b1b-a19c-be3df5b5a899.4325.1196', time=2019-11-29T15:50:39.707325+0000, chain.objs.size()=7 2019-11-29T14:59:26.017 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:26.013+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.67__multipart_key1.2~7tYDvtNXQSzevtuLOTN8NoYJ4QryFbn.1 2019-11-29T14:59:26.017 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:26.013+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.67__shadow_key1.2~7tYDvtNXQSzevtuLOTN8NoYJ4QryFbn.1_1 2019-11-29T14:59:26.017 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:26.013+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.67__shadow_key1.2~7tYDvtNXQSzevtuLOTN8NoYJ4QryFbn.1_2 2019-11-29T14:59:26.017 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:26.013+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.67__multipart_key1.2~7tYDvtNXQSzevtuLOTN8NoYJ4QryFbn.2 2019-11-29T14:59:26.017 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:26.013+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.67__shadow_key1.2~7tYDvtNXQSzevtuLOTN8NoYJ4QryFbn.2_1 2019-11-29T14:59:26.017 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:26.013+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.67__shadow_key1.2~7tYDvtNXQSzevtuLOTN8NoYJ4QryFbn.2_2 2019-11-29T14:59:26.018 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:26.013+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.67__multipart_key1.2~7tYDvtNXQSzevtuLOTN8NoYJ4QryFbn.3 2019-11-29T14:59:26.229 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:26.226+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-29T14:59:26.318 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:26.315+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2019-11-29T14:59:26.359 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:26.356+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T14:59:26.378 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:26.374+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T14:59:26.393 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:26.389+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-29T14:59:26.393 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:26.389+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process iterating over entry tag='7f922895-c6d7-4b1b-a19c-be3df5b5a899.4325.1147', time=2019-11-29T15:45:38.996997+0000, chain.objs.size()=9 2019-11-29T14:59:26.393 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:26.389+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.64__multipart_key1.2~tymBsM-GOjRewIsJlGErmOPq-ukZZGG.1 2019-11-29T14:59:26.393 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:26.389+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.64__shadow_key1.2~tymBsM-GOjRewIsJlGErmOPq-ukZZGG.1_1 2019-11-29T14:59:26.394 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:26.389+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.64__multipart_key1.2~tymBsM-GOjRewIsJlGErmOPq-ukZZGG.2 2019-11-29T14:59:26.394 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:26.389+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.64__shadow_key1.2~tymBsM-GOjRewIsJlGErmOPq-ukZZGG.2_1 2019-11-29T14:59:26.394 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:26.389+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.64__multipart_key1.2~tymBsM-GOjRewIsJlGErmOPq-ukZZGG.3 2019-11-29T14:59:26.394 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:26.389+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.64__shadow_key1.2~tymBsM-GOjRewIsJlGErmOPq-ukZZGG.3_1 2019-11-29T14:59:26.394 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:26.389+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.64__multipart_key1.2~tymBsM-GOjRewIsJlGErmOPq-ukZZGG.4 2019-11-29T14:59:26.394 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:26.389+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.64__shadow_key1.2~tymBsM-GOjRewIsJlGErmOPq-ukZZGG.4_1 2019-11-29T14:59:26.394 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:26.389+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.64__multipart_key1.2~tymBsM-GOjRewIsJlGErmOPq-ukZZGG.5 2019-11-29T14:59:26.556 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:26.553+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-29T14:59:26.658 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:26.655+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2019-11-29T14:59:26.717 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:26.714+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T14:59:26.750 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:26.747+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T14:59:26.763 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:26.759+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T14:59:26.817 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:26.808+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2019-11-29T14:59:26.869 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:26.862+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T14:59:26.882 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:26.879+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T14:59:26.898 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:26.894+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-29T14:59:26.898 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:26.894+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process iterating over entry tag='7f922895-c6d7-4b1b-a19c-be3df5b5a899.4325.1328', time=2019-11-29T16:00:02.178551+0000, chain.objs.size()=9 2019-11-29T14:59:26.898 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:26.894+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.75__multipart_key1.2~pxMlN8DQkOVHmdFN9NWkeuBphuzRjXf.1 2019-11-29T14:59:26.898 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:26.894+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.75__shadow_key1.2~pxMlN8DQkOVHmdFN9NWkeuBphuzRjXf.1_1 2019-11-29T14:59:26.898 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:26.894+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.75__multipart_key1.2~pxMlN8DQkOVHmdFN9NWkeuBphuzRjXf.2 2019-11-29T14:59:26.898 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:26.894+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.75__shadow_key1.2~pxMlN8DQkOVHmdFN9NWkeuBphuzRjXf.2_1 2019-11-29T14:59:26.899 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:26.894+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.75__multipart_key1.2~pxMlN8DQkOVHmdFN9NWkeuBphuzRjXf.3 2019-11-29T14:59:26.899 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:26.894+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.75__shadow_key1.2~pxMlN8DQkOVHmdFN9NWkeuBphuzRjXf.3_1 2019-11-29T14:59:26.899 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:26.894+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.75__multipart_key1.2~pxMlN8DQkOVHmdFN9NWkeuBphuzRjXf.4 2019-11-29T14:59:26.899 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:26.894+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.75__shadow_key1.2~pxMlN8DQkOVHmdFN9NWkeuBphuzRjXf.4_1 2019-11-29T14:59:26.899 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:26.894+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.75__multipart_key1.2~pxMlN8DQkOVHmdFN9NWkeuBphuzRjXf.5 2019-11-29T14:59:27.256 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:27.246+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-29T14:59:27.366 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:27.362+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2019-11-29T14:59:27.441 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:27.438+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T14:59:27.478 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:27.475+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T14:59:27.521 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:27.516+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-11-29T14:59:27.521 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:27.516+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process iterating over entry tag='7f922895-c6d7-4b1b-a19c-be3df5b5a899.4325.1338', time=2019-11-29T16:02:09.509174+0000, chain.objs.size()=7 2019-11-29T14:59:27.522 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:27.516+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.75__multipart_key1.2~WCO9TX0gwxm-XzXYwSqph-71WrCMdyn.1 2019-11-29T14:59:27.522 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:27.516+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.75__shadow_key1.2~WCO9TX0gwxm-XzXYwSqph-71WrCMdyn.1_1 2019-11-29T14:59:27.522 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:27.516+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.75__shadow_key1.2~WCO9TX0gwxm-XzXYwSqph-71WrCMdyn.1_2 2019-11-29T14:59:27.522 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:27.516+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.75__multipart_key1.2~WCO9TX0gwxm-XzXYwSqph-71WrCMdyn.2 2019-11-29T14:59:27.523 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:27.516+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.75__shadow_key1.2~WCO9TX0gwxm-XzXYwSqph-71WrCMdyn.2_1 2019-11-29T14:59:27.523 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:27.516+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.75__shadow_key1.2~WCO9TX0gwxm-XzXYwSqph-71WrCMdyn.2_2 2019-11-29T14:59:27.523 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:27.516+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.75__multipart_key1.2~WCO9TX0gwxm-XzXYwSqph-71WrCMdyn.3 2019-11-29T14:59:27.523 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:27.516+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process iterating over entry tag='2~p1IZvmK_SY1UxBxI4lWqAI5RfvkOUCi', time=2019-11-29T16:05:55.204319+0000, chain.objs.size()=25 2019-11-29T14:59:27.524 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:27.516+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.78__multipart_key1.2~p1IZvmK_SY1UxBxI4lWqAI5RfvkOUCi.1 2019-11-29T14:59:27.524 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:27.516+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.78__multipart_key1.2~p1IZvmK_SY1UxBxI4lWqAI5RfvkOUCi.2 2019-11-29T14:59:27.524 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:27.517+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.78__multipart_key1.2~p1IZvmK_SY1UxBxI4lWqAI5RfvkOUCi.3 2019-11-29T14:59:27.524 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:27.517+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.78__multipart_key1.2~p1IZvmK_SY1UxBxI4lWqAI5RfvkOUCi.4 2019-11-29T14:59:27.524 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:27.517+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.78__multipart_key1.2~p1IZvmK_SY1UxBxI4lWqAI5RfvkOUCi.5 2019-11-29T14:59:27.879 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:27.876+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.78__multipart_key1.2~p1IZvmK_SY1UxBxI4lWqAI5RfvkOUCi.6 2019-11-29T14:59:27.899 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:27.896+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.78__multipart_key1.2~p1IZvmK_SY1UxBxI4lWqAI5RfvkOUCi.7 2019-11-29T14:59:27.899 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:27.896+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.78__multipart_key1.2~p1IZvmK_SY1UxBxI4lWqAI5RfvkOUCi.8 2019-11-29T14:59:27.983 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:27.979+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.78__multipart_key1.2~p1IZvmK_SY1UxBxI4lWqAI5RfvkOUCi.9 2019-11-29T14:59:27.984 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:27.979+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.78__multipart_key1.2~p1IZvmK_SY1UxBxI4lWqAI5RfvkOUCi.10 2019-11-29T14:59:27.984 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:27.979+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.78__multipart_key1.2~p1IZvmK_SY1UxBxI4lWqAI5RfvkOUCi.11 2019-11-29T14:59:27.984 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:27.979+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.78__multipart_key1.2~p1IZvmK_SY1UxBxI4lWqAI5RfvkOUCi.12 2019-11-29T14:59:27.984 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:27.979+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.78__multipart_key1.2~p1IZvmK_SY1UxBxI4lWqAI5RfvkOUCi.13 2019-11-29T14:59:27.985 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:27.979+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.78__multipart_key1.2~p1IZvmK_SY1UxBxI4lWqAI5RfvkOUCi.14 2019-11-29T14:59:27.985 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:27.979+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.78__multipart_key1.2~p1IZvmK_SY1UxBxI4lWqAI5RfvkOUCi.15 2019-11-29T14:59:27.985 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:27.979+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.78__multipart_key1.RrBj8FaK2FU8rbIuuB_QI5HaZ2QyA-i.16 2019-11-29T14:59:27.985 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:27.979+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.78__multipart_key1.wnxOcnEOFb38HDwsMRREc0o-hZOk-AD.17 2019-11-29T14:59:28.001 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:27.996+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.78__multipart_key1.e09Mc6uLJJb-F7t743vD81E7eyfkJTa.18 2019-11-29T14:59:28.001 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:27.996+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.78__multipart_key1.AgQj9BycgFZrc98VzCDuUWMGE0ZYGfZ.19 2019-11-29T14:59:28.057 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:28.054+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.78__multipart_key1.7RS-GMOuLAyZkZJ34xQEHJb_r-ey14v.20 2019-11-29T14:59:28.058 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:28.054+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.78__multipart_key1.2~p1IZvmK_SY1UxBxI4lWqAI5RfvkOUCi.21 2019-11-29T14:59:28.072 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:28.069+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.78__multipart_key1.2~p1IZvmK_SY1UxBxI4lWqAI5RfvkOUCi.22 2019-11-29T14:59:28.106 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:28.102+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.78__multipart_key1.2~p1IZvmK_SY1UxBxI4lWqAI5RfvkOUCi.23 2019-11-29T14:59:28.137 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:28.133+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.78__multipart_key1.2~p1IZvmK_SY1UxBxI4lWqAI5RfvkOUCi.24 2019-11-29T14:59:28.137 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:28.133+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.78__multipart_key1.2~p1IZvmK_SY1UxBxI4lWqAI5RfvkOUCi.25 2019-11-29T14:59:28.307 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:28.303+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-29T14:59:28.414 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:28.411+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2019-11-29T14:59:28.480 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:28.476+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T14:59:28.495 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:28.492+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T14:59:28.507 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:28.504+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-29T14:59:28.508 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:28.504+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process iterating over entry tag='7f922895-c6d7-4b1b-a19c-be3df5b5a899.4325.1190', time=2019-11-29T15:49:56.460216+0000, chain.objs.size()=7 2019-11-29T14:59:28.508 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:28.504+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.67__multipart_key1.2~D8sZGj6d-5Cj-1XuwjUsMOvWtv1NBi0.1 2019-11-29T14:59:28.508 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:28.504+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.67__shadow_key1.2~D8sZGj6d-5Cj-1XuwjUsMOvWtv1NBi0.1_1 2019-11-29T14:59:28.508 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:28.504+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.67__shadow_key1.2~D8sZGj6d-5Cj-1XuwjUsMOvWtv1NBi0.1_2 2019-11-29T14:59:28.508 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:28.504+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.67__multipart_key1.2~D8sZGj6d-5Cj-1XuwjUsMOvWtv1NBi0.2 2019-11-29T14:59:28.508 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:28.504+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.67__shadow_key1.2~D8sZGj6d-5Cj-1XuwjUsMOvWtv1NBi0.2_1 2019-11-29T14:59:28.509 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:28.504+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.67__shadow_key1.2~D8sZGj6d-5Cj-1XuwjUsMOvWtv1NBi0.2_2 2019-11-29T14:59:28.509 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:28.504+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.67__multipart_key1.2~D8sZGj6d-5Cj-1XuwjUsMOvWtv1NBi0.3 2019-11-29T14:59:28.826 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:28.822+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-29T14:59:28.907 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:28.904+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2019-11-29T14:59:28.959 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:28.955+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T14:59:28.977 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:28.974+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T14:59:28.993 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:28.990+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-29T14:59:28.993 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:28.990+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process iterating over entry tag='7f922895-c6d7-4b1b-a19c-be3df5b5a899.4325.1145', time=2019-11-29T15:45:47.545351+0000, chain.objs.size()=9 2019-11-29T14:59:28.994 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:28.990+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.64__multipart_key1.2~tymBsM-GOjRewIsJlGErmOPq-ukZZGG.1 2019-11-29T14:59:28.994 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:28.990+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.64__shadow_key1.2~tymBsM-GOjRewIsJlGErmOPq-ukZZGG.1_1 2019-11-29T14:59:28.994 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:28.990+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.64__multipart_key1.2~tymBsM-GOjRewIsJlGErmOPq-ukZZGG.2 2019-11-29T14:59:28.995 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:28.990+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.64__shadow_key1.2~tymBsM-GOjRewIsJlGErmOPq-ukZZGG.2_1 2019-11-29T14:59:28.995 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:28.990+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.64__multipart_key1.2~tymBsM-GOjRewIsJlGErmOPq-ukZZGG.3 2019-11-29T14:59:28.995 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:28.990+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.64__shadow_key1.2~tymBsM-GOjRewIsJlGErmOPq-ukZZGG.3_1 2019-11-29T14:59:28.995 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:28.990+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.64__multipart_key1.2~tymBsM-GOjRewIsJlGErmOPq-ukZZGG.4 2019-11-29T14:59:28.995 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:28.990+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.64__shadow_key1.2~tymBsM-GOjRewIsJlGErmOPq-ukZZGG.4_1 2019-11-29T14:59:28.995 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:28.990+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.64__multipart_key1.2~tymBsM-GOjRewIsJlGErmOPq-ukZZGG.5 2019-11-29T14:59:29.243 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:29.239+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-29T14:59:29.389 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:29.385+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2019-11-29T14:59:29.644 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:29.641+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T14:59:29.685 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:29.682+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T14:59:29.725 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:29.721+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2019-11-29T14:59:29.725 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:29.721+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process iterating over entry tag='2~0LfdYld7Y-IbGhHLJ4W3njd3AGQ5hxx', time=2019-11-29T15:41:44.285562+0000, chain.objs.size()=9 2019-11-29T14:59:29.726 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:29.721+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.52__multipart_key1.2~0LfdYld7Y-IbGhHLJ4W3njd3AGQ5hxx.1 2019-11-29T14:59:29.726 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:29.721+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.52__shadow_key1.2~0LfdYld7Y-IbGhHLJ4W3njd3AGQ5hxx.1_1 2019-11-29T14:59:29.726 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:29.721+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.52__multipart_key1.2~0LfdYld7Y-IbGhHLJ4W3njd3AGQ5hxx.2 2019-11-29T14:59:29.726 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:29.721+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.52__shadow_key1.2~0LfdYld7Y-IbGhHLJ4W3njd3AGQ5hxx.2_1 2019-11-29T14:59:29.726 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:29.721+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.52__multipart_key1.2~0LfdYld7Y-IbGhHLJ4W3njd3AGQ5hxx.3 2019-11-29T14:59:29.726 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:29.721+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.52__shadow_key1.2~0LfdYld7Y-IbGhHLJ4W3njd3AGQ5hxx.3_1 2019-11-29T14:59:29.726 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:29.721+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.52__multipart_key1.2~0LfdYld7Y-IbGhHLJ4W3njd3AGQ5hxx.4 2019-11-29T14:59:29.727 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:29.721+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.52__shadow_key1.2~0LfdYld7Y-IbGhHLJ4W3njd3AGQ5hxx.4_1 2019-11-29T14:59:29.727 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:29.721+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.52__multipart_key1.2~0LfdYld7Y-IbGhHLJ4W3njd3AGQ5hxx.5 2019-11-29T14:59:29.727 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:29.721+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process iterating over entry tag='7f922895-c6d7-4b1b-a19c-be3df5b5a899.4325.1202', time=2019-11-29T15:50:53.860665+0000, chain.objs.size()=7 2019-11-29T14:59:29.727 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:29.721+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.67__multipart_key1.2~Mf-1xUJ4RxLOZZc_VJMRF_noexhMdSV.1 2019-11-29T14:59:29.727 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:29.721+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.67__shadow_key1.2~Mf-1xUJ4RxLOZZc_VJMRF_noexhMdSV.1_1 2019-11-29T14:59:29.727 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:29.721+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.67__shadow_key1.2~Mf-1xUJ4RxLOZZc_VJMRF_noexhMdSV.1_2 2019-11-29T14:59:30.077 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:30.074+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.67__multipart_key1.2~Mf-1xUJ4RxLOZZc_VJMRF_noexhMdSV.2 2019-11-29T14:59:30.077 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:30.074+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.67__shadow_key1.2~Mf-1xUJ4RxLOZZc_VJMRF_noexhMdSV.2_1 2019-11-29T14:59:30.131 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:30.128+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.67__shadow_key1.2~Mf-1xUJ4RxLOZZc_VJMRF_noexhMdSV.2_2 2019-11-29T14:59:30.131 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:30.128+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.67__multipart_key1.2~Mf-1xUJ4RxLOZZc_VJMRF_noexhMdSV.3 2019-11-29T14:59:30.132 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:30.128+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process iterating over entry tag='7f922895-c6d7-4b1b-a19c-be3df5b5a899.4325.1314', time=2019-11-29T15:58:10.385082+0000, chain.objs.size()=9 2019-11-29T14:59:30.132 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:30.128+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.75__multipart_key1.2~kBU-GR5GWTJpitDXFiXkmfbwzkZqxlW.1 2019-11-29T14:59:30.132 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:30.128+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.75__shadow_key1.2~kBU-GR5GWTJpitDXFiXkmfbwzkZqxlW.1_1 2019-11-29T14:59:30.182 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:30.178+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.75__multipart_key1.2~kBU-GR5GWTJpitDXFiXkmfbwzkZqxlW.2 2019-11-29T14:59:30.182 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:30.178+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.75__shadow_key1.2~kBU-GR5GWTJpitDXFiXkmfbwzkZqxlW.2_1 2019-11-29T14:59:30.182 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:30.178+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.75__multipart_key1.2~kBU-GR5GWTJpitDXFiXkmfbwzkZqxlW.3 2019-11-29T14:59:30.182 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:30.178+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.75__shadow_key1.2~kBU-GR5GWTJpitDXFiXkmfbwzkZqxlW.3_1 2019-11-29T14:59:30.182 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:30.178+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.75__multipart_key1.2~kBU-GR5GWTJpitDXFiXkmfbwzkZqxlW.4 2019-11-29T14:59:30.332 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:30.329+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.75__shadow_key1.2~kBU-GR5GWTJpitDXFiXkmfbwzkZqxlW.4_1 2019-11-29T14:59:30.333 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:30.329+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.75__multipart_key1.2~kBU-GR5GWTJpitDXFiXkmfbwzkZqxlW.5 2019-11-29T14:59:30.333 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:30.329+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process iterating over entry tag='7f922895-c6d7-4b1b-a19c-be3df5b5a899.4325.1373', time=2019-11-29T16:05:16.595806+0000, chain.objs.size()=9 2019-11-29T14:59:30.333 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:30.329+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.77__multipart_key1.2~dGL635e18STuXm_iLCfQD62aEmhoV8I.1 2019-11-29T14:59:30.376 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:30.373+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.77__shadow_key1.2~dGL635e18STuXm_iLCfQD62aEmhoV8I.1_1 2019-11-29T14:59:30.515 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:30.511+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.77__multipart_key1.2~dGL635e18STuXm_iLCfQD62aEmhoV8I.2 2019-11-29T14:59:30.515 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:30.511+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.77__shadow_key1.2~dGL635e18STuXm_iLCfQD62aEmhoV8I.2_1 2019-11-29T14:59:30.515 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:30.511+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.77__multipart_key1.2~dGL635e18STuXm_iLCfQD62aEmhoV8I.3 2019-11-29T14:59:30.515 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:30.511+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.77__shadow_key1.2~dGL635e18STuXm_iLCfQD62aEmhoV8I.3_1 2019-11-29T14:59:30.515 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:30.511+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.77__multipart_key1.2~dGL635e18STuXm_iLCfQD62aEmhoV8I.4 2019-11-29T14:59:30.515 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:30.511+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.77__shadow_key1.2~dGL635e18STuXm_iLCfQD62aEmhoV8I.4_1 2019-11-29T14:59:30.516 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:30.511+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.77__multipart_key1.2~dGL635e18STuXm_iLCfQD62aEmhoV8I.5 2019-11-29T14:59:30.705 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:30.702+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-29T14:59:30.800 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:30.796+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2019-11-29T14:59:30.864 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:30.861+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T14:59:30.883 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:30.880+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T14:59:30.898 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:30.895+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T14:59:30.951 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:30.947+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2019-11-29T14:59:31.003 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:31.000+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T14:59:31.031 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:31.028+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T14:59:31.042 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:31.038+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T14:59:31.094 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:31.091+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2019-11-29T14:59:31.143 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:31.139+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T14:59:31.158 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:31.155+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T14:59:31.172 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:31.168+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T14:59:31.223 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:31.220+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2019-11-29T14:59:31.271 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:31.268+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T14:59:31.288 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:31.285+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T14:59:31.308 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:31.304+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-11-29T14:59:31.308 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:31.304+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process iterating over entry tag='7f922895-c6d7-4b1b-a19c-be3df5b5a899.4325.1358', time=2019-11-29T16:03:59.298617+0000, chain.objs.size()=9 2019-11-29T14:59:31.308 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:31.304+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.76__multipart_key1.2~VYMF1rcOyIPezCnLb79oaYdDMTNnUKI.1 2019-11-29T14:59:31.309 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:31.304+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.76__shadow_key1.2~VYMF1rcOyIPezCnLb79oaYdDMTNnUKI.1_1 2019-11-29T14:59:31.309 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:31.304+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.76__multipart_key1.2~VYMF1rcOyIPezCnLb79oaYdDMTNnUKI.2 2019-11-29T14:59:31.309 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:31.304+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.76__shadow_key1.2~VYMF1rcOyIPezCnLb79oaYdDMTNnUKI.2_1 2019-11-29T14:59:31.309 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:31.304+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.76__multipart_key1.2~VYMF1rcOyIPezCnLb79oaYdDMTNnUKI.3 2019-11-29T14:59:31.309 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:31.304+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.76__shadow_key1.2~VYMF1rcOyIPezCnLb79oaYdDMTNnUKI.3_1 2019-11-29T14:59:31.310 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:31.304+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.76__multipart_key1.2~VYMF1rcOyIPezCnLb79oaYdDMTNnUKI.4 2019-11-29T14:59:31.310 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:31.304+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.76__shadow_key1.2~VYMF1rcOyIPezCnLb79oaYdDMTNnUKI.4_1 2019-11-29T14:59:31.310 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:31.304+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.76__multipart_key1.2~VYMF1rcOyIPezCnLb79oaYdDMTNnUKI.5 2019-11-29T14:59:31.310 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:31.304+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process iterating over entry tag='7f922895-c6d7-4b1b-a19c-be3df5b5a899.4325.2174', time=2019-11-29T16:58:27.428928+0000, chain.objs.size()=9 2019-11-29T14:59:31.311 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:31.304+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.118__multipart_key1.2~0-ozLdgCvC8U8nxHmAuzN7jfZCXYIP0.1 2019-11-29T14:59:31.311 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:31.304+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.118__shadow_key1.2~0-ozLdgCvC8U8nxHmAuzN7jfZCXYIP0.1_1 2019-11-29T14:59:31.311 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:31.304+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.118__multipart_key1.2~0-ozLdgCvC8U8nxHmAuzN7jfZCXYIP0.2 2019-11-29T14:59:31.519 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:31.516+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.118__shadow_key1.2~0-ozLdgCvC8U8nxHmAuzN7jfZCXYIP0.2_1 2019-11-29T14:59:31.519 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:31.516+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.118__multipart_key1.2~0-ozLdgCvC8U8nxHmAuzN7jfZCXYIP0.3 2019-11-29T14:59:31.701 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:31.697+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.118__shadow_key1.2~0-ozLdgCvC8U8nxHmAuzN7jfZCXYIP0.3_1 2019-11-29T14:59:31.701 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:31.697+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.118__multipart_key1.2~0-ozLdgCvC8U8nxHmAuzN7jfZCXYIP0.4 2019-11-29T14:59:31.738 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:31.734+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.118__shadow_key1.2~0-ozLdgCvC8U8nxHmAuzN7jfZCXYIP0.4_1 2019-11-29T14:59:31.738 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:31.734+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.118__multipart_key1.2~0-ozLdgCvC8U8nxHmAuzN7jfZCXYIP0.5 2019-11-29T14:59:31.921 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:31.918+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-29T14:59:32.020 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:32.016+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2019-11-29T14:59:32.097 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:32.094+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T14:59:32.135 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:32.132+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T14:59:32.156 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:32.153+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-29T14:59:32.156 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:32.153+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process iterating over entry tag='7f922895-c6d7-4b1b-a19c-be3df5b5a899.4325.1258', time=2019-11-29T15:53:22.305347+0000, chain.objs.size()=9 2019-11-29T14:59:32.157 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:32.153+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.72__multipart_key1.2~t4UzujPHBeIXi3aNRWKx0V8OMIOHid_.1 2019-11-29T14:59:32.157 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:32.153+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.72__shadow_key1.2~t4UzujPHBeIXi3aNRWKx0V8OMIOHid_.1_1 2019-11-29T14:59:32.157 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:32.153+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.72__multipart_key1.2~t4UzujPHBeIXi3aNRWKx0V8OMIOHid_.2 2019-11-29T14:59:32.157 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:32.153+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.72__shadow_key1.2~t4UzujPHBeIXi3aNRWKx0V8OMIOHid_.2_1 2019-11-29T14:59:32.157 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:32.153+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.72__multipart_key1.2~t4UzujPHBeIXi3aNRWKx0V8OMIOHid_.3 2019-11-29T14:59:32.158 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:32.153+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.72__shadow_key1.2~t4UzujPHBeIXi3aNRWKx0V8OMIOHid_.3_1 2019-11-29T14:59:32.158 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:32.153+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.72__multipart_key1.2~t4UzujPHBeIXi3aNRWKx0V8OMIOHid_.4 2019-11-29T14:59:32.158 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:32.153+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.72__shadow_key1.2~t4UzujPHBeIXi3aNRWKx0V8OMIOHid_.4_1 2019-11-29T14:59:32.158 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:32.153+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.72__multipart_key1.2~t4UzujPHBeIXi3aNRWKx0V8OMIOHid_.5 2019-11-29T14:59:32.443 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:32.440+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-29T14:59:32.539 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:32.536+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2019-11-29T14:59:32.639 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:32.636+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T14:59:32.668 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:32.665+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T14:59:32.687 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:32.683+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T14:59:32.755 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:32.752+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2019-11-29T14:59:32.866 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:32.862+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T14:59:32.896 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:32.892+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T14:59:32.939 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:32.935+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-29T14:59:32.939 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:32.935+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process iterating over entry tag='7f922895-c6d7-4b1b-a19c-be3df5b5a899.4325.1283', time=2019-11-29T15:54:56.270690+0000, chain.objs.size()=9 2019-11-29T14:59:32.939 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:32.935+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.73__multipart_file.mpg.2~vhnPs4r-6B3UyOZahEFHToNQ9eSPIep.1 2019-11-29T14:59:32.939 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:32.935+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.73__shadow_file.mpg.2~vhnPs4r-6B3UyOZahEFHToNQ9eSPIep.1_1 2019-11-29T14:59:32.939 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:32.935+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.73__multipart_file.mpg.2~vhnPs4r-6B3UyOZahEFHToNQ9eSPIep.2 2019-11-29T14:59:32.940 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:32.935+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.73__shadow_file.mpg.2~vhnPs4r-6B3UyOZahEFHToNQ9eSPIep.2_1 2019-11-29T14:59:32.940 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:32.935+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.73__multipart_file.mpg.2~vhnPs4r-6B3UyOZahEFHToNQ9eSPIep.3 2019-11-29T14:59:32.940 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:32.935+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.73__shadow_file.mpg.2~vhnPs4r-6B3UyOZahEFHToNQ9eSPIep.3_1 2019-11-29T14:59:32.940 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:32.935+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.73__multipart_file.mpg.2~vhnPs4r-6B3UyOZahEFHToNQ9eSPIep.4 2019-11-29T14:59:32.940 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:32.935+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.73__shadow_file.mpg.2~vhnPs4r-6B3UyOZahEFHToNQ9eSPIep.4_1 2019-11-29T14:59:32.940 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:32.935+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.73__multipart_file.mpg.2~vhnPs4r-6B3UyOZahEFHToNQ9eSPIep.5 2019-11-29T14:59:33.201 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:33.197+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-29T14:59:33.299 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:33.296+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2019-11-29T14:59:33.343 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:33.339+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T14:59:33.359 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:33.356+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T14:59:33.369 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:33.365+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T14:59:33.402 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:33.398+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2019-11-29T14:59:33.445 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:33.441+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T14:59:33.460 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:33.456+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T14:59:33.469 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:33.466+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T14:59:33.509 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:33.506+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2019-11-29T14:59:33.558 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:33.555+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T14:59:33.577 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:33.574+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T14:59:33.592 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:33.589+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-29T14:59:33.593 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:33.589+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process iterating over entry tag='2~89rkAFGNwv8vo_oK9icqk66GgNNLLl8', time=2019-11-29T15:56:07.723175+0000, chain.objs.size()=9 2019-11-29T14:59:33.593 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:33.589+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.74__multipart_key1.2~89rkAFGNwv8vo_oK9icqk66GgNNLLl8.7 2019-11-29T14:59:33.593 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:33.589+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.74__shadow_key1.2~89rkAFGNwv8vo_oK9icqk66GgNNLLl8.7_1 2019-11-29T14:59:33.593 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:33.589+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.74__multipart_key1.2~89rkAFGNwv8vo_oK9icqk66GgNNLLl8.8 2019-11-29T14:59:33.593 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:33.589+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.74__shadow_key1.2~89rkAFGNwv8vo_oK9icqk66GgNNLLl8.8_1 2019-11-29T14:59:33.594 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:33.589+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.74__multipart_key1.2~89rkAFGNwv8vo_oK9icqk66GgNNLLl8.9 2019-11-29T14:59:33.594 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:33.589+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.74__shadow_key1.2~89rkAFGNwv8vo_oK9icqk66GgNNLLl8.9_1 2019-11-29T14:59:33.594 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:33.589+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.74__multipart_key1.2~89rkAFGNwv8vo_oK9icqk66GgNNLLl8.10 2019-11-29T14:59:33.594 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:33.589+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.74__shadow_key1.2~89rkAFGNwv8vo_oK9icqk66GgNNLLl8.10_1 2019-11-29T14:59:33.594 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:33.589+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.74__multipart_key1.2~89rkAFGNwv8vo_oK9icqk66GgNNLLl8.11 2019-11-29T14:59:33.878 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:33.875+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-29T14:59:34.018 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:34.015+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2019-11-29T14:59:34.074 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:34.071+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T14:59:34.093 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:34.090+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T14:59:34.105 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:34.102+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-29T14:59:34.106 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:34.102+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process iterating over entry tag='7f922895-c6d7-4b1b-a19c-be3df5b5a899.4325.2190', time=2019-11-29T16:59:14.426476+0000, chain.objs.size()=9 2019-11-29T14:59:34.106 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:34.102+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.119__multipart_key1/data/file.mpg.2~1MgU9NUtjyJ1-jCE5yAFbJsBj7xWuGh.1 2019-11-29T14:59:34.106 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:34.102+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.119__shadow_key1/data/file.mpg.2~1MgU9NUtjyJ1-jCE5yAFbJsBj7xWuGh.1_1 2019-11-29T14:59:34.106 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:34.102+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.119__multipart_key1/data/file.mpg.2~1MgU9NUtjyJ1-jCE5yAFbJsBj7xWuGh.2 2019-11-29T14:59:34.106 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:34.102+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.119__shadow_key1/data/file.mpg.2~1MgU9NUtjyJ1-jCE5yAFbJsBj7xWuGh.2_1 2019-11-29T14:59:34.106 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:34.102+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.119__multipart_key1/data/file.mpg.2~1MgU9NUtjyJ1-jCE5yAFbJsBj7xWuGh.3 2019-11-29T14:59:34.106 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:34.102+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.119__shadow_key1/data/file.mpg.2~1MgU9NUtjyJ1-jCE5yAFbJsBj7xWuGh.3_1 2019-11-29T14:59:34.107 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:34.102+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.119__multipart_key1/data/file.mpg.2~1MgU9NUtjyJ1-jCE5yAFbJsBj7xWuGh.4 2019-11-29T14:59:34.107 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:34.102+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.119__shadow_key1/data/file.mpg.2~1MgU9NUtjyJ1-jCE5yAFbJsBj7xWuGh.4_1 2019-11-29T14:59:34.107 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:34.102+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.119__multipart_key1/data/file.mpg.2~1MgU9NUtjyJ1-jCE5yAFbJsBj7xWuGh.5 2019-11-29T14:59:34.493 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:34.489+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-29T14:59:34.862 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:34.858+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2019-11-29T14:59:34.917 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:34.914+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T14:59:34.936 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:34.933+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T14:59:34.946 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:34.943+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T14:59:34.983 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:34.979+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2019-11-29T14:59:35.039 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:35.036+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T14:59:35.060 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:35.057+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T14:59:35.078 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:35.075+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-29T14:59:35.078 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:35.075+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process iterating over entry tag='7f922895-c6d7-4b1b-a19c-be3df5b5a899.4325.1073', time=2019-11-29T15:43:11.267962+0000, chain.objs.size()=2 2019-11-29T14:59:35.078 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:35.075+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.56__shadow_.ZgQaIMnzHetoK0FysdX9r0cBUnJcD_c_1 2019-11-29T14:59:35.078 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:35.075+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.56__shadow_.ZgQaIMnzHetoK0FysdX9r0cBUnJcD_c_2 2019-11-29T14:59:35.224 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:35.220+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-29T14:59:35.370 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:35.367+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2019-11-29T14:59:35.464 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:35.461+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T14:59:35.493 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:35.490+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T14:59:35.504 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:35.500+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T14:59:35.556 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:35.553+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2019-11-29T14:59:35.629 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:35.626+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T14:59:35.652 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:35.649+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T14:59:35.664 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:35.661+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T14:59:35.751 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:35.748+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2019-11-29T14:59:35.823 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:35.819+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T14:59:35.843 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:35.840+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T14:59:35.853 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:35.849+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T14:59:35.907 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:35.903+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2019-11-29T14:59:35.956 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:35.952+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T14:59:35.972 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:35.969+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T14:59:35.985 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:35.981+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-29T14:59:35.985 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:35.981+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process iterating over entry tag='7f922895-c6d7-4b1b-a19c-be3df5b5a899.4325.1168', time=2019-11-29T15:47:58.846819+0000, chain.objs.size()=9 2019-11-29T14:59:35.985 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:35.981+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.67__multipart_key1.2~MI3mPRl3Fq4iPiGM15TBfHTSXEjhdcY.1 2019-11-29T14:59:35.985 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:35.981+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.67__shadow_key1.2~MI3mPRl3Fq4iPiGM15TBfHTSXEjhdcY.1_1 2019-11-29T14:59:35.985 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:35.981+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.67__multipart_key1.2~MI3mPRl3Fq4iPiGM15TBfHTSXEjhdcY.2 2019-11-29T14:59:35.986 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:35.981+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.67__shadow_key1.2~MI3mPRl3Fq4iPiGM15TBfHTSXEjhdcY.2_1 2019-11-29T14:59:35.986 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:35.981+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.67__multipart_key1.2~MI3mPRl3Fq4iPiGM15TBfHTSXEjhdcY.3 2019-11-29T14:59:35.986 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:35.981+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.67__shadow_key1.2~MI3mPRl3Fq4iPiGM15TBfHTSXEjhdcY.3_1 2019-11-29T14:59:35.986 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:35.981+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.67__multipart_key1.2~MI3mPRl3Fq4iPiGM15TBfHTSXEjhdcY.4 2019-11-29T14:59:35.986 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:35.981+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.67__shadow_key1.2~MI3mPRl3Fq4iPiGM15TBfHTSXEjhdcY.4_1 2019-11-29T14:59:35.986 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:35.981+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.67__multipart_key1.2~MI3mPRl3Fq4iPiGM15TBfHTSXEjhdcY.5 2019-11-29T14:59:36.308 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:36.305+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-29T14:59:36.423 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:36.419+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2019-11-29T14:59:36.520 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:36.517+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T14:59:36.558 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:36.555+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T14:59:36.593 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:36.589+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-11-29T14:59:36.593 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:36.589+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process iterating over entry tag='7f922895-c6d7-4b1b-a19c-be3df5b5a899.4325.1176', time=2019-11-29T15:48:51.610244+0000, chain.objs.size()=9 2019-11-29T14:59:36.594 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:36.589+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.67__multipart_key1.2~flDM6vUt7lvoYOASK1AdHFZ4gD1PvwR.1 2019-11-29T14:59:36.594 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:36.589+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.67__shadow_key1.2~flDM6vUt7lvoYOASK1AdHFZ4gD1PvwR.1_1 2019-11-29T14:59:36.594 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:36.589+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.67__multipart_key1.2~flDM6vUt7lvoYOASK1AdHFZ4gD1PvwR.2 2019-11-29T14:59:36.594 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:36.589+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.67__shadow_key1.2~flDM6vUt7lvoYOASK1AdHFZ4gD1PvwR.2_1 2019-11-29T14:59:36.594 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:36.589+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.67__multipart_key1.2~flDM6vUt7lvoYOASK1AdHFZ4gD1PvwR.3 2019-11-29T14:59:36.595 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:36.589+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.67__shadow_key1.2~flDM6vUt7lvoYOASK1AdHFZ4gD1PvwR.3_1 2019-11-29T14:59:36.595 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:36.589+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.67__multipart_key1.2~flDM6vUt7lvoYOASK1AdHFZ4gD1PvwR.4 2019-11-29T14:59:36.595 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:36.589+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.67__shadow_key1.2~flDM6vUt7lvoYOASK1AdHFZ4gD1PvwR.4_1 2019-11-29T14:59:36.595 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:36.589+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.67__multipart_key1.2~flDM6vUt7lvoYOASK1AdHFZ4gD1PvwR.5 2019-11-29T14:59:36.596 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:36.589+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process iterating over entry tag='7f922895-c6d7-4b1b-a19c-be3df5b5a899.4325.1333', time=2019-11-29T16:00:58.634940+0000, chain.objs.size()=7 2019-11-29T14:59:36.597 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:36.589+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.75__multipart_key1.2~-bcX4uhxLNQPDnh1aPy6JgML2rBALUF.1 2019-11-29T14:59:36.598 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:36.589+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.75__shadow_key1.2~-bcX4uhxLNQPDnh1aPy6JgML2rBALUF.1_1 2019-11-29T14:59:36.598 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:36.589+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.75__shadow_key1.2~-bcX4uhxLNQPDnh1aPy6JgML2rBALUF.1_2 2019-11-29T14:59:36.938 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:36.934+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.75__multipart_key1.2~-bcX4uhxLNQPDnh1aPy6JgML2rBALUF.2 2019-11-29T14:59:36.938 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:36.934+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.75__shadow_key1.2~-bcX4uhxLNQPDnh1aPy6JgML2rBALUF.2_1 2019-11-29T14:59:36.938 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:36.935+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.75__shadow_key1.2~-bcX4uhxLNQPDnh1aPy6JgML2rBALUF.2_2 2019-11-29T14:59:36.938 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:36.935+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.75__multipart_key1.2~-bcX4uhxLNQPDnh1aPy6JgML2rBALUF.3 2019-11-29T14:59:37.141 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:37.138+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-29T14:59:37.269 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:37.266+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2019-11-29T14:59:37.335 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:37.331+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T14:59:37.351 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:37.348+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T14:59:37.370 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:37.366+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-29T14:59:37.370 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:37.366+0000 7f82f1b41ec0 20 garbage collection: RGWGC::process iterating over entry tag='7f922895-c6d7-4b1b-a19c-be3df5b5a899.4325.1239', time=2019-11-29T15:52:19.429824+0000, chain.objs.size()=9 2019-11-29T14:59:37.370 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:37.366+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.71__multipart_key1.2~pYqITL3KvGh6lK5aFT-xROtR2THTxLC.1 2019-11-29T14:59:37.371 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:37.366+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.71__shadow_key1.2~pYqITL3KvGh6lK5aFT-xROtR2THTxLC.1_1 2019-11-29T14:59:37.371 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:37.366+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.71__multipart_key1.2~pYqITL3KvGh6lK5aFT-xROtR2THTxLC.2 2019-11-29T14:59:37.371 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:37.366+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.71__shadow_key1.2~pYqITL3KvGh6lK5aFT-xROtR2THTxLC.2_1 2019-11-29T14:59:37.371 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:37.366+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.71__multipart_key1.2~pYqITL3KvGh6lK5aFT-xROtR2THTxLC.3 2019-11-29T14:59:37.371 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:37.366+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.71__shadow_key1.2~pYqITL3KvGh6lK5aFT-xROtR2THTxLC.3_1 2019-11-29T14:59:37.372 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:37.366+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.71__multipart_key1.2~pYqITL3KvGh6lK5aFT-xROtR2THTxLC.4 2019-11-29T14:59:37.372 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:37.366+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.71__shadow_key1.2~pYqITL3KvGh6lK5aFT-xROtR2THTxLC.4_1 2019-11-29T14:59:37.372 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:37.366+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.71__multipart_key1.2~pYqITL3KvGh6lK5aFT-xROtR2THTxLC.5 2019-11-29T14:59:37.709 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:37.705+0000 7f82f1b41ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-29T14:59:37.886 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:37.883+0000 7f82f1b41ec0 20 remove_watcher() i=0 2019-11-29T14:59:37.886 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:37.883+0000 7f82f1b41ec0 2 removed watcher, disabling cache 2019-11-29T14:59:37.944 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:37.941+0000 7f82f1b41ec0 20 remove_watcher() i=1 2019-11-29T14:59:37.997 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:37.994+0000 7f82f1b41ec0 20 remove_watcher() i=2 2019-11-29T14:59:38.069 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:38.062+0000 7f82f1b41ec0 20 remove_watcher() i=3 2019-11-29T14:59:38.109 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:38.106+0000 7f82f1b41ec0 20 remove_watcher() i=4 2019-11-29T14:59:38.164 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:38.161+0000 7f82f1b41ec0 20 remove_watcher() i=5 2019-11-29T14:59:38.224 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:38.220+0000 7f82f1b41ec0 20 remove_watcher() i=6 2019-11-29T14:59:38.266 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:38.263+0000 7f82f1b41ec0 20 remove_watcher() i=7 2019-11-29T14:59:38.276 INFO:teuthology.orchestra.run.smithi062:> radosgw-admin gc process --include-all 2019-11-29T14:59:38.394 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:38.391+0000 7f05d5397ec0 20 rados->read ofs=0 len=0 2019-11-29T14:59:38.428 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:38.425+0000 7f05d5397ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T14:59:38.428 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:38.425+0000 7f05d5397ec0 20 rados->read ofs=0 len=0 2019-11-29T14:59:38.443 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:38.440+0000 7f05d5397ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T14:59:38.443 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:38.440+0000 7f05d5397ec0 20 rados->read ofs=0 len=0 2019-11-29T14:59:38.456 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:38.453+0000 7f05d5397ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T14:59:38.456 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:38.453+0000 7f05d5397ec0 20 rados->read ofs=0 len=0 2019-11-29T14:59:38.473 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:38.470+0000 7f05d5397ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T14:59:38.730 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:38.726+0000 7f05d5397ec0 20 RGWRados::pool_iterate: got zone_info.7f922895-c6d7-4b1b-a19c-be3df5b5a899 2019-11-29T14:59:38.730 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:38.726+0000 7f05d5397ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-29T14:59:38.730 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:38.726+0000 7f05d5397ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-29T14:59:38.731 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:38.726+0000 7f05d5397ec0 20 RGWRados::pool_iterate: got zonegroup_info.76ba47ff-1c23-4409-aae0-24fe26589cae 2019-11-29T14:59:38.731 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:38.726+0000 7f05d5397ec0 20 rados->read ofs=0 len=0 2019-11-29T14:59:38.745 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:38.742+0000 7f05d5397ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T14:59:38.745 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:38.742+0000 7f05d5397ec0 20 rados->read ofs=0 len=0 2019-11-29T14:59:38.765 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:38.761+0000 7f05d5397ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-29T14:59:38.765 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:38.762+0000 7f05d5397ec0 20 rados->read ofs=0 len=0 2019-11-29T14:59:38.779 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:38.776+0000 7f05d5397ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T14:59:38.779 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:38.776+0000 7f05d5397ec0 20 rados->read ofs=0 len=0 2019-11-29T14:59:38.796 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:38.793+0000 7f05d5397ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-29T14:59:38.796 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:38.793+0000 7f05d5397ec0 20 rados->read ofs=0 len=0 2019-11-29T14:59:38.808 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:38.805+0000 7f05d5397ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T14:59:38.808 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:38.805+0000 7f05d5397ec0 10 cannot find current period zonegroup using local zonegroup 2019-11-29T14:59:38.808 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:38.805+0000 7f05d5397ec0 20 rados->read ofs=0 len=0 2019-11-29T14:59:38.846 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:38.842+0000 7f05d5397ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T14:59:38.846 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:38.842+0000 7f05d5397ec0 20 rados->read ofs=0 len=0 2019-11-29T14:59:38.857 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:38.854+0000 7f05d5397ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T14:59:38.857 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:38.854+0000 7f05d5397ec0 20 rados->read ofs=0 len=0 2019-11-29T14:59:38.871 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:38.866+0000 7f05d5397ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-29T14:59:38.872 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:38.866+0000 7f05d5397ec0 20 zonegroup default 2019-11-29T14:59:38.872 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:38.866+0000 7f05d5397ec0 20 rados->read ofs=0 len=0 2019-11-29T14:59:38.881 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:38.878+0000 7f05d5397ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T14:59:38.882 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:38.878+0000 7f05d5397ec0 10 Cannot find current period zone using local zone 2019-11-29T14:59:38.882 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:38.878+0000 7f05d5397ec0 20 rados->read ofs=0 len=0 2019-11-29T14:59:38.893 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:38.890+0000 7f05d5397ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T14:59:38.893 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:38.890+0000 7f05d5397ec0 20 rados->read ofs=0 len=0 2019-11-29T14:59:38.916 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:38.913+0000 7f05d5397ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T14:59:38.917 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:38.913+0000 7f05d5397ec0 20 rados->read ofs=0 len=0 2019-11-29T14:59:38.928 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:38.925+0000 7f05d5397ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-29T14:59:38.929 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:38.925+0000 7f05d5397ec0 20 zone default found 2019-11-29T14:59:38.929 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:38.925+0000 7f05d5397ec0 20 started sync module instance, tier type = 2019-11-29T14:59:38.929 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:38.925+0000 7f05d5397ec0 20 started zone id=7f922895-c6d7-4b1b-a19c-be3df5b5a899 (name=default) with tier type = 2019-11-29T14:59:39.253 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:39.250+0000 7f05d5397ec0 20 add_watcher() i=0 2019-11-29T14:59:39.253 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:39.250+0000 7f05d5397ec0 20 add_watcher() i=1 2019-11-29T14:59:39.253 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:39.250+0000 7f05d5397ec0 20 add_watcher() i=2 2019-11-29T14:59:39.253 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:39.250+0000 7f05d5397ec0 20 add_watcher() i=3 2019-11-29T14:59:39.254 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:39.250+0000 7f05d5397ec0 20 add_watcher() i=4 2019-11-29T14:59:39.254 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:39.250+0000 7f05d5397ec0 20 add_watcher() i=5 2019-11-29T14:59:39.254 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:39.250+0000 7f05d5397ec0 20 add_watcher() i=6 2019-11-29T14:59:39.286 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:39.283+0000 7f05d5397ec0 20 add_watcher() i=7 2019-11-29T14:59:39.287 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:39.283+0000 7f05d5397ec0 2 all 8 watchers are set, enabling cache 2019-11-29T14:59:39.287 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:39.283+0000 7f0592fdd700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-29T14:59:39.298 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:39.295+0000 7f05c2dc5700 0 -- 172.21.15.62:0/464843164 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x5581cac4fca0 msgr2=0x5581cac63ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-29T14:59:39.348 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:39.345+0000 7f05c2dc5700 0 -- 172.21.15.62:0/4088660211 >> [v2:172.21.15.22:6800/8367,v1:172.21.15.22:6801/8367] conn(0x7f0504017580 msgr2=0x7f0504019a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-29T14:59:40.924 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:40.921+0000 7f05017fa700 20 reqs_thread_entry: start 2019-11-29T14:59:40.924 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:40.921+0000 7f04faffd700 20 reqs_thread_entry: start 2019-11-29T14:59:40.925 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:40.921+0000 7f05d5397ec0 20 init_complete bucket index max shards: 0 2019-11-29T14:59:40.925 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:40.922+0000 7f04f97fa700 20 reqs_thread_entry: start 2019-11-29T14:59:40.925 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:40.922+0000 7f05d5397ec0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2019-11-29T14:59:40.979 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:40.976+0000 7f05d5397ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T14:59:40.995 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:40.992+0000 7f05d5397ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T14:59:41.004 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:41.001+0000 7f05d5397ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T14:59:41.045 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:41.042+0000 7f05d5397ec0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2019-11-29T14:59:41.110 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:41.107+0000 7f05d5397ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T14:59:41.132 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:41.128+0000 7f05d5397ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T14:59:41.140 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:41.137+0000 7f05d5397ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T14:59:41.194 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:41.191+0000 7f05d5397ec0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2019-11-29T14:59:41.273 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:41.270+0000 7f05d5397ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T14:59:41.307 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:41.303+0000 7f05d5397ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T14:59:41.320 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:41.317+0000 7f05d5397ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T14:59:41.378 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:41.375+0000 7f05d5397ec0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2019-11-29T14:59:41.445 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:41.442+0000 7f05d5397ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T14:59:41.470 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:41.467+0000 7f05d5397ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T14:59:41.482 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:41.479+0000 7f05d5397ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T14:59:41.530 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:41.526+0000 7f05d5397ec0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2019-11-29T14:59:41.598 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:41.595+0000 7f05d5397ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T14:59:41.637 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:41.633+0000 7f05d5397ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T14:59:41.657 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:41.654+0000 7f05d5397ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T14:59:41.703 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:41.699+0000 7f05d5397ec0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2019-11-29T14:59:41.748 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:41.745+0000 7f05d5397ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T14:59:41.771 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:41.768+0000 7f05d5397ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T14:59:41.782 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:41.779+0000 7f05d5397ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T14:59:41.824 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:41.821+0000 7f05d5397ec0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2019-11-29T14:59:41.886 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:41.883+0000 7f05d5397ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T14:59:41.905 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:41.901+0000 7f05d5397ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T14:59:41.912 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:41.909+0000 7f05d5397ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T14:59:41.975 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:41.972+0000 7f05d5397ec0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2019-11-29T14:59:42.098 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:42.095+0000 7f05d5397ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T14:59:42.135 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:42.132+0000 7f05d5397ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T14:59:42.155 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:42.152+0000 7f05d5397ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T14:59:42.220 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:42.216+0000 7f05d5397ec0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2019-11-29T14:59:42.294 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:42.291+0000 7f05d5397ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T14:59:42.316 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:42.313+0000 7f05d5397ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T14:59:42.327 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:42.324+0000 7f05d5397ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T14:59:42.386 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:42.382+0000 7f05d5397ec0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2019-11-29T14:59:42.463 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:42.460+0000 7f05d5397ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T14:59:42.495 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:42.492+0000 7f05d5397ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T14:59:42.514 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:42.511+0000 7f05d5397ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T14:59:42.568 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:42.565+0000 7f05d5397ec0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2019-11-29T14:59:42.642 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:42.638+0000 7f05d5397ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T14:59:42.669 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:42.665+0000 7f05d5397ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T14:59:42.678 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:42.675+0000 7f05d5397ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T14:59:42.727 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:42.724+0000 7f05d5397ec0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2019-11-29T14:59:42.807 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:42.803+0000 7f05d5397ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T14:59:42.830 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:42.827+0000 7f05d5397ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T14:59:42.842 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:42.838+0000 7f05d5397ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T14:59:42.893 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:42.890+0000 7f05d5397ec0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2019-11-29T14:59:42.970 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:42.966+0000 7f05d5397ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T14:59:42.989 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:42.985+0000 7f05d5397ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T14:59:42.997 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:42.994+0000 7f05d5397ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T14:59:43.044 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:43.041+0000 7f05d5397ec0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2019-11-29T14:59:43.091 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:43.088+0000 7f05d5397ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T14:59:43.119 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:43.115+0000 7f05d5397ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T14:59:43.127 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:43.123+0000 7f05d5397ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T14:59:43.173 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:43.170+0000 7f05d5397ec0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2019-11-29T14:59:43.237 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:43.234+0000 7f05d5397ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T14:59:43.264 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:43.261+0000 7f05d5397ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T14:59:43.279 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:43.276+0000 7f05d5397ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T14:59:43.320 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:43.316+0000 7f05d5397ec0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2019-11-29T14:59:43.402 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:43.398+0000 7f05d5397ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T14:59:43.428 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:43.425+0000 7f05d5397ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T14:59:43.448 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:43.444+0000 7f05d5397ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T14:59:43.490 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:43.487+0000 7f05d5397ec0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2019-11-29T14:59:43.549 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:43.542+0000 7f05d5397ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T14:59:43.574 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:43.571+0000 7f05d5397ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T14:59:43.592 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:43.588+0000 7f05d5397ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T14:59:43.660 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:43.650+0000 7f05d5397ec0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2019-11-29T14:59:43.726 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:43.722+0000 7f05d5397ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T14:59:43.752 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:43.748+0000 7f05d5397ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T14:59:43.766 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:43.762+0000 7f05d5397ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T14:59:43.809 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:43.806+0000 7f05d5397ec0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2019-11-29T14:59:43.869 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:43.866+0000 7f05d5397ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T14:59:43.895 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:43.892+0000 7f05d5397ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T14:59:43.909 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:43.906+0000 7f05d5397ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T14:59:43.957 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:43.953+0000 7f05d5397ec0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2019-11-29T14:59:44.006 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:44.003+0000 7f05d5397ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T14:59:44.023 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:44.020+0000 7f05d5397ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T14:59:44.031 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:44.028+0000 7f05d5397ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T14:59:44.067 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:44.063+0000 7f05d5397ec0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2019-11-29T14:59:44.116 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:44.112+0000 7f05d5397ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T14:59:44.138 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:44.134+0000 7f05d5397ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T14:59:44.150 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:44.147+0000 7f05d5397ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T14:59:44.193 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:44.190+0000 7f05d5397ec0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2019-11-29T14:59:44.246 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:44.242+0000 7f05d5397ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T14:59:44.262 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:44.259+0000 7f05d5397ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T14:59:44.269 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:44.266+0000 7f05d5397ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T14:59:44.315 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:44.312+0000 7f05d5397ec0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2019-11-29T14:59:44.362 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:44.359+0000 7f05d5397ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T14:59:44.378 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:44.374+0000 7f05d5397ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T14:59:44.386 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:44.383+0000 7f05d5397ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T14:59:44.485 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:44.482+0000 7f05d5397ec0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2019-11-29T14:59:44.540 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:44.536+0000 7f05d5397ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T14:59:44.558 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:44.555+0000 7f05d5397ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T14:59:44.570 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:44.567+0000 7f05d5397ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T14:59:44.619 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:44.616+0000 7f05d5397ec0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2019-11-29T14:59:44.710 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:44.707+0000 7f05d5397ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T14:59:44.749 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:44.746+0000 7f05d5397ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T14:59:44.768 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:44.765+0000 7f05d5397ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T14:59:44.809 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:44.806+0000 7f05d5397ec0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2019-11-29T14:59:44.862 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:44.858+0000 7f05d5397ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T14:59:44.885 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:44.879+0000 7f05d5397ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T14:59:44.891 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:44.888+0000 7f05d5397ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T14:59:44.919 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:44.916+0000 7f05d5397ec0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2019-11-29T14:59:44.971 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:44.968+0000 7f05d5397ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T14:59:44.990 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:44.987+0000 7f05d5397ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T14:59:45.001 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:44.998+0000 7f05d5397ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T14:59:45.050 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:45.047+0000 7f05d5397ec0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2019-11-29T14:59:45.100 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:45.097+0000 7f05d5397ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T14:59:45.120 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:45.117+0000 7f05d5397ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T14:59:45.129 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:45.126+0000 7f05d5397ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T14:59:45.175 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:45.172+0000 7f05d5397ec0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2019-11-29T14:59:45.232 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:45.229+0000 7f05d5397ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T14:59:45.253 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:45.250+0000 7f05d5397ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T14:59:45.266 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:45.263+0000 7f05d5397ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T14:59:45.303 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:45.299+0000 7f05d5397ec0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2019-11-29T14:59:45.348 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:45.345+0000 7f05d5397ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T14:59:45.375 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:45.372+0000 7f05d5397ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T14:59:45.388 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:45.385+0000 7f05d5397ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T14:59:45.454 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:45.451+0000 7f05d5397ec0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2019-11-29T14:59:45.519 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:45.516+0000 7f05d5397ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T14:59:45.546 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:45.543+0000 7f05d5397ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T14:59:45.562 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:45.559+0000 7f05d5397ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T14:59:45.608 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:45.604+0000 7f05d5397ec0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2019-11-29T14:59:45.668 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:45.665+0000 7f05d5397ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T14:59:45.694 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:45.691+0000 7f05d5397ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T14:59:45.705 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:45.702+0000 7f05d5397ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T14:59:45.815 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:45.812+0000 7f05d5397ec0 20 remove_watcher() i=0 2019-11-29T14:59:45.816 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:45.812+0000 7f05d5397ec0 2 removed watcher, disabling cache 2019-11-29T14:59:45.870 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:45.867+0000 7f05d5397ec0 20 remove_watcher() i=1 2019-11-29T14:59:45.905 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:45.902+0000 7f05d5397ec0 20 remove_watcher() i=2 2019-11-29T14:59:45.944 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:45.941+0000 7f05d5397ec0 20 remove_watcher() i=3 2019-11-29T14:59:45.985 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:45.982+0000 7f05d5397ec0 20 remove_watcher() i=4 2019-11-29T14:59:46.023 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:46.019+0000 7f05d5397ec0 20 remove_watcher() i=5 2019-11-29T14:59:46.068 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:46.065+0000 7f05d5397ec0 20 remove_watcher() i=6 2019-11-29T14:59:46.110 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:46.107+0000 7f05d5397ec0 20 remove_watcher() i=7 2019-11-29T14:59:46.119 INFO:teuthology.run_tasks:Running task s3tests... 2019-11-29T14:59:46.140 DEBUG:tasks.s3tests:s3tests config is {'client.0': {'rgw_server': 'client.0', 'force-branch': 'ceph-master'}} 2019-11-29T14:59:46.141 INFO:tasks.s3tests:Downloading s3-tests... 2019-11-29T14:59:46.141 INFO:tasks.s3tests:Using branch 'ceph-master' for s3tests 2019-11-29T14:59:46.142 INFO:teuthology.orchestra.run.smithi062:> git clone -b ceph-master git://git.ceph.com/git/s3-tests.git /home/ubuntu/cephtest/s3-tests 2019-11-29T14:59:46.240 INFO:teuthology.orchestra.run.smithi062.stdout:Cloning into '/home/ubuntu/cephtest/s3-tests'... 2019-11-29T14:59:46.737 INFO:tasks.s3tests:Creating rgw users... 2019-11-29T14:59:46.737 DEBUG:tasks.s3tests:Creating user bar.client.0 on client.0 2019-11-29T14:59:46.738 INFO:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid bar.client.0 --display-name 'Mr. bar.client.0' --access-key VDQUOJLYDLVQIJHAPMSV --secret XsaBBgMY9X8YiZlC0IiQpzDAS0HY0DDjN7Eo2ZYNHz9syb63i5JzwQ== --email bar.client.0+test@test.test --cluster ceph 2019-11-29T14:59:46.862 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:46.859+0000 7f80fb561ec0 20 rados->read ofs=0 len=0 2019-11-29T14:59:46.899 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:46.895+0000 7f80fb561ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T14:59:46.899 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:46.896+0000 7f80fb561ec0 20 rados->read ofs=0 len=0 2019-11-29T14:59:46.918 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:46.915+0000 7f80fb561ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T14:59:46.918 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:46.915+0000 7f80fb561ec0 20 rados->read ofs=0 len=0 2019-11-29T14:59:46.930 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:46.927+0000 7f80fb561ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T14:59:46.930 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:46.927+0000 7f80fb561ec0 20 rados->read ofs=0 len=0 2019-11-29T14:59:46.951 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:46.947+0000 7f80fb561ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T14:59:47.195 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:47.191+0000 7f80fb561ec0 20 RGWRados::pool_iterate: got zone_info.7f922895-c6d7-4b1b-a19c-be3df5b5a899 2019-11-29T14:59:47.195 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:47.191+0000 7f80fb561ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-29T14:59:47.195 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:47.191+0000 7f80fb561ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-29T14:59:47.195 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:47.191+0000 7f80fb561ec0 20 RGWRados::pool_iterate: got zonegroup_info.76ba47ff-1c23-4409-aae0-24fe26589cae 2019-11-29T14:59:47.196 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:47.191+0000 7f80fb561ec0 20 rados->read ofs=0 len=0 2019-11-29T14:59:47.206 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:47.202+0000 7f80fb561ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T14:59:47.206 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:47.202+0000 7f80fb561ec0 20 rados->read ofs=0 len=0 2019-11-29T14:59:47.216 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:47.213+0000 7f80fb561ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-29T14:59:47.216 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:47.213+0000 7f80fb561ec0 20 rados->read ofs=0 len=0 2019-11-29T14:59:47.225 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:47.222+0000 7f80fb561ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T14:59:47.225 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:47.222+0000 7f80fb561ec0 20 rados->read ofs=0 len=0 2019-11-29T14:59:47.236 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:47.230+0000 7f80fb561ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-29T14:59:47.237 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:47.231+0000 7f80fb561ec0 20 rados->read ofs=0 len=0 2019-11-29T14:59:47.246 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:47.242+0000 7f80fb561ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T14:59:47.246 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:47.242+0000 7f80fb561ec0 10 cannot find current period zonegroup using local zonegroup 2019-11-29T14:59:47.246 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:47.242+0000 7f80fb561ec0 20 rados->read ofs=0 len=0 2019-11-29T14:59:47.254 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:47.251+0000 7f80fb561ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T14:59:47.255 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:47.251+0000 7f80fb561ec0 20 rados->read ofs=0 len=0 2019-11-29T14:59:47.263 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:47.260+0000 7f80fb561ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T14:59:47.264 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:47.260+0000 7f80fb561ec0 20 rados->read ofs=0 len=0 2019-11-29T14:59:47.273 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:47.269+0000 7f80fb561ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-29T14:59:47.273 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:47.270+0000 7f80fb561ec0 20 zonegroup default 2019-11-29T14:59:47.273 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:47.270+0000 7f80fb561ec0 20 rados->read ofs=0 len=0 2019-11-29T14:59:47.283 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:47.280+0000 7f80fb561ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T14:59:47.283 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:47.280+0000 7f80fb561ec0 10 Cannot find current period zone using local zone 2019-11-29T14:59:47.283 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:47.280+0000 7f80fb561ec0 20 rados->read ofs=0 len=0 2019-11-29T14:59:47.292 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:47.289+0000 7f80fb561ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T14:59:47.292 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:47.289+0000 7f80fb561ec0 20 rados->read ofs=0 len=0 2019-11-29T14:59:47.300 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:47.297+0000 7f80fb561ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T14:59:47.301 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:47.297+0000 7f80fb561ec0 20 rados->read ofs=0 len=0 2019-11-29T14:59:47.310 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:47.306+0000 7f80fb561ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-29T14:59:47.310 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:47.306+0000 7f80fb561ec0 20 zone default found 2019-11-29T14:59:47.310 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:47.306+0000 7f80fb561ec0 20 started sync module instance, tier type = 2019-11-29T14:59:47.310 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:47.307+0000 7f80fb561ec0 20 started zone id=7f922895-c6d7-4b1b-a19c-be3df5b5a899 (name=default) with tier type = 2019-11-29T14:59:47.685 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:47.681+0000 7f80fb561ec0 20 add_watcher() i=0 2019-11-29T14:59:47.685 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:47.681+0000 7f80fb561ec0 20 add_watcher() i=1 2019-11-29T14:59:47.685 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:47.681+0000 7f80fb561ec0 20 add_watcher() i=2 2019-11-29T14:59:47.685 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:47.681+0000 7f80fb561ec0 20 add_watcher() i=3 2019-11-29T14:59:47.685 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:47.681+0000 7f80fb561ec0 20 add_watcher() i=4 2019-11-29T14:59:47.686 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:47.681+0000 7f80fb561ec0 20 add_watcher() i=5 2019-11-29T14:59:47.686 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:47.681+0000 7f80fb561ec0 20 add_watcher() i=6 2019-11-29T14:59:47.717 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:47.714+0000 7f80fb561ec0 20 add_watcher() i=7 2019-11-29T14:59:47.718 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:47.714+0000 7f80fb561ec0 2 all 8 watchers are set, enabling cache 2019-11-29T14:59:47.718 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:47.714+0000 7f80b8fe1700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-29T14:59:47.731 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:47.728+0000 7f80e7f8d700 0 -- 172.21.15.62:0/1843390271 >> v2:172.21.15.62:3300/0 conn(0x55835cd8ce90 msgr2=0x55835cd8f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-29T14:59:47.903 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:47.900+0000 7f80e878e700 0 -- 172.21.15.62:0/1843390271 >> [v2:172.21.15.22:6821/9265,v1:172.21.15.22:6823/9265] conn(0x55835cd9dde0 msgr2=0x55835cda0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-29T14:59:49.675 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:49.672+0000 7f802affd700 20 reqs_thread_entry: start 2019-11-29T14:59:49.676 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:49.672+0000 7f8028ff9700 20 reqs_thread_entry: start 2019-11-29T14:59:49.676 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:49.673+0000 7f80fb561ec0 20 init_complete bucket index max shards: 0 2019-11-29T14:59:49.677 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:49.673+0000 7f801effd700 20 reqs_thread_entry: start 2019-11-29T14:59:49.677 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:49.674+0000 7f80fb561ec0 20 get_system_obj_state: rctx=0x7ffe689e3db8 obj=default.rgw.meta:users.uid:bar.client.0 state=0x55835ce01620 s->prefetch_data=0 2019-11-29T14:59:49.677 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:49.674+0000 7f80fb561ec0 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2019-11-29T14:59:49.686 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:49.683+0000 7f80fb561ec0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x0 2019-11-29T14:59:49.687 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:49.683+0000 7f80fb561ec0 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-11-29T14:59:49.687 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:49.683+0000 7f80fb561ec0 20 get_system_obj_state: rctx=0x7ffe689e3dc8 obj=default.rgw.meta:users.email:bar.client.0+test@test.test state=0x55835ce033b0 s->prefetch_data=0 2019-11-29T14:59:49.687 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:49.683+0000 7f80fb561ec0 10 cache get: name=default.rgw.meta+users.email+bar.client.0+test@test.test : miss 2019-11-29T14:59:49.698 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:49.695+0000 7f80fb561ec0 10 cache put: name=default.rgw.meta+users.email+bar.client.0+test@test.test info.flags=0x0 2019-11-29T14:59:49.698 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:49.695+0000 7f80fb561ec0 10 adding default.rgw.meta+users.email+bar.client.0+test@test.test to cache LRU end 2019-11-29T14:59:49.698 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:49.695+0000 7f80fb561ec0 20 get_system_obj_state: rctx=0x7ffe689e3dc8 obj=default.rgw.meta:users.keys:VDQUOJLYDLVQIJHAPMSV state=0x55835ce033b0 s->prefetch_data=0 2019-11-29T14:59:49.698 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:49.695+0000 7f80fb561ec0 10 cache get: name=default.rgw.meta+users.keys+VDQUOJLYDLVQIJHAPMSV : miss 2019-11-29T14:59:49.715 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:49.712+0000 7f80fb561ec0 10 cache put: name=default.rgw.meta+users.keys+VDQUOJLYDLVQIJHAPMSV info.flags=0x0 2019-11-29T14:59:49.715 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:49.712+0000 7f80fb561ec0 10 adding default.rgw.meta+users.keys+VDQUOJLYDLVQIJHAPMSV to cache LRU end 2019-11-29T14:59:49.715 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:49.712+0000 7f80fb561ec0 20 get_system_obj_state: rctx=0x7ffe689e39d8 obj=default.rgw.meta:users.keys:VDQUOJLYDLVQIJHAPMSV state=0x55835ce033b0 s->prefetch_data=0 2019-11-29T14:59:49.716 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:49.712+0000 7f80fb561ec0 10 cache get: name=default.rgw.meta+users.keys+VDQUOJLYDLVQIJHAPMSV : type miss (requested=0x6, cached=0x0) 2019-11-29T14:59:49.730 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:49.726+0000 7f80fb561ec0 10 cache put: name=default.rgw.meta+users.keys+VDQUOJLYDLVQIJHAPMSV info.flags=0x0 2019-11-29T14:59:49.730 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:49.726+0000 7f80fb561ec0 10 moving default.rgw.meta+users.keys+VDQUOJLYDLVQIJHAPMSV to cache LRU end 2019-11-29T14:59:49.730 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:49.727+0000 7f80fb561ec0 20 get_system_obj_state: rctx=0x7ffe689e3b58 obj=default.rgw.meta:users.keys:VDQUOJLYDLVQIJHAPMSV state=0x55835ce033b0 s->prefetch_data=0 2019-11-29T14:59:49.730 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:49.727+0000 7f80fb561ec0 10 cache get: name=default.rgw.meta+users.keys+VDQUOJLYDLVQIJHAPMSV : type miss (requested=0x6, cached=0x0) 2019-11-29T14:59:49.745 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:49.742+0000 7f80fb561ec0 10 cache put: name=default.rgw.meta+users.keys+VDQUOJLYDLVQIJHAPMSV info.flags=0x0 2019-11-29T14:59:49.745 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:49.742+0000 7f80fb561ec0 10 moving default.rgw.meta+users.keys+VDQUOJLYDLVQIJHAPMSV to cache LRU end 2019-11-29T14:59:49.804 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:49.801+0000 7f80fb561ec0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2019-11-29T14:59:49.804 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:49.801+0000 7f80fb561ec0 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-11-29T14:59:49.804 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:49.801+0000 7f80fb561ec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=617 2019-11-29T14:59:49.816 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:49.813+0000 7f80cdffb700 10 RGWWatcher::handle_notify() notify_id 566935683139 cookie 94022686660784 notifier 4586 bl.length()=617 2019-11-29T14:59:49.816 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:49.813+0000 7f80cdffb700 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2019-11-29T14:59:49.816 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:49.813+0000 7f80cdffb700 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-11-29T14:59:50.032 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:50.029+0000 7f80fb561ec0 10 cache put: name=default.rgw.meta+users.email+bar.client.0+test@test.test info.flags=0x7 2019-11-29T14:59:50.033 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:50.029+0000 7f80fb561ec0 10 moving default.rgw.meta+users.email+bar.client.0+test@test.test to cache LRU end 2019-11-29T14:59:50.033 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:50.029+0000 7f80fb561ec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=194 2019-11-29T14:59:50.051 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:50.048+0000 7f80cdffb700 10 RGWWatcher::handle_notify() notify_id 566935683140 cookie 94022686660784 notifier 4586 bl.length()=194 2019-11-29T14:59:50.051 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:50.048+0000 7f80cdffb700 10 cache put: name=default.rgw.meta+users.email+bar.client.0+test@test.test info.flags=0x7 2019-11-29T14:59:50.052 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:50.048+0000 7f80cdffb700 10 moving default.rgw.meta+users.email+bar.client.0+test@test.test to cache LRU end 2019-11-29T14:59:50.349 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:50.346+0000 7f80fb561ec0 10 cache put: name=default.rgw.meta+users.keys+VDQUOJLYDLVQIJHAPMSV info.flags=0x7 2019-11-29T14:59:50.350 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:50.346+0000 7f80fb561ec0 10 moving default.rgw.meta+users.keys+VDQUOJLYDLVQIJHAPMSV to cache LRU end 2019-11-29T14:59:50.350 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:50.346+0000 7f80fb561ec0 10 distributing notification oid=default.rgw.control:notify.6 bl.length()=186 2019-11-29T14:59:50.361 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:50.358+0000 7f80cdffb700 10 RGWWatcher::handle_notify() notify_id 566935683108 cookie 94022686674464 notifier 4586 bl.length()=186 2019-11-29T14:59:50.361 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:50.358+0000 7f80cdffb700 10 cache put: name=default.rgw.meta+users.keys+VDQUOJLYDLVQIJHAPMSV info.flags=0x7 2019-11-29T14:59:50.361 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:50.358+0000 7f80cdffb700 10 moving default.rgw.meta+users.keys+VDQUOJLYDLVQIJHAPMSV to cache LRU end 2019-11-29T14:59:50.513 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2019-11-29T14:59:50.513 INFO:teuthology.orchestra.run.smithi062.stdout: "user_id": "bar.client.0", 2019-11-29T14:59:50.513 INFO:teuthology.orchestra.run.smithi062.stdout: "display_name": "Mr. bar.client.0", 2019-11-29T14:59:50.513 INFO:teuthology.orchestra.run.smithi062.stdout: "email": "bar.client.0+test@test.test", 2019-11-29T14:59:50.514 INFO:teuthology.orchestra.run.smithi062.stdout: "suspended": 0, 2019-11-29T14:59:50.514 INFO:teuthology.orchestra.run.smithi062.stdout: "max_buckets": 1000, 2019-11-29T14:59:50.514 INFO:teuthology.orchestra.run.smithi062.stdout: "subusers": [], 2019-11-29T14:59:50.514 INFO:teuthology.orchestra.run.smithi062.stdout: "keys": [ 2019-11-29T14:59:50.514 INFO:teuthology.orchestra.run.smithi062.stdout: { 2019-11-29T14:59:50.514 INFO:teuthology.orchestra.run.smithi062.stdout: "user": "bar.client.0", 2019-11-29T14:59:50.514 INFO:teuthology.orchestra.run.smithi062.stdout: "access_key": "VDQUOJLYDLVQIJHAPMSV", 2019-11-29T14:59:50.514 INFO:teuthology.orchestra.run.smithi062.stdout: "secret_key": "XsaBBgMY9X8YiZlC0IiQpzDAS0HY0DDjN7Eo2ZYNHz9syb63i5JzwQ==" 2019-11-29T14:59:50.515 INFO:teuthology.orchestra.run.smithi062.stdout: } 2019-11-29T14:59:50.515 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2019-11-29T14:59:50.515 INFO:teuthology.orchestra.run.smithi062.stdout: "swift_keys": [], 2019-11-29T14:59:50.515 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": [], 2019-11-29T14:59:50.515 INFO:teuthology.orchestra.run.smithi062.stdout: "op_mask": "read, write, delete", 2019-11-29T14:59:50.515 INFO:teuthology.orchestra.run.smithi062.stdout: "default_placement": "", 2019-11-29T14:59:50.515 INFO:teuthology.orchestra.run.smithi062.stdout: "default_storage_class": "", 2019-11-29T14:59:50.516 INFO:teuthology.orchestra.run.smithi062.stdout: "placement_tags": [], 2019-11-29T14:59:50.516 INFO:teuthology.orchestra.run.smithi062.stdout: "bucket_quota": { 2019-11-29T14:59:50.516 INFO:teuthology.orchestra.run.smithi062.stdout: "enabled": false, 2019-11-29T14:59:50.516 INFO:teuthology.orchestra.run.smithi062.stdout: "check_on_raw": false, 2019-11-29T14:59:50.516 INFO:teuthology.orchestra.run.smithi062.stdout: "max_size": -1, 2019-11-29T14:59:50.516 INFO:teuthology.orchestra.run.smithi062.stdout: "max_size_kb": 0, 2019-11-29T14:59:50.516 INFO:teuthology.orchestra.run.smithi062.stdout: "max_objects": -1 2019-11-29T14:59:50.517 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2019-11-29T14:59:50.517 INFO:teuthology.orchestra.run.smithi062.stdout: "user_quota": { 2019-11-29T14:59:50.517 INFO:teuthology.orchestra.run.smithi062.stdout: "enabled": false, 2019-11-29T14:59:50.517 INFO:teuthology.orchestra.run.smithi062.stdout: "check_on_raw": false, 2019-11-29T14:59:50.517 INFO:teuthology.orchestra.run.smithi062.stdout: "max_size": -1, 2019-11-29T14:59:50.517 INFO:teuthology.orchestra.run.smithi062.stdout: "max_size_kb": 0, 2019-11-29T14:59:50.517 INFO:teuthology.orchestra.run.smithi062.stdout: "max_objects": -1 2019-11-29T14:59:50.517 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2019-11-29T14:59:50.518 INFO:teuthology.orchestra.run.smithi062.stdout: "temp_url_keys": [], 2019-11-29T14:59:50.518 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "rgw", 2019-11-29T14:59:50.518 INFO:teuthology.orchestra.run.smithi062.stdout: "mfa_ids": [] 2019-11-29T14:59:50.518 INFO:teuthology.orchestra.run.smithi062.stdout:} 2019-11-29T14:59:50.518 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T14:59:50.557 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:50.554+0000 7f80fb561ec0 20 remove_watcher() i=0 2019-11-29T14:59:50.557 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:50.554+0000 7f80fb561ec0 2 removed watcher, disabling cache 2019-11-29T14:59:50.644 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:50.641+0000 7f80fb561ec0 20 remove_watcher() i=1 2019-11-29T14:59:50.710 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:50.706+0000 7f80fb561ec0 20 remove_watcher() i=2 2019-11-29T14:59:50.784 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:50.781+0000 7f80fb561ec0 20 remove_watcher() i=3 2019-11-29T14:59:50.849 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:50.846+0000 7f80fb561ec0 20 remove_watcher() i=4 2019-11-29T14:59:50.897 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:50.893+0000 7f80fb561ec0 20 remove_watcher() i=5 2019-11-29T14:59:50.929 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:50.926+0000 7f80fb561ec0 20 remove_watcher() i=6 2019-11-29T14:59:50.969 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:50.965+0000 7f80fb561ec0 20 remove_watcher() i=7 2019-11-29T14:59:50.975 INFO:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid bar.client.0 --totp-serial 4166084401 --totp-seed 2PD2ZML6EPBALDAR7V3XSVLAUEUOEYAXUWHI74MVY6QX3N7YGRTXCSPIEAOL2YTS --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2019-11-29T14:59:51.099 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:51.096+0000 7f4259b68ec0 20 rados->read ofs=0 len=0 2019-11-29T14:59:51.130 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:51.127+0000 7f4259b68ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T14:59:51.130 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:51.127+0000 7f4259b68ec0 20 rados->read ofs=0 len=0 2019-11-29T14:59:51.137 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:51.134+0000 7f4259b68ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T14:59:51.137 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:51.134+0000 7f4259b68ec0 20 rados->read ofs=0 len=0 2019-11-29T14:59:51.149 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:51.146+0000 7f4259b68ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T14:59:51.149 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:51.146+0000 7f4259b68ec0 20 rados->read ofs=0 len=0 2019-11-29T14:59:51.169 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:51.166+0000 7f4259b68ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T14:59:51.416 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:51.413+0000 7f4259b68ec0 20 RGWRados::pool_iterate: got zone_info.7f922895-c6d7-4b1b-a19c-be3df5b5a899 2019-11-29T14:59:51.417 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:51.413+0000 7f4259b68ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-29T14:59:51.417 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:51.413+0000 7f4259b68ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-29T14:59:51.417 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:51.413+0000 7f4259b68ec0 20 RGWRados::pool_iterate: got zonegroup_info.76ba47ff-1c23-4409-aae0-24fe26589cae 2019-11-29T14:59:51.417 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:51.413+0000 7f4259b68ec0 20 rados->read ofs=0 len=0 2019-11-29T14:59:51.435 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:51.432+0000 7f4259b68ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T14:59:51.435 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:51.432+0000 7f4259b68ec0 20 rados->read ofs=0 len=0 2019-11-29T14:59:51.452 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:51.449+0000 7f4259b68ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-29T14:59:51.453 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:51.449+0000 7f4259b68ec0 20 rados->read ofs=0 len=0 2019-11-29T14:59:51.464 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:51.460+0000 7f4259b68ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T14:59:51.464 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:51.460+0000 7f4259b68ec0 20 rados->read ofs=0 len=0 2019-11-29T14:59:51.481 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:51.478+0000 7f4259b68ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-29T14:59:51.481 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:51.478+0000 7f4259b68ec0 20 rados->read ofs=0 len=0 2019-11-29T14:59:51.493 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:51.489+0000 7f4259b68ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T14:59:51.493 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:51.489+0000 7f4259b68ec0 10 cannot find current period zonegroup using local zonegroup 2019-11-29T14:59:51.493 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:51.489+0000 7f4259b68ec0 20 rados->read ofs=0 len=0 2019-11-29T14:59:51.506 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:51.503+0000 7f4259b68ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T14:59:51.506 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:51.503+0000 7f4259b68ec0 20 rados->read ofs=0 len=0 2019-11-29T14:59:51.526 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:51.522+0000 7f4259b68ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T14:59:51.526 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:51.523+0000 7f4259b68ec0 20 rados->read ofs=0 len=0 2019-11-29T14:59:51.545 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:51.542+0000 7f4259b68ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-29T14:59:51.546 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:51.542+0000 7f4259b68ec0 20 zonegroup default 2019-11-29T14:59:51.546 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:51.542+0000 7f4259b68ec0 20 rados->read ofs=0 len=0 2019-11-29T14:59:51.559 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:51.556+0000 7f4259b68ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T14:59:51.559 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:51.556+0000 7f4259b68ec0 10 Cannot find current period zone using local zone 2019-11-29T14:59:51.560 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:51.556+0000 7f4259b68ec0 20 rados->read ofs=0 len=0 2019-11-29T14:59:51.571 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:51.568+0000 7f4259b68ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T14:59:51.571 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:51.568+0000 7f4259b68ec0 20 rados->read ofs=0 len=0 2019-11-29T14:59:51.585 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:51.581+0000 7f4259b68ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T14:59:51.585 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:51.581+0000 7f4259b68ec0 20 rados->read ofs=0 len=0 2019-11-29T14:59:51.599 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:51.595+0000 7f4259b68ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-29T14:59:51.599 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:51.595+0000 7f4259b68ec0 20 zone default found 2019-11-29T14:59:51.599 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:51.595+0000 7f4259b68ec0 20 started sync module instance, tier type = 2019-11-29T14:59:51.599 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:51.595+0000 7f4259b68ec0 20 started zone id=7f922895-c6d7-4b1b-a19c-be3df5b5a899 (name=default) with tier type = 2019-11-29T14:59:52.021 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:52.017+0000 7f4259b68ec0 20 add_watcher() i=0 2019-11-29T14:59:52.021 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:52.017+0000 7f4259b68ec0 20 add_watcher() i=1 2019-11-29T14:59:52.021 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:52.017+0000 7f4259b68ec0 20 add_watcher() i=2 2019-11-29T14:59:52.021 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:52.017+0000 7f4259b68ec0 20 add_watcher() i=3 2019-11-29T14:59:52.021 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:52.017+0000 7f4259b68ec0 20 add_watcher() i=4 2019-11-29T14:59:52.022 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:52.017+0000 7f4259b68ec0 20 add_watcher() i=5 2019-11-29T14:59:52.025 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:52.022+0000 7f4259b68ec0 20 add_watcher() i=6 2019-11-29T14:59:52.052 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:52.049+0000 7f4259b68ec0 20 add_watcher() i=7 2019-11-29T14:59:52.053 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:52.049+0000 7f4259b68ec0 2 all 8 watchers are set, enabling cache 2019-11-29T14:59:52.053 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:52.049+0000 7f42177de700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-29T14:59:52.054 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:52.051+0000 7f4246594700 0 -- 172.21.15.62:0/1505955234 >> v1:172.21.15.62:6789/0 conn(0x557bfae7bb30 legacy=0x557bfae7e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2019-11-29T14:59:52.090 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:52.086+0000 7f4246d95700 0 -- 172.21.15.62:0/1044123978 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x557bfae7b700 msgr2=0x557bfae801b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-29T14:59:53.671 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:53.668+0000 7f4185ffb700 20 reqs_thread_entry: start 2019-11-29T14:59:53.672 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:53.668+0000 7f417f7fe700 20 reqs_thread_entry: start 2019-11-29T14:59:53.672 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:53.668+0000 7f4259b68ec0 20 init_complete bucket index max shards: 0 2019-11-29T14:59:53.672 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:53.669+0000 7f417dffb700 20 reqs_thread_entry: start 2019-11-29T14:59:53.673 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:53.669+0000 7f4259b68ec0 20 get_system_obj_state: rctx=0x7ffe97782bb8 obj=default.rgw.meta:users.uid:bar.client.0 state=0x557bfaef3680 s->prefetch_data=0 2019-11-29T14:59:53.673 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:53.669+0000 7f4259b68ec0 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2019-11-29T14:59:53.686 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:53.683+0000 7f4259b68ec0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x16 2019-11-29T14:59:53.687 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:53.683+0000 7f4259b68ec0 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-11-29T14:59:53.687 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:53.683+0000 7f4259b68ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-29T14:59:53.687 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:53.683+0000 7f4259b68ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-29T14:59:53.687 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:53.683+0000 7f4259b68ec0 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : type miss (requested=0x11, cached=0x16) 2019-11-29T14:59:53.687 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:53.683+0000 7f4259b68ec0 20 rados->read ofs=0 len=0 2019-11-29T14:59:53.707 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:53.704+0000 7f4259b68ec0 20 rados_obj.operate() r=0 bl.length=432 2019-11-29T14:59:53.708 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:53.704+0000 7f4259b68ec0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x11 2019-11-29T14:59:53.708 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:53.704+0000 7f4259b68ec0 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-11-29T14:59:55.871 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:55.868+0000 7f4259b68ec0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2019-11-29T14:59:55.872 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:55.868+0000 7f4259b68ec0 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-11-29T14:59:55.872 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:55.868+0000 7f4259b68ec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=631 2019-11-29T14:59:55.879 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:55.876+0000 7f4227fff700 10 RGWWatcher::handle_notify() notify_id 575525617733 cookie 93990978735792 notifier 4939 bl.length()=631 2019-11-29T14:59:55.879 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:55.876+0000 7f4227fff700 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2019-11-29T14:59:55.880 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:55.876+0000 7f4227fff700 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-11-29T14:59:56.904 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:56.901+0000 7f4259b68ec0 20 remove_watcher() i=0 2019-11-29T14:59:56.904 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:56.901+0000 7f4259b68ec0 2 removed watcher, disabling cache 2019-11-29T14:59:56.970 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:56.967+0000 7f4259b68ec0 20 remove_watcher() i=1 2019-11-29T14:59:57.037 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:57.030+0000 7f4259b68ec0 20 remove_watcher() i=2 2019-11-29T14:59:57.082 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:57.079+0000 7f4259b68ec0 20 remove_watcher() i=3 2019-11-29T14:59:57.129 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:57.126+0000 7f4259b68ec0 20 remove_watcher() i=4 2019-11-29T14:59:57.170 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:57.167+0000 7f4259b68ec0 20 remove_watcher() i=5 2019-11-29T14:59:57.243 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:57.239+0000 7f4259b68ec0 20 remove_watcher() i=6 2019-11-29T14:59:57.299 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:57.296+0000 7f4259b68ec0 20 remove_watcher() i=7 2019-11-29T14:59:57.308 DEBUG:tasks.s3tests:Creating user foo.client.0 on client.0 2019-11-29T14:59:57.309 INFO:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid foo.client.0 --display-name 'Mr. foo.client.0' --access-key AVJXJSVQIWYDNWDCDMTS --secret ryFcSkGTT1Eh+aFLtJ/n2aTGCrx89aU04++VOG7VxoRS+xwgi7o+bg== --email foo.client.0+test@test.test --cluster ceph 2019-11-29T14:59:57.493 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:57.490+0000 7fe4b0aecec0 20 rados->read ofs=0 len=0 2019-11-29T14:59:57.531 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:57.527+0000 7fe4b0aecec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T14:59:57.531 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:57.527+0000 7fe4b0aecec0 20 rados->read ofs=0 len=0 2019-11-29T14:59:57.539 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:57.536+0000 7fe4b0aecec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T14:59:57.539 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:57.536+0000 7fe4b0aecec0 20 rados->read ofs=0 len=0 2019-11-29T14:59:57.550 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:57.547+0000 7fe4b0aecec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T14:59:57.550 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:57.547+0000 7fe4b0aecec0 20 rados->read ofs=0 len=0 2019-11-29T14:59:57.569 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:57.566+0000 7fe4b0aecec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T14:59:57.841 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:57.837+0000 7fe4b0aecec0 20 RGWRados::pool_iterate: got zone_info.7f922895-c6d7-4b1b-a19c-be3df5b5a899 2019-11-29T14:59:57.841 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:57.837+0000 7fe4b0aecec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-29T14:59:57.841 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:57.837+0000 7fe4b0aecec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-29T14:59:57.841 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:57.837+0000 7fe4b0aecec0 20 RGWRados::pool_iterate: got zonegroup_info.76ba47ff-1c23-4409-aae0-24fe26589cae 2019-11-29T14:59:57.841 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:57.837+0000 7fe4b0aecec0 20 rados->read ofs=0 len=0 2019-11-29T14:59:57.851 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:57.848+0000 7fe4b0aecec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T14:59:57.851 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:57.848+0000 7fe4b0aecec0 20 rados->read ofs=0 len=0 2019-11-29T14:59:57.864 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:57.860+0000 7fe4b0aecec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-29T14:59:57.864 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:57.861+0000 7fe4b0aecec0 20 rados->read ofs=0 len=0 2019-11-29T14:59:57.880 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:57.877+0000 7fe4b0aecec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T14:59:57.881 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:57.877+0000 7fe4b0aecec0 20 rados->read ofs=0 len=0 2019-11-29T14:59:57.892 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:57.889+0000 7fe4b0aecec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-29T14:59:57.892 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:57.889+0000 7fe4b0aecec0 20 rados->read ofs=0 len=0 2019-11-29T14:59:57.908 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:57.904+0000 7fe4b0aecec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T14:59:57.908 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:57.904+0000 7fe4b0aecec0 10 cannot find current period zonegroup using local zonegroup 2019-11-29T14:59:57.908 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:57.904+0000 7fe4b0aecec0 20 rados->read ofs=0 len=0 2019-11-29T14:59:57.919 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:57.916+0000 7fe4b0aecec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T14:59:57.919 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:57.916+0000 7fe4b0aecec0 20 rados->read ofs=0 len=0 2019-11-29T14:59:57.938 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:57.935+0000 7fe4b0aecec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T14:59:57.938 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:57.935+0000 7fe4b0aecec0 20 rados->read ofs=0 len=0 2019-11-29T14:59:57.956 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:57.951+0000 7fe4b0aecec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-29T14:59:57.956 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:57.951+0000 7fe4b0aecec0 20 zonegroup default 2019-11-29T14:59:57.956 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:57.951+0000 7fe4b0aecec0 20 rados->read ofs=0 len=0 2019-11-29T14:59:57.963 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:57.960+0000 7fe4b0aecec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T14:59:57.964 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:57.960+0000 7fe4b0aecec0 10 Cannot find current period zone using local zone 2019-11-29T14:59:57.964 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:57.960+0000 7fe4b0aecec0 20 rados->read ofs=0 len=0 2019-11-29T14:59:57.970 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:57.967+0000 7fe4b0aecec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T14:59:57.970 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:57.967+0000 7fe4b0aecec0 20 rados->read ofs=0 len=0 2019-11-29T14:59:57.985 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:57.982+0000 7fe4b0aecec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T14:59:57.985 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:57.982+0000 7fe4b0aecec0 20 rados->read ofs=0 len=0 2019-11-29T14:59:57.998 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:57.995+0000 7fe4b0aecec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-29T14:59:57.998 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:57.995+0000 7fe4b0aecec0 20 zone default found 2019-11-29T14:59:57.998 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:57.995+0000 7fe4b0aecec0 20 started sync module instance, tier type = 2019-11-29T14:59:57.999 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:57.995+0000 7fe4b0aecec0 20 started zone id=7f922895-c6d7-4b1b-a19c-be3df5b5a899 (name=default) with tier type = 2019-11-29T14:59:58.438 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:58.435+0000 7fe4b0aecec0 20 add_watcher() i=0 2019-11-29T14:59:58.438 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:58.435+0000 7fe4b0aecec0 20 add_watcher() i=1 2019-11-29T14:59:58.438 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:58.435+0000 7fe4b0aecec0 20 add_watcher() i=2 2019-11-29T14:59:58.438 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:58.435+0000 7fe4b0aecec0 20 add_watcher() i=3 2019-11-29T14:59:58.438 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:58.435+0000 7fe4b0aecec0 20 add_watcher() i=4 2019-11-29T14:59:58.439 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:58.435+0000 7fe4b0aecec0 20 add_watcher() i=5 2019-11-29T14:59:58.439 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:58.435+0000 7fe4b0aecec0 20 add_watcher() i=6 2019-11-29T14:59:58.477 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:58.473+0000 7fe4b0aecec0 20 add_watcher() i=7 2019-11-29T14:59:58.477 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:58.473+0000 7fe4b0aecec0 2 all 8 watchers are set, enabling cache 2019-11-29T14:59:58.477 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:58.474+0000 7fe46e7dc700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-29T14:59:58.490 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:58.487+0000 7fe49dd19700 0 -- 172.21.15.62:0/1170622446 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55cf73901f40 msgr2=0x55cf73904360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2019-11-29T14:59:58.614 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T14:59:58.611+0000 7fe49e51a700 0 -- 172.21.15.62:0/1170622446 >> [v2:172.21.15.22:6803/9262,v1:172.21.15.22:6805/9262] conn(0x55cf73912b50 msgr2=0x55cf73914f70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-29T15:00:00.282 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:00.278+0000 7fe3e4ff9700 20 reqs_thread_entry: start 2019-11-29T15:00:00.282 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:00.278+0000 7fe3de7fc700 20 reqs_thread_entry: start 2019-11-29T15:00:00.282 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:00.278+0000 7fe4b0aecec0 20 init_complete bucket index max shards: 0 2019-11-29T15:00:00.282 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:00.278+0000 7fe3dcff9700 20 reqs_thread_entry: start 2019-11-29T15:00:00.283 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:00.278+0000 7fe4b0aecec0 20 get_system_obj_state: rctx=0x7ffe7fc53a28 obj=default.rgw.meta:users.uid:foo.client.0 state=0x55cf73979360 s->prefetch_data=0 2019-11-29T15:00:00.283 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:00.278+0000 7fe4b0aecec0 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2019-11-29T15:00:00.289 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:00.286+0000 7fe4b0aecec0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x0 2019-11-29T15:00:00.289 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:00.286+0000 7fe4b0aecec0 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-11-29T15:00:00.289 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:00.286+0000 7fe4b0aecec0 20 get_system_obj_state: rctx=0x7ffe7fc53a38 obj=default.rgw.meta:users.email:foo.client.0+test@test.test state=0x55cf7397b0f0 s->prefetch_data=0 2019-11-29T15:00:00.290 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:00.286+0000 7fe4b0aecec0 10 cache get: name=default.rgw.meta+users.email+foo.client.0+test@test.test : miss 2019-11-29T15:00:00.295 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:00.292+0000 7fe4b0aecec0 10 cache put: name=default.rgw.meta+users.email+foo.client.0+test@test.test info.flags=0x0 2019-11-29T15:00:00.295 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:00.292+0000 7fe4b0aecec0 10 adding default.rgw.meta+users.email+foo.client.0+test@test.test to cache LRU end 2019-11-29T15:00:00.296 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:00.292+0000 7fe4b0aecec0 20 get_system_obj_state: rctx=0x7ffe7fc53a38 obj=default.rgw.meta:users.keys:AVJXJSVQIWYDNWDCDMTS state=0x55cf7397b0f0 s->prefetch_data=0 2019-11-29T15:00:00.296 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:00.292+0000 7fe4b0aecec0 10 cache get: name=default.rgw.meta+users.keys+AVJXJSVQIWYDNWDCDMTS : miss 2019-11-29T15:00:00.302 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:00.299+0000 7fe4b0aecec0 10 cache put: name=default.rgw.meta+users.keys+AVJXJSVQIWYDNWDCDMTS info.flags=0x0 2019-11-29T15:00:00.302 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:00.299+0000 7fe4b0aecec0 10 adding default.rgw.meta+users.keys+AVJXJSVQIWYDNWDCDMTS to cache LRU end 2019-11-29T15:00:00.303 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:00.299+0000 7fe4b0aecec0 20 get_system_obj_state: rctx=0x7ffe7fc53648 obj=default.rgw.meta:users.keys:AVJXJSVQIWYDNWDCDMTS state=0x55cf7397b0f0 s->prefetch_data=0 2019-11-29T15:00:00.303 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:00.299+0000 7fe4b0aecec0 10 cache get: name=default.rgw.meta+users.keys+AVJXJSVQIWYDNWDCDMTS : type miss (requested=0x6, cached=0x0) 2019-11-29T15:00:00.310 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:00.307+0000 7fe4b0aecec0 10 cache put: name=default.rgw.meta+users.keys+AVJXJSVQIWYDNWDCDMTS info.flags=0x0 2019-11-29T15:00:00.311 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:00.307+0000 7fe4b0aecec0 10 moving default.rgw.meta+users.keys+AVJXJSVQIWYDNWDCDMTS to cache LRU end 2019-11-29T15:00:00.311 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:00.307+0000 7fe4b0aecec0 20 get_system_obj_state: rctx=0x7ffe7fc537c8 obj=default.rgw.meta:users.keys:AVJXJSVQIWYDNWDCDMTS state=0x55cf7397b0f0 s->prefetch_data=0 2019-11-29T15:00:00.311 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:00.307+0000 7fe4b0aecec0 10 cache get: name=default.rgw.meta+users.keys+AVJXJSVQIWYDNWDCDMTS : type miss (requested=0x6, cached=0x0) 2019-11-29T15:00:00.317 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:00.314+0000 7fe4b0aecec0 10 cache put: name=default.rgw.meta+users.keys+AVJXJSVQIWYDNWDCDMTS info.flags=0x0 2019-11-29T15:00:00.317 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:00.314+0000 7fe4b0aecec0 10 moving default.rgw.meta+users.keys+AVJXJSVQIWYDNWDCDMTS to cache LRU end 2019-11-29T15:00:00.367 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:00.363+0000 7fe4b0aecec0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2019-11-29T15:00:00.367 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:00.363+0000 7fe4b0aecec0 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-11-29T15:00:00.367 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:00.363+0000 7fe4b0aecec0 10 distributing notification oid=default.rgw.control:notify.0 bl.length()=617 2019-11-29T15:00:00.376 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:00.373+0000 7fe47effd700 10 RGWWatcher::handle_notify() notify_id 579820585026 cookie 94349485306000 notifier 4890 bl.length()=617 2019-11-29T15:00:00.376 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:00.373+0000 7fe47effd700 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2019-11-29T15:00:00.376 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:00.373+0000 7fe47effd700 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-11-29T15:00:00.884 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:00.880+0000 7fe4b0aecec0 10 cache put: name=default.rgw.meta+users.email+foo.client.0+test@test.test info.flags=0x7 2019-11-29T15:00:00.884 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:00.880+0000 7fe4b0aecec0 10 moving default.rgw.meta+users.email+foo.client.0+test@test.test to cache LRU end 2019-11-29T15:00:00.884 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:00.880+0000 7fe4b0aecec0 10 distributing notification oid=default.rgw.control:notify.6 bl.length()=194 2019-11-29T15:00:00.894 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:00.891+0000 7fe47effd700 10 RGWWatcher::handle_notify() notify_id 579820584997 cookie 94349485320720 notifier 4890 bl.length()=194 2019-11-29T15:00:00.895 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:00.891+0000 7fe47effd700 10 cache put: name=default.rgw.meta+users.email+foo.client.0+test@test.test info.flags=0x7 2019-11-29T15:00:00.895 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:00.891+0000 7fe47effd700 10 moving default.rgw.meta+users.email+foo.client.0+test@test.test to cache LRU end 2019-11-29T15:00:00.995 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:00.991+0000 7fe4b0aecec0 10 cache put: name=default.rgw.meta+users.keys+AVJXJSVQIWYDNWDCDMTS info.flags=0x7 2019-11-29T15:00:00.995 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:00.992+0000 7fe4b0aecec0 10 moving default.rgw.meta+users.keys+AVJXJSVQIWYDNWDCDMTS to cache LRU end 2019-11-29T15:00:00.995 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:00.992+0000 7fe4b0aecec0 10 distributing notification oid=default.rgw.control:notify.5 bl.length()=186 2019-11-29T15:00:01.007 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:01.004+0000 7fe47effd700 10 RGWWatcher::handle_notify() notify_id 579820585030 cookie 94349485319200 notifier 4890 bl.length()=186 2019-11-29T15:00:01.007 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:01.004+0000 7fe47effd700 10 cache put: name=default.rgw.meta+users.keys+AVJXJSVQIWYDNWDCDMTS info.flags=0x7 2019-11-29T15:00:01.007 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:01.004+0000 7fe47effd700 10 moving default.rgw.meta+users.keys+AVJXJSVQIWYDNWDCDMTS to cache LRU end 2019-11-29T15:00:01.822 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2019-11-29T15:00:01.822 INFO:teuthology.orchestra.run.smithi062.stdout: "user_id": "foo.client.0", 2019-11-29T15:00:01.822 INFO:teuthology.orchestra.run.smithi062.stdout: "display_name": "Mr. foo.client.0", 2019-11-29T15:00:01.822 INFO:teuthology.orchestra.run.smithi062.stdout: "email": "foo.client.0+test@test.test", 2019-11-29T15:00:01.822 INFO:teuthology.orchestra.run.smithi062.stdout: "suspended": 0, 2019-11-29T15:00:01.822 INFO:teuthology.orchestra.run.smithi062.stdout: "max_buckets": 1000, 2019-11-29T15:00:01.823 INFO:teuthology.orchestra.run.smithi062.stdout: "subusers": [], 2019-11-29T15:00:01.823 INFO:teuthology.orchestra.run.smithi062.stdout: "keys": [ 2019-11-29T15:00:01.823 INFO:teuthology.orchestra.run.smithi062.stdout: { 2019-11-29T15:00:01.823 INFO:teuthology.orchestra.run.smithi062.stdout: "user": "foo.client.0", 2019-11-29T15:00:01.823 INFO:teuthology.orchestra.run.smithi062.stdout: "access_key": "AVJXJSVQIWYDNWDCDMTS", 2019-11-29T15:00:01.823 INFO:teuthology.orchestra.run.smithi062.stdout: "secret_key": "ryFcSkGTT1Eh+aFLtJ/n2aTGCrx89aU04++VOG7VxoRS+xwgi7o+bg==" 2019-11-29T15:00:01.823 INFO:teuthology.orchestra.run.smithi062.stdout: } 2019-11-29T15:00:01.824 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2019-11-29T15:00:01.824 INFO:teuthology.orchestra.run.smithi062.stdout: "swift_keys": [], 2019-11-29T15:00:01.824 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": [], 2019-11-29T15:00:01.824 INFO:teuthology.orchestra.run.smithi062.stdout: "op_mask": "read, write, delete", 2019-11-29T15:00:01.824 INFO:teuthology.orchestra.run.smithi062.stdout: "default_placement": "", 2019-11-29T15:00:01.824 INFO:teuthology.orchestra.run.smithi062.stdout: "default_storage_class": "", 2019-11-29T15:00:01.824 INFO:teuthology.orchestra.run.smithi062.stdout: "placement_tags": [], 2019-11-29T15:00:01.825 INFO:teuthology.orchestra.run.smithi062.stdout: "bucket_quota": { 2019-11-29T15:00:01.825 INFO:teuthology.orchestra.run.smithi062.stdout: "enabled": false, 2019-11-29T15:00:01.825 INFO:teuthology.orchestra.run.smithi062.stdout: "check_on_raw": false, 2019-11-29T15:00:01.825 INFO:teuthology.orchestra.run.smithi062.stdout: "max_size": -1, 2019-11-29T15:00:01.825 INFO:teuthology.orchestra.run.smithi062.stdout: "max_size_kb": 0, 2019-11-29T15:00:01.825 INFO:teuthology.orchestra.run.smithi062.stdout: "max_objects": -1 2019-11-29T15:00:01.825 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2019-11-29T15:00:01.826 INFO:teuthology.orchestra.run.smithi062.stdout: "user_quota": { 2019-11-29T15:00:01.826 INFO:teuthology.orchestra.run.smithi062.stdout: "enabled": false, 2019-11-29T15:00:01.826 INFO:teuthology.orchestra.run.smithi062.stdout: "check_on_raw": false, 2019-11-29T15:00:01.826 INFO:teuthology.orchestra.run.smithi062.stdout: "max_size": -1, 2019-11-29T15:00:01.826 INFO:teuthology.orchestra.run.smithi062.stdout: "max_size_kb": 0, 2019-11-29T15:00:01.826 INFO:teuthology.orchestra.run.smithi062.stdout: "max_objects": -1 2019-11-29T15:00:01.826 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2019-11-29T15:00:01.826 INFO:teuthology.orchestra.run.smithi062.stdout: "temp_url_keys": [], 2019-11-29T15:00:01.827 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "rgw", 2019-11-29T15:00:01.827 INFO:teuthology.orchestra.run.smithi062.stdout: "mfa_ids": [] 2019-11-29T15:00:01.827 INFO:teuthology.orchestra.run.smithi062.stdout:} 2019-11-29T15:00:01.827 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T15:00:01.863 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:01.859+0000 7fe4b0aecec0 20 remove_watcher() i=0 2019-11-29T15:00:01.863 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:01.859+0000 7fe4b0aecec0 2 removed watcher, disabling cache 2019-11-29T15:00:01.949 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:01.946+0000 7fe4b0aecec0 20 remove_watcher() i=1 2019-11-29T15:00:02.009 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:02.005+0000 7fe4b0aecec0 20 remove_watcher() i=2 2019-11-29T15:00:02.103 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:02.099+0000 7fe4b0aecec0 20 remove_watcher() i=3 2019-11-29T15:00:02.158 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:02.155+0000 7fe4b0aecec0 20 remove_watcher() i=4 2019-11-29T15:00:02.218 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:02.215+0000 7fe4b0aecec0 20 remove_watcher() i=5 2019-11-29T15:00:02.256 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:02.253+0000 7fe4b0aecec0 20 remove_watcher() i=6 2019-11-29T15:00:02.288 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:02.285+0000 7fe4b0aecec0 20 remove_watcher() i=7 2019-11-29T15:00:02.294 INFO:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid foo.client.0 --totp-serial 1708321984 --totp-seed X2ZPM3EPH6A5W76BEYFXS3DZADFZSZGBNH6UNOHDDZ7WOUDCDIXL5V56CU52SJDW --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2019-11-29T15:00:02.428 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:02.425+0000 7f1ef0f06ec0 20 rados->read ofs=0 len=0 2019-11-29T15:00:02.457 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:02.453+0000 7f1ef0f06ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T15:00:02.457 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:02.453+0000 7f1ef0f06ec0 20 rados->read ofs=0 len=0 2019-11-29T15:00:02.467 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:02.464+0000 7f1ef0f06ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T15:00:02.468 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:02.464+0000 7f1ef0f06ec0 20 rados->read ofs=0 len=0 2019-11-29T15:00:02.480 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:02.477+0000 7f1ef0f06ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T15:00:02.480 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:02.477+0000 7f1ef0f06ec0 20 rados->read ofs=0 len=0 2019-11-29T15:00:02.499 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:02.496+0000 7f1ef0f06ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T15:00:02.743 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:02.739+0000 7f1ef0f06ec0 20 RGWRados::pool_iterate: got zone_info.7f922895-c6d7-4b1b-a19c-be3df5b5a899 2019-11-29T15:00:02.743 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:02.739+0000 7f1ef0f06ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-29T15:00:02.743 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:02.739+0000 7f1ef0f06ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-29T15:00:02.743 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:02.739+0000 7f1ef0f06ec0 20 RGWRados::pool_iterate: got zonegroup_info.76ba47ff-1c23-4409-aae0-24fe26589cae 2019-11-29T15:00:02.743 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:02.739+0000 7f1ef0f06ec0 20 rados->read ofs=0 len=0 2019-11-29T15:00:02.757 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:02.754+0000 7f1ef0f06ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T15:00:02.757 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:02.754+0000 7f1ef0f06ec0 20 rados->read ofs=0 len=0 2019-11-29T15:00:02.788 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:02.783+0000 7f1ef0f06ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-29T15:00:02.788 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:02.783+0000 7f1ef0f06ec0 20 rados->read ofs=0 len=0 2019-11-29T15:00:02.807 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:02.803+0000 7f1ef0f06ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T15:00:02.807 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:02.804+0000 7f1ef0f06ec0 20 rados->read ofs=0 len=0 2019-11-29T15:00:02.825 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:02.821+0000 7f1ef0f06ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-29T15:00:02.825 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:02.822+0000 7f1ef0f06ec0 20 rados->read ofs=0 len=0 2019-11-29T15:00:02.839 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:02.836+0000 7f1ef0f06ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T15:00:02.839 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:02.836+0000 7f1ef0f06ec0 10 cannot find current period zonegroup using local zonegroup 2019-11-29T15:00:02.840 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:02.836+0000 7f1ef0f06ec0 20 rados->read ofs=0 len=0 2019-11-29T15:00:02.853 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:02.849+0000 7f1ef0f06ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T15:00:02.853 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:02.849+0000 7f1ef0f06ec0 20 rados->read ofs=0 len=0 2019-11-29T15:00:02.867 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:02.864+0000 7f1ef0f06ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T15:00:02.867 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:02.864+0000 7f1ef0f06ec0 20 rados->read ofs=0 len=0 2019-11-29T15:00:02.883 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:02.880+0000 7f1ef0f06ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-29T15:00:02.884 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:02.880+0000 7f1ef0f06ec0 20 zonegroup default 2019-11-29T15:00:02.884 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:02.880+0000 7f1ef0f06ec0 20 rados->read ofs=0 len=0 2019-11-29T15:00:02.899 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:02.895+0000 7f1ef0f06ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T15:00:02.899 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:02.895+0000 7f1ef0f06ec0 10 Cannot find current period zone using local zone 2019-11-29T15:00:02.899 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:02.895+0000 7f1ef0f06ec0 20 rados->read ofs=0 len=0 2019-11-29T15:00:02.916 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:02.913+0000 7f1ef0f06ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T15:00:02.916 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:02.913+0000 7f1ef0f06ec0 20 rados->read ofs=0 len=0 2019-11-29T15:00:02.935 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:02.932+0000 7f1ef0f06ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T15:00:02.936 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:02.932+0000 7f1ef0f06ec0 20 rados->read ofs=0 len=0 2019-11-29T15:00:02.957 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:02.953+0000 7f1ef0f06ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-29T15:00:02.957 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:02.953+0000 7f1ef0f06ec0 20 zone default found 2019-11-29T15:00:02.957 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:02.953+0000 7f1ef0f06ec0 20 started sync module instance, tier type = 2019-11-29T15:00:02.957 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:02.953+0000 7f1ef0f06ec0 20 started zone id=7f922895-c6d7-4b1b-a19c-be3df5b5a899 (name=default) with tier type = 2019-11-29T15:00:03.370 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:03.367+0000 7f1ef0f06ec0 20 add_watcher() i=0 2019-11-29T15:00:03.370 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:03.367+0000 7f1ef0f06ec0 20 add_watcher() i=1 2019-11-29T15:00:03.370 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:03.367+0000 7f1ef0f06ec0 20 add_watcher() i=2 2019-11-29T15:00:03.370 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:03.367+0000 7f1ef0f06ec0 20 add_watcher() i=3 2019-11-29T15:00:03.371 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:03.367+0000 7f1ef0f06ec0 20 add_watcher() i=4 2019-11-29T15:00:03.371 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:03.367+0000 7f1ef0f06ec0 20 add_watcher() i=5 2019-11-29T15:00:03.371 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:03.367+0000 7f1ef0f06ec0 20 add_watcher() i=6 2019-11-29T15:00:03.397 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:03.394+0000 7f1ef0f06ec0 20 add_watcher() i=7 2019-11-29T15:00:03.397 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:03.394+0000 7f1ef0f06ec0 2 all 8 watchers are set, enabling cache 2019-11-29T15:00:03.397 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:03.394+0000 7f1eaefdd700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-29T15:00:03.400 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:03.395+0000 7f1ede934700 0 -- >> v2:172.21.15.62:3300/0 conn(0x558ee0b5f830 msgr2=0x558ee0b5fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2019-11-29T15:00:03.447 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:03.444+0000 7f1ed5932700 0 -- 172.21.15.62:0/1816058043 >> [v2:172.21.15.22:6818/9264,v1:172.21.15.22:6819/9264] conn(0x558ee0b77b10 msgr2=0x558ee0b79f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-29T15:00:05.225 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:05.221+0000 7f1e1d7fa700 20 reqs_thread_entry: start 2019-11-29T15:00:05.225 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:05.222+0000 7f1e16ffd700 20 reqs_thread_entry: start 2019-11-29T15:00:05.225 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:05.222+0000 7f1ef0f06ec0 20 init_complete bucket index max shards: 0 2019-11-29T15:00:05.226 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:05.223+0000 7f1e157fa700 20 reqs_thread_entry: start 2019-11-29T15:00:05.226 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:05.223+0000 7f1ef0f06ec0 20 get_system_obj_state: rctx=0x7fff60065bc8 obj=default.rgw.meta:users.uid:foo.client.0 state=0x558ee0be12a0 s->prefetch_data=0 2019-11-29T15:00:05.227 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:05.223+0000 7f1ef0f06ec0 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2019-11-29T15:00:05.238 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:05.235+0000 7f1ef0f06ec0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x16 2019-11-29T15:00:05.238 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:05.235+0000 7f1ef0f06ec0 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-11-29T15:00:05.238 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:05.235+0000 7f1ef0f06ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-29T15:00:05.239 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:05.235+0000 7f1ef0f06ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-29T15:00:05.239 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:05.235+0000 7f1ef0f06ec0 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : type miss (requested=0x11, cached=0x16) 2019-11-29T15:00:05.239 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:05.235+0000 7f1ef0f06ec0 20 rados->read ofs=0 len=0 2019-11-29T15:00:05.252 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:05.249+0000 7f1ef0f06ec0 20 rados_obj.operate() r=0 bl.length=432 2019-11-29T15:00:05.253 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:05.249+0000 7f1ef0f06ec0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x11 2019-11-29T15:00:05.253 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:05.249+0000 7f1ef0f06ec0 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-11-29T15:00:05.374 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:05.370+0000 7f1ef0f06ec0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2019-11-29T15:00:05.374 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:05.370+0000 7f1ef0f06ec0 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-11-29T15:00:05.374 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:05.370+0000 7f1ef0f06ec0 10 distributing notification oid=default.rgw.control:notify.0 bl.length()=631 2019-11-29T15:00:05.384 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:05.381+0000 7f1ebf7fe700 10 RGWWatcher::handle_notify() notify_id 579820585027 cookie 94072143671040 notifier 4966 bl.length()=631 2019-11-29T15:00:05.385 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:05.381+0000 7f1ebf7fe700 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2019-11-29T15:00:05.385 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:05.381+0000 7f1ebf7fe700 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-11-29T15:00:05.496 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:05.492+0000 7f1ef0f06ec0 20 remove_watcher() i=0 2019-11-29T15:00:05.496 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:05.492+0000 7f1ef0f06ec0 2 removed watcher, disabling cache 2019-11-29T15:00:05.577 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:05.573+0000 7f1ef0f06ec0 20 remove_watcher() i=1 2019-11-29T15:00:05.653 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:05.649+0000 7f1ef0f06ec0 20 remove_watcher() i=2 2019-11-29T15:00:05.712 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:05.708+0000 7f1ef0f06ec0 20 remove_watcher() i=3 2019-11-29T15:00:05.758 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:05.755+0000 7f1ef0f06ec0 20 remove_watcher() i=4 2019-11-29T15:00:05.799 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:05.796+0000 7f1ef0f06ec0 20 remove_watcher() i=5 2019-11-29T15:00:05.838 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:05.835+0000 7f1ef0f06ec0 20 remove_watcher() i=6 2019-11-29T15:00:05.878 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:05.874+0000 7f1ef0f06ec0 20 remove_watcher() i=7 2019-11-29T15:00:05.885 DEBUG:tasks.s3tests:Creating user testx$tenanteduser.client.0 on client.0 2019-11-29T15:00:05.885 INFO:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid 'testx$tenanteduser.client.0' --display-name 'Mr. testx$tenanteduser.client.0' --access-key HWGBIJVSGICBIIVGHYIN --secret 1hFHwNRnkZa9PtaU1OXpmP15eG6sBm+ODWYcQiSSZzhTSRz6GgJMeg== --email 'testx$tenanteduser.client.0+test@test.test' --cluster ceph 2019-11-29T15:00:06.023 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:06.020+0000 7f8ea21bbec0 20 rados->read ofs=0 len=0 2019-11-29T15:00:06.052 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:06.049+0000 7f8ea21bbec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T15:00:06.052 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:06.049+0000 7f8ea21bbec0 20 rados->read ofs=0 len=0 2019-11-29T15:00:06.066 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:06.063+0000 7f8ea21bbec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T15:00:06.066 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:06.063+0000 7f8ea21bbec0 20 rados->read ofs=0 len=0 2019-11-29T15:00:06.077 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:06.074+0000 7f8ea21bbec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T15:00:06.078 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:06.074+0000 7f8ea21bbec0 20 rados->read ofs=0 len=0 2019-11-29T15:00:06.098 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:06.095+0000 7f8ea21bbec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T15:00:06.351 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:06.348+0000 7f8ea21bbec0 20 RGWRados::pool_iterate: got zone_info.7f922895-c6d7-4b1b-a19c-be3df5b5a899 2019-11-29T15:00:06.352 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:06.348+0000 7f8ea21bbec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-29T15:00:06.352 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:06.348+0000 7f8ea21bbec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-29T15:00:06.352 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:06.348+0000 7f8ea21bbec0 20 RGWRados::pool_iterate: got zonegroup_info.76ba47ff-1c23-4409-aae0-24fe26589cae 2019-11-29T15:00:06.352 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:06.348+0000 7f8ea21bbec0 20 rados->read ofs=0 len=0 2019-11-29T15:00:06.369 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:06.366+0000 7f8ea21bbec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T15:00:06.369 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:06.366+0000 7f8ea21bbec0 20 rados->read ofs=0 len=0 2019-11-29T15:00:06.434 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:06.431+0000 7f8ea21bbec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-29T15:00:06.434 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:06.431+0000 7f8ea21bbec0 20 rados->read ofs=0 len=0 2019-11-29T15:00:06.449 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:06.446+0000 7f8ea21bbec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T15:00:06.449 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:06.446+0000 7f8ea21bbec0 20 rados->read ofs=0 len=0 2019-11-29T15:00:06.464 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:06.460+0000 7f8ea21bbec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-29T15:00:06.464 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:06.460+0000 7f8ea21bbec0 20 rados->read ofs=0 len=0 2019-11-29T15:00:06.475 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:06.472+0000 7f8ea21bbec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T15:00:06.475 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:06.472+0000 7f8ea21bbec0 10 cannot find current period zonegroup using local zonegroup 2019-11-29T15:00:06.475 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:06.472+0000 7f8ea21bbec0 20 rados->read ofs=0 len=0 2019-11-29T15:00:06.485 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:06.482+0000 7f8ea21bbec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T15:00:06.485 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:06.482+0000 7f8ea21bbec0 20 rados->read ofs=0 len=0 2019-11-29T15:00:06.494 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:06.491+0000 7f8ea21bbec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T15:00:06.494 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:06.491+0000 7f8ea21bbec0 20 rados->read ofs=0 len=0 2019-11-29T15:00:06.506 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:06.502+0000 7f8ea21bbec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-29T15:00:06.506 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:06.502+0000 7f8ea21bbec0 20 zonegroup default 2019-11-29T15:00:06.506 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:06.503+0000 7f8ea21bbec0 20 rados->read ofs=0 len=0 2019-11-29T15:00:06.516 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:06.511+0000 7f8ea21bbec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T15:00:06.517 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:06.511+0000 7f8ea21bbec0 10 Cannot find current period zone using local zone 2019-11-29T15:00:06.517 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:06.511+0000 7f8ea21bbec0 20 rados->read ofs=0 len=0 2019-11-29T15:00:06.529 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:06.526+0000 7f8ea21bbec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T15:00:06.529 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:06.526+0000 7f8ea21bbec0 20 rados->read ofs=0 len=0 2019-11-29T15:00:06.546 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:06.543+0000 7f8ea21bbec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T15:00:06.546 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:06.543+0000 7f8ea21bbec0 20 rados->read ofs=0 len=0 2019-11-29T15:00:06.556 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:06.553+0000 7f8ea21bbec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-29T15:00:06.556 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:06.553+0000 7f8ea21bbec0 20 zone default found 2019-11-29T15:00:06.557 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:06.553+0000 7f8ea21bbec0 20 started sync module instance, tier type = 2019-11-29T15:00:06.557 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:06.553+0000 7f8ea21bbec0 20 started zone id=7f922895-c6d7-4b1b-a19c-be3df5b5a899 (name=default) with tier type = 2019-11-29T15:00:06.962 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:06.959+0000 7f8ea21bbec0 20 add_watcher() i=0 2019-11-29T15:00:06.962 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:06.959+0000 7f8ea21bbec0 20 add_watcher() i=1 2019-11-29T15:00:06.962 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:06.959+0000 7f8ea21bbec0 20 add_watcher() i=2 2019-11-29T15:00:06.962 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:06.959+0000 7f8ea21bbec0 20 add_watcher() i=3 2019-11-29T15:00:06.963 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:06.959+0000 7f8ea21bbec0 20 add_watcher() i=4 2019-11-29T15:00:06.963 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:06.959+0000 7f8ea21bbec0 20 add_watcher() i=5 2019-11-29T15:00:06.963 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:06.959+0000 7f8ea21bbec0 20 add_watcher() i=6 2019-11-29T15:00:06.996 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:06.993+0000 7f8ea21bbec0 20 add_watcher() i=7 2019-11-29T15:00:06.996 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:06.993+0000 7f8ea21bbec0 2 all 8 watchers are set, enabling cache 2019-11-29T15:00:06.996 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:06.993+0000 7f8e5ffdf700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-29T15:00:06.997 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:06.993+0000 7f8e8f3e8700 0 -- >> v1:172.21.15.62:6789/0 conn(0x55a7de3d7a20 legacy=0x55a7de3d9e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0)._try_send injecting socket failure 2019-11-29T15:00:07.070 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:07.067+0000 7f8e8f3e8700 0 -- 172.21.15.62:0/3966737658 >> [v2:172.21.15.22:6818/9264,v1:172.21.15.22:6819/9264] conn(0x55a7de3ec840 msgr2=0x55a7de3eec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-29T15:00:08.902 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:08.900+0000 7f8dce7fc700 20 reqs_thread_entry: start 2019-11-29T15:00:08.902 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:08.900+0000 7f8dc7fff700 20 reqs_thread_entry: start 2019-11-29T15:00:08.902 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:08.900+0000 7f8ea21bbec0 20 init_complete bucket index max shards: 0 2019-11-29T15:00:08.903 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:08.900+0000 7f8dc67fc700 20 reqs_thread_entry: start 2019-11-29T15:00:08.903 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:08.900+0000 7f8ea21bbec0 20 get_system_obj_state: rctx=0x7ffe6ed03e48 obj=default.rgw.meta:users.uid:testx$tenanteduser.client.0 state=0x55a7de456150 s->prefetch_data=0 2019-11-29T15:00:08.903 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:08.900+0000 7f8ea21bbec0 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2019-11-29T15:00:08.914 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:08.912+0000 7f8ea21bbec0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x0 2019-11-29T15:00:08.914 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:08.912+0000 7f8ea21bbec0 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2019-11-29T15:00:08.914 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:08.912+0000 7f8ea21bbec0 20 get_system_obj_state: rctx=0x7ffe6ed03e58 obj=default.rgw.meta:users.email:testx$tenanteduser.client.0+test@test.test state=0x55a7de457f00 s->prefetch_data=0 2019-11-29T15:00:08.914 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:08.912+0000 7f8ea21bbec0 10 cache get: name=default.rgw.meta+users.email+testx$tenanteduser.client.0+test@test.test : miss 2019-11-29T15:00:08.925 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:08.923+0000 7f8ea21bbec0 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser.client.0+test@test.test info.flags=0x0 2019-11-29T15:00:08.925 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:08.923+0000 7f8ea21bbec0 10 adding default.rgw.meta+users.email+testx$tenanteduser.client.0+test@test.test to cache LRU end 2019-11-29T15:00:08.926 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:08.923+0000 7f8ea21bbec0 20 get_system_obj_state: rctx=0x7ffe6ed03e58 obj=default.rgw.meta:users.keys:HWGBIJVSGICBIIVGHYIN state=0x55a7de457f00 s->prefetch_data=0 2019-11-29T15:00:08.926 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:08.923+0000 7f8ea21bbec0 10 cache get: name=default.rgw.meta+users.keys+HWGBIJVSGICBIIVGHYIN : miss 2019-11-29T15:00:08.935 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:08.932+0000 7f8ea21bbec0 10 cache put: name=default.rgw.meta+users.keys+HWGBIJVSGICBIIVGHYIN info.flags=0x0 2019-11-29T15:00:08.935 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:08.932+0000 7f8ea21bbec0 10 adding default.rgw.meta+users.keys+HWGBIJVSGICBIIVGHYIN to cache LRU end 2019-11-29T15:00:08.935 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:08.932+0000 7f8ea21bbec0 20 get_system_obj_state: rctx=0x7ffe6ed03a68 obj=default.rgw.meta:users.keys:HWGBIJVSGICBIIVGHYIN state=0x55a7de457f00 s->prefetch_data=0 2019-11-29T15:00:08.935 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:08.932+0000 7f8ea21bbec0 10 cache get: name=default.rgw.meta+users.keys+HWGBIJVSGICBIIVGHYIN : type miss (requested=0x6, cached=0x0) 2019-11-29T15:00:08.949 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:08.947+0000 7f8ea21bbec0 10 cache put: name=default.rgw.meta+users.keys+HWGBIJVSGICBIIVGHYIN info.flags=0x0 2019-11-29T15:00:08.949 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:08.947+0000 7f8ea21bbec0 10 moving default.rgw.meta+users.keys+HWGBIJVSGICBIIVGHYIN to cache LRU end 2019-11-29T15:00:08.950 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:08.947+0000 7f8ea21bbec0 20 get_system_obj_state: rctx=0x7ffe6ed03be8 obj=default.rgw.meta:users.keys:HWGBIJVSGICBIIVGHYIN state=0x55a7de457f00 s->prefetch_data=0 2019-11-29T15:00:08.950 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:08.947+0000 7f8ea21bbec0 10 cache get: name=default.rgw.meta+users.keys+HWGBIJVSGICBIIVGHYIN : type miss (requested=0x6, cached=0x0) 2019-11-29T15:00:08.958 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:08.956+0000 7f8ea21bbec0 10 cache put: name=default.rgw.meta+users.keys+HWGBIJVSGICBIIVGHYIN info.flags=0x0 2019-11-29T15:00:08.958 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:08.956+0000 7f8ea21bbec0 10 moving default.rgw.meta+users.keys+HWGBIJVSGICBIIVGHYIN to cache LRU end 2019-11-29T15:00:09.017 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:09.015+0000 7f8ea21bbec0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2019-11-29T15:00:09.018 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:09.015+0000 7f8ea21bbec0 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2019-11-29T15:00:09.018 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:09.015+0000 7f8ea21bbec0 10 distributing notification oid=default.rgw.control:notify.5 bl.length()=691 2019-11-29T15:00:09.055 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:09.051+0000 7f8e84be3700 10 RGWWatcher::handle_notify() notify_id 579820585031 cookie 94179476401344 notifier 4975 bl.length()=691 2019-11-29T15:00:09.055 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:09.051+0000 7f8e84be3700 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2019-11-29T15:00:09.055 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:09.051+0000 7f8e84be3700 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2019-11-29T15:00:10.105 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:10.101+0000 7f8ea21bbec0 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser.client.0+test@test.test info.flags=0x7 2019-11-29T15:00:10.106 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:10.101+0000 7f8ea21bbec0 10 moving default.rgw.meta+users.email+testx$tenanteduser.client.0+test@test.test to cache LRU end 2019-11-29T15:00:10.106 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:10.101+0000 7f8ea21bbec0 10 distributing notification oid=default.rgw.control:notify.7 bl.length()=224 2019-11-29T15:00:10.130 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:10.127+0000 7f8e84be3700 10 RGWWatcher::handle_notify() notify_id 579820585028 cookie 94179476408320 notifier 4975 bl.length()=224 2019-11-29T15:00:10.130 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:10.127+0000 7f8e84be3700 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser.client.0+test@test.test info.flags=0x7 2019-11-29T15:00:10.130 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:10.127+0000 7f8e84be3700 10 moving default.rgw.meta+users.email+testx$tenanteduser.client.0+test@test.test to cache LRU end 2019-11-29T15:00:10.283 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:10.280+0000 7f8ea21bbec0 10 cache put: name=default.rgw.meta+users.keys+HWGBIJVSGICBIIVGHYIN info.flags=0x7 2019-11-29T15:00:10.283 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:10.280+0000 7f8ea21bbec0 10 moving default.rgw.meta+users.keys+HWGBIJVSGICBIIVGHYIN to cache LRU end 2019-11-29T15:00:10.283 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:10.280+0000 7f8ea21bbec0 10 distributing notification oid=default.rgw.control:notify.0 bl.length()=201 2019-11-29T15:00:10.299 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:10.295+0000 7f8e84be3700 10 RGWWatcher::handle_notify() notify_id 579820585029 cookie 94179476389808 notifier 4975 bl.length()=201 2019-11-29T15:00:10.299 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:10.295+0000 7f8e84be3700 10 cache put: name=default.rgw.meta+users.keys+HWGBIJVSGICBIIVGHYIN info.flags=0x7 2019-11-29T15:00:10.299 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:10.295+0000 7f8e84be3700 10 moving default.rgw.meta+users.keys+HWGBIJVSGICBIIVGHYIN to cache LRU end 2019-11-29T15:00:10.884 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2019-11-29T15:00:10.884 INFO:teuthology.orchestra.run.smithi062.stdout: "user_id": "testx$tenanteduser.client.0", 2019-11-29T15:00:10.884 INFO:teuthology.orchestra.run.smithi062.stdout: "display_name": "Mr. testx$tenanteduser.client.0", 2019-11-29T15:00:10.884 INFO:teuthology.orchestra.run.smithi062.stdout: "email": "testx$tenanteduser.client.0+test@test.test", 2019-11-29T15:00:10.885 INFO:teuthology.orchestra.run.smithi062.stdout: "suspended": 0, 2019-11-29T15:00:10.885 INFO:teuthology.orchestra.run.smithi062.stdout: "max_buckets": 1000, 2019-11-29T15:00:10.885 INFO:teuthology.orchestra.run.smithi062.stdout: "subusers": [], 2019-11-29T15:00:10.885 INFO:teuthology.orchestra.run.smithi062.stdout: "keys": [ 2019-11-29T15:00:10.886 INFO:teuthology.orchestra.run.smithi062.stdout: { 2019-11-29T15:00:10.886 INFO:teuthology.orchestra.run.smithi062.stdout: "user": "testx$tenanteduser.client.0", 2019-11-29T15:00:10.886 INFO:teuthology.orchestra.run.smithi062.stdout: "access_key": "HWGBIJVSGICBIIVGHYIN", 2019-11-29T15:00:10.886 INFO:teuthology.orchestra.run.smithi062.stdout: "secret_key": "1hFHwNRnkZa9PtaU1OXpmP15eG6sBm+ODWYcQiSSZzhTSRz6GgJMeg==" 2019-11-29T15:00:10.886 INFO:teuthology.orchestra.run.smithi062.stdout: } 2019-11-29T15:00:10.887 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2019-11-29T15:00:10.887 INFO:teuthology.orchestra.run.smithi062.stdout: "swift_keys": [], 2019-11-29T15:00:10.887 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": [], 2019-11-29T15:00:10.887 INFO:teuthology.orchestra.run.smithi062.stdout: "op_mask": "read, write, delete", 2019-11-29T15:00:10.888 INFO:teuthology.orchestra.run.smithi062.stdout: "default_placement": "", 2019-11-29T15:00:10.888 INFO:teuthology.orchestra.run.smithi062.stdout: "default_storage_class": "", 2019-11-29T15:00:10.888 INFO:teuthology.orchestra.run.smithi062.stdout: "placement_tags": [], 2019-11-29T15:00:10.888 INFO:teuthology.orchestra.run.smithi062.stdout: "bucket_quota": { 2019-11-29T15:00:10.889 INFO:teuthology.orchestra.run.smithi062.stdout: "enabled": false, 2019-11-29T15:00:10.889 INFO:teuthology.orchestra.run.smithi062.stdout: "check_on_raw": false, 2019-11-29T15:00:10.889 INFO:teuthology.orchestra.run.smithi062.stdout: "max_size": -1, 2019-11-29T15:00:10.889 INFO:teuthology.orchestra.run.smithi062.stdout: "max_size_kb": 0, 2019-11-29T15:00:10.889 INFO:teuthology.orchestra.run.smithi062.stdout: "max_objects": -1 2019-11-29T15:00:10.890 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2019-11-29T15:00:10.890 INFO:teuthology.orchestra.run.smithi062.stdout: "user_quota": { 2019-11-29T15:00:10.890 INFO:teuthology.orchestra.run.smithi062.stdout: "enabled": false, 2019-11-29T15:00:10.890 INFO:teuthology.orchestra.run.smithi062.stdout: "check_on_raw": false, 2019-11-29T15:00:10.891 INFO:teuthology.orchestra.run.smithi062.stdout: "max_size": -1, 2019-11-29T15:00:10.891 INFO:teuthology.orchestra.run.smithi062.stdout: "max_size_kb": 0, 2019-11-29T15:00:10.891 INFO:teuthology.orchestra.run.smithi062.stdout: "max_objects": -1 2019-11-29T15:00:10.891 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2019-11-29T15:00:10.891 INFO:teuthology.orchestra.run.smithi062.stdout: "temp_url_keys": [], 2019-11-29T15:00:10.892 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "rgw", 2019-11-29T15:00:10.892 INFO:teuthology.orchestra.run.smithi062.stdout: "mfa_ids": [] 2019-11-29T15:00:10.892 INFO:teuthology.orchestra.run.smithi062.stdout:} 2019-11-29T15:00:10.892 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T15:00:10.959 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:10.956+0000 7f8ea21bbec0 20 remove_watcher() i=0 2019-11-29T15:00:10.959 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:10.956+0000 7f8ea21bbec0 2 removed watcher, disabling cache 2019-11-29T15:00:11.021 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:11.018+0000 7f8ea21bbec0 20 remove_watcher() i=1 2019-11-29T15:00:11.081 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:11.077+0000 7f8ea21bbec0 20 remove_watcher() i=2 2019-11-29T15:00:11.111 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:11.108+0000 7f8ea21bbec0 20 remove_watcher() i=3 2019-11-29T15:00:11.149 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:11.145+0000 7f8ea21bbec0 20 remove_watcher() i=4 2019-11-29T15:00:11.194 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:11.191+0000 7f8ea21bbec0 20 remove_watcher() i=5 2019-11-29T15:00:11.239 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:11.236+0000 7f8ea21bbec0 20 remove_watcher() i=6 2019-11-29T15:00:11.301 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:11.298+0000 7f8ea21bbec0 20 remove_watcher() i=7 2019-11-29T15:00:11.309 INFO:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid 'testx$tenanteduser.client.0' --totp-serial 5999212382 --totp-seed EROEZ4OQQBD3F2T3RFYHKPH74OFG77NFBYEXSJXHQYDEZ7CI3MZUHNXVAJAKM23V --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2019-11-29T15:00:11.447 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:11.444+0000 7f5bf38dcec0 20 rados->read ofs=0 len=0 2019-11-29T15:00:11.481 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:11.477+0000 7f5bf38dcec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T15:00:11.481 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:11.477+0000 7f5bf38dcec0 20 rados->read ofs=0 len=0 2019-11-29T15:00:11.502 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:11.499+0000 7f5bf38dcec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T15:00:11.502 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:11.499+0000 7f5bf38dcec0 20 rados->read ofs=0 len=0 2019-11-29T15:00:11.514 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:11.511+0000 7f5bf38dcec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T15:00:11.514 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:11.511+0000 7f5bf38dcec0 20 rados->read ofs=0 len=0 2019-11-29T15:00:11.536 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:11.533+0000 7f5bf38dcec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T15:00:11.838 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:11.834+0000 7f5bf38dcec0 20 RGWRados::pool_iterate: got zone_info.7f922895-c6d7-4b1b-a19c-be3df5b5a899 2019-11-29T15:00:11.838 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:11.834+0000 7f5bf38dcec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-29T15:00:11.838 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:11.834+0000 7f5bf38dcec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-29T15:00:11.838 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:11.834+0000 7f5bf38dcec0 20 RGWRados::pool_iterate: got zonegroup_info.76ba47ff-1c23-4409-aae0-24fe26589cae 2019-11-29T15:00:11.838 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:11.834+0000 7f5bf38dcec0 20 rados->read ofs=0 len=0 2019-11-29T15:00:11.857 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:11.853+0000 7f5bf38dcec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T15:00:11.857 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:11.853+0000 7f5bf38dcec0 20 rados->read ofs=0 len=0 2019-11-29T15:00:11.871 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:11.867+0000 7f5bf38dcec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-29T15:00:11.871 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:11.867+0000 7f5bf38dcec0 20 rados->read ofs=0 len=0 2019-11-29T15:00:11.883 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:11.880+0000 7f5bf38dcec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T15:00:11.883 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:11.880+0000 7f5bf38dcec0 20 rados->read ofs=0 len=0 2019-11-29T15:00:11.900 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:11.897+0000 7f5bf38dcec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-29T15:00:11.900 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:11.897+0000 7f5bf38dcec0 20 rados->read ofs=0 len=0 2019-11-29T15:00:11.909 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:11.906+0000 7f5bf38dcec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T15:00:11.910 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:11.906+0000 7f5bf38dcec0 10 cannot find current period zonegroup using local zonegroup 2019-11-29T15:00:11.910 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:11.906+0000 7f5bf38dcec0 20 rados->read ofs=0 len=0 2019-11-29T15:00:11.918 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:11.915+0000 7f5bf38dcec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T15:00:11.918 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:11.915+0000 7f5bf38dcec0 20 rados->read ofs=0 len=0 2019-11-29T15:00:11.929 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:11.926+0000 7f5bf38dcec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T15:00:11.929 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:11.926+0000 7f5bf38dcec0 20 rados->read ofs=0 len=0 2019-11-29T15:00:11.938 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:11.935+0000 7f5bf38dcec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-29T15:00:11.939 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:11.935+0000 7f5bf38dcec0 20 zonegroup default 2019-11-29T15:00:11.939 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:11.935+0000 7f5bf38dcec0 20 rados->read ofs=0 len=0 2019-11-29T15:00:11.946 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:11.943+0000 7f5bf38dcec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T15:00:11.946 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:11.943+0000 7f5bf38dcec0 10 Cannot find current period zone using local zone 2019-11-29T15:00:11.947 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:11.943+0000 7f5bf38dcec0 20 rados->read ofs=0 len=0 2019-11-29T15:00:11.961 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:11.952+0000 7f5bf38dcec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T15:00:11.961 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:11.952+0000 7f5bf38dcec0 20 rados->read ofs=0 len=0 2019-11-29T15:00:11.967 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:11.964+0000 7f5bf38dcec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T15:00:11.967 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:11.964+0000 7f5bf38dcec0 20 rados->read ofs=0 len=0 2019-11-29T15:00:11.977 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:11.974+0000 7f5bf38dcec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-29T15:00:11.978 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:11.974+0000 7f5bf38dcec0 20 zone default found 2019-11-29T15:00:11.978 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:11.974+0000 7f5bf38dcec0 20 started sync module instance, tier type = 2019-11-29T15:00:11.978 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:11.974+0000 7f5bf38dcec0 20 started zone id=7f922895-c6d7-4b1b-a19c-be3df5b5a899 (name=default) with tier type = 2019-11-29T15:00:12.299 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:12.295+0000 7f5bf38dcec0 20 add_watcher() i=0 2019-11-29T15:00:12.299 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:12.295+0000 7f5bf38dcec0 20 add_watcher() i=1 2019-11-29T15:00:12.299 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:12.295+0000 7f5bf38dcec0 20 add_watcher() i=2 2019-11-29T15:00:12.299 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:12.295+0000 7f5bf38dcec0 20 add_watcher() i=3 2019-11-29T15:00:12.299 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:12.295+0000 7f5bf38dcec0 20 add_watcher() i=4 2019-11-29T15:00:12.300 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:12.295+0000 7f5bf38dcec0 20 add_watcher() i=5 2019-11-29T15:00:12.300 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:12.295+0000 7f5bf38dcec0 20 add_watcher() i=6 2019-11-29T15:00:12.334 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:12.330+0000 7f5bf38dcec0 20 add_watcher() i=7 2019-11-29T15:00:12.334 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:12.330+0000 7f5bf38dcec0 2 all 8 watchers are set, enabling cache 2019-11-29T15:00:12.334 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:12.331+0000 7f5bb0fe1700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-29T15:00:12.335 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:12.332+0000 7f5be0b09700 0 -- 172.21.15.62:0/1156168291 >> v1:172.21.15.62:6789/0 conn(0x564c78653950 legacy=0x564c78655db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0)._try_send injecting socket failure 2019-11-29T15:00:12.376 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:12.373+0000 7f5be130a700 0 -- 172.21.15.62:0/3267450691 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x564c786569c0 msgr2=0x564c78656dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-29T15:00:14.093 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:14.089+0000 7f5b22ffd700 20 reqs_thread_entry: start 2019-11-29T15:00:14.093 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:14.090+0000 7f5b20ff9700 20 reqs_thread_entry: start 2019-11-29T15:00:14.094 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:14.090+0000 7f5bf38dcec0 20 init_complete bucket index max shards: 0 2019-11-29T15:00:14.094 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:14.091+0000 7f5b16ffd700 20 reqs_thread_entry: start 2019-11-29T15:00:14.094 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:14.091+0000 7f5bf38dcec0 20 get_system_obj_state: rctx=0x7fffcd2acf38 obj=default.rgw.meta:users.uid:testx$tenanteduser.client.0 state=0x564c786ce500 s->prefetch_data=0 2019-11-29T15:00:14.094 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:14.091+0000 7f5bf38dcec0 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2019-11-29T15:00:14.111 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:14.108+0000 7f5bf38dcec0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x16 2019-11-29T15:00:14.112 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:14.108+0000 7f5bf38dcec0 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2019-11-29T15:00:14.112 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:14.108+0000 7f5bf38dcec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-29T15:00:14.112 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:14.108+0000 7f5bf38dcec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-29T15:00:14.112 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:14.108+0000 7f5bf38dcec0 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : type miss (requested=0x11, cached=0x16) 2019-11-29T15:00:14.112 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:14.108+0000 7f5bf38dcec0 20 rados->read ofs=0 len=0 2019-11-29T15:00:14.137 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:14.134+0000 7f5bf38dcec0 20 rados_obj.operate() r=0 bl.length=491 2019-11-29T15:00:14.168 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:14.134+0000 7f5bf38dcec0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x11 2019-11-29T15:00:14.168 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:14.134+0000 7f5bf38dcec0 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2019-11-29T15:00:14.315 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:14.312+0000 7f5bf38dcec0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2019-11-29T15:00:14.316 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:14.312+0000 7f5bf38dcec0 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2019-11-29T15:00:14.316 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:14.312+0000 7f5bf38dcec0 10 distributing notification oid=default.rgw.control:notify.5 bl.length()=705 2019-11-29T15:00:14.332 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:14.329+0000 7f5bc9ffb700 10 RGWWatcher::handle_notify() notify_id 579820585032 cookie 94886437335344 notifier 4625 bl.length()=705 2019-11-29T15:00:14.332 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:14.329+0000 7f5bc9ffb700 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2019-11-29T15:00:14.333 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:14.329+0000 7f5bc9ffb700 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2019-11-29T15:00:14.773 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:14.770+0000 7f5bf38dcec0 20 remove_watcher() i=0 2019-11-29T15:00:14.773 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:14.770+0000 7f5bf38dcec0 2 removed watcher, disabling cache 2019-11-29T15:00:14.874 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:14.870+0000 7f5bf38dcec0 20 remove_watcher() i=1 2019-11-29T15:00:14.918 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:14.914+0000 7f5bf38dcec0 20 remove_watcher() i=2 2019-11-29T15:00:14.961 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:14.958+0000 7f5bf38dcec0 20 remove_watcher() i=3 2019-11-29T15:00:14.998 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:14.995+0000 7f5bf38dcec0 20 remove_watcher() i=4 2019-11-29T15:00:15.036 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:15.033+0000 7f5bf38dcec0 20 remove_watcher() i=5 2019-11-29T15:00:15.082 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:15.079+0000 7f5bf38dcec0 20 remove_watcher() i=6 2019-11-29T15:00:15.117 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T15:00:15.114+0000 7f5bf38dcec0 20 remove_watcher() i=7 2019-11-29T15:00:15.124 INFO:tasks.s3tests:Configuring s3-tests... 2019-11-29T15:00:15.125 INFO:teuthology.orchestra.run.smithi062:> cd /home/ubuntu/cephtest/s3-tests && ./bootstrap 2019-11-29T15:00:20.567 INFO:teuthology.orchestra.run.smithi062.stderr:./bootstrap: missing required RPM packages. Installing via sudo. 2019-11-29T15:00:20.671 INFO:teuthology.orchestra.run.smithi062.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-29T15:00:20.709 INFO:teuthology.orchestra.run.smithi062.stdout:Loading mirror speeds from cached hostfile 2019-11-29T15:00:20.710 INFO:teuthology.orchestra.run.smithi062.stdout: * base: mirror.us-midwest-1.nexcess.net 2019-11-29T15:00:20.710 INFO:teuthology.orchestra.run.smithi062.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-29T15:00:20.711 INFO:teuthology.orchestra.run.smithi062.stdout: * extras: www.gtlib.gatech.edu 2019-11-29T15:00:20.711 INFO:teuthology.orchestra.run.smithi062.stdout: * updates: reflector.westga.edu 2019-11-29T15:00:21.372 INFO:teuthology.orchestra.run.smithi062.stdout:7 packages excluded due to repository priority protections 2019-11-29T15:00:21.729 INFO:teuthology.orchestra.run.smithi062.stdout:Resolving Dependencies 2019-11-29T15:00:21.729 INFO:teuthology.orchestra.run.smithi062.stdout:--> Running transaction check 2019-11-29T15:00:21.729 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package libffi-devel.x86_64 0:3.0.13-18.el7 will be installed 2019-11-29T15:00:22.135 INFO:teuthology.orchestra.run.smithi062.stdout:--> Finished Dependency Resolution 2019-11-29T15:00:22.370 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T15:00:22.371 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies Resolved 2019-11-29T15:00:22.372 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T15:00:22.372 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2019-11-29T15:00:22.372 INFO:teuthology.orchestra.run.smithi062.stdout: Package Arch Version Repository Size 2019-11-29T15:00:22.373 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2019-11-29T15:00:22.373 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2019-11-29T15:00:22.373 INFO:teuthology.orchestra.run.smithi062.stdout: libffi-devel x86_64 3.0.13-18.el7 base 23 k 2019-11-29T15:00:22.373 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T15:00:22.374 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2019-11-29T15:00:22.374 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2019-11-29T15:00:22.374 INFO:teuthology.orchestra.run.smithi062.stdout:Install 1 Package 2019-11-29T15:00:22.374 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T15:00:22.375 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 23 k 2019-11-29T15:00:22.375 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 27 k 2019-11-29T15:00:22.375 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading packages: 2019-11-29T15:00:22.547 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2019-11-29T15:00:22.549 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2019-11-29T15:00:22.551 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded 2019-11-29T15:00:22.551 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2019-11-29T15:00:23.088 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libffi-devel-3.0.13-18.el7.x86_64 1/1 2019-11-29T15:00:23.555 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libffi-devel-3.0.13-18.el7.x86_64 1/1 2019-11-29T15:00:23.555 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T15:00:23.555 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2019-11-29T15:00:23.556 INFO:teuthology.orchestra.run.smithi062.stdout: libffi-devel.x86_64 0:3.0.13-18.el7 2019-11-29T15:00:23.556 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T15:00:23.556 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2019-11-29T15:00:23.747 INFO:teuthology.orchestra.run.smithi062.stdout:New python executable in /home/ubuntu/cephtest/s3-tests/virtualenv/bin/python 2019-11-29T15:00:25.048 INFO:teuthology.orchestra.run.smithi062.stdout:Installing setuptools, pip, wheel...done. 2019-11-29T15:00:25.309 INFO:teuthology.orchestra.run.smithi062.stderr:Cache entry deserialization failed, entry ignored 2019-11-29T15:00:25.427 INFO:teuthology.orchestra.run.smithi062.stdout:Collecting pip 2019-11-29T15:00:25.510 INFO:teuthology.orchestra.run.smithi062.stdout: Using cached https://files.pythonhosted.org/packages/00/b6/9cfa56b4081ad13874b0c6f96af8ce16cfbc1cb06bedf8e9164ce5551ec1/pip-19.3.1-py2.py3-none-any.whl 2019-11-29T15:00:25.582 INFO:teuthology.orchestra.run.smithi062.stdout:Installing collected packages: pip 2019-11-29T15:00:25.582 INFO:teuthology.orchestra.run.smithi062.stdout: Found existing installation: pip 9.0.1 2019-11-29T15:00:25.646 INFO:teuthology.orchestra.run.smithi062.stdout: Uninstalling pip-9.0.1: 2019-11-29T15:00:25.689 INFO:teuthology.orchestra.run.smithi062.stdout: Successfully uninstalled pip-9.0.1 2019-11-29T15:00:26.540 INFO:teuthology.orchestra.run.smithi062.stdout:Successfully installed pip-19.3.1 2019-11-29T15:00:26.878 INFO:teuthology.orchestra.run.smithi062.stderr:DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support 2019-11-29T15:00:27.399 INFO:teuthology.orchestra.run.smithi062.stdout:Collecting setuptools==32.3.1 2019-11-29T15:00:27.402 INFO:teuthology.orchestra.run.smithi062.stdout: Using cached https://files.pythonhosted.org/packages/69/19/b1dff551058ce79d88b1e3688f1c735590d7ddf44d10681512133b35019f/setuptools-32.3.1-py2.py3-none-any.whl 2019-11-29T15:00:27.443 INFO:teuthology.orchestra.run.smithi062.stdout:Installing collected packages: setuptools 2019-11-29T15:00:27.443 INFO:teuthology.orchestra.run.smithi062.stdout: Found existing installation: setuptools 28.8.0 2019-11-29T15:00:27.458 INFO:teuthology.orchestra.run.smithi062.stdout: Uninstalling setuptools-28.8.0: 2019-11-29T15:00:27.467 INFO:teuthology.orchestra.run.smithi062.stdout: Successfully uninstalled setuptools-28.8.0 2019-11-29T15:00:27.645 INFO:teuthology.orchestra.run.smithi062.stdout:Successfully installed setuptools-32.3.1 2019-11-29T15:00:28.123 INFO:teuthology.orchestra.run.smithi062.stderr:DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support 2019-11-29T15:00:28.300 INFO:teuthology.orchestra.run.smithi062.stdout:Processing /home/ubuntu/.cache/pip/wheels/d9/45/dd/65f0b38450c47cf7e5312883deb97d065e030c5cca0a365030/PyYAML-5.1.2-cp27-cp27mu-linux_x86_64.whl 2019-11-29T15:00:28.359 INFO:teuthology.orchestra.run.smithi062.stdout:Collecting nose>=1.0.0 2019-11-29T15:00:28.361 INFO:teuthology.orchestra.run.smithi062.stdout: Using cached https://files.pythonhosted.org/packages/99/4f/13fb671119e65c4dce97c60e67d3fd9e6f7f809f2b307e2611f4701205cb/nose-1.3.7-py2-none-any.whl 2019-11-29T15:00:28.491 INFO:teuthology.orchestra.run.smithi062.stdout:Collecting boto>=2.6.0 2019-11-29T15:00:28.498 INFO:teuthology.orchestra.run.smithi062.stdout: Using cached https://files.pythonhosted.org/packages/23/10/c0b78c27298029e4454a472a1919bde20cb182dab1662cec7f2ca1dcc523/boto-2.49.0-py2.py3-none-any.whl 2019-11-29T15:00:29.013 INFO:teuthology.orchestra.run.smithi062.stdout:Collecting boto3>=1.0.0 2019-11-29T15:00:29.053 INFO:teuthology.orchestra.run.smithi062.stdout: Downloading https://files.pythonhosted.org/packages/67/17/567f679dac6ec93611ce05637094e9736afa40e41c9ed0aaefd90de6f7e8/boto3-1.10.28-py2.py3-none-any.whl (128kB) 2019-11-29T15:00:29.155 INFO:teuthology.orchestra.run.smithi062.stdout:Processing /home/ubuntu/.cache/pip/wheels/56/0f/19/fbbf81e5764e6d8b74501c4357a88c14c94466ec777c03734c/bunch-1.0.1-cp27-none-any.whl 2019-11-29T15:00:29.453 INFO:teuthology.orchestra.run.smithi062.stdout:Collecting gevent>=1.0 2019-11-29T15:00:29.466 INFO:teuthology.orchestra.run.smithi062.stdout: Using cached https://files.pythonhosted.org/packages/e6/e9/3a693414f706e12abe60554cd73c5ae8f848b182ae58018f93d86c9eb418/gevent-1.4.0-cp27-cp27mu-manylinux1_x86_64.whl 2019-11-29T15:00:29.724 INFO:teuthology.orchestra.run.smithi062.stdout:Collecting isodate>=0.4.4 2019-11-29T15:00:29.735 INFO:teuthology.orchestra.run.smithi062.stdout: Downloading https://files.pythonhosted.org/packages/9b/9f/b36f7774ff5ea8e428fdcfc4bb332c39ee5b9362ddd3d40d9516a55221b2/isodate-0.6.0-py2.py3-none-any.whl (45kB) 2019-11-29T15:00:29.932 INFO:teuthology.orchestra.run.smithi062.stdout:Collecting requests>=0.14.0 2019-11-29T15:00:29.942 INFO:teuthology.orchestra.run.smithi062.stdout: Downloading https://files.pythonhosted.org/packages/51/bd/23c926cd341ea6b7dd0b2a00aba99ae0f828be89d72b2190f27c11d4b7fb/requests-2.22.0-py2.py3-none-any.whl (57kB) 2019-11-29T15:00:30.274 INFO:teuthology.orchestra.run.smithi062.stdout:Collecting pytz>=2011k 2019-11-29T15:00:30.283 INFO:teuthology.orchestra.run.smithi062.stdout: Downloading https://files.pythonhosted.org/packages/e7/f9/f0b53f88060247251bf481fa6ea62cd0d25bf1b11a87888e53ce5b7c8ad2/pytz-2019.3-py2.py3-none-any.whl (509kB) 2019-11-29T15:00:30.508 INFO:teuthology.orchestra.run.smithi062.stdout:Collecting ordereddict 2019-11-29T15:00:30.517 INFO:teuthology.orchestra.run.smithi062.stdout: Downloading https://files.pythonhosted.org/packages/53/25/ef88e8e45db141faa9598fbf7ad0062df8f50f881a36ed6a0073e1572126/ordereddict-1.1.tar.gz 2019-11-29T15:00:30.920 INFO:teuthology.orchestra.run.smithi062.stdout:Processing /home/ubuntu/.cache/pip/wheels/51/ab/65/f318b4271019823cf7d7c178ac76a8ea4d6e6271fe9f5ba488/httplib2-0.14.0-cp27-none-any.whl 2019-11-29T15:00:31.350 INFO:teuthology.orchestra.run.smithi062.stdout:Collecting lxml 2019-11-29T15:00:31.364 INFO:teuthology.orchestra.run.smithi062.stdout: Using cached https://files.pythonhosted.org/packages/25/73/730ad7249847f741c7e622f52b971daa5540f6fb87589bc92c717f5aafba/lxml-4.4.2-cp27-cp27mu-manylinux1_x86_64.whl 2019-11-29T15:00:32.157 INFO:teuthology.orchestra.run.smithi062.stdout:Collecting botocore<1.14.0,>=1.13.28 2019-11-29T15:00:32.167 INFO:teuthology.orchestra.run.smithi062.stdout: Downloading https://files.pythonhosted.org/packages/8e/b3/ab9044d3aa14208f5b6f69665d5f82ad9b028809666e4e70dac1ab0bfd3a/botocore-1.13.28-py2.py3-none-any.whl (5.7MB) 2019-11-29T15:00:32.729 INFO:teuthology.orchestra.run.smithi062.stdout:Collecting jmespath<1.0.0,>=0.7.1 2019-11-29T15:00:32.738 INFO:teuthology.orchestra.run.smithi062.stdout: Downloading https://files.pythonhosted.org/packages/83/94/7179c3832a6d45b266ddb2aac329e101367fbdb11f425f13771d27f225bb/jmespath-0.9.4-py2.py3-none-any.whl 2019-11-29T15:00:32.824 INFO:teuthology.orchestra.run.smithi062.stdout:Collecting s3transfer<0.3.0,>=0.2.0 2019-11-29T15:00:32.834 INFO:teuthology.orchestra.run.smithi062.stdout: Downloading https://files.pythonhosted.org/packages/16/8a/1fc3dba0c4923c2a76e1ff0d52b305c44606da63f718d14d3231e21c51b0/s3transfer-0.2.1-py2.py3-none-any.whl (70kB) 2019-11-29T15:00:33.019 INFO:teuthology.orchestra.run.smithi062.stdout:Collecting greenlet>=0.4.14; platform_python_implementation == "CPython" 2019-11-29T15:00:33.022 INFO:teuthology.orchestra.run.smithi062.stdout: Using cached https://files.pythonhosted.org/packages/8b/6e/f2d25875713ad0885c8d3c69269697406652e6f64e1a6bd8264f7a609327/greenlet-0.4.15-cp27-cp27mu-manylinux1_x86_64.whl 2019-11-29T15:00:33.097 INFO:teuthology.orchestra.run.smithi062.stdout:Collecting six 2019-11-29T15:00:33.107 INFO:teuthology.orchestra.run.smithi062.stdout: Downloading https://files.pythonhosted.org/packages/65/26/32b8464df2a97e6dd1b656ed26b2c194606c16fe163c695a992b36c11cdf/six-1.13.0-py2.py3-none-any.whl 2019-11-29T15:00:33.186 INFO:teuthology.orchestra.run.smithi062.stdout:Collecting chardet<3.1.0,>=3.0.2 2019-11-29T15:00:33.197 INFO:teuthology.orchestra.run.smithi062.stdout: Downloading https://files.pythonhosted.org/packages/bc/a9/01ffebfb562e4274b6487b4bb1ddec7ca55ec7510b22e4c51f14098443b8/chardet-3.0.4-py2.py3-none-any.whl (133kB) 2019-11-29T15:00:33.309 INFO:teuthology.orchestra.run.smithi062.stdout:Collecting idna<2.9,>=2.5 2019-11-29T15:00:33.319 INFO:teuthology.orchestra.run.smithi062.stdout: Downloading https://files.pythonhosted.org/packages/14/2c/cd551d81dbe15200be1cf41cd03869a46fe7226e7450af7a6545bfc474c9/idna-2.8-py2.py3-none-any.whl (58kB) 2019-11-29T15:00:33.480 INFO:teuthology.orchestra.run.smithi062.stdout:Collecting urllib3!=1.25.0,!=1.25.1,<1.26,>=1.21.1 2019-11-29T15:00:33.491 INFO:teuthology.orchestra.run.smithi062.stdout: Downloading https://files.pythonhosted.org/packages/b4/40/a9837291310ee1ccc242ceb6ebfd9eb21539649f193a7c8c86ba15b98539/urllib3-1.25.7-py2.py3-none-any.whl (125kB) 2019-11-29T15:00:33.607 INFO:teuthology.orchestra.run.smithi062.stdout:Collecting certifi>=2017.4.17 2019-11-29T15:00:33.619 INFO:teuthology.orchestra.run.smithi062.stdout: Downloading https://files.pythonhosted.org/packages/b9/63/df50cac98ea0d5b006c55a399c3bf1db9da7b5a24de7890bc9cfd5dd9e99/certifi-2019.11.28-py2.py3-none-any.whl (156kB) 2019-11-29T15:00:33.722 INFO:teuthology.orchestra.run.smithi062.stdout:Collecting docutils<0.16,>=0.10 2019-11-29T15:00:33.733 INFO:teuthology.orchestra.run.smithi062.stdout: Downloading https://files.pythonhosted.org/packages/3a/dc/bf2b15d1fa15a6f7a9e77a61b74ecbbae7258558fcda8ffc9a6638a6b327/docutils-0.15.2-py2-none-any.whl (548kB) 2019-11-29T15:00:33.910 INFO:teuthology.orchestra.run.smithi062.stdout:Collecting python-dateutil<2.8.1,>=2.1; python_version >= "2.7" 2019-11-29T15:00:33.920 INFO:teuthology.orchestra.run.smithi062.stdout: Downloading https://files.pythonhosted.org/packages/41/17/c62faccbfbd163c7f57f3844689e3a78bae1f403648a6afb1d0866d87fbb/python_dateutil-2.8.0-py2.py3-none-any.whl (226kB) 2019-11-29T15:00:34.024 INFO:teuthology.orchestra.run.smithi062.stdout:Collecting futures<4.0.0,>=2.2.0; python_version == "2.6" or python_version == "2.7" 2019-11-29T15:00:34.032 INFO:teuthology.orchestra.run.smithi062.stdout: Downloading https://files.pythonhosted.org/packages/d8/a6/f46ae3f1da0cd4361c344888f59ec2f5785e69c872e175a748ef6071cdb5/futures-3.3.0-py2-none-any.whl 2019-11-29T15:00:34.066 INFO:teuthology.orchestra.run.smithi062.stdout:Building wheels for collected packages: ordereddict 2019-11-29T15:00:34.067 INFO:teuthology.orchestra.run.smithi062.stdout: Building wheel for ordereddict (setup.py): started 2019-11-29T15:00:34.338 INFO:teuthology.orchestra.run.smithi062.stdout: Building wheel for ordereddict (setup.py): finished with status 'done' 2019-11-29T15:00:34.338 INFO:teuthology.orchestra.run.smithi062.stdout: Created wheel for ordereddict: filename=ordereddict-1.1-cp27-none-any.whl size=3327 sha256=ae632b296165cd0fb3e6832a31ed7e927d714a9c541c43ae91f8f9216e0a94d0 2019-11-29T15:00:34.339 INFO:teuthology.orchestra.run.smithi062.stdout: Stored in directory: /home/ubuntu/.cache/pip/wheels/78/d3/a8/9f52c7a389a0ffba6f575a3886b5f7a55461fb6ec34aa5fd38 2019-11-29T15:00:34.340 INFO:teuthology.orchestra.run.smithi062.stdout:Successfully built ordereddict 2019-11-29T15:00:34.423 INFO:teuthology.orchestra.run.smithi062.stdout:Installing collected packages: PyYAML, nose, boto, jmespath, docutils, six, python-dateutil, urllib3, botocore, futures, s3transfer, boto3, bunch, greenlet, gevent, isodate, chardet, idna, certifi, requests, pytz, ordereddict, httplib2, lxml 2019-11-29T15:00:36.896 INFO:teuthology.orchestra.run.smithi062.stdout:Successfully installed PyYAML-5.1.2 boto-2.49.0 boto3-1.10.28 botocore-1.13.28 bunch-1.0.1 certifi-2019.11.28 chardet-3.0.4 docutils-0.15.2 futures-3.3.0 gevent-1.4.0 greenlet-0.4.15 httplib2-0.14.0 idna-2.8 isodate-0.6.0 jmespath-0.9.4 lxml-4.4.2 nose-1.3.7 ordereddict-1.1 python-dateutil-2.8.0 pytz-2019.3 requests-2.22.0 s3transfer-0.2.1 six-1.13.0 urllib3-1.25.7 2019-11-29T15:00:37.217 INFO:teuthology.orchestra.run.smithi062.stdout:running develop 2019-11-29T15:00:37.271 INFO:teuthology.orchestra.run.smithi062.stdout:running egg_info 2019-11-29T15:00:37.271 INFO:teuthology.orchestra.run.smithi062.stdout:creating s3tests.egg-info 2019-11-29T15:00:37.271 INFO:teuthology.orchestra.run.smithi062.stdout:writing requirements to s3tests.egg-info/requires.txt 2019-11-29T15:00:37.272 INFO:teuthology.orchestra.run.smithi062.stdout:writing s3tests.egg-info/PKG-INFO 2019-11-29T15:00:37.272 INFO:teuthology.orchestra.run.smithi062.stdout:writing top-level names to s3tests.egg-info/top_level.txt 2019-11-29T15:00:37.272 INFO:teuthology.orchestra.run.smithi062.stdout:writing dependency_links to s3tests.egg-info/dependency_links.txt 2019-11-29T15:00:37.273 INFO:teuthology.orchestra.run.smithi062.stdout:writing entry points to s3tests.egg-info/entry_points.txt 2019-11-29T15:00:37.273 INFO:teuthology.orchestra.run.smithi062.stdout:writing manifest file 's3tests.egg-info/SOURCES.txt' 2019-11-29T15:00:37.275 INFO:teuthology.orchestra.run.smithi062.stdout:reading manifest file 's3tests.egg-info/SOURCES.txt' 2019-11-29T15:00:37.276 INFO:teuthology.orchestra.run.smithi062.stdout:writing manifest file 's3tests.egg-info/SOURCES.txt' 2019-11-29T15:00:37.277 INFO:teuthology.orchestra.run.smithi062.stdout:running build_ext 2019-11-29T15:00:37.277 INFO:teuthology.orchestra.run.smithi062.stdout:Creating /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/s3tests.egg-link (link to .) 2019-11-29T15:00:37.277 INFO:teuthology.orchestra.run.smithi062.stdout:Adding s3tests 0.0.1 to easy-install.pth file 2019-11-29T15:00:37.280 INFO:teuthology.orchestra.run.smithi062.stdout:Installing s3tests-fuzz-headers script to /home/ubuntu/cephtest/s3-tests/virtualenv/bin 2019-11-29T15:00:37.280 INFO:teuthology.orchestra.run.smithi062.stdout:Installing s3tests-generate-objects script to /home/ubuntu/cephtest/s3-tests/virtualenv/bin 2019-11-29T15:00:37.280 INFO:teuthology.orchestra.run.smithi062.stdout:Installing s3tests-test-roundtrip script to /home/ubuntu/cephtest/s3-tests/virtualenv/bin 2019-11-29T15:00:37.280 INFO:teuthology.orchestra.run.smithi062.stdout:Installing s3tests-analysis-rwstats script to /home/ubuntu/cephtest/s3-tests/virtualenv/bin 2019-11-29T15:00:37.280 INFO:teuthology.orchestra.run.smithi062.stdout:Installing s3tests-test-readwrite script to /home/ubuntu/cephtest/s3-tests/virtualenv/bin 2019-11-29T15:00:37.281 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T15:00:37.281 INFO:teuthology.orchestra.run.smithi062.stdout:Installed /home/ubuntu/cephtest/s3-tests 2019-11-29T15:00:37.281 INFO:teuthology.orchestra.run.smithi062.stdout:Processing dependencies for s3tests==0.0.1 2019-11-29T15:00:37.331 INFO:teuthology.orchestra.run.smithi062.stdout:Searching for isodate==0.6.0 2019-11-29T15:00:37.331 INFO:teuthology.orchestra.run.smithi062.stdout:Best match: isodate 0.6.0 2019-11-29T15:00:37.331 INFO:teuthology.orchestra.run.smithi062.stdout:Adding isodate 0.6.0 to easy-install.pth file 2019-11-29T15:00:37.331 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T15:00:37.331 INFO:teuthology.orchestra.run.smithi062.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-11-29T15:00:37.332 INFO:teuthology.orchestra.run.smithi062.stdout:Searching for gevent==1.4.0 2019-11-29T15:00:37.332 INFO:teuthology.orchestra.run.smithi062.stdout:Best match: gevent 1.4.0 2019-11-29T15:00:37.332 INFO:teuthology.orchestra.run.smithi062.stdout:Adding gevent 1.4.0 to easy-install.pth file 2019-11-29T15:00:37.333 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T15:00:37.333 INFO:teuthology.orchestra.run.smithi062.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-11-29T15:00:37.334 INFO:teuthology.orchestra.run.smithi062.stdout:Searching for bunch==1.0.1 2019-11-29T15:00:37.334 INFO:teuthology.orchestra.run.smithi062.stdout:Best match: bunch 1.0.1 2019-11-29T15:00:37.334 INFO:teuthology.orchestra.run.smithi062.stdout:Adding bunch 1.0.1 to easy-install.pth file 2019-11-29T15:00:37.334 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T15:00:37.334 INFO:teuthology.orchestra.run.smithi062.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-11-29T15:00:37.334 INFO:teuthology.orchestra.run.smithi062.stdout:Searching for PyYAML==5.1.2 2019-11-29T15:00:37.335 INFO:teuthology.orchestra.run.smithi062.stdout:Best match: PyYAML 5.1.2 2019-11-29T15:00:37.335 INFO:teuthology.orchestra.run.smithi062.stdout:Adding PyYAML 5.1.2 to easy-install.pth file 2019-11-29T15:00:37.336 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T15:00:37.336 INFO:teuthology.orchestra.run.smithi062.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-11-29T15:00:37.336 INFO:teuthology.orchestra.run.smithi062.stdout:Searching for boto3==1.10.28 2019-11-29T15:00:37.336 INFO:teuthology.orchestra.run.smithi062.stdout:Best match: boto3 1.10.28 2019-11-29T15:00:37.336 INFO:teuthology.orchestra.run.smithi062.stdout:Adding boto3 1.10.28 to easy-install.pth file 2019-11-29T15:00:37.336 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T15:00:37.336 INFO:teuthology.orchestra.run.smithi062.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-11-29T15:00:37.337 INFO:teuthology.orchestra.run.smithi062.stdout:Searching for boto==2.49.0 2019-11-29T15:00:37.338 INFO:teuthology.orchestra.run.smithi062.stdout:Best match: boto 2.49.0 2019-11-29T15:00:37.338 INFO:teuthology.orchestra.run.smithi062.stdout:Adding boto 2.49.0 to easy-install.pth file 2019-11-29T15:00:37.338 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T15:00:37.338 INFO:teuthology.orchestra.run.smithi062.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-11-29T15:00:37.338 INFO:teuthology.orchestra.run.smithi062.stdout:Searching for six==1.13.0 2019-11-29T15:00:37.338 INFO:teuthology.orchestra.run.smithi062.stdout:Best match: six 1.13.0 2019-11-29T15:00:37.338 INFO:teuthology.orchestra.run.smithi062.stdout:Adding six 1.13.0 to easy-install.pth file 2019-11-29T15:00:37.340 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T15:00:37.340 INFO:teuthology.orchestra.run.smithi062.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-11-29T15:00:37.340 INFO:teuthology.orchestra.run.smithi062.stdout:Searching for greenlet==0.4.15 2019-11-29T15:00:37.340 INFO:teuthology.orchestra.run.smithi062.stdout:Best match: greenlet 0.4.15 2019-11-29T15:00:37.340 INFO:teuthology.orchestra.run.smithi062.stdout:Adding greenlet 0.4.15 to easy-install.pth file 2019-11-29T15:00:37.340 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T15:00:37.341 INFO:teuthology.orchestra.run.smithi062.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-11-29T15:00:37.341 INFO:teuthology.orchestra.run.smithi062.stdout:Searching for s3transfer==0.2.1 2019-11-29T15:00:37.341 INFO:teuthology.orchestra.run.smithi062.stdout:Best match: s3transfer 0.2.1 2019-11-29T15:00:37.341 INFO:teuthology.orchestra.run.smithi062.stdout:Adding s3transfer 0.2.1 to easy-install.pth file 2019-11-29T15:00:37.341 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T15:00:37.341 INFO:teuthology.orchestra.run.smithi062.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-11-29T15:00:37.351 INFO:teuthology.orchestra.run.smithi062.stdout:Searching for jmespath==0.9.4 2019-11-29T15:00:37.351 INFO:teuthology.orchestra.run.smithi062.stdout:Best match: jmespath 0.9.4 2019-11-29T15:00:37.351 INFO:teuthology.orchestra.run.smithi062.stdout:Adding jmespath 0.9.4 to easy-install.pth file 2019-11-29T15:00:37.352 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T15:00:37.352 INFO:teuthology.orchestra.run.smithi062.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-11-29T15:00:37.352 INFO:teuthology.orchestra.run.smithi062.stdout:Searching for botocore==1.13.28 2019-11-29T15:00:37.352 INFO:teuthology.orchestra.run.smithi062.stdout:Best match: botocore 1.13.28 2019-11-29T15:00:37.353 INFO:teuthology.orchestra.run.smithi062.stdout:Adding botocore 1.13.28 to easy-install.pth file 2019-11-29T15:00:37.353 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T15:00:37.353 INFO:teuthology.orchestra.run.smithi062.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-11-29T15:00:37.353 INFO:teuthology.orchestra.run.smithi062.stdout:Searching for futures==3.3.0 2019-11-29T15:00:37.354 INFO:teuthology.orchestra.run.smithi062.stdout:Best match: futures 3.3.0 2019-11-29T15:00:37.354 INFO:teuthology.orchestra.run.smithi062.stdout:Adding futures 3.3.0 to easy-install.pth file 2019-11-29T15:00:37.357 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T15:00:37.357 INFO:teuthology.orchestra.run.smithi062.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-11-29T15:00:37.357 INFO:teuthology.orchestra.run.smithi062.stdout:Searching for urllib3==1.25.7 2019-11-29T15:00:37.358 INFO:teuthology.orchestra.run.smithi062.stdout:Best match: urllib3 1.25.7 2019-11-29T15:00:37.358 INFO:teuthology.orchestra.run.smithi062.stdout:Adding urllib3 1.25.7 to easy-install.pth file 2019-11-29T15:00:37.358 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T15:00:37.358 INFO:teuthology.orchestra.run.smithi062.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-11-29T15:00:37.359 INFO:teuthology.orchestra.run.smithi062.stdout:Searching for python-dateutil==2.8.0 2019-11-29T15:00:37.359 INFO:teuthology.orchestra.run.smithi062.stdout:Best match: python-dateutil 2.8.0 2019-11-29T15:00:37.359 INFO:teuthology.orchestra.run.smithi062.stdout:Adding python-dateutil 2.8.0 to easy-install.pth file 2019-11-29T15:00:37.359 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T15:00:37.360 INFO:teuthology.orchestra.run.smithi062.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-11-29T15:00:37.360 INFO:teuthology.orchestra.run.smithi062.stdout:Searching for docutils==0.15.2 2019-11-29T15:00:37.360 INFO:teuthology.orchestra.run.smithi062.stdout:Best match: docutils 0.15.2 2019-11-29T15:00:37.361 INFO:teuthology.orchestra.run.smithi062.stdout:Adding docutils 0.15.2 to easy-install.pth file 2019-11-29T15:00:37.361 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T15:00:37.361 INFO:teuthology.orchestra.run.smithi062.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-11-29T15:00:37.361 INFO:teuthology.orchestra.run.smithi062.stdout:Finished processing dependencies for s3tests==0.0.1 2019-11-29T15:00:37.362 INFO:teuthology.orchestra.run.smithi062:> cat > /home/ubuntu/cephtest/archive/s3-tests.client.0.conf 2019-11-29T15:00:37.408 INFO:tasks.s3tests:Configuring boto... 2019-11-29T15:00:37.408 INFO:teuthology.orchestra.run.smithi062:> cat > /home/ubuntu/cephtest/boto.cfg 2019-11-29T15:00:37.523 INFO:teuthology.orchestra.run.smithi062:s3 tests against rgw> S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt /home/ubuntu/cephtest/s3-tests/virtualenv/bin/nosetests -w /home/ubuntu/cephtest/s3-tests -v -a '!fails_on_rgw,!lifecycle_expiration,!fails_strict_rfc2616,!fails_with_subdomain' 2019-11-29T15:00:43.097 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests.functional.test_headers.test_object_create_bad_contentlength_none ... ok 2019-11-29T15:00:46.261 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests.functional.test_headers.test_object_create_bad_authorization_empty ... ok 2019-11-29T15:00:50.393 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests.functional.test_headers.test_object_create_date_and_amz_date ... ok 2019-11-29T15:00:56.393 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests.functional.test_headers.test_object_create_amz_date_and_no_date ... ok 2019-11-29T15:00:59.265 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests.functional.test_headers.test_object_create_bad_authorization_none ... ok 2019-11-29T15:01:01.821 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests.functional.test_headers.test_bucket_create_contentlength_none ... ok 2019-11-29T15:01:06.133 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests.functional.test_headers.test_object_acl_create_contentlength_none ... ok 2019-11-29T15:01:08.266 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests.functional.test_headers.test_bucket_create_bad_contentlength_none ... ok 2019-11-29T15:01:08.741 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests.functional.test_headers.test_bucket_create_bad_authorization_empty ... ok 2019-11-29T15:01:09.135 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests.functional.test_headers.test_bucket_create_bad_authorization_none ... ok 2019-11-29T15:01:11.246 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests.functional.test_headers.test_object_create_bad_contentlength_mismatch_below_aws2 ... ok 2019-11-29T15:01:14.159 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests.functional.test_headers.test_object_create_bad_authorization_incorrect_aws2 ... ok 2019-11-29T15:01:17.446 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests.functional.test_headers.test_object_create_bad_authorization_invalid_aws2 ... ok 2019-11-29T15:01:20.215 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests.functional.test_headers.test_object_create_bad_date_none_aws2 ... ok 2019-11-29T15:01:20.597 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests.functional.test_headers.test_bucket_create_bad_authorization_invalid_aws2 ... ok 2019-11-29T15:01:21.117 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests.functional.test_headers.test_bucket_create_bad_date_none_aws2 ... ok 2019-11-29T15:01:21.118 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests.functional.test_headers.test_object_create_bad_md5_invalid_garbage_aws4 ... SKIP 2019-11-29T15:01:21.120 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests.functional.test_headers.test_object_create_bad_contentlength_mismatch_below_aws4 ... SKIP 2019-11-29T15:01:21.120 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests.functional.test_headers.test_object_create_bad_authorization_incorrect_aws4 ... SKIP 2019-11-29T15:01:21.120 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests.functional.test_headers.test_object_create_bad_authorization_invalid_aws4 ... SKIP 2019-11-29T15:01:21.120 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests.functional.test_headers.test_object_create_bad_ua_empty_aws4 ... SKIP 2019-11-29T15:01:21.120 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests.functional.test_headers.test_object_create_bad_ua_none_aws4 ... SKIP 2019-11-29T15:01:21.120 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests.functional.test_headers.test_object_create_bad_date_invalid_aws4 ... SKIP 2019-11-29T15:01:21.120 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests.functional.test_headers.test_object_create_bad_amz_date_invalid_aws4 ... SKIP 2019-11-29T15:01:21.121 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests.functional.test_headers.test_object_create_bad_date_empty_aws4 ... SKIP 2019-11-29T15:01:21.121 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests.functional.test_headers.test_object_create_bad_amz_date_empty_aws4 ... SKIP 2019-11-29T15:01:21.122 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests.functional.test_headers.test_object_create_bad_date_none_aws4 ... SKIP 2019-11-29T15:01:21.122 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests.functional.test_headers.test_object_create_bad_amz_date_none_aws4 ... SKIP 2019-11-29T15:01:21.123 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests.functional.test_headers.test_object_create_bad_date_before_today_aws4 ... SKIP 2019-11-29T15:01:21.124 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests.functional.test_headers.test_object_create_bad_amz_date_before_today_aws4 ... SKIP 2019-11-29T15:01:21.124 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests.functional.test_headers.test_object_create_bad_date_after_today_aws4 ... SKIP 2019-11-29T15:01:21.124 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests.functional.test_headers.test_object_create_bad_amz_date_after_today_aws4 ... SKIP 2019-11-29T15:01:21.125 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests.functional.test_headers.test_object_create_bad_date_before_epoch_aws4 ... SKIP 2019-11-29T15:01:21.125 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests.functional.test_headers.test_object_create_bad_amz_date_before_epoch_aws4 ... SKIP 2019-11-29T15:01:21.125 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests.functional.test_headers.test_object_create_bad_date_after_end_aws4 ... SKIP 2019-11-29T15:01:21.125 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests.functional.test_headers.test_object_create_bad_amz_date_after_end_aws4 ... SKIP 2019-11-29T15:01:21.125 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests.functional.test_headers.test_object_create_missing_signed_custom_header_aws4 ... SKIP 2019-11-29T15:01:21.126 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests.functional.test_headers.test_object_create_missing_signed_header_aws4 ... SKIP 2019-11-29T15:01:21.127 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests.functional.test_headers.test_bucket_create_bad_authorization_invalid_aws4 ... SKIP 2019-11-29T15:01:21.127 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests.functional.test_headers.test_bucket_create_bad_ua_empty_aws4 ... SKIP 2019-11-29T15:01:21.129 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests.functional.test_headers.test_bucket_create_bad_ua_none_aws4 ... SKIP 2019-11-29T15:01:21.129 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests.functional.test_headers.test_bucket_create_bad_date_invalid_aws4 ... SKIP 2019-11-29T15:01:21.129 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests.functional.test_headers.test_bucket_create_bad_amz_date_invalid_aws4 ... SKIP 2019-11-29T15:01:21.129 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests.functional.test_headers.test_bucket_create_bad_date_empty_aws4 ... SKIP 2019-11-29T15:01:21.129 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests.functional.test_headers.test_bucket_create_bad_amz_date_empty_aws4 ... SKIP 2019-11-29T15:01:21.129 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests.functional.test_headers.test_bucket_create_bad_date_none_aws4 ... SKIP 2019-11-29T15:01:21.130 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests.functional.test_headers.test_bucket_create_bad_amz_date_none_aws4 ... SKIP 2019-11-29T15:01:21.130 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests.functional.test_headers.test_bucket_create_bad_date_before_today_aws4 ... SKIP 2019-11-29T15:01:21.130 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests.functional.test_headers.test_bucket_create_bad_amz_date_before_today_aws4 ... SKIP 2019-11-29T15:01:21.131 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests.functional.test_headers.test_bucket_create_bad_date_after_today_aws4 ... SKIP 2019-11-29T15:01:21.131 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests.functional.test_headers.test_bucket_create_bad_amz_date_after_today_aws4 ... SKIP 2019-11-29T15:01:21.131 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests.functional.test_headers.test_bucket_create_bad_date_before_epoch_aws4 ... SKIP 2019-11-29T15:01:21.131 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests.functional.test_headers.test_bucket_create_bad_amz_date_before_epoch_aws4 ... SKIP 2019-11-29T15:01:28.660 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests.functional.test_s3.test_versioning_obj_read_not_exist_null ... ok 2019-11-29T15:01:28.661 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests.functional.test_s3.test_lifecycle_transition ... SKIP 2019-11-29T15:01:28.661 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests.functional.test_s3.test_lifecycle_transition_single_rule_multi_trans ... SKIP 2019-11-29T15:01:28.661 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests.functional.test_s3.test_lifecycle_set_noncurrent_transition ... SKIP 2019-11-29T15:01:28.662 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests.functional.test_s3.test_object_storage_class ... SKIP 2019-11-29T15:01:28.662 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests.functional.test_s3.test_object_storage_class_multipart ... SKIP 2019-11-29T15:01:28.662 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests.functional.test_s3.test_object_modify_storage_class ... SKIP 2019-11-29T15:01:28.663 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests.functional.test_s3.test_object_modify_storage_class_multipart ... SKIP 2019-11-29T15:01:28.663 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests.functional.test_s3.test_object_storage_class_copy ... SKIP 2019-11-29T15:01:28.663 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests.functional.test_s3.test_object_storage_class_copy_multipart ... SKIP 2019-11-29T15:01:41.890 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests.functional.test_s3.test_atomic_dual_conditional_write_1mb ... ok 2019-11-29T15:01:50.376 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests.functional.test_s3.test_atomic_write_bucket_gone ... ok 2019-11-29T15:02:10.452 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:02:36:51.110 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T15:02:10.464 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:02:36:51.072 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T15:02:10.465 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:02:36:51.073 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T15:02:10.467 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:02:36:51.074 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T15:02:10.469 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:02:36:51.076 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T15:02:10.470 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:02:36:51.129 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T15:02:10.653 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:02:36:51.260 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T15:02:10.656 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:02:36:51.264 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T15:02:10.692 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:02:36:51.350 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T15:04:16.332 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests.functional.test_s3.test_encryption_sse_c_multipart_invalid_chunks_1 ... ok 2019-11-29T15:05:21.002 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:02:40:01.660 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T15:05:21.011 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:02:40:01.669 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T15:05:21.055 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:02:40:01.662 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T15:05:21.082 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:02:40:01.690 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T15:05:21.084 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:02:40:01.692 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T15:05:21.085 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:02:40:01.692 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T15:05:21.105 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:02:40:01.763 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T15:05:21.184 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:02:40:01.791 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T15:05:21.193 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:02:40:01.801 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T15:07:21.604 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:02:42:02.262 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T15:07:21.616 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:02:42:02.275 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T15:07:21.620 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:02:42:02.228 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T15:07:21.622 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:02:42:02.230 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T15:07:21.627 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:02:42:02.234 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T15:07:21.630 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:02:42:02.237 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T15:07:21.734 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:02:42:02.341 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T15:07:21.738 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:02:42:02.346 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T15:07:21.750 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:02:42:02.408 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T15:07:40.173 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests.functional.test_s3.test_encryption_sse_c_multipart_invalid_chunks_2 ... ok 2019-11-29T15:07:48.237 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests.functional.test_s3.test_bucket_policy_set_condition_operator_end_with_IfExists ... ok 2019-11-29T15:07:52.284 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests.functional.test_s3.test_bucket_policy_put_obj_enc ... ok 2019-11-29T15:07:56.033 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests.functional.test_s3.test_bucket_policy_put_obj_request_obj_tag ... ok 2019-11-29T15:08:00.880 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests.functional.test_s3_website.check_can_test_website ... SKIP 2019-11-29T15:08:00.880 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests.functional.test_s3_website.test_website_nonexistant_bucket_rgw ... SKIP 2019-11-29T15:08:00.880 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests.functional.test_s3_website.test_website_public_bucket_list_public_index ... SKIP 2019-11-29T15:08:00.880 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests.functional.test_s3_website.test_website_private_bucket_list_public_index ... SKIP 2019-11-29T15:08:00.881 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests.functional.test_s3_website.test_website_private_bucket_list_empty ... SKIP 2019-11-29T15:08:00.881 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests.functional.test_s3_website.test_website_public_bucket_list_empty ... SKIP 2019-11-29T15:08:00.881 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests.functional.test_s3_website.test_website_public_bucket_list_private_index ... SKIP 2019-11-29T15:08:00.881 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests.functional.test_s3_website.test_website_private_bucket_list_private_index ... SKIP 2019-11-29T15:08:00.881 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests.functional.test_s3_website.test_website_private_bucket_list_empty_missingerrordoc ... SKIP 2019-11-29T15:08:00.881 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests.functional.test_s3_website.test_website_public_bucket_list_empty_missingerrordoc ... SKIP 2019-11-29T15:08:00.882 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests.functional.test_s3_website.test_website_public_bucket_list_private_index_missingerrordoc ... SKIP 2019-11-29T15:08:00.885 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests.functional.test_s3_website.test_website_private_bucket_list_private_index_missingerrordoc ... SKIP 2019-11-29T15:08:00.885 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests.functional.test_s3_website.test_website_private_bucket_list_empty_blockederrordoc ... SKIP 2019-11-29T15:08:00.885 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests.functional.test_s3_website.test_website_public_bucket_list_empty_blockederrordoc ... SKIP 2019-11-29T15:08:00.885 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests.functional.test_s3_website.test_website_public_bucket_list_private_index_blockederrordoc ... SKIP 2019-11-29T15:08:00.885 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests.functional.test_s3_website.test_website_private_bucket_list_private_index_blockederrordoc ... SKIP 2019-11-29T15:08:00.885 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests.functional.test_s3_website.test_website_private_bucket_list_empty_gooderrordoc ... SKIP 2019-11-29T15:08:00.886 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests.functional.test_s3_website.test_website_public_bucket_list_empty_gooderrordoc ... SKIP 2019-11-29T15:08:00.886 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests.functional.test_s3_website.test_website_public_bucket_list_private_index_gooderrordoc ... SKIP 2019-11-29T15:08:00.886 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests.functional.test_s3_website.test_website_private_bucket_list_private_index_gooderrordoc ... SKIP 2019-11-29T15:08:00.886 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests.functional.test_s3_website.test_website_bucket_private_redirectall_base ... SKIP 2019-11-29T15:08:00.886 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests.functional.test_s3_website.test_website_bucket_private_redirectall_path ... SKIP 2019-11-29T15:08:00.887 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests.functional.test_s3_website.test_website_bucket_private_redirectall_path_upgrade ... SKIP 2019-11-29T15:08:00.887 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests.functional.test_s3_website.test_website_xredirect_nonwebsite ... SKIP 2019-11-29T15:08:00.887 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests.functional.test_s3_website.test_website_xredirect_public_relative ... SKIP 2019-11-29T15:08:00.887 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests.functional.test_s3_website.test_website_xredirect_public_abs ... SKIP 2019-11-29T15:08:00.888 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests.functional.test_s3_website.test_website_xredirect_private_relative ... SKIP 2019-11-29T15:08:00.888 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests.functional.test_s3_website.test_website_xredirect_private_abs ... SKIP 2019-11-29T15:08:00.888 INFO:teuthology.orchestra.run.smithi062.stderr:SKIP 2019-11-29T15:08:00.894 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests.functional.test_utils.test_generate ... ok 2019-11-29T15:09:10.562 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests.fuzz.test.test_fuzzer.test_load_graph ... ok 2019-11-29T15:09:10.562 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests.fuzz.test.test_fuzzer.test_descend_leaf_node ... ok 2019-11-29T15:09:10.562 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests.fuzz.test.test_fuzzer.test_descend_node ... ok 2019-11-29T15:09:10.562 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests.fuzz.test.test_fuzzer.test_descend_bad_node ... ok 2019-11-29T15:09:10.562 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests.fuzz.test.test_fuzzer.test_descend_nonexistant_child ... ok 2019-11-29T15:09:10.563 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_random_printable ... ok 2019-11-29T15:09:10.563 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_random_binary ... ok 2019-11-29T15:09:10.924 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_random_printable_no_whitespace ... ok 2019-11-29T15:09:11.090 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_random_binary_no_whitespace ... ok 2019-11-29T15:09:11.445 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_random_no_args ... ok 2019-11-29T15:09:11.470 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_random_no_charset ... ok 2019-11-29T15:09:11.489 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_random_exact_length ... ok 2019-11-29T15:09:11.490 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_random_bad_charset ... ok 2019-11-29T15:09:11.490 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_random_missing_length ... ok 2019-11-29T15:09:11.490 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests.fuzz.test.test_fuzzer.test_assemble_decision ... ok 2019-11-29T15:09:11.490 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_escape ... ok 2019-11-29T15:09:11.490 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_indirect ... ok 2019-11-29T15:09:11.490 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_indirect_double ... ok 2019-11-29T15:09:11.490 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_recursive ... ok 2019-11-29T15:09:11.491 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_recursive_mutual ... ok 2019-11-29T15:09:11.491 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_recursive_not_too_eager ... ok 2019-11-29T15:09:11.492 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests.fuzz.test.test_fuzzer.test_make_choice_unweighted_with_space ... ok 2019-11-29T15:09:11.496 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests.fuzz.test.test_fuzzer.test_weighted_choices ... ok 2019-11-29T15:09:11.496 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests.fuzz.test.test_fuzzer.test_null_choices ... ok 2019-11-29T15:09:11.496 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests.fuzz.test.test_fuzzer.test_weighted_null_choices ... ok 2019-11-29T15:09:11.496 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests.fuzz.test.test_fuzzer.test_null_child ... ok 2019-11-29T15:09:11.500 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests.fuzz.test.test_fuzzer.test_weighted_set ... ok 2019-11-29T15:09:11.500 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests.fuzz.test.test_fuzzer.test_header_presence ... ok 2019-11-29T15:09:11.501 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests.fuzz.test.test_fuzzer.test_duplicate_header ... ok 2019-11-29T15:09:11.501 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_headers ... ok 2019-11-29T15:09:11.524 INFO:teuthology.orchestra.run.smithi062.stderr:test_realistic.TestFileValidator.test_new_file_is_valid ... ok 2019-11-29T15:09:11.548 INFO:teuthology.orchestra.run.smithi062.stderr:test_realistic.TestFileValidator.test_new_file_is_valid_on_several_calls ... ok 2019-11-29T15:09:11.548 INFO:teuthology.orchestra.run.smithi062.stderr:test_realistic.TestFileValidator.test_new_file_is_valid_when_size_is_1 ... ok 2019-11-29T15:09:11.731 INFO:teuthology.orchestra.run.smithi062.stderr:test_realistic.TestFiles.test_random_file_valid ... ok 2019-11-29T15:09:12.586 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:09:12.586 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:09:13.035 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:09:13.035 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:09:14.091 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:09:14.091 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:09:15.181 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_md5_invalid_short ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:09:15.181 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:09:18.370 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:09:18.371 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:09:18.561 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:09:18.816 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_md5_bad ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:09:18.816 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:09:21.149 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:09:21.149 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:09:27.252 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:09:27.606 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_md5_empty ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:09:27.606 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:09:30.035 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:09:30.035 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:09:30.252 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:09:30.547 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_md5_none ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:09:30.548 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:09:33.215 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:09:33.215 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:09:35.630 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:09:35.631 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:09:37.429 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:09:37.696 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_expect_mismatch ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:09:37.696 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:09:40.727 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:09:40.727 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:09:41.778 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:09:41.779 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:09:43.367 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:09:43.879 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_expect_empty ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:09:43.880 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:09:46.753 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:09:46.754 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:09:48.681 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:09:48.681 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:09:51.300 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:09:51.715 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_expect_none ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:09:51.715 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:09:55.269 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:09:55.270 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:09:56.767 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:09:56.767 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:09:58.974 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:09:59.381 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_contentlength_negative ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:09:59.381 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:10:03.666 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:10:03.666 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:10:03.755 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:10:04.278 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_contenttype_invalid ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:10:04.278 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:10:07.318 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:10:07.318 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:10:09.284 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:10:09.284 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:10:11.374 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:10:11.606 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_contenttype_empty ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:10:11.607 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:10:14.626 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:10:14.627 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:10:16.392 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:10:16.912 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_contenttype_none ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:10:16.913 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:10:19.590 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:10:19.591 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:10:21.251 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:10:21.887 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_headers.test_bucket_put_bad_canned_acl ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:10:21.888 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:10:23.871 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:10:23.871 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:10:23.997 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:10:24.368 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_headers.test_bucket_create_bad_expect_mismatch ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:10:24.368 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:10:26.668 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:10:26.931 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_headers.test_bucket_create_bad_expect_empty ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:10:26.931 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:10:28.520 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:10:28.848 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_headers.test_bucket_create_bad_contentlength_negative ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:10:28.848 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:10:28.924 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:10:29.433 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_md5_invalid_garbage_aws2 ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:10:29.434 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:10:31.909 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:10:31.910 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:10:32.135 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:10:32.443 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_ua_empty_aws2 ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:10:32.443 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:10:36.207 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:10:36.207 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:10:40.133 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:10:40.567 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_ua_none_aws2 ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:10:40.567 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:10:43.589 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:10:43.589 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:10:46.825 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:10:47.095 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_date_invalid_aws2 ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:10:47.095 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:10:49.647 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:10:49.647 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:10:49.835 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:10:50.099 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_date_empty_aws2 ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:10:50.099 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:10:52.713 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:10:52.714 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:10:52.803 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:10:53.605 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_date_before_today_aws2 ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:10:53.605 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:10:56.105 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:10:56.105 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:10:56.190 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:10:56.493 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_date_before_epoch_aws2 ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:10:56.493 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:10:59.118 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:10:59.118 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:10:59.427 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:10:59.680 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_date_after_end_aws2 ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:10:59.680 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:11:02.784 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:11:02.785 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:11:02.971 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:11:03.275 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_headers.test_bucket_create_bad_ua_empty_aws2 ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:11:03.276 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:11:05.814 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:11:06.471 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_headers.test_bucket_create_bad_ua_none_aws2 ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:11:06.471 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:11:10.039 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:11:10.440 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_headers.test_bucket_create_bad_date_invalid_aws2 ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:11:10.441 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:11:10.564 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:11:11.109 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_headers.test_bucket_create_bad_date_empty_aws2 ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:11:11.110 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:11:11.218 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:11:11.638 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_headers.test_bucket_create_bad_date_before_today_aws2 ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:11:11.638 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:11:11.786 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:11:12.084 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_headers.test_bucket_create_bad_date_after_today_aws2 ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:11:12.084 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:11:12.210 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:11:12.448 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_headers.test_bucket_create_bad_date_before_epoch_aws2 ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:11:12.449 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:11:12.771 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:11:13.437 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_empty ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:11:13.437 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:11:16.925 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:11:17.350 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_distinct ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:11:17.350 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:11:20.825 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:11:20.826 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:11:27.258 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:11:27.545 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_many ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:11:27.545 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:11:34.809 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:11:34.809 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:11:35.860 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:11:36.249 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_many ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:11:36.249 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:11:43.487 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:11:43.487 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:11:44.378 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:11:44.771 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_basic_key_count ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:11:44.771 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:11:55.256 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:11:55.526 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_delimiter_basic ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:11:55.526 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:12:02.950 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:12:02.950 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:12:03.516 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:12:03.831 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_delimiter_basic ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:12:03.831 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:12:12.855 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:12:12.855 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:12:13.365 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:12:13.685 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_delimiter_prefix ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:12:13.685 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:12:23.706 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:12:23.706 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:12:24.949 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:12:24.949 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:12:25.907 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:12:25.907 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:12:27.528 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:12:27.528 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:12:28.488 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:12:28.488 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:12:29.581 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:12:29.582 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:12:30.693 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:12:30.693 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:12:31.647 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:12:31.647 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:12:32.318 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:12:32.561 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_delimiter_prefix ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:12:32.561 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:12:33.650 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:02:47:14.308 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T15:12:33.661 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:02:47:14.268 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T15:12:33.669 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:02:47:14.271 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T15:12:33.669 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:02:47:14.272 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T15:12:33.669 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:02:47:14.322 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T15:12:33.669 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:02:47:14.276 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T15:12:33.863 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:02:47:14.470 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T15:12:33.869 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:02:47:14.476 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T15:12:33.968 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:02:47:14.626 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T15:12:41.424 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:12:41.424 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:12:42.342 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:12:42.342 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:12:43.529 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:12:43.530 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:12:45.032 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:12:45.032 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:12:45.725 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:12:45.725 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:12:47.171 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:12:47.171 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:12:48.091 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:12:48.092 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:12:48.944 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:12:48.944 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:12:49.506 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:12:49.767 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_delimiter_prefix_ends_with_delimiter ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:12:49.767 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:12:53.675 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:12:53.676 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:12:54.562 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:12:54.817 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_delimiter_prefix_ends_with_delimiter ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:12:54.817 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:12:59.643 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:12:59.643 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:13:00.110 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:13:00.395 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_delimiter_alt ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:13:00.395 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:13:08.536 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:13:08.536 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:13:08.903 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:13:09.174 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_delimiter_alt ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:13:09.174 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:13:18.327 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:13:18.327 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:13:18.963 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:13:19.225 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_delimiter_prefix_underscore ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:13:19.225 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:13:29.598 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:13:29.598 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:13:30.512 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:13:30.512 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:13:31.530 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:13:31.530 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:13:32.729 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:13:32.729 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:13:33.595 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:13:33.595 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:13:34.644 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:13:34.644 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:13:35.974 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:13:35.975 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:13:36.485 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:13:36.485 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:13:37.797 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:13:38.149 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_delimiter_prefix_underscore ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:13:38.149 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:13:42.897 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:02:48:23.555 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T15:13:42.905 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:02:48:23.564 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T15:13:42.944 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:02:48:23.551 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T15:13:42.951 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:02:48:23.559 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T15:13:42.964 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:02:48:23.572 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T15:13:42.972 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:02:48:23.631 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T15:13:42.987 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:02:48:23.594 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T15:13:42.997 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:02:48:23.605 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T15:13:43.045 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:02:48:23.647 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T15:13:47.055 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:13:47.055 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:13:47.762 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:13:47.762 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:13:49.577 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:13:49.577 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:13:50.627 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:13:50.628 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:13:51.323 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:13:51.323 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:13:52.098 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:13:52.098 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:13:53.247 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:13:53.247 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:13:54.520 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:13:54.520 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:13:54.899 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:13:55.293 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_delimiter_percentage ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:13:55.293 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:14:04.370 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:14:04.371 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:14:05.542 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:14:06.155 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_delimiter_percentage ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:14:06.155 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:14:13.268 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:14:13.268 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:14:14.046 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:14:14.431 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_delimiter_whitespace ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:14:14.431 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:14:22.967 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:14:22.967 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:14:23.931 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:14:24.236 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_delimiter_whitespace ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:14:24.237 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:14:33.430 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:14:33.430 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:14:34.720 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:14:34.971 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_delimiter_dot ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:14:34.971 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:14:43.627 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:14:43.627 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:14:44.317 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:14:44.687 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_delimiter_dot ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:14:44.687 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:14:55.414 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:14:55.414 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:14:55.889 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:14:56.140 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_delimiter_unreadable ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:14:56.140 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:15:05.694 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:15:05.694 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:15:06.770 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:15:07.263 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_delimiter_unreadable ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:15:07.263 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:15:15.805 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:15:15.805 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:15:16.268 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:15:16.548 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_delimiter_empty ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:15:16.548 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:15:27.603 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:15:27.603 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:15:28.246 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:15:28.479 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_delimiter_empty ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:15:28.479 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:15:36.783 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:15:36.783 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:15:37.121 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:15:37.419 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_delimiter_none ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:15:37.420 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:15:45.456 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:15:45.456 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:15:46.394 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:15:46.668 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_delimiter_none ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:15:46.668 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:15:54.099 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:15:54.099 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:15:55.148 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:15:55.417 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_fetchowner_notempty ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:15:55.418 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:16:00.889 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:16:00.889 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:16:01.492 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:16:01.791 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_fetchowner_defaultempty ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:16:01.791 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:16:07.738 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:16:07.738 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:16:08.275 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:16:08.521 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_fetchowner_empty ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:16:08.521 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:16:15.845 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:16:15.845 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:16:16.402 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:16:16.834 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_delimiter_not_exist ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:16:16.834 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:16:25.412 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:16:25.413 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:16:26.084 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:16:26.335 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_delimiter_not_exist ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:16:26.335 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:16:34.333 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:16:34.333 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:16:34.885 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:16:35.459 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_delimiter_not_skip_special ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:16:35.459 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:17:46.861 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:02:52:27.519 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T15:17:46.869 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:02:52:27.528 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T15:17:46.880 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:02:52:27.487 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T15:17:46.886 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:02:52:27.493 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T15:17:47.064 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:02:52:27.722 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T15:17:47.075 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:02:52:27.683 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T15:17:47.095 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:02:52:27.702 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T15:17:47.099 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:02:52:27.706 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T15:17:47.296 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:02:52:27.903 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T15:22:09.643 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:02:56:50.301 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T15:22:09.653 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:02:56:50.311 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T15:22:09.654 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:02:56:50.262 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T15:22:09.661 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:02:56:50.268 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T15:22:09.693 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:02:56:50.300 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T15:22:09.700 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:02:56:50.307 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T15:22:09.829 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:02:56:50.436 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T15:22:09.851 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:02:56:50.458 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T15:22:09.903 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:02:56:50.558 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T15:22:56.056 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:02:57:36.714 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T15:22:56.061 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:02:57:36.668 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T15:22:56.061 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:02:57:36.719 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T15:22:56.065 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:02:57:36.672 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T15:22:56.066 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:02:57:36.673 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T15:22:56.075 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:02:57:36.680 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T15:22:56.125 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:02:57:36.732 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T15:22:56.131 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:02:57:36.789 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T15:22:56.138 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:02:57:36.745 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T15:28:07.132 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:03:02:47.791 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T15:28:07.139 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:03:02:47.798 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T15:28:07.152 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:03:02:47.760 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T15:28:07.163 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:03:02:47.770 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T15:28:07.164 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:03:02:47.771 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T15:28:07.169 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:03:02:47.777 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T15:28:07.386 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:03:02:48.044 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T15:28:07.404 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:03:02:48.011 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T15:28:07.411 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:03:02:48.019 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T15:28:11.098 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:03:02:51.756 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T15:28:11.100 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:03:02:51.759 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T15:28:11.119 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:03:02:51.778 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T15:28:11.127 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:03:02:51.735 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T15:28:11.153 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:03:02:51.760 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T15:28:11.159 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:03:02:51.766 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T15:28:11.170 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:03:02:51.777 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T15:28:11.201 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:03:02:51.808 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T15:28:11.245 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:03:02:51.852 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T15:30:31.782 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:03:05:12.441 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T15:30:31.818 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:03:05:12.476 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T15:30:31.858 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:03:05:12.466 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T15:30:31.860 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:03:05:12.468 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T15:30:31.864 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:03:05:12.472 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T15:30:31.869 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:03:05:12.476 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T15:30:31.897 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:03:05:12.556 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T15:30:31.945 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:03:05:12.553 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T15:30:31.962 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:03:05:12.570 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T15:33:17.491 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:03:07:58.149 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T15:33:17.512 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:03:07:58.155 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T15:33:17.512 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:03:07:58.120 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T15:33:17.516 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:03:07:58.124 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T15:33:17.553 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:03:07:58.161 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T15:33:17.562 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:03:07:58.170 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T15:33:17.642 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:03:07:58.300 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T15:33:17.660 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:03:07:58.268 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T15:33:17.683 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:03:07:58.291 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T15:38:30.866 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:03:13:11.523 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T15:38:30.873 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:03:13:11.531 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T15:38:30.883 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:03:13:11.490 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T15:38:30.884 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:03:13:11.491 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T15:38:30.886 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:03:13:11.494 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T15:38:30.887 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:03:13:11.494 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T15:38:31.100 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:03:13:11.707 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T15:38:31.117 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:03:13:11.775 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T15:38:31.119 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:03:13:11.727 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T15:38:41.010 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:38:41.010 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:38:43.508 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:38:43.755 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_prefix_basic ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:38:43.755 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:38:51.760 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:38:51.760 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:38:52.667 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:38:53.272 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_prefix_basic ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:38:53.272 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:38:53.594 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:03:13:34.252 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T15:38:53.631 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:03:13:34.239 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T15:38:53.634 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:03:13:34.241 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T15:38:53.637 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:03:13:34.295 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T15:38:53.665 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:03:13:34.273 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T15:38:53.670 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:03:13:34.278 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T15:38:53.670 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:03:13:34.278 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T15:38:53.677 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:03:13:34.336 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T15:38:53.698 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:03:13:34.306 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T15:39:00.131 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:39:00.131 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:39:00.819 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:39:01.085 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_prefix_alt ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:39:01.085 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:39:06.253 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:39:06.253 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:39:06.787 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:39:07.079 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_prefix_alt ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:39:07.079 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:39:12.707 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:39:12.707 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:39:13.052 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:39:13.408 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_prefix_empty ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:39:13.409 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:39:20.073 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:39:20.074 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:39:20.861 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:39:21.301 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_prefix_empty ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:39:21.301 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:39:27.953 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:39:27.953 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:39:28.364 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:39:28.593 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_prefix_none ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:39:28.593 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:39:34.086 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:39:34.086 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:39:34.793 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:39:35.177 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_prefix_none ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:39:35.177 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:39:41.353 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:39:41.353 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:39:42.001 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:39:42.648 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_prefix_not_exist ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:39:42.648 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:39:49.061 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:39:49.061 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:39:49.528 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:39:49.819 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_prefix_not_exist ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:39:49.819 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:39:57.458 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:39:57.459 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:39:57.795 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:39:58.629 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_prefix_unreadable ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:39:58.629 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:40:05.431 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:40:05.432 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:40:06.242 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:40:06.734 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_prefix_unreadable ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:40:06.734 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:40:13.669 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:40:13.670 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:40:14.524 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:40:15.105 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_prefix_delimiter_basic ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:40:15.106 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:40:22.347 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:40:22.347 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:40:22.931 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:40:23.438 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_prefix_delimiter_basic ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:40:23.438 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:40:32.663 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:40:32.663 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:40:32.984 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:40:33.369 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_prefix_delimiter_alt ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:40:33.369 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:40:42.613 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:40:42.613 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:40:43.170 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:40:43.465 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_prefix_delimiter_alt ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:40:43.466 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:40:51.280 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:40:51.280 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:40:52.612 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:40:53.114 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_prefix_delimiter_prefix_not_exist ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:40:53.115 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:41:01.045 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:41:01.045 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:41:01.429 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:41:02.025 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_prefix_delimiter_prefix_not_exist ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:41:02.026 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:41:10.428 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:41:10.428 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:41:10.911 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:41:11.210 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_prefix_delimiter_delimiter_not_exist ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:41:11.210 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:41:19.798 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:41:19.798 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:41:20.009 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:41:20.661 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_prefix_delimiter_delimiter_not_exist ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:41:20.661 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:41:29.223 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:41:29.223 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:41:30.004 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:41:30.302 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_prefix_delimiter_prefix_delimiter_not_exist ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:41:30.302 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:41:37.683 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:41:37.684 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:41:38.330 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:41:38.768 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_prefix_delimiter_prefix_delimiter_not_exist ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:41:38.769 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:41:47.326 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:41:47.326 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:41:47.878 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:41:48.186 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_maxkeys_one ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:41:48.186 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:41:58.038 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:41:58.039 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:41:58.994 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:41:59.202 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_maxkeys_one ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:41:59.202 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:42:08.954 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:42:08.954 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:42:10.623 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:42:10.886 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_maxkeys_zero ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:42:10.887 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:42:20.693 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:42:20.693 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:42:21.105 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:42:21.475 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_maxkeys_zero ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:42:21.475 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:42:29.871 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:42:29.872 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:42:30.546 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:42:30.894 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_maxkeys_none ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:42:30.894 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:42:40.023 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:42:40.024 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:42:40.490 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:42:40.861 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_maxkeys_none ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:42:40.861 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:42:49.821 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:42:49.821 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:42:50.544 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:42:50.940 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_unordered ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:42:50.940 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:43:31.421 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:43:31.421 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:43:35.098 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:43:35.534 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_unordered ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:43:35.534 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:43:43.179 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:03:18:23.836 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T15:43:43.199 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:03:18:23.857 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T15:43:43.205 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:03:18:23.812 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T15:43:43.210 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:03:18:23.817 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T15:43:43.212 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:03:18:23.820 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T15:43:43.214 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:03:18:23.822 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T15:43:43.392 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:03:18:23.999 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T15:43:43.428 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:03:18:24.036 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T15:43:43.473 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:03:18:24.132 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T15:44:13.301 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:44:13.302 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:44:16.236 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:44:16.607 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_maxkeys_invalid ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:44:16.607 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:44:25.828 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:44:25.829 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:44:26.005 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:44:26.650 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_marker_none ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:44:26.650 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:44:35.488 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:44:35.488 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:44:36.206 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:44:36.528 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_marker_empty ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:44:36.528 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:44:43.559 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:44:43.559 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:44:43.867 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:44:44.195 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_continuationtoken_empty ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:44:44.196 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:44:52.940 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:44:52.940 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:44:53.258 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:44:53.482 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_marker_unreadable ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:44:53.482 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:45:03.134 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:45:03.134 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:45:03.635 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:45:04.087 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_startafter_unreadable ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:45:04.087 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:45:15.315 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:45:15.315 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:45:16.225 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:45:16.514 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_marker_not_in_list ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:45:16.514 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:45:24.195 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:45:24.196 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:45:24.768 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:45:25.147 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_startafter_not_in_list ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:45:25.147 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:45:34.157 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:45:34.158 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:45:34.824 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:45:35.164 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_marker_after_list ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:45:35.164 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:45:45.198 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:45:45.198 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:45:45.906 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:45:46.277 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_startafter_after_list ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:45:46.278 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:45:55.646 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:45:55.646 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:45:55.937 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:45:56.406 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_return_data ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:45:56.406 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:46:03.430 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:46:03.431 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:46:06.691 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:46:06.917 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_return_data_versioning ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:46:06.918 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:46:09.425 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:46:09.425 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:46:11.020 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:46:11.021 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:46:26.485 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:46:26.485 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:46:31.994 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:46:32.268 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_objects_anonymous ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:46:32.268 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:46:34.252 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:46:34.252 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:46:35.416 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:46:35.416 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:46:36.634 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:46:36.948 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_objects_anonymous ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:46:36.949 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:46:40.544 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:46:40.544 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:46:42.288 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:46:42.288 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:46:43.178 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:46:44.053 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_objects_anonymous_fail ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:46:44.053 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:46:46.366 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:46:46.366 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:46:47.289 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:46:47.594 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_objects_anonymous_fail ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:46:47.595 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:46:52.043 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:46:52.043 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:46:52.383 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:46:52.745 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_bucket_notexist ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:46:52.746 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:46:53.109 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:46:53.633 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_bucketv2_notexist ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:46:53.633 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:46:54.037 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:46:54.330 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_bucket_delete_notexist ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:46:54.331 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:46:54.549 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:46:55.283 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_bucket_delete_nonempty ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:46:55.284 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:46:59.087 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:46:59.087 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:47:00.282 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:47:00.536 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_bucket_concurrent_set_canned_acl ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:47:00.536 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:47:02.634 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:47:02.634 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:47:02.926 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:47:02.926 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:47:03.832 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:47:03.832 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:47:03.916 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:47:03.916 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:47:04.145 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:47:04.145 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:47:04.664 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:47:04.664 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:47:04.906 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:47:04.906 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:47:05.329 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:47:05.330 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:47:05.508 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:47:05.508 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:47:06.093 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:47:06.093 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:47:06.419 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:47:06.420 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:47:06.943 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:47:06.943 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:47:08.199 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:47:08.199 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:47:08.569 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:47:08.570 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:47:09.024 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:47:09.024 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:47:09.422 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:47:09.423 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:47:09.609 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:47:09.609 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:47:09.871 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:47:09.872 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:47:10.532 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:47:10.532 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:47:10.920 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:47:10.921 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:47:11.201 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:47:11.201 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:47:11.560 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:47:11.561 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:47:12.359 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:47:12.360 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:47:12.733 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:47:12.734 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:47:12.934 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:47:12.935 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:47:13.153 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:47:13.154 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:47:13.447 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:47:13.448 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:47:14.624 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:47:14.625 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:47:15.489 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:47:15.490 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:47:15.556 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:03:21:56.213 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T15:47:15.612 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:03:21:56.219 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T15:47:15.613 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:03:21:56.221 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T15:47:15.619 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:03:21:56.277 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T15:47:15.625 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:03:21:56.232 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T15:47:15.656 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:03:21:56.262 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T15:47:15.708 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:03:21:56.314 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T15:47:15.752 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:03:21:56.410 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T15:47:15.763 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:03:21:56.370 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T15:47:15.949 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:47:15.949 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:47:16.491 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:47:16.491 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:47:16.666 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:47:16.666 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:47:17.630 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:47:17.630 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:47:17.867 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:47:17.868 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:47:18.202 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:47:18.203 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:47:18.613 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:47:18.613 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:47:18.884 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:47:18.884 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:47:19.197 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:47:19.197 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:47:19.798 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:47:19.798 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:47:19.875 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:47:19.875 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:47:20.810 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:47:20.810 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:47:21.009 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:47:21.009 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:47:22.629 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:47:22.629 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:47:22.882 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:47:22.882 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:47:23.104 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:47:23.105 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:47:23.673 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:47:23.674 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:47:23.998 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:47:23.999 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:47:25.243 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:47:25.243 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:47:25.580 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:47:25.580 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:47:26.857 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:47:26.858 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:47:31.225 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:47:31.925 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_object_write_to_nonexist_bucket ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:47:31.925 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:47:32.402 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:47:32.719 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_bucket_create_delete ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:47:32.720 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:47:35.084 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:47:35.084 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:47:39.766 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:47:40.119 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_object_read_notexist ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:47:40.119 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:47:42.322 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:47:42.322 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:47:42.752 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:47:43.056 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_object_requestid_matches_header_on_error ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:47:43.056 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:47:45.248 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:47:45.248 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:47:45.470 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:47:45.746 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_multi_object_delete ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:47:45.746 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:47:51.449 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:47:51.450 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:47:57.695 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:47:57.943 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_multi_objectv2_delete ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:47:57.943 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:48:04.264 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:48:04.264 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:48:11.336 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:48:11.603 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_object_head_zero_bytes ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:48:11.603 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:48:13.537 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:48:13.538 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:48:14.792 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:48:15.155 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_object_write_check_etag ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:48:15.155 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:48:16.976 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:48:16.976 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:48:18.196 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:48:18.425 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_object_write_cache_control ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:48:18.426 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:48:21.275 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:48:21.275 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:48:22.233 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:48:22.641 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_object_write_expires ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:48:22.641 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:48:25.989 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:48:25.989 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:48:29.016 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:48:29.267 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_object_write_read_update_read_delete ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:48:29.267 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:48:31.666 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:48:31.667 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:48:36.820 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:48:37.151 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_object_set_get_metadata_none_to_good ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:48:37.152 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:48:39.339 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:48:39.339 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:48:41.013 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:48:41.289 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_object_set_get_metadata_none_to_empty ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:48:41.289 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:48:43.960 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:48:43.961 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:48:45.936 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:48:46.160 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_object_set_get_metadata_overwrite_to_empty ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:48:46.161 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:48:48.205 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:48:48.205 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:48:49.418 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:48:49.418 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:48:51.038 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:48:51.327 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_object_set_get_unicode_metadata ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:48:51.328 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:48:53.512 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:48:53.512 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:48:55.101 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:48:55.351 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_object_metadata_replaced_on_put ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:48:55.351 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:48:55.360 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:03:23:36.018 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T15:48:55.373 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:03:23:36.031 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T15:48:55.419 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:03:23:36.026 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T15:48:55.420 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:03:23:36.027 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T15:48:55.421 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:03:23:36.028 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T15:48:55.448 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:03:23:36.055 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T15:48:55.504 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:03:23:36.161 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T15:48:55.551 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:03:23:36.158 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T15:48:55.573 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:03:23:36.176 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T15:48:56.906 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:48:56.906 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:49:00.356 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:49:00.797 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_object_write_file ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:49:00.797 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:49:02.841 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:49:02.841 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:49:04.199 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:49:04.525 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_post_object_anonymous_request ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:49:04.525 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:49:06.798 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:49:06.798 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:49:08.354 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:49:08.619 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_post_object_authenticated_request ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:49:08.619 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:49:10.355 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:49:10.355 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:49:12.969 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:49:12.969 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:49:13.367 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:49:13.792 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_post_object_authenticated_no_content_type ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:49:13.792 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:49:16.560 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:49:16.560 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:49:18.593 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:49:19.099 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_post_object_authenticated_request_bad_access_key ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:49:19.099 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:49:21.761 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:49:21.762 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:49:22.989 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:49:23.292 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_post_object_set_success_code ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:49:23.292 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:49:25.914 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:49:25.915 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:49:28.017 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:49:28.320 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_post_object_set_invalid_success_code ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:49:28.321 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:49:31.314 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:49:31.314 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:49:32.597 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:49:33.271 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_post_object_upload_larger_than_chunk ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:49:33.271 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:49:36.668 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:49:36.668 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:49:43.812 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:49:43.812 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:49:47.512 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:49:48.056 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_post_object_set_key_from_filename ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:49:48.056 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:49:51.388 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:49:51.388 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:49:52.854 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:49:52.854 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:49:53.272 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:49:53.710 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_post_object_ignored_header ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:49:53.710 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:49:56.905 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:49:56.905 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:49:57.583 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:49:58.029 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_post_object_case_insensitive_condition_fields ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:49:58.029 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:50:00.880 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:50:00.880 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:50:02.798 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:50:03.170 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_post_object_escaped_field_values ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:50:03.170 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:50:05.287 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:50:05.288 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:50:08.062 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:50:08.062 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:50:08.383 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:50:08.695 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_post_object_success_redirect_action ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:50:08.695 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:50:11.449 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:50:11.450 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:50:14.865 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:50:15.351 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_post_object_invalid_signature ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:50:15.351 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:50:17.716 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:50:17.716 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:50:18.140 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:50:18.497 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_post_object_invalid_access_key ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:50:18.497 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:50:21.650 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:50:21.650 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:50:22.667 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:50:23.121 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_post_object_invalid_date_format ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:50:23.121 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:50:25.438 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:50:25.438 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:50:26.353 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:50:26.615 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_post_object_no_key_specified ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:50:26.615 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:50:29.249 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:50:29.249 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:50:29.803 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:50:30.414 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_post_object_missing_signature ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:50:30.415 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:50:33.260 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:50:33.261 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:50:33.938 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:50:34.236 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_post_object_missing_policy_condition ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:50:34.236 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:50:36.677 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:50:36.677 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:50:37.114 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:50:37.527 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_post_object_user_specified_header ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:50:37.527 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:50:40.540 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:50:40.540 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:50:42.446 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:50:42.447 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:50:42.945 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:50:43.219 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_post_object_request_missing_policy_specified_field ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:50:43.219 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:50:45.476 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:50:45.476 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:50:45.820 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:50:46.205 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_post_object_condition_is_case_sensitive ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:50:46.205 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:50:48.306 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:50:48.306 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:50:49.200 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:50:49.505 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_post_object_expires_is_case_sensitive ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:50:49.505 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:50:53.017 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:50:53.017 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:50:53.481 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:50:53.744 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_post_object_expired_policy ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:50:53.744 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:50:56.325 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:50:56.326 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:50:56.590 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:50:56.799 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_post_object_invalid_request_field_value ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:50:56.800 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:50:59.274 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:50:59.275 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:50:59.713 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:51:00.132 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_post_object_missing_expires_condition ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:51:00.132 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:51:01.675 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:51:01.675 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:51:02.961 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:51:03.339 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_post_object_missing_conditions_list ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:51:03.340 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:51:06.327 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:51:06.328 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:51:07.112 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:51:07.342 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_post_object_upload_size_limit_exceeded ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:51:07.343 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:51:10.173 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:51:10.174 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:51:10.472 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:51:11.751 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_post_object_missing_content_length_argument ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:51:11.751 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:51:13.585 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:51:13.585 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:51:15.023 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:51:15.334 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_post_object_invalid_content_length_argument ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:51:15.334 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:51:18.270 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:51:18.270 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:51:18.830 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:51:19.262 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_post_object_upload_size_below_minimum ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:51:19.262 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:51:23.040 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:51:23.041 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:51:23.753 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:51:24.101 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_post_object_empty_conditions ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:51:24.101 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:51:27.365 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:51:27.365 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:51:27.592 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:51:27.909 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_get_object_ifmatch_good ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:51:27.909 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:51:30.632 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:51:30.632 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:51:32.945 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:51:33.276 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_get_object_ifmatch_failed ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:51:33.277 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:51:35.613 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:51:35.613 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:51:37.285 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:51:37.772 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_get_object_ifnonematch_good ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:51:37.772 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:51:40.580 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:51:40.581 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:51:42.113 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:51:43.008 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_get_object_ifnonematch_failed ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:51:43.008 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:51:45.134 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:51:45.134 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:51:47.674 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:51:47.933 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_get_object_ifmodifiedsince_good ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:51:47.933 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:51:50.444 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:51:50.444 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:51:53.348 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:51:53.600 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_get_object_ifmodifiedsince_failed ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:51:53.600 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:51:57.828 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:51:57.829 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:52:01.771 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:52:01.772 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:52:02.098 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:52:03.017 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_get_object_ifunmodifiedsince_good ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:52:03.018 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:52:05.249 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:52:05.249 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:52:07.660 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:52:07.895 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_get_object_ifunmodifiedsince_failed ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:52:07.895 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:52:12.132 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:52:12.132 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:52:15.281 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:52:15.609 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_put_object_ifmatch_good ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:52:15.610 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:52:18.911 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:52:18.912 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:52:22.688 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:52:23.300 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_put_object_ifmatch_failed ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:52:23.300 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:52:26.405 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:52:26.405 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:52:30.040 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:52:30.755 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_put_object_ifmatch_overwrite_existed_good ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:52:30.755 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:52:33.608 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:52:33.608 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:52:36.778 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:52:37.056 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_put_object_ifmatch_nonexisted_failed ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:52:37.057 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:52:40.209 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:52:40.210 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:52:41.690 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:52:42.074 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_put_object_ifnonmatch_good ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:52:42.074 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:52:44.574 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:52:44.575 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:52:47.897 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:52:48.267 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_put_object_ifnonmatch_failed ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:52:48.268 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:52:50.807 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:52:50.807 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:52:54.085 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:52:54.555 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_put_object_ifnonmatch_nonexisted_good ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:52:54.555 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:52:58.408 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:52:58.409 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:53:00.842 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:53:01.369 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_put_object_ifnonmatch_overwrite_existed_failed ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:53:01.369 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:53:03.692 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:53:03.692 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:53:07.536 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:53:08.134 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_object_raw_get ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:53:08.135 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:53:13.018 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:53:13.018 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:53:13.920 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:53:14.492 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_object_raw_get_bucket_gone ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:53:14.493 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:53:20.311 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:53:20.311 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:53:26.953 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:53:26.953 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:53:27.515 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:53:27.832 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_object_delete_key_bucket_gone ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:53:27.833 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:53:32.289 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:53:32.289 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:53:39.482 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:53:39.483 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:53:39.744 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:53:40.132 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_object_raw_get_object_gone ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:53:40.132 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:53:43.088 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:53:43.088 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:53:45.232 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:53:45.233 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:53:46.062 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:53:46.684 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_bucket_head ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:53:46.684 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:53:48.955 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:53:48.955 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:53:49.504 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:53:49.841 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_bucket_head_extended ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:53:49.841 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:53:53.045 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:53:53.046 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:53:54.240 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:53:54.240 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:54:01.467 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:54:01.729 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_object_raw_get_bucket_acl ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:54:01.730 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:54:06.250 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:54:06.251 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:54:06.569 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:54:06.701 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:03:28:47.358 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T15:54:06.709 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:03:28:47.367 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T15:54:06.744 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:03:28:47.351 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T15:54:06.759 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:03:28:47.365 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T15:54:06.761 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:03:28:47.367 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T15:54:06.769 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:03:28:47.376 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T15:54:06.796 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_object_raw_get_object_acl ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:54:06.797 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:54:06.924 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:03:28:47.581 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T15:54:07.028 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:03:28:47.635 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T15:54:07.047 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:03:28:47.653 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T15:54:09.452 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:54:09.452 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:54:10.320 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:54:10.757 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_object_raw_authenticated ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:54:10.758 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:54:15.355 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:54:15.355 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:54:16.108 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:54:16.350 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_object_raw_response_headers ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:54:16.350 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:54:20.300 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:54:20.300 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:54:20.830 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:54:21.112 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_object_raw_authenticated_bucket_acl ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:54:21.112 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:54:25.698 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:54:25.698 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:54:26.248 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:54:26.586 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_object_raw_authenticated_object_acl ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:54:26.586 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:54:31.581 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:54:31.581 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:54:31.814 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:54:32.315 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_object_raw_authenticated_bucket_gone ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:54:32.316 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:54:36.218 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:54:36.218 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:54:41.289 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:54:41.684 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_object_raw_authenticated_object_gone ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:54:41.685 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:54:45.146 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:54:45.146 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:54:46.964 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:54:47.296 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_object_raw_get_x_amz_expires_not_expired ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:54:47.296 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:54:53.063 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:54:53.063 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:54:53.365 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:54:53.822 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_object_raw_get_x_amz_expires_out_range_zero ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:54:53.823 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:54:58.104 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:54:58.104 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:54:58.225 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:54:58.793 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_object_raw_get_x_amz_expires_out_max_range ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:54:58.793 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:55:02.326 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:55:02.327 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:55:02.783 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:55:03.465 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_object_raw_get_x_amz_expires_out_positive_range ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:55:03.466 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:55:08.000 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:55:08.000 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:55:08.103 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:55:08.695 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_object_anon_put ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:55:08.695 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:55:11.766 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:55:11.766 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:55:13.744 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:55:13.744 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:55:14.548 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:55:15.026 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_object_anon_put_write_access ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:55:15.027 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:55:17.656 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:55:17.656 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:55:19.189 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:55:19.189 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:55:21.132 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:55:21.650 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_object_put_authenticated ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:55:21.650 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:55:24.484 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:55:24.484 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:55:26.603 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:55:26.884 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_object_raw_put_authenticated_expired ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:55:26.885 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:55:29.389 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:55:29.389 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:55:31.114 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:55:31.114 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:55:31.197 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:55:31.565 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_bucket_create_naming_bad_short_one ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:55:31.565 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:55:32.158 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:55:32.487 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_bucket_create_naming_bad_short_two ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:55:32.487 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:55:33.053 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:55:33.411 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_bucket_create_naming_bad_ip ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:55:33.412 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:55:34.115 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:55:34.520 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_bucket_create_naming_dns_underscore ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:55:34.520 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:55:35.265 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:55:35.570 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_bucket_create_exists ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:55:35.570 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:55:37.541 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:03:30:18.198 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T15:55:37.548 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:03:30:18.205 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T15:55:37.606 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:03:30:18.263 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T15:55:37.623 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:03:30:18.230 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T15:55:37.624 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:03:30:18.230 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T15:55:37.629 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:03:30:18.235 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T15:55:37.638 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:03:30:18.244 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T15:55:37.696 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:03:30:18.302 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T15:55:37.696 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:03:30:18.303 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T15:55:39.936 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:55:40.394 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_bucket_get_location ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:55:40.394 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:55:43.352 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:55:43.613 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_bucket_create_exists_nonowner ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:55:43.613 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:55:46.691 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:55:46.692 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:55:48.237 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:55:49.217 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_default ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:55:49.217 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:55:52.140 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:55:52.141 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:55:52.481 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:55:52.820 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_canned_during_create ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:55:52.820 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:55:57.413 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:55:57.636 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_canned ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:55:57.636 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:56:01.395 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:56:02.359 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_canned_publicreadwrite ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:56:02.359 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:56:05.475 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:56:05.797 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_canned_authenticatedread ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:56:05.797 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:56:08.606 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:56:08.859 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_object_acl_default ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:56:08.859 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:56:13.193 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:56:13.193 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:56:14.347 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:56:15.085 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_object_acl_canned_during_create ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:56:15.085 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:56:17.734 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:56:17.734 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:56:19.728 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:56:20.005 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_object_acl_canned ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:56:20.005 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:56:23.749 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:56:23.750 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:56:27.927 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:56:28.186 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_object_acl_canned_publicreadwrite ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:56:28.187 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:56:31.609 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:56:31.610 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:56:32.833 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:56:33.069 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_object_acl_canned_authenticatedread ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:56:33.069 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:56:36.339 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:56:36.340 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:56:37.729 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:56:38.145 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_object_acl_canned_bucketownerread ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:56:38.145 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:56:41.358 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:56:41.358 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:56:46.073 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:56:46.553 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_object_acl_canned_bucketownerfullcontrol ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:56:46.553 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:56:49.739 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:56:49.739 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:56:52.851 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:56:53.184 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_object_acl_full_control_verify_owner ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:56:53.184 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:56:58.885 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:56:58.885 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:57:00.605 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:57:01.105 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_object_acl_full_control_verify_attributes ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:57:01.105 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:57:05.633 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:57:05.633 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:57:06.486 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:57:06.486 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:57:08.048 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:57:08.376 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_canned_private_to_private ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:57:08.376 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:57:10.652 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:57:10.653 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:57:12.034 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:57:12.572 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_object_acl ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:57:12.572 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:57:15.238 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:57:15.238 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:57:18.294 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:57:18.749 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_object_acl_write ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:57:18.750 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:57:20.966 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:57:20.966 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:57:24.518 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:57:24.944 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_object_acl_writeacp ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:57:24.944 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:57:28.473 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:57:28.473 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:57:32.451 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:57:32.706 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_object_acl_read ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:57:32.706 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:57:35.342 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:57:35.342 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:57:37.795 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:57:38.091 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_object_acl_readacp ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:57:38.092 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:57:40.680 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:57:40.680 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:57:43.213 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:57:44.093 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_grant_userid_fullcontrol ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:57:44.093 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:57:46.520 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:57:46.520 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:57:47.260 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:57:47.261 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:57:48.247 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:57:48.247 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:57:49.391 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:57:49.392 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:57:49.842 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:57:49.843 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:57:51.831 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:57:51.832 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:57:52.981 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:57:52.982 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:57:53.107 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:57:53.385 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_grant_userid_read ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:57:53.385 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:57:55.650 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:57:55.650 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:57:56.002 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:57:56.002 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:57:57.699 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:57:57.699 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:57:58.323 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:57:58.323 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:57:58.981 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:57:58.981 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:57:59.521 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:57:59.522 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:57:59.742 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:58:00.039 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_grant_userid_readacp ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:58:00.039 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:58:03.172 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:58:03.172 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:58:03.605 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:58:03.605 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:58:06.082 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:58:06.082 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:58:06.491 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:58:06.491 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:58:06.999 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:58:06.999 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:58:07.805 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:58:07.805 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:58:07.964 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:58:08.355 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_grant_userid_write ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:58:08.356 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:58:10.957 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:58:10.957 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:58:11.585 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:58:11.586 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:58:12.929 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:58:12.929 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:58:13.429 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:58:13.429 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:58:13.788 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:58:13.788 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:58:15.267 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:58:15.268 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:58:15.437 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:58:16.033 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_grant_userid_writeacp ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:58:16.034 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:58:19.695 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:58:19.695 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:58:20.189 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:58:20.189 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:58:22.091 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:58:22.092 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:58:22.549 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:58:22.549 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:58:23.177 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:58:23.177 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:58:23.517 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:58:23.518 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:58:24.647 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:58:24.956 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_grant_nonexist_user ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:58:24.956 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:58:27.307 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:58:27.307 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:58:27.746 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:58:27.746 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:58:28.218 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:58:28.456 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_no_grants ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:58:28.456 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:58:31.474 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:58:31.474 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:58:35.616 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:58:35.616 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:58:36.127 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:58:36.127 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:58:38.532 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:58:39.112 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_object_header_acl_grants ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:58:39.113 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:58:41.295 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:58:41.295 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:58:43.957 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:58:44.261 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_bucket_header_acl_grants ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:58:44.261 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:58:47.350 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:58:47.351 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:58:49.375 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:58:49.664 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_grant_email ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:58:49.664 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:58:52.641 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:58:52.641 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:58:53.457 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:58:53.457 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:58:55.218 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:58:55.586 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_grant_email_notexist ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:58:55.587 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:58:58.004 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:58:58.004 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:58:58.384 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:58:58.385 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:58:59.120 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:58:59.443 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_revoke_all ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:58:59.444 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:59:02.605 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:59:02.606 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:59:07.715 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:59:08.062 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_access_bucket_private_object_private ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:59:08.062 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:59:10.572 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:59:10.572 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:59:16.138 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:59:16.138 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:59:17.666 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:59:17.666 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:59:18.160 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:59:18.160 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:59:18.294 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:59:18.602 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_access_bucket_private_objectv2_private ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:59:18.602 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:59:20.949 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:59:20.949 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:59:27.225 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:59:27.226 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:59:28.977 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:59:28.977 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:59:29.387 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:59:29.387 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:59:29.528 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:59:29.822 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_access_bucket_private_object_publicread ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:59:29.822 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:59:33.111 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:59:33.111 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:59:39.804 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:59:39.805 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:59:40.714 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:59:40.714 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:59:42.172 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:59:42.172 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:59:43.121 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:59:43.449 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_access_bucket_private_objectv2_publicread ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:59:43.450 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:59:45.956 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:59:45.956 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:59:51.781 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:59:51.781 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:59:53.240 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:59:53.240 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:59:55.476 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:59:55.477 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:59:55.792 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T15:59:56.076 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_access_bucket_private_object_publicreadwrite ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:59:56.076 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T15:59:59.441 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T15:59:59.442 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:00:04.554 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:00:04.555 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:00:05.538 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:00:05.538 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:00:07.270 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:00:07.270 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:00:07.808 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T16:00:08.180 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_access_bucket_private_objectv2_publicreadwrite ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:00:08.180 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:00:11.219 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:00:11.219 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:00:19.282 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:00:19.283 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:00:20.392 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:00:20.393 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:00:21.793 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:00:21.793 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:00:22.467 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T16:00:22.832 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_access_bucket_publicread_object_private ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:00:22.832 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:00:26.029 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:00:26.029 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:00:33.376 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:00:33.376 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:00:34.732 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:00:34.732 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:00:35.681 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:00:35.681 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:00:36.623 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T16:00:36.907 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_access_bucket_publicread_object_publicread ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:00:36.907 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:00:40.332 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:00:40.333 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:00:46.543 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:00:46.543 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:00:47.721 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:00:47.721 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:00:48.645 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:00:48.645 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:00:49.810 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T16:00:50.328 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_access_bucket_publicread_object_publicreadwrite ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:00:50.328 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:00:53.133 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:00:53.133 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:00:59.592 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:00:59.592 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:01:00.402 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:01:00.402 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:01:02.017 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:01:02.018 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:01:02.666 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T16:01:03.106 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_access_bucket_publicreadwrite_object_private ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:01:03.106 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:01:07.014 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:01:07.014 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:01:13.812 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:01:13.812 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:01:21.055 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T16:01:21.435 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_access_bucket_publicreadwrite_object_publicread ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:01:21.435 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:01:24.535 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:01:24.535 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:01:32.442 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:01:32.442 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:01:41.795 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T16:01:42.276 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_access_bucket_publicreadwrite_object_publicreadwrite ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:01:42.277 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:01:44.725 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:01:44.725 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:01:50.074 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:01:50.074 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:01:56.548 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T16:01:56.864 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_buckets_create_then_list ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:01:56.864 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:02:13.968 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:02:13.968 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:02:14.979 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T16:02:15.232 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_list_buckets_anonymous ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:02:15.232 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:02:16.047 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T16:02:16.572 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_list_buckets_invalid_auth ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:02:16.572 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:02:17.052 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T16:02:17.446 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_list_buckets_bad_auth ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:02:17.446 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:02:17.659 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T16:02:18.076 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_bucket_create_naming_good_starts_alpha ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:02:18.076 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:02:19.966 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:02:19.966 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:02:24.066 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:02:24.066 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:02:32.400 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T16:02:32.857 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_bucket_create_naming_good_starts_digit ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:02:32.858 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:02:34.542 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:02:34.542 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:02:38.235 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:02:38.235 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:02:44.330 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T16:02:44.577 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_bucket_create_naming_good_contains_period ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:02:44.577 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:02:46.682 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T16:02:47.173 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_bucket_create_naming_good_contains_hyphen ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:02:47.173 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:02:49.989 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T16:02:50.723 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_bucket_recreate_not_overriding ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:02:50.723 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:02:57.158 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:02:57.158 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:02:58.302 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:02:58.302 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:03:01.581 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:03:01.582 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:03:02.887 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T16:03:03.252 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_bucket_create_special_key_names ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:03:03.253 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:03:24.860 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:03:24.861 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:03:25.959 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:03:25.959 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:03:47.821 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T16:03:48.196 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_special_prefix ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:03:48.197 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:03:59.312 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:03:38:39.969 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T16:03:59.318 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:03:38:39.975 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T16:03:59.326 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:03:38:39.932 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T16:03:59.337 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:03:38:39.943 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T16:03:59.358 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:03:38:39.964 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T16:03:59.378 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:03:38:39.984 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T16:03:59.561 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:03:38:40.167 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T16:03:59.579 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:03:38:40.184 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T16:03:59.662 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:03:38:40.319 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T16:04:00.139 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:04:00.139 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:04:00.883 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:04:00.883 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:04:01.095 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T16:04:01.331 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_object_copy_zero_size ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:04:01.331 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:04:06.796 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:04:06.796 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:04:13.565 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T16:04:13.818 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_object_copy_same_bucket ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:04:13.818 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:04:17.616 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:04:17.616 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:04:21.219 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T16:04:21.570 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_object_copy_verify_contenttype ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:04:21.570 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:04:25.525 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:04:25.526 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:04:29.717 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T16:04:30.330 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_object_copy_to_itself ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:04:30.330 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:04:30.595 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:03:39:11.252 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T16:04:30.601 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:03:39:11.258 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T16:04:30.607 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:03:39:11.213 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T16:04:30.607 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:03:39:11.213 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T16:04:30.612 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:03:39:11.218 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T16:04:30.617 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:03:39:11.223 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T16:04:30.646 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:03:39:11.302 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T16:04:30.657 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:03:39:11.263 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T16:04:30.660 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:03:39:11.266 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T16:04:33.443 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:04:33.444 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:04:35.239 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T16:04:35.602 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_object_copy_to_itself_with_metadata ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:04:35.602 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:04:39.382 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:04:39.382 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:04:44.018 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T16:04:44.369 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_object_copy_diff_bucket ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:04:44.370 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:04:47.433 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:04:47.434 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:04:50.270 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:04:50.270 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:04:54.581 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T16:04:55.267 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_object_copy_not_owned_bucket ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:04:55.268 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:04:59.280 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:04:59.281 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:05:04.090 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T16:05:04.326 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_object_copy_not_owned_object_bucket ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:05:04.326 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:05:08.820 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:05:08.821 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:05:12.583 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:05:12.583 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:05:15.091 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:05:15.092 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:05:16.071 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:05:16.071 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:05:19.936 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T16:05:20.488 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_object_copy_canned_acl ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:05:20.488 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:05:23.410 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:05:23.410 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:05:27.888 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:05:27.888 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:05:32.138 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:05:32.139 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:05:32.497 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T16:05:32.940 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_object_copy_retaining_metadata ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:05:32.941 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:05:35.823 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:05:35.824 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:05:40.360 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:05:40.360 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:05:44.256 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:05:44.256 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:05:49.763 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T16:05:49.860 INFO:tasks.rgw.client.0.smithi062.stdout:2019-11-29T16:05:49.841+0000 812f9700 -1 handle_data failed with exit code -32 2019-11-29T16:05:50.130 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_object_copy_replacing_metadata ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:05:50.131 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:05:53.037 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:05:53.038 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:05:57.349 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:05:57.349 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:06:00.988 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:06:00.989 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:06:05.542 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T16:06:05.600 INFO:tasks.rgw.client.0.smithi062.stdout:2019-11-29T16:06:05.583+0000 cbb8e700 -1 handle_data failed with exit code -32 2019-11-29T16:06:05.842 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_object_copy_bucket_not_found ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:06:05.842 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:06:09.288 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:06:09.288 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:06:09.713 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T16:06:10.130 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_object_copy_key_not_found ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:06:10.130 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:06:13.794 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:06:13.795 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:06:14.276 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T16:06:15.029 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_object_copy_versioned_bucket ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:06:15.029 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:06:19.478 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:06:19.478 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:06:21.264 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:06:21.265 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:06:25.987 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:06:25.987 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:06:39.522 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:06:39.523 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:06:42.698 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:06:42.698 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:06:48.927 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:06:48.928 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:07:00.964 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T16:07:01.252 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_object_copy_versioned_url_encoding ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:07:01.253 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:07:05.445 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:07:05.445 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:07:16.152 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T16:07:16.441 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_object_copy_versioning_multipart_upload ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:07:16.441 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:07:19.920 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:07:19.920 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:07:21.320 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:07:21.321 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:08:14.877 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:08:14.877 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:08:21.364 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:08:21.364 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:08:28.514 INFO:tasks.rgw.client.0.smithi062.stdout:2019-11-29T16:08:28.463+0000 cfb96700 -1 handle_data failed with exit code -104 2019-11-29T16:09:35.653 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:09:35.654 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:09:37.782 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:09:37.783 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:09:42.276 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:03:44:22.933 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T16:09:42.283 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:03:44:22.940 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T16:09:42.298 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:03:44:22.899 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T16:09:42.299 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:03:44:22.904 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T16:09:42.301 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:03:44:22.907 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T16:09:42.305 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:03:44:22.911 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T16:09:42.490 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:03:44:23.147 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T16:09:42.504 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:03:44:23.110 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T16:09:42.539 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:03:44:23.145 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T16:10:22.155 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:10:22.156 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:11:45.717 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T16:11:45.971 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_multipart_upload_empty ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:11:45.971 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:11:49.811 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:11:49.811 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:11:52.107 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:11:52.107 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:11:52.380 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T16:11:52.763 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_multipart_upload_small ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:11:52.763 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:11:55.725 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:11:55.726 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:11:59.257 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:11:59.257 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:12:03.345 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T16:12:03.941 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_multipart_copy_small ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:12:03.941 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:12:06.600 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:12:06.601 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:12:20.280 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:12:20.280 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:12:21.574 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:03:47:02.232 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T16:12:21.607 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:03:47:02.213 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T16:12:21.621 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:03:47:02.278 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T16:12:21.629 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:03:47:02.235 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T16:12:21.646 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:03:47:02.252 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T16:12:21.649 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:03:47:02.254 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T16:12:21.725 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:03:47:02.382 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T16:12:21.757 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:03:47:02.363 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T16:12:21.764 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:03:47:02.369 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T16:12:22.983 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:12:22.983 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:12:27.562 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:12:27.562 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:12:31.892 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:12:31.892 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:12:32.983 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:12:32.983 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:12:33.725 INFO:tasks.rgw.client.0.smithi062.stdout:2019-11-29T16:12:33.682+0000 122c3c700 -1 handle_data failed with exit code -104 2019-11-29T16:12:34.803 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T16:12:35.256 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_multipart_copy_invalid_range ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:12:35.257 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:12:37.852 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:12:37.853 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:12:40.518 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:12:40.518 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:12:42.640 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T16:12:42.952 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_multipart_copy_without_range ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:12:42.952 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:12:46.677 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:12:46.677 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:12:48.359 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:12:48.359 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:12:52.130 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:12:52.131 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:13:00.061 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:13:00.061 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:13:00.438 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:13:00.438 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:13:02.029 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T16:13:02.296 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_multipart_copy_special_names ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:13:02.296 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:13:05.221 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:13:05.221 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:13:07.865 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:13:07.866 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:13:24.571 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:13:24.572 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:13:30.792 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:13:30.792 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:13:34.989 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:13:34.990 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:13:36.210 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:13:36.211 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:13:37.413 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:13:37.413 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:13:52.369 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:13:52.369 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:13:56.556 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:13:56.556 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:14:01.438 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:14:01.438 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:14:02.504 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:14:02.504 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:14:04.422 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:14:04.423 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:14:17.884 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:14:17.884 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:14:22.042 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:14:22.042 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:14:28.296 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:14:28.296 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:14:28.752 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:14:28.752 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:14:29.237 INFO:tasks.rgw.client.0.smithi062.stdout:2019-11-29T16:14:29.191+0000 73ade700 -1 handle_data failed with exit code -104 2019-11-29T16:14:30.000 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:14:30.000 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:14:45.832 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:14:45.832 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:14:51.010 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:14:51.010 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:14:54.526 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:03:49:35.183 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T16:14:54.532 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:03:49:35.189 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T16:14:54.544 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:03:49:35.150 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T16:14:54.544 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:03:49:35.150 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T16:14:54.551 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:03:49:35.155 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T16:14:54.554 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:03:49:35.159 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T16:14:54.661 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:03:49:35.312 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T16:14:54.672 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:03:49:35.278 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T16:14:54.688 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:03:49:35.294 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T16:14:56.386 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:14:56.386 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:14:57.301 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:14:57.302 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:14:58.519 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T16:14:58.942 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_multipart_upload ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:14:58.943 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:15:01.848 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:15:01.849 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:16:10.970 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:16:10.970 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:16:49.258 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:16:49.259 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:16:51.273 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:16:51.273 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:16:52.323 INFO:tasks.rgw.client.0.smithi062.stdout:2019-11-29T16:16:52.208+0000 122c3c700 -1 handle_data failed with exit code -104 2019-11-29T16:17:55.720 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:17:55.720 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:17:56.699 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:17:56.699 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:17:57.592 INFO:tasks.rgw.client.0.smithi062.stdout:2019-11-29T16:17:57.526+0000 ea3cb700 -1 handle_data failed with exit code -104 2019-11-29T16:18:30.236 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T16:18:30.525 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_multipart_copy_versioned ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:18:30.525 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:18:33.040 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:18:33.040 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:18:35.860 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:18:35.860 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:18:36.298 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:18:36.298 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:18:38.211 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:18:38.211 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:19:03.324 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:19:03.325 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:19:32.913 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:19:32.913 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:20:05.355 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:20:05.356 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:20:06.348 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:20:06.349 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:20:07.401 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:03:54:48.058 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T16:20:07.412 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:03:54:48.069 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T16:20:07.434 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:03:54:48.040 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T16:20:07.442 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:03:54:48.048 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T16:20:07.445 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:03:54:48.051 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T16:20:07.452 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:03:54:48.058 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T16:20:07.656 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:03:54:48.313 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T16:20:07.747 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:03:54:48.353 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T16:20:07.757 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:03:54:48.363 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T16:20:30.836 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:20:30.836 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:20:32.288 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:20:32.289 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:20:43.550 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:03:55:24.207 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T16:20:43.556 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:03:55:24.214 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T16:20:43.614 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:03:55:24.271 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T16:20:43.630 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:03:55:24.232 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T16:20:43.631 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:03:55:24.237 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T16:20:43.636 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:03:55:24.242 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T16:20:43.639 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:03:55:24.245 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T16:20:43.674 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:03:55:24.280 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T16:20:43.675 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:03:55:24.280 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T16:21:09.059 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:21:09.059 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:21:28.359 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:21:28.360 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:21:33.914 INFO:tasks.rgw.client.0.smithi062.stdout:2019-11-29T16:21:33.804+0000 b335d700 -1 handle_data failed with exit code -104 2019-11-29T16:21:35.566 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:21:35.567 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:21:36.708 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:21:36.709 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:21:37.224 INFO:tasks.rgw.client.0.smithi062.stdout:2019-11-29T16:21:37.205+0000 afb56700 -1 handle_data failed with exit code -104 2019-11-29T16:22:11.337 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:22:11.337 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:22:29.699 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:22:29.699 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:22:34.369 INFO:tasks.rgw.client.0.smithi062.stdout:2019-11-29T16:22:34.348+0000 656c2700 -1 handle_data failed with exit code -104 2019-11-29T16:22:36.169 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:22:36.169 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:22:37.550 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:22:37.550 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:23:17.530 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T16:23:17.617 INFO:tasks.rgw.client.0.smithi062.stdout:2019-11-29T16:23:17.560+0000 62ebd700 -1 handle_data failed with exit code -104 2019-11-29T16:23:17.870 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_multipart_upload_resend_part ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:23:17.870 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:23:21.508 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:23:21.508 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:24:46.614 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:24:46.615 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:25:18.962 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:03:59:59.619 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T16:25:18.975 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:03:59:59.632 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T16:25:18.988 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:03:59:59.594 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T16:25:18.993 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:03:59:59.599 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T16:25:18.997 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:03:59:59.602 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T16:25:18.997 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:03:59:59.603 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T16:25:19.195 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:03:59:59.800 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T16:25:19.208 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:03:59:59.814 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T16:25:19.228 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:03:59:59.884 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T16:25:24.857 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:25:24.858 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:25:25.892 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:25:25.892 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:26:38.461 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:26:38.462 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:26:39.991 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:26:39.991 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:27:17.188 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:27:17.188 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:28:25.721 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:28:25.722 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:29:00.297 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:29:00.297 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:29:01.781 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:29:01.781 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:29:03.022 INFO:tasks.rgw.client.0.smithi062.stdout:2019-11-29T16:29:02.992+0000 13bc6e700 -1 handle_data failed with exit code -104 2019-11-29T16:29:05.417 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:04:03:46.074 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T16:29:05.421 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:04:03:46.078 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T16:29:05.454 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:04:03:46.059 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T16:29:05.459 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:04:03:46.061 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T16:29:05.467 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:04:03:46.072 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T16:29:05.475 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:04:03:46.081 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T16:29:05.545 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:04:03:46.201 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T16:29:05.559 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:04:03:46.164 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T16:29:05.590 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:04:03:46.196 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T16:30:14.209 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:30:14.209 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:30:15.689 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:30:15.689 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:30:16.450 INFO:tasks.rgw.client.0.smithi062.stdout:2019-11-29T16:30:16.383+0000 117c26700 -1 handle_data failed with exit code -104 2019-11-29T16:30:29.210 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:04:05:09.866 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T16:30:29.218 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:04:05:09.875 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T16:30:29.231 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:04:05:09.836 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T16:30:29.232 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:04:05:09.838 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T16:30:29.236 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:04:05:09.841 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T16:30:29.241 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:04:05:09.847 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T16:30:29.309 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:04:05:09.915 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T16:30:29.319 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:04:05:09.923 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T16:30:29.324 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:04:05:09.981 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T16:30:54.496 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:30:54.496 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:32:06.928 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:32:06.929 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:32:47.238 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:32:47.238 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:32:48.760 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:32:48.760 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:32:49.273 INFO:tasks.rgw.client.0.smithi062.stdout:2019-11-29T16:32:49.246+0000 822fb700 -1 handle_data failed with exit code -104 2019-11-29T16:33:56.223 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:33:56.224 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:33:56.938 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:33:56.938 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:33:57.554 INFO:tasks.rgw.client.0.smithi062.stdout:2019-11-29T16:33:57.519+0000 ef3d5700 -1 handle_data failed with exit code -104 2019-11-29T16:34:37.833 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:34:37.833 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:35:41.989 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:04:10:22.645 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T16:35:42.003 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:04:10:22.659 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T16:35:42.006 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:04:10:22.611 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T16:35:42.013 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:04:10:22.619 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T16:35:42.014 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:04:10:22.619 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T16:35:42.020 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:04:10:22.626 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T16:35:42.204 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:04:10:22.809 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T16:35:42.227 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:04:10:22.832 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T16:35:42.260 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:04:10:22.916 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T16:36:09.558 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:36:09.558 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:36:49.487 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:36:49.487 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:36:51.209 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:36:51.209 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:37:27.383 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:04:12:08.040 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T16:37:27.391 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:04:12:08.048 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T16:37:27.418 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:04:12:08.023 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T16:37:27.450 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:04:12:08.055 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T16:37:27.464 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:04:12:08.069 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T16:37:27.469 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:04:12:08.075 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T16:37:27.496 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:04:12:08.152 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T16:37:27.525 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:04:12:08.130 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T16:37:27.537 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:04:12:08.136 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T16:37:50.568 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:37:50.568 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:37:51.759 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:37:51.760 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:38:27.500 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:38:27.500 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:40:26.069 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:40:26.069 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:40:54.146 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:04:15:34.801 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T16:40:54.166 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:04:15:34.772 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T16:40:54.167 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:04:15:34.823 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T16:40:54.174 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:04:15:34.779 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T16:40:54.180 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:04:15:34.786 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T16:40:54.189 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:04:15:34.795 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T16:40:54.325 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:04:15:34.931 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T16:40:54.334 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:04:15:34.939 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T16:40:54.375 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:04:15:35.031 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T16:41:02.104 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:41:02.104 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:41:03.400 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:41:03.401 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:41:03.933 INFO:tasks.rgw.client.0.smithi062.stdout:2019-11-29T16:41:03.879+0000 f73e5700 -1 handle_data failed with exit code -104 2019-11-29T16:42:09.189 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:42:09.189 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:42:10.792 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:42:10.792 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:42:11.509 INFO:tasks.rgw.client.0.smithi062.stdout:2019-11-29T16:42:11.463+0000 fc3ef700 -1 handle_data failed with exit code -104 2019-11-29T16:42:45.988 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T16:42:46.427 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_multipart_upload_multiple_sizes ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:42:46.428 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:42:49.779 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:42:49.780 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:43:01.509 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:43:01.510 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:43:04.761 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:43:04.761 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:43:26.073 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:43:26.073 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:43:47.574 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:43:47.574 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:44:14.908 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:44:14.908 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:44:47.341 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:44:47.342 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:45:16.623 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T16:45:16.913 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_multipart_copy_multiple_sizes ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:45:16.914 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:45:20.655 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:45:20.656 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:45:41.725 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:45:41.726 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:45:44.787 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:45:44.787 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:45:49.186 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:04:20:29.834 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T16:45:49.187 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:04:20:29.839 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T16:45:49.197 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:04:20:29.802 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T16:45:49.205 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:04:20:29.809 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T16:45:49.217 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:04:20:29.818 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T16:45:49.224 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:04:20:29.830 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T16:45:49.339 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:04:20:29.995 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T16:45:49.355 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:04:20:29.960 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T16:45:49.362 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:04:20:29.967 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T16:45:49.733 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:45:49.733 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:45:52.486 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:45:52.487 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:45:53.716 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:45:53.716 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:45:54.425 INFO:tasks.rgw.client.0.smithi062.stdout:2019-11-29T16:45:54.403+0000 686c8700 -1 handle_data failed with exit code -104 2019-11-29T16:46:05.771 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:04:20:46.427 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T16:46:05.783 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:04:20:46.439 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T16:46:05.785 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:04:20:46.390 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T16:46:05.791 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:04:20:46.397 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T16:46:05.792 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:04:20:46.398 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T16:46:05.798 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:04:20:46.404 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T16:46:05.835 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:04:20:46.440 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T16:46:05.835 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:04:20:46.441 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T16:46:05.849 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:04:20:46.505 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T16:46:07.479 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:46:07.479 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:46:18.681 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:46:18.682 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:46:19.579 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:46:19.580 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:46:20.417 INFO:tasks.rgw.client.0.smithi062.stdout:2019-11-29T16:46:20.372+0000 cab8c700 -1 handle_data failed with exit code -104 2019-11-29T16:46:32.964 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:46:32.965 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:46:48.072 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:46:48.072 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:46:49.090 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:46:49.090 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:46:50.515 INFO:tasks.rgw.client.0.smithi062.stdout:2019-11-29T16:46:50.473+0000 4b676700 -1 handle_data failed with exit code -104 2019-11-29T16:47:02.180 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:47:02.181 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:47:19.624 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:47:19.624 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:47:20.587 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:47:20.587 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:47:21.744 INFO:tasks.rgw.client.0.smithi062.stdout:2019-11-29T16:47:21.620+0000 a1b3a700 -1 handle_data failed with exit code -104 2019-11-29T16:47:42.318 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:47:42.318 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:47:55.194 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:47:55.194 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:47:55.810 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:47:55.810 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:47:56.890 INFO:tasks.rgw.client.0.smithi062.stdout:2019-11-29T16:47:56.869+0000 f2bdc700 -1 handle_data failed with exit code -104 2019-11-29T16:48:18.014 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:48:18.014 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:48:33.595 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:48:33.595 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:48:34.114 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:48:34.114 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:48:35.264 INFO:tasks.rgw.client.0.smithi062.stdout:2019-11-29T16:48:35.216+0000 bbb6e700 -1 handle_data failed with exit code -104 2019-11-29T16:48:55.878 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T16:48:56.216 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_multipart_upload_size_too_small ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:48:56.216 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:48:59.363 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:48:59.364 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:49:24.260 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:49:24.260 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:49:25.716 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T16:49:26.036 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_multipart_upload_contents ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:49:26.036 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:49:29.716 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:49:29.716 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:50:30.531 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:04:25:11.187 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T16:50:30.534 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:04:25:11.190 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T16:50:30.616 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:04:25:11.221 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T16:50:30.620 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:04:25:11.226 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T16:50:30.623 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:04:25:11.228 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T16:50:30.636 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:04:25:11.240 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T16:50:30.749 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:04:25:11.405 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T16:50:30.829 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:04:25:11.434 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T16:50:30.869 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:04:25:11.470 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T16:50:32.426 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T16:50:33.046 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_multipart_upload_overwrite_existing_object ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:50:33.046 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:50:35.502 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:50:35.503 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:51:16.778 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:04:25:57.434 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T16:51:16.796 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:04:25:57.452 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T16:51:16.808 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:04:25:57.412 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T16:51:16.815 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:04:25:57.420 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T16:51:16.821 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:04:25:57.424 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T16:51:16.824 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:04:25:57.426 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T16:51:16.862 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:04:25:57.518 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T16:51:16.880 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:04:25:57.485 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T16:51:16.891 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:04:25:57.496 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T16:51:22.828 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T16:51:23.184 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_abort_multipart_upload ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:51:23.184 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:51:26.834 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:51:26.835 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:51:50.697 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:51:50.697 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:51:52.975 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T16:51:53.284 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_abort_multipart_upload_not_found ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:51:53.284 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:51:56.723 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:51:56.723 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:51:58.547 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T16:51:58.831 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_list_multipart_upload ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:51:58.831 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:52:01.528 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:52:01.528 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:52:13.253 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:52:13.253 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:52:29.320 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:52:29.320 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:52:41.726 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:52:41.726 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:52:48.903 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T16:52:49.240 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_multipart_upload_missing_part ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:52:49.240 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:52:52.305 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:52:52.305 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:52:57.909 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T16:52:58.245 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_multipart_upload_incorrect_etag ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:52:58.245 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:53:01.703 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:53:01.703 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:53:07.837 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T16:53:08.087 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_100_continue ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:53:08.088 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:53:14.805 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T16:53:15.095 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_set_cors ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:53:15.095 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:53:18.454 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:53:18.454 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:53:21.427 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T16:53:21.660 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_cors_origin_response ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:53:21.660 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:53:25.449 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:53:25.450 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:53:30.135 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:53:30.135 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:53:31.326 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:53:31.326 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:53:32.618 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:53:32.618 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:53:33.661 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:53:33.661 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:53:35.270 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:53:35.270 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:53:37.284 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:53:37.284 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:53:38.914 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:53:38.914 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:53:39.921 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:53:39.921 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:53:41.252 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:53:41.252 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:53:42.326 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:53:42.326 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:53:43.895 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:53:43.895 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:53:45.789 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:53:45.789 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:53:46.890 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:53:46.891 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:53:47.883 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:53:47.883 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:53:48.936 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:53:48.937 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:53:50.147 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:53:50.148 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:53:51.246 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:53:51.247 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:53:52.065 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:53:52.065 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:53:52.893 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:53:52.893 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:53:53.746 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:53:53.746 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:53:54.661 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:53:54.662 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:53:55.678 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:53:55.678 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:53:56.267 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:53:56.267 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:53:57.100 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:53:57.100 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:53:57.813 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:53:57.814 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:53:58.248 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:53:58.248 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:53:58.907 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:53:58.907 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:54:00.127 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:54:00.128 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:54:00.988 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:54:00.988 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:54:02.500 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:54:02.500 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:54:03.704 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:54:03.704 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:54:04.942 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:54:04.943 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:54:06.038 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:54:06.038 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:54:06.390 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T16:54:06.637 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_cors_origin_wildcard ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:54:06.637 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:54:09.533 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:54:09.533 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:54:11.372 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:04:28:52.028 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T16:54:11.422 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:04:28:52.068 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T16:54:11.456 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:04:28:52.060 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T16:54:11.458 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:04:28:52.063 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T16:54:11.463 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:04:28:52.068 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T16:54:11.469 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:04:28:52.074 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T16:54:11.505 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:04:28:52.161 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T16:54:11.559 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:04:28:52.164 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T16:54:11.575 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:04:28:52.179 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T16:54:14.288 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:54:14.288 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:54:15.540 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:54:15.540 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:54:16.010 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T16:54:16.239 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_cors_header_option ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:54:16.240 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:54:19.426 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:54:19.426 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:54:24.950 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:54:24.950 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:54:25.171 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T16:54:25.439 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_atomic_read_1mb ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:54:25.439 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:54:28.292 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:54:28.292 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:54:32.305 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:54:32.305 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:54:37.031 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:54:37.031 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:54:39.688 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T16:54:40.143 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_atomic_read_4mb ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:54:40.144 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:54:42.411 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:54:42.411 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:54:50.335 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:54:50.335 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:54:59.604 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:54:59.604 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:55:05.702 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T16:55:06.000 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_atomic_read_8mb ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:55:06.000 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:55:08.718 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:55:08.718 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:55:25.006 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:55:25.006 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:55:42.681 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:55:42.681 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:55:51.691 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T16:55:51.961 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_atomic_write_1mb ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:55:51.961 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:55:55.170 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:55:55.170 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:55:57.710 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:55:57.710 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:56:00.568 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:56:00.568 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:56:03.597 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:56:03.597 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:56:08.108 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:56:08.108 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:56:10.035 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T16:56:10.736 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_atomic_write_4mb ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:56:10.736 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:56:14.412 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:56:14.412 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:56:22.141 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:56:22.141 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:56:27.610 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:56:27.610 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:56:28.265 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:04:31:08.922 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T16:56:28.274 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:04:31:08.930 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T16:56:28.280 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:04:31:08.886 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T16:56:28.282 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:04:31:08.887 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T16:56:28.283 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:04:31:08.888 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T16:56:28.296 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:04:31:08.901 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T16:56:28.396 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:04:31:09.001 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T16:56:28.402 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:04:31:09.007 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T16:56:28.411 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:04:31:09.067 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T16:56:34.790 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:56:34.790 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:56:43.170 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:56:43.171 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:56:49.689 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T16:56:50.111 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_atomic_write_8mb ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:56:50.111 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:56:53.072 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:56:53.072 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:57:07.874 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:57:07.874 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:57:17.322 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:57:17.322 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:57:36.696 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:57:36.697 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:57:45.267 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:57:45.267 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:57:54.809 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T16:57:55.050 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_atomic_dual_write_1mb ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:57:55.051 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:57:57.150 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:57:57.150 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:58:01.852 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:58:01.852 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:58:09.019 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:58:09.020 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:58:10.880 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T16:58:11.159 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_atomic_dual_write_4mb ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:58:11.160 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:58:13.299 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:58:13.300 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:58:21.107 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:58:21.108 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:58:29.834 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:58:29.834 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:58:34.857 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T16:58:35.149 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_atomic_dual_write_8mb ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:58:35.149 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:58:37.633 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:58:37.633 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:59:01.132 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:59:01.132 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:59:16.317 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:59:16.317 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:59:26.608 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T16:59:27.319 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_atomic_conditional_write_1mb ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:59:27.320 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:59:30.100 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:59:30.101 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:59:32.612 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:59:32.612 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:59:37.465 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:59:37.466 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:59:41.917 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:59:41.917 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:59:44.269 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T16:59:44.572 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_atomic_multipart_upload_write ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:59:44.572 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:59:47.793 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:59:47.793 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:59:55.907 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T16:59:56.155 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_multipart_resend_first_finishes_last ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:59:56.156 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T16:59:59.184 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T16:59:59.184 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:00:11.668 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:00:11.668 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:00:20.911 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:00:20.912 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:00:22.441 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T17:00:22.815 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_ranged_request_response_code ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:00:22.815 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:00:27.503 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:00:27.503 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:00:30.177 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T17:00:30.789 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_ranged_big_request_response_code ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:00:30.789 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:00:33.151 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:00:33.151 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:00:52.121 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T17:00:52.427 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_ranged_request_skip_leading_bytes_response_code ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:00:52.427 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:00:55.552 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:00:55.552 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:00:59.687 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T17:01:00.178 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_ranged_request_return_trailing_bytes_response_code ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:01:00.178 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:01:03.965 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:01:03.965 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:01:06.807 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T17:01:07.063 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_ranged_request_invalid_range ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:01:07.063 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:01:10.471 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:01:10.471 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:01:12.143 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T17:01:12.458 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_ranged_request_empty_object ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:01:12.458 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:01:15.900 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:01:15.900 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:01:17.824 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T17:01:18.271 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_versioning_bucket_create_suspend ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:01:18.271 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:01:21.989 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:01:21.989 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:01:22.683 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:01:22.684 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:01:24.160 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:01:24.160 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:01:25.421 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:01:25.421 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:01:26.582 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:01:26.582 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:01:27.826 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T17:01:28.203 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_versioning_obj_create_read_remove ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:01:28.203 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:01:31.722 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:01:31.722 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:01:40.329 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:04:36:20.985 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T17:01:40.342 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:04:36:20.999 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T17:01:40.351 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:04:36:20.956 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T17:01:40.351 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:04:36:20.956 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T17:01:40.353 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:04:36:20.958 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T17:01:40.353 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:04:36:20.959 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T17:01:40.546 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:04:36:21.151 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T17:01:40.564 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:04:36:21.169 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T17:01:40.579 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:04:36:21.235 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T17:02:33.160 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:04:37:13.815 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T17:02:33.193 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:04:37:13.849 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T17:02:33.214 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:04:37:13.819 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T17:02:33.217 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:04:37:13.822 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T17:02:33.248 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:04:37:13.853 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T17:02:33.252 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:04:37:13.908 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T17:02:33.254 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:04:37:13.860 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T17:02:33.256 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:04:37:13.861 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T17:02:33.292 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:04:37:13.897 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T17:06:52.620 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:04:41:33.275 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T17:06:52.635 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:04:41:33.291 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T17:06:52.650 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:04:41:33.255 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T17:06:52.655 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:04:41:33.260 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T17:06:52.657 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:04:41:33.263 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T17:06:52.667 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:04:41:33.272 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T17:06:52.901 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:04:41:33.506 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T17:06:52.908 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:04:41:33.563 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T17:06:52.913 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:04:41:33.518 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T17:07:00.139 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T17:07:00.374 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_versioning_obj_create_read_remove_head ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:07:00.374 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:07:03.635 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:07:03.635 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:08:00.967 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T17:08:01.411 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_versioning_obj_plain_null_version_removal ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:08:01.412 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:08:04.279 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:08:04.280 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:08:04.738 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:08:04.738 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:08:06.066 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:08:06.067 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:08:11.714 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T17:08:12.239 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_versioning_obj_plain_null_version_overwrite ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:08:12.239 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:08:15.384 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:08:15.384 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:08:15.955 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:08:15.955 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:08:16.691 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:08:16.692 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:08:32.762 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T17:08:33.134 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_versioning_obj_plain_null_version_overwrite_suspended ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:08:33.134 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:08:35.123 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:08:35.123 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:08:36.136 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:08:36.136 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:08:37.472 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:08:37.472 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:08:38.655 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:08:38.655 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:08:50.549 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T17:08:51.023 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_versioning_obj_suspend_versions ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:08:51.023 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:08:53.709 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:08:53.709 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:08:55.596 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:08:55.597 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:09:15.660 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:09:15.660 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:09:43.411 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:09:43.412 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:10:54.967 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:04:45:35.622 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T17:10:55.006 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:04:45:35.662 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T17:10:55.008 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:04:45:35.613 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T17:10:55.008 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:04:45:35.614 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T17:10:55.056 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:04:45:35.661 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T17:10:55.059 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:04:45:35.665 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T17:10:55.171 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:04:45:35.776 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T17:10:55.237 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:04:45:35.893 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T17:10:55.256 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:04:45:35.861 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T17:10:58.509 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T17:10:58.879 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_versioning_obj_create_versions_remove_all ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:10:58.880 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:11:01.285 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:11:01.285 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:11:02.852 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:11:02.852 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:12:02.749 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:04:46:43.405 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T17:12:02.760 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:04:46:43.416 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T17:12:02.771 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:04:46:43.376 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T17:12:02.779 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:04:46:43.381 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T17:12:02.790 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:04:46:43.395 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T17:12:02.796 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:04:46:43.401 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T17:12:02.842 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:04:46:43.447 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T17:12:02.883 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:04:46:43.488 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T17:12:02.883 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:04:46:43.539 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T17:13:07.293 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T17:13:07.653 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_versioning_obj_create_versions_remove_special_names ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:13:07.653 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:13:10.269 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:13:10.269 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:13:11.172 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:13:11.173 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:17:16.366 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:04:51:57.022 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T17:17:16.385 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:04:51:57.040 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T17:17:16.386 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:04:51:56.990 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T17:17:16.387 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:04:51:56.992 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T17:17:16.390 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:04:51:56.995 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T17:17:16.391 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:04:51:56.996 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T17:17:16.615 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:04:51:57.220 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T17:17:16.616 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:04:51:57.221 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T17:17:16.634 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:04:51:57.289 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T17:19:21.718 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:04:54:02.373 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T17:19:21.770 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:04:54:02.426 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T17:19:21.841 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:04:54:02.446 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T17:19:21.852 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:04:54:02.457 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T17:19:21.865 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:04:54:02.521 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T17:19:21.867 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:04:54:02.473 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T17:19:21.869 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:04:54:02.474 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T17:19:21.962 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:04:54:02.564 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T17:19:22.002 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:04:54:02.607 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T17:21:07.628 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T17:21:07.905 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_versioning_obj_create_overwrite_multipart ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:21:07.905 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:21:10.906 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:21:10.906 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:21:12.901 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:21:12.902 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:22:27.490 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:04:57:08.146 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T17:22:27.508 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:04:57:08.162 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T17:22:27.535 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:04:57:08.137 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T17:22:27.535 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:04:57:08.138 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T17:22:27.545 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:04:57:08.142 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T17:22:27.545 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:04:57:08.145 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T17:22:27.669 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:04:57:08.325 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T17:22:27.711 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:04:57:08.316 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T17:22:27.717 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:04:57:08.321 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T17:22:30.610 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:22:30.611 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:23:31.494 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:23:31.494 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:24:37.619 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:24:37.619 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:27:38.662 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:05:02:19.317 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T17:27:38.677 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:05:02:19.332 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T17:27:38.686 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:05:02:19.291 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T17:27:38.689 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:05:02:19.294 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T17:27:38.691 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:05:02:19.297 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T17:27:38.693 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:05:02:19.298 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T17:27:38.913 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:05:02:19.568 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T17:27:38.916 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:05:02:19.521 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T17:27:38.933 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:05:02:19.538 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T17:27:43.619 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:05:02:24.274 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T17:27:43.625 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:05:02:24.281 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T17:27:43.648 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:05:02:24.303 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T17:27:43.668 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:05:02:24.273 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T17:27:43.673 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:05:02:24.278 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T17:27:43.703 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:05:02:24.306 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T17:27:43.714 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:05:02:24.319 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T17:27:43.715 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:05:02:24.320 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T17:27:43.739 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:05:02:24.344 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T17:27:55.682 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T17:27:56.056 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_versioning_obj_list_marker ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:27:56.056 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:27:57.762 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:27:57.762 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:27:59.491 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:27:59.491 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:28:36.096 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T17:28:36.433 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_versioning_copy_obj_version ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:28:36.433 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:28:38.461 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:28:38.462 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:28:39.789 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:28:39.789 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:29:02.217 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:29:02.217 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:29:11.335 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T17:29:11.583 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_versioning_multi_object_delete ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:29:11.583 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:29:14.303 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:29:14.304 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:29:16.116 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:29:16.116 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:29:38.122 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T17:29:38.349 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_versioning_multi_object_delete_with_marker ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:29:38.349 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:29:41.081 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:29:41.081 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:29:42.311 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:29:42.312 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:30:08.557 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T17:30:08.946 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_versioning_multi_object_delete_with_marker_create ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:30:08.947 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:30:11.746 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:30:11.747 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:30:13.669 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:30:13.669 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:30:17.417 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T17:30:17.661 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_versioned_object_acl ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:30:17.662 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:30:20.741 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:30:20.741 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:30:22.131 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:30:22.131 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:30:41.874 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T17:30:42.146 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_versioned_object_acl_no_version_specified ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:30:42.146 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:30:46.091 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:30:46.091 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:30:48.378 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:30:48.378 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:31:07.622 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:31:07.622 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:31:09.975 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T17:31:10.212 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_versioned_concurrent_object_create_concurrent_remove ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:31:10.212 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:31:14.475 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:31:14.475 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:31:16.386 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:31:16.386 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:31:16.596 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:31:16.596 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:31:16.959 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:31:16.959 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:31:17.529 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:31:17.529 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:31:17.553 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:31:17.554 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:31:19.590 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:05:06:00.245 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T17:31:19.640 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:05:06:00.295 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T17:31:19.650 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:05:06:00.255 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T17:31:19.652 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:05:06:00.257 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T17:31:19.666 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:05:06:00.271 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T17:31:19.673 INFO:teuthology.orchestra.run.smithi062.stderr:Exception in thread Thread-54: 2019-11-29T17:31:19.673 INFO:teuthology.orchestra.run.smithi062.stderr:Traceback (most recent call last): 2019-11-29T17:31:19.673 INFO:teuthology.orchestra.run.smithi062.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-29T17:31:19.674 INFO:teuthology.orchestra.run.smithi062.stderr: self.run() 2019-11-29T17:31:19.674 INFO:teuthology.orchestra.run.smithi062.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-29T17:31:19.674 INFO:teuthology.orchestra.run.smithi062.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-29T17:31:19.674 INFO:teuthology.orchestra.run.smithi062.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-29T17:31:19.674 INFO:teuthology.orchestra.run.smithi062.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-29T17:31:19.674 INFO:teuthology.orchestra.run.smithi062.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-29T17:31:19.675 INFO:teuthology.orchestra.run.smithi062.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-29T17:31:19.675 INFO:teuthology.orchestra.run.smithi062.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-29T17:31:19.675 INFO:teuthology.orchestra.run.smithi062.stderr: raise error_class(parsed_response, operation_name) 2019-11-29T17:31:19.675 INFO:teuthology.orchestra.run.smithi062.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-29T17:31:19.676 INFO:teuthology.orchestra.run.smithi062.stderr: 2019-11-29T17:31:19.711 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:05:06:00.316 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T17:31:19.797 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:05:06:00.452 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T17:31:19.822 INFO:teuthology.orchestra.run.smithi062.stderr:Exception in thread Thread-55: 2019-11-29T17:31:19.823 INFO:teuthology.orchestra.run.smithi062.stderr:Traceback (most recent call last): 2019-11-29T17:31:19.823 INFO:teuthology.orchestra.run.smithi062.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-29T17:31:19.823 INFO:teuthology.orchestra.run.smithi062.stderr: self.run() 2019-11-29T17:31:19.823 INFO:teuthology.orchestra.run.smithi062.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-29T17:31:19.823 INFO:teuthology.orchestra.run.smithi062.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-29T17:31:19.823 INFO:teuthology.orchestra.run.smithi062.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-29T17:31:19.823 INFO:teuthology.orchestra.run.smithi062.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-29T17:31:19.824 INFO:teuthology.orchestra.run.smithi062.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-29T17:31:19.824 INFO:teuthology.orchestra.run.smithi062.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-29T17:31:19.824 INFO:teuthology.orchestra.run.smithi062.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-29T17:31:19.824 INFO:teuthology.orchestra.run.smithi062.stderr: raise error_class(parsed_response, operation_name) 2019-11-29T17:31:19.824 INFO:teuthology.orchestra.run.smithi062.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-29T17:31:19.824 INFO:teuthology.orchestra.run.smithi062.stderr: 2019-11-29T17:31:19.824 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:05:06:00.427 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T17:31:19.827 INFO:teuthology.orchestra.run.smithi062.stderr:Exception in thread Thread-53: 2019-11-29T17:31:19.827 INFO:teuthology.orchestra.run.smithi062.stderr:Traceback (most recent call last): 2019-11-29T17:31:19.827 INFO:teuthology.orchestra.run.smithi062.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-29T17:31:19.827 INFO:teuthology.orchestra.run.smithi062.stderr: self.run() 2019-11-29T17:31:19.827 INFO:teuthology.orchestra.run.smithi062.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-29T17:31:19.827 INFO:teuthology.orchestra.run.smithi062.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-29T17:31:19.828 INFO:teuthology.orchestra.run.smithi062.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-29T17:31:19.828 INFO:teuthology.orchestra.run.smithi062.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-29T17:31:19.828 INFO:teuthology.orchestra.run.smithi062.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-29T17:31:19.828 INFO:teuthology.orchestra.run.smithi062.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-29T17:31:19.828 INFO:teuthology.orchestra.run.smithi062.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-29T17:31:19.828 INFO:teuthology.orchestra.run.smithi062.stderr: raise error_class(parsed_response, operation_name) 2019-11-29T17:31:19.828 INFO:teuthology.orchestra.run.smithi062.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-29T17:31:19.829 INFO:teuthology.orchestra.run.smithi062.stderr: 2019-11-29T17:31:19.929 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:05:06:00.532 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T17:31:20.454 INFO:teuthology.orchestra.run.smithi062.stderr:Exception in thread Thread-52: 2019-11-29T17:31:20.454 INFO:teuthology.orchestra.run.smithi062.stderr:Traceback (most recent call last): 2019-11-29T17:31:20.454 INFO:teuthology.orchestra.run.smithi062.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-29T17:31:20.455 INFO:teuthology.orchestra.run.smithi062.stderr: self.run() 2019-11-29T17:31:20.455 INFO:teuthology.orchestra.run.smithi062.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-29T17:31:20.455 INFO:teuthology.orchestra.run.smithi062.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-29T17:31:20.455 INFO:teuthology.orchestra.run.smithi062.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-29T17:31:20.455 INFO:teuthology.orchestra.run.smithi062.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-29T17:31:20.455 INFO:teuthology.orchestra.run.smithi062.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-29T17:31:20.455 INFO:teuthology.orchestra.run.smithi062.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-29T17:31:20.456 INFO:teuthology.orchestra.run.smithi062.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-29T17:31:20.456 INFO:teuthology.orchestra.run.smithi062.stderr: raise error_class(parsed_response, operation_name) 2019-11-29T17:31:20.456 INFO:teuthology.orchestra.run.smithi062.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-29T17:31:20.456 INFO:teuthology.orchestra.run.smithi062.stderr: 2019-11-29T17:31:32.425 INFO:teuthology.orchestra.run.smithi062.stderr:Exception in thread Thread-62: 2019-11-29T17:31:32.426 INFO:teuthology.orchestra.run.smithi062.stderr:Traceback (most recent call last): 2019-11-29T17:31:32.426 INFO:teuthology.orchestra.run.smithi062.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-29T17:31:32.426 INFO:teuthology.orchestra.run.smithi062.stderr: self.run() 2019-11-29T17:31:32.426 INFO:teuthology.orchestra.run.smithi062.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-29T17:31:32.426 INFO:teuthology.orchestra.run.smithi062.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-29T17:31:32.426 INFO:teuthology.orchestra.run.smithi062.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-29T17:31:32.427 INFO:teuthology.orchestra.run.smithi062.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-29T17:31:32.427 INFO:teuthology.orchestra.run.smithi062.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-29T17:31:32.427 INFO:teuthology.orchestra.run.smithi062.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-29T17:31:32.427 INFO:teuthology.orchestra.run.smithi062.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-29T17:31:32.427 INFO:teuthology.orchestra.run.smithi062.stderr: raise error_class(parsed_response, operation_name) 2019-11-29T17:31:32.427 INFO:teuthology.orchestra.run.smithi062.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-29T17:31:32.427 INFO:teuthology.orchestra.run.smithi062.stderr: 2019-11-29T17:31:33.012 INFO:teuthology.orchestra.run.smithi062.stderr:Exception in thread Thread-61: 2019-11-29T17:31:33.012 INFO:teuthology.orchestra.run.smithi062.stderr:Traceback (most recent call last): 2019-11-29T17:31:33.013 INFO:teuthology.orchestra.run.smithi062.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-29T17:31:33.013 INFO:teuthology.orchestra.run.smithi062.stderr: self.run() 2019-11-29T17:31:33.013 INFO:teuthology.orchestra.run.smithi062.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-29T17:31:33.013 INFO:teuthology.orchestra.run.smithi062.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-29T17:31:33.013 INFO:teuthology.orchestra.run.smithi062.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-29T17:31:33.013 INFO:teuthology.orchestra.run.smithi062.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-29T17:31:33.013 INFO:teuthology.orchestra.run.smithi062.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-29T17:31:33.014 INFO:teuthology.orchestra.run.smithi062.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-29T17:31:33.014 INFO:teuthology.orchestra.run.smithi062.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-29T17:31:33.014 INFO:teuthology.orchestra.run.smithi062.stderr: raise error_class(parsed_response, operation_name) 2019-11-29T17:31:33.014 INFO:teuthology.orchestra.run.smithi062.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-29T17:31:33.014 INFO:teuthology.orchestra.run.smithi062.stderr: 2019-11-29T17:31:33.228 INFO:teuthology.orchestra.run.smithi062.stderr:Exception in thread Thread-65: 2019-11-29T17:31:33.229 INFO:teuthology.orchestra.run.smithi062.stderr:Traceback (most recent call last): 2019-11-29T17:31:33.229 INFO:teuthology.orchestra.run.smithi062.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-29T17:31:33.229 INFO:teuthology.orchestra.run.smithi062.stderr: self.run() 2019-11-29T17:31:33.229 INFO:teuthology.orchestra.run.smithi062.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-29T17:31:33.229 INFO:teuthology.orchestra.run.smithi062.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-29T17:31:33.229 INFO:teuthology.orchestra.run.smithi062.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-29T17:31:33.229 INFO:teuthology.orchestra.run.smithi062.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-29T17:31:33.230 INFO:teuthology.orchestra.run.smithi062.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-29T17:31:33.230 INFO:teuthology.orchestra.run.smithi062.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-29T17:31:33.230 INFO:teuthology.orchestra.run.smithi062.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-29T17:31:33.230 INFO:teuthology.orchestra.run.smithi062.stderr: raise error_class(parsed_response, operation_name) 2019-11-29T17:31:33.230 INFO:teuthology.orchestra.run.smithi062.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-29T17:31:33.230 INFO:teuthology.orchestra.run.smithi062.stderr: 2019-11-29T17:31:47.766 INFO:teuthology.orchestra.run.smithi062.stderr:Exception in thread Thread-71: 2019-11-29T17:31:47.766 INFO:teuthology.orchestra.run.smithi062.stderr:Traceback (most recent call last): 2019-11-29T17:31:47.766 INFO:teuthology.orchestra.run.smithi062.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-29T17:31:47.767 INFO:teuthology.orchestra.run.smithi062.stderr: self.run() 2019-11-29T17:31:47.767 INFO:teuthology.orchestra.run.smithi062.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-29T17:31:47.767 INFO:teuthology.orchestra.run.smithi062.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-29T17:31:47.767 INFO:teuthology.orchestra.run.smithi062.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-29T17:31:47.767 INFO:teuthology.orchestra.run.smithi062.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-29T17:31:47.767 INFO:teuthology.orchestra.run.smithi062.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-29T17:31:47.767 INFO:teuthology.orchestra.run.smithi062.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-29T17:31:47.768 INFO:teuthology.orchestra.run.smithi062.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-29T17:31:47.768 INFO:teuthology.orchestra.run.smithi062.stderr: raise error_class(parsed_response, operation_name) 2019-11-29T17:31:47.768 INFO:teuthology.orchestra.run.smithi062.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-29T17:31:47.768 INFO:teuthology.orchestra.run.smithi062.stderr: 2019-11-29T17:31:48.327 INFO:teuthology.orchestra.run.smithi062.stderr:Exception in thread Thread-72: 2019-11-29T17:31:48.327 INFO:teuthology.orchestra.run.smithi062.stderr:Traceback (most recent call last): 2019-11-29T17:31:48.327 INFO:teuthology.orchestra.run.smithi062.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-29T17:31:48.327 INFO:teuthology.orchestra.run.smithi062.stderr: self.run() 2019-11-29T17:31:48.327 INFO:teuthology.orchestra.run.smithi062.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-29T17:31:48.328 INFO:teuthology.orchestra.run.smithi062.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-29T17:31:48.328 INFO:teuthology.orchestra.run.smithi062.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-29T17:31:48.328 INFO:teuthology.orchestra.run.smithi062.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-29T17:31:48.328 INFO:teuthology.orchestra.run.smithi062.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-29T17:31:48.328 INFO:teuthology.orchestra.run.smithi062.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-29T17:31:48.328 INFO:teuthology.orchestra.run.smithi062.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-29T17:31:48.328 INFO:teuthology.orchestra.run.smithi062.stderr: raise error_class(parsed_response, operation_name) 2019-11-29T17:31:48.329 INFO:teuthology.orchestra.run.smithi062.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-29T17:31:48.329 INFO:teuthology.orchestra.run.smithi062.stderr: 2019-11-29T17:31:48.361 INFO:teuthology.orchestra.run.smithi062.stderr:Exception in thread Thread-75: 2019-11-29T17:31:48.361 INFO:teuthology.orchestra.run.smithi062.stderr:Traceback (most recent call last): 2019-11-29T17:31:48.361 INFO:teuthology.orchestra.run.smithi062.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-29T17:31:48.361 INFO:teuthology.orchestra.run.smithi062.stderr: self.run() 2019-11-29T17:31:48.362 INFO:teuthology.orchestra.run.smithi062.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-29T17:31:48.362 INFO:teuthology.orchestra.run.smithi062.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-29T17:31:48.362 INFO:teuthology.orchestra.run.smithi062.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-29T17:31:48.362 INFO:teuthology.orchestra.run.smithi062.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-29T17:31:48.362 INFO:teuthology.orchestra.run.smithi062.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-29T17:31:48.362 INFO:teuthology.orchestra.run.smithi062.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-29T17:31:48.362 INFO:teuthology.orchestra.run.smithi062.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-29T17:31:48.363 INFO:teuthology.orchestra.run.smithi062.stderr: raise error_class(parsed_response, operation_name) 2019-11-29T17:31:48.363 INFO:teuthology.orchestra.run.smithi062.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-29T17:31:48.363 INFO:teuthology.orchestra.run.smithi062.stderr: 2019-11-29T17:31:48.366 INFO:teuthology.orchestra.run.smithi062.stderr:Exception in thread Thread-73: 2019-11-29T17:31:48.366 INFO:teuthology.orchestra.run.smithi062.stderr:Traceback (most recent call last): 2019-11-29T17:31:48.366 INFO:teuthology.orchestra.run.smithi062.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-29T17:31:48.366 INFO:teuthology.orchestra.run.smithi062.stderr: self.run() 2019-11-29T17:31:48.366 INFO:teuthology.orchestra.run.smithi062.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-29T17:31:48.366 INFO:teuthology.orchestra.run.smithi062.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-29T17:31:48.366 INFO:teuthology.orchestra.run.smithi062.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-29T17:31:48.367 INFO:teuthology.orchestra.run.smithi062.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-29T17:31:48.367 INFO:teuthology.orchestra.run.smithi062.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-29T17:31:48.367 INFO:teuthology.orchestra.run.smithi062.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-29T17:31:48.367 INFO:teuthology.orchestra.run.smithi062.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-29T17:31:48.367 INFO:teuthology.orchestra.run.smithi062.stderr: raise error_class(parsed_response, operation_name) 2019-11-29T17:31:48.367 INFO:teuthology.orchestra.run.smithi062.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-29T17:31:48.367 INFO:teuthology.orchestra.run.smithi062.stderr: 2019-11-29T17:32:04.002 INFO:teuthology.orchestra.run.smithi062.stderr:Exception in thread Thread-85: 2019-11-29T17:32:04.002 INFO:teuthology.orchestra.run.smithi062.stderr:Traceback (most recent call last): 2019-11-29T17:32:04.002 INFO:teuthology.orchestra.run.smithi062.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-29T17:32:04.002 INFO:teuthology.orchestra.run.smithi062.stderr: self.run() 2019-11-29T17:32:04.002 INFO:teuthology.orchestra.run.smithi062.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-29T17:32:04.003 INFO:teuthology.orchestra.run.smithi062.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-29T17:32:04.003 INFO:teuthology.orchestra.run.smithi062.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-29T17:32:04.003 INFO:teuthology.orchestra.run.smithi062.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-29T17:32:04.003 INFO:teuthology.orchestra.run.smithi062.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-29T17:32:04.003 INFO:teuthology.orchestra.run.smithi062.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-29T17:32:04.004 INFO:teuthology.orchestra.run.smithi062.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-29T17:32:04.004 INFO:teuthology.orchestra.run.smithi062.stderr: raise error_class(parsed_response, operation_name) 2019-11-29T17:32:04.004 INFO:teuthology.orchestra.run.smithi062.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-29T17:32:04.004 INFO:teuthology.orchestra.run.smithi062.stderr: 2019-11-29T17:32:04.040 INFO:teuthology.orchestra.run.smithi062.stderr:Exception in thread Thread-82: 2019-11-29T17:32:04.040 INFO:teuthology.orchestra.run.smithi062.stderr:Traceback (most recent call last): 2019-11-29T17:32:04.041 INFO:teuthology.orchestra.run.smithi062.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-29T17:32:04.041 INFO:teuthology.orchestra.run.smithi062.stderr: self.run() 2019-11-29T17:32:04.041 INFO:teuthology.orchestra.run.smithi062.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-29T17:32:04.041 INFO:teuthology.orchestra.run.smithi062.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-29T17:32:04.041 INFO:teuthology.orchestra.run.smithi062.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-29T17:32:04.041 INFO:teuthology.orchestra.run.smithi062.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-29T17:32:04.041 INFO:teuthology.orchestra.run.smithi062.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-29T17:32:04.042 INFO:teuthology.orchestra.run.smithi062.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-29T17:32:04.042 INFO:teuthology.orchestra.run.smithi062.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-29T17:32:04.042 INFO:teuthology.orchestra.run.smithi062.stderr: raise error_class(parsed_response, operation_name) 2019-11-29T17:32:04.042 INFO:teuthology.orchestra.run.smithi062.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-29T17:32:04.042 INFO:teuthology.orchestra.run.smithi062.stderr: 2019-11-29T17:32:04.131 INFO:teuthology.orchestra.run.smithi062.stderr:Exception in thread Thread-84: 2019-11-29T17:32:04.131 INFO:teuthology.orchestra.run.smithi062.stderr:Traceback (most recent call last): 2019-11-29T17:32:04.131 INFO:teuthology.orchestra.run.smithi062.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-29T17:32:04.132 INFO:teuthology.orchestra.run.smithi062.stderr: self.run() 2019-11-29T17:32:04.132 INFO:teuthology.orchestra.run.smithi062.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-29T17:32:04.132 INFO:teuthology.orchestra.run.smithi062.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-29T17:32:04.132 INFO:teuthology.orchestra.run.smithi062.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-29T17:32:04.132 INFO:teuthology.orchestra.run.smithi062.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-29T17:32:04.132 INFO:teuthology.orchestra.run.smithi062.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-29T17:32:04.133 INFO:teuthology.orchestra.run.smithi062.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-29T17:32:04.133 INFO:teuthology.orchestra.run.smithi062.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-29T17:32:04.133 INFO:teuthology.orchestra.run.smithi062.stderr: raise error_class(parsed_response, operation_name) 2019-11-29T17:32:04.133 INFO:teuthology.orchestra.run.smithi062.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-29T17:32:04.133 INFO:teuthology.orchestra.run.smithi062.stderr: 2019-11-29T17:32:04.143 INFO:teuthology.orchestra.run.smithi062.stderr:Exception in thread Thread-81: 2019-11-29T17:32:04.143 INFO:teuthology.orchestra.run.smithi062.stderr:Traceback (most recent call last): 2019-11-29T17:32:04.144 INFO:teuthology.orchestra.run.smithi062.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-29T17:32:04.144 INFO:teuthology.orchestra.run.smithi062.stderr: self.run() 2019-11-29T17:32:04.144 INFO:teuthology.orchestra.run.smithi062.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-29T17:32:04.144 INFO:teuthology.orchestra.run.smithi062.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-29T17:32:04.144 INFO:teuthology.orchestra.run.smithi062.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-29T17:32:04.144 INFO:teuthology.orchestra.run.smithi062.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-29T17:32:04.144 INFO:teuthology.orchestra.run.smithi062.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-29T17:32:04.145 INFO:teuthology.orchestra.run.smithi062.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-29T17:32:04.145 INFO:teuthology.orchestra.run.smithi062.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-29T17:32:04.145 INFO:teuthology.orchestra.run.smithi062.stderr: raise error_class(parsed_response, operation_name) 2019-11-29T17:32:04.145 INFO:teuthology.orchestra.run.smithi062.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-29T17:32:04.145 INFO:teuthology.orchestra.run.smithi062.stderr: 2019-11-29T17:32:18.606 INFO:teuthology.orchestra.run.smithi062.stderr:Exception in thread Thread-94: 2019-11-29T17:32:18.606 INFO:teuthology.orchestra.run.smithi062.stderr:Traceback (most recent call last): 2019-11-29T17:32:18.607 INFO:teuthology.orchestra.run.smithi062.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-29T17:32:18.607 INFO:teuthology.orchestra.run.smithi062.stderr: self.run() 2019-11-29T17:32:18.607 INFO:teuthology.orchestra.run.smithi062.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-29T17:32:18.607 INFO:teuthology.orchestra.run.smithi062.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-29T17:32:18.607 INFO:teuthology.orchestra.run.smithi062.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-29T17:32:18.607 INFO:teuthology.orchestra.run.smithi062.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-29T17:32:18.607 INFO:teuthology.orchestra.run.smithi062.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-29T17:32:18.608 INFO:teuthology.orchestra.run.smithi062.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-29T17:32:18.608 INFO:teuthology.orchestra.run.smithi062.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-29T17:32:18.608 INFO:teuthology.orchestra.run.smithi062.stderr: raise error_class(parsed_response, operation_name) 2019-11-29T17:32:18.608 INFO:teuthology.orchestra.run.smithi062.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-29T17:32:18.608 INFO:teuthology.orchestra.run.smithi062.stderr: 2019-11-29T17:32:18.822 INFO:teuthology.orchestra.run.smithi062.stderr:Exception in thread Thread-91: 2019-11-29T17:32:18.822 INFO:teuthology.orchestra.run.smithi062.stderr:Traceback (most recent call last): 2019-11-29T17:32:18.822 INFO:teuthology.orchestra.run.smithi062.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-29T17:32:18.823 INFO:teuthology.orchestra.run.smithi062.stderr: self.run() 2019-11-29T17:32:18.823 INFO:teuthology.orchestra.run.smithi062.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-29T17:32:18.823 INFO:teuthology.orchestra.run.smithi062.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-29T17:32:18.823 INFO:teuthology.orchestra.run.smithi062.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-29T17:32:18.823 INFO:teuthology.orchestra.run.smithi062.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-29T17:32:18.823 INFO:teuthology.orchestra.run.smithi062.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-29T17:32:18.823 INFO:teuthology.orchestra.run.smithi062.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-29T17:32:18.824 INFO:teuthology.orchestra.run.smithi062.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-29T17:32:18.824 INFO:teuthology.orchestra.run.smithi062.stderr: raise error_class(parsed_response, operation_name) 2019-11-29T17:32:18.824 INFO:teuthology.orchestra.run.smithi062.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-29T17:32:18.824 INFO:teuthology.orchestra.run.smithi062.stderr: 2019-11-29T17:32:18.874 INFO:teuthology.orchestra.run.smithi062.stderr:Exception in thread Thread-95: 2019-11-29T17:32:18.874 INFO:teuthology.orchestra.run.smithi062.stderr:Traceback (most recent call last): 2019-11-29T17:32:18.874 INFO:teuthology.orchestra.run.smithi062.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-29T17:32:18.875 INFO:teuthology.orchestra.run.smithi062.stderr: self.run() 2019-11-29T17:32:18.875 INFO:teuthology.orchestra.run.smithi062.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-29T17:32:18.875 INFO:teuthology.orchestra.run.smithi062.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-29T17:32:18.875 INFO:teuthology.orchestra.run.smithi062.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-29T17:32:18.875 INFO:teuthology.orchestra.run.smithi062.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-29T17:32:18.875 INFO:teuthology.orchestra.run.smithi062.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-29T17:32:18.875 INFO:teuthology.orchestra.run.smithi062.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-29T17:32:18.876 INFO:teuthology.orchestra.run.smithi062.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-29T17:32:18.876 INFO:teuthology.orchestra.run.smithi062.stderr: raise error_class(parsed_response, operation_name) 2019-11-29T17:32:18.876 INFO:teuthology.orchestra.run.smithi062.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-29T17:32:18.876 INFO:teuthology.orchestra.run.smithi062.stderr: 2019-11-29T17:32:19.024 INFO:teuthology.orchestra.run.smithi062.stderr:Exception in thread Thread-93: 2019-11-29T17:32:19.024 INFO:teuthology.orchestra.run.smithi062.stderr:Traceback (most recent call last): 2019-11-29T17:32:19.024 INFO:teuthology.orchestra.run.smithi062.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-29T17:32:19.024 INFO:teuthology.orchestra.run.smithi062.stderr: self.run() 2019-11-29T17:32:19.025 INFO:teuthology.orchestra.run.smithi062.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-29T17:32:19.025 INFO:teuthology.orchestra.run.smithi062.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-29T17:32:19.025 INFO:teuthology.orchestra.run.smithi062.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-29T17:32:19.025 INFO:teuthology.orchestra.run.smithi062.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-29T17:32:19.025 INFO:teuthology.orchestra.run.smithi062.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-29T17:32:19.025 INFO:teuthology.orchestra.run.smithi062.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-29T17:32:19.025 INFO:teuthology.orchestra.run.smithi062.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-29T17:32:19.026 INFO:teuthology.orchestra.run.smithi062.stderr: raise error_class(parsed_response, operation_name) 2019-11-29T17:32:19.026 INFO:teuthology.orchestra.run.smithi062.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-29T17:32:19.026 INFO:teuthology.orchestra.run.smithi062.stderr: 2019-11-29T17:32:29.751 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T17:32:30.166 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_versioned_concurrent_object_create_and_remove ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:32:30.166 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:32:33.779 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:32:33.779 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:32:35.199 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:32:35.200 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:32:35.452 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:32:35.452 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:32:35.685 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:32:35.685 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:32:35.868 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:32:35.868 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:32:36.709 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:32:36.710 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:32:36.941 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:32:36.942 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:32:37.180 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:32:37.180 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:32:38.453 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:32:38.453 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:32:38.729 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:32:38.729 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:32:39.169 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:32:39.169 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:32:40.945 INFO:teuthology.orchestra.run.smithi062.stderr:Exception in thread Thread-102: 2019-11-29T17:32:40.945 INFO:teuthology.orchestra.run.smithi062.stderr:Traceback (most recent call last): 2019-11-29T17:32:40.945 INFO:teuthology.orchestra.run.smithi062.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-29T17:32:40.946 INFO:teuthology.orchestra.run.smithi062.stderr: self.run() 2019-11-29T17:32:40.946 INFO:teuthology.orchestra.run.smithi062.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-29T17:32:40.946 INFO:teuthology.orchestra.run.smithi062.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-29T17:32:40.946 INFO:teuthology.orchestra.run.smithi062.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-29T17:32:40.946 INFO:teuthology.orchestra.run.smithi062.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-29T17:32:40.946 INFO:teuthology.orchestra.run.smithi062.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-29T17:32:40.947 INFO:teuthology.orchestra.run.smithi062.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-29T17:32:40.947 INFO:teuthology.orchestra.run.smithi062.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-29T17:32:40.947 INFO:teuthology.orchestra.run.smithi062.stderr: raise error_class(parsed_response, operation_name) 2019-11-29T17:32:40.947 INFO:teuthology.orchestra.run.smithi062.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-29T17:32:40.947 INFO:teuthology.orchestra.run.smithi062.stderr: 2019-11-29T17:32:40.972 INFO:teuthology.orchestra.run.smithi062.stderr:Exception in thread Thread-106: 2019-11-29T17:32:40.972 INFO:teuthology.orchestra.run.smithi062.stderr:Traceback (most recent call last): 2019-11-29T17:32:40.972 INFO:teuthology.orchestra.run.smithi062.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-29T17:32:40.972 INFO:teuthology.orchestra.run.smithi062.stderr: self.run() 2019-11-29T17:32:40.973 INFO:teuthology.orchestra.run.smithi062.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-29T17:32:40.973 INFO:teuthology.orchestra.run.smithi062.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-29T17:32:40.973 INFO:teuthology.orchestra.run.smithi062.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-29T17:32:40.973 INFO:teuthology.orchestra.run.smithi062.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-29T17:32:40.973 INFO:teuthology.orchestra.run.smithi062.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-29T17:32:40.973 INFO:teuthology.orchestra.run.smithi062.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-29T17:32:40.973 INFO:teuthology.orchestra.run.smithi062.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-29T17:32:40.974 INFO:teuthology.orchestra.run.smithi062.stderr: raise error_class(parsed_response, operation_name) 2019-11-29T17:32:40.974 INFO:teuthology.orchestra.run.smithi062.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-29T17:32:40.974 INFO:teuthology.orchestra.run.smithi062.stderr: 2019-11-29T17:32:40.995 INFO:teuthology.orchestra.run.smithi062.stderr:Exception in thread Thread-105: 2019-11-29T17:32:40.995 INFO:teuthology.orchestra.run.smithi062.stderr:Traceback (most recent call last): 2019-11-29T17:32:40.995 INFO:teuthology.orchestra.run.smithi062.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-29T17:32:40.996 INFO:teuthology.orchestra.run.smithi062.stderr: self.run() 2019-11-29T17:32:40.996 INFO:teuthology.orchestra.run.smithi062.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-29T17:32:40.996 INFO:teuthology.orchestra.run.smithi062.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-29T17:32:40.996 INFO:teuthology.orchestra.run.smithi062.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-29T17:32:40.996 INFO:teuthology.orchestra.run.smithi062.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-29T17:32:40.996 INFO:teuthology.orchestra.run.smithi062.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-29T17:32:40.997 INFO:teuthology.orchestra.run.smithi062.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-29T17:32:40.997 INFO:teuthology.orchestra.run.smithi062.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-29T17:32:40.997 INFO:teuthology.orchestra.run.smithi062.stderr: raise error_class(parsed_response, operation_name) 2019-11-29T17:32:40.997 INFO:teuthology.orchestra.run.smithi062.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-29T17:32:40.997 INFO:teuthology.orchestra.run.smithi062.stderr: 2019-11-29T17:32:40.999 INFO:teuthology.orchestra.run.smithi062.stderr:Exception in thread Thread-104: 2019-11-29T17:32:41.000 INFO:teuthology.orchestra.run.smithi062.stderr:Traceback (most recent call last): 2019-11-29T17:32:41.000 INFO:teuthology.orchestra.run.smithi062.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-29T17:32:41.000 INFO:teuthology.orchestra.run.smithi062.stderr: self.run() 2019-11-29T17:32:41.000 INFO:teuthology.orchestra.run.smithi062.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-29T17:32:41.000 INFO:teuthology.orchestra.run.smithi062.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-29T17:32:41.001 INFO:teuthology.orchestra.run.smithi062.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-29T17:32:41.001 INFO:teuthology.orchestra.run.smithi062.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-29T17:32:41.001 INFO:teuthology.orchestra.run.smithi062.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-29T17:32:41.001 INFO:teuthology.orchestra.run.smithi062.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-29T17:32:41.001 INFO:teuthology.orchestra.run.smithi062.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-29T17:32:41.001 INFO:teuthology.orchestra.run.smithi062.stderr: raise error_class(parsed_response, operation_name) 2019-11-29T17:32:41.002 INFO:teuthology.orchestra.run.smithi062.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-29T17:32:41.002 INFO:teuthology.orchestra.run.smithi062.stderr: 2019-11-29T17:32:41.650 INFO:teuthology.orchestra.run.smithi062.stderr:Exception in thread Thread-109: 2019-11-29T17:32:41.650 INFO:teuthology.orchestra.run.smithi062.stderr:Traceback (most recent call last): 2019-11-29T17:32:41.651 INFO:teuthology.orchestra.run.smithi062.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-29T17:32:41.651 INFO:teuthology.orchestra.run.smithi062.stderr: self.run() 2019-11-29T17:32:41.651 INFO:teuthology.orchestra.run.smithi062.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-29T17:32:41.651 INFO:teuthology.orchestra.run.smithi062.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-29T17:32:41.651 INFO:teuthology.orchestra.run.smithi062.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-29T17:32:41.651 INFO:teuthology.orchestra.run.smithi062.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-29T17:32:41.652 INFO:teuthology.orchestra.run.smithi062.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-29T17:32:41.652 INFO:teuthology.orchestra.run.smithi062.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-29T17:32:41.652 INFO:teuthology.orchestra.run.smithi062.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-29T17:32:41.652 INFO:teuthology.orchestra.run.smithi062.stderr: raise error_class(parsed_response, operation_name) 2019-11-29T17:32:41.652 INFO:teuthology.orchestra.run.smithi062.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-29T17:32:41.652 INFO:teuthology.orchestra.run.smithi062.stderr: 2019-11-29T17:32:41.678 INFO:teuthology.orchestra.run.smithi062.stderr:Exception in thread Thread-108: 2019-11-29T17:32:41.679 INFO:teuthology.orchestra.run.smithi062.stderr:Traceback (most recent call last): 2019-11-29T17:32:41.679 INFO:teuthology.orchestra.run.smithi062.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-29T17:32:41.679 INFO:teuthology.orchestra.run.smithi062.stderr: self.run() 2019-11-29T17:32:41.679 INFO:teuthology.orchestra.run.smithi062.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-29T17:32:41.679 INFO:teuthology.orchestra.run.smithi062.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-29T17:32:41.679 INFO:teuthology.orchestra.run.smithi062.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-29T17:32:41.680 INFO:teuthology.orchestra.run.smithi062.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-29T17:32:41.680 INFO:teuthology.orchestra.run.smithi062.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-29T17:32:41.680 INFO:teuthology.orchestra.run.smithi062.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-29T17:32:41.680 INFO:teuthology.orchestra.run.smithi062.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-29T17:32:41.680 INFO:teuthology.orchestra.run.smithi062.stderr: raise error_class(parsed_response, operation_name) 2019-11-29T17:32:41.680 INFO:teuthology.orchestra.run.smithi062.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-29T17:32:41.680 INFO:teuthology.orchestra.run.smithi062.stderr: 2019-11-29T17:32:42.024 INFO:teuthology.orchestra.run.smithi062.stderr:Exception in thread Thread-107: 2019-11-29T17:32:42.024 INFO:teuthology.orchestra.run.smithi062.stderr:Traceback (most recent call last): 2019-11-29T17:32:42.024 INFO:teuthology.orchestra.run.smithi062.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-29T17:32:42.025 INFO:teuthology.orchestra.run.smithi062.stderr: self.run() 2019-11-29T17:32:42.025 INFO:teuthology.orchestra.run.smithi062.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-29T17:32:42.025 INFO:teuthology.orchestra.run.smithi062.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-29T17:32:42.025 INFO:teuthology.orchestra.run.smithi062.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-29T17:32:42.025 INFO:teuthology.orchestra.run.smithi062.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-29T17:32:42.025 INFO:teuthology.orchestra.run.smithi062.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-29T17:32:42.025 INFO:teuthology.orchestra.run.smithi062.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-29T17:32:42.026 INFO:teuthology.orchestra.run.smithi062.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-29T17:32:42.026 INFO:teuthology.orchestra.run.smithi062.stderr: raise error_class(parsed_response, operation_name) 2019-11-29T17:32:42.026 INFO:teuthology.orchestra.run.smithi062.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-29T17:32:42.026 INFO:teuthology.orchestra.run.smithi062.stderr: 2019-11-29T17:32:42.059 INFO:teuthology.orchestra.run.smithi062.stderr:Exception in thread Thread-103: 2019-11-29T17:32:42.060 INFO:teuthology.orchestra.run.smithi062.stderr:Traceback (most recent call last): 2019-11-29T17:32:42.060 INFO:teuthology.orchestra.run.smithi062.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-29T17:32:42.060 INFO:teuthology.orchestra.run.smithi062.stderr: self.run() 2019-11-29T17:32:42.060 INFO:teuthology.orchestra.run.smithi062.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-29T17:32:42.060 INFO:teuthology.orchestra.run.smithi062.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-29T17:32:42.060 INFO:teuthology.orchestra.run.smithi062.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-29T17:32:42.061 INFO:teuthology.orchestra.run.smithi062.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-29T17:32:42.061 INFO:teuthology.orchestra.run.smithi062.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-29T17:32:42.061 INFO:teuthology.orchestra.run.smithi062.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-29T17:32:42.061 INFO:teuthology.orchestra.run.smithi062.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-29T17:32:42.061 INFO:teuthology.orchestra.run.smithi062.stderr: raise error_class(parsed_response, operation_name) 2019-11-29T17:32:42.061 INFO:teuthology.orchestra.run.smithi062.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-29T17:32:42.062 INFO:teuthology.orchestra.run.smithi062.stderr: 2019-11-29T17:32:47.946 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:05:07:28.602 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T17:32:47.953 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:05:07:28.609 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T17:32:47.966 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:05:07:28.571 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T17:32:47.969 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:05:07:28.574 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T17:32:47.971 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:05:07:28.576 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T17:32:47.974 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:05:07:28.579 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T17:32:48.044 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:05:07:28.699 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T17:32:48.046 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:05:07:28.651 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T17:32:48.051 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:05:07:28.657 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T17:33:00.316 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T17:33:00.693 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_lifecycle_set ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:33:00.693 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:33:03.965 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:33:03.965 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:33:06.099 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T17:33:06.470 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_lifecycle_get ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:33:06.470 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:33:09.766 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:33:09.766 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:33:12.545 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T17:33:13.003 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_lifecycle_get_no_id ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:33:13.004 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:33:16.715 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:33:16.716 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:33:19.077 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T17:33:19.292 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_lifecycle_id_too_long ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:33:19.293 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:33:21.876 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:33:21.876 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:33:22.069 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T17:33:22.574 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_lifecycle_same_id ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:33:22.575 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:33:25.208 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:33:25.208 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:33:25.404 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T17:33:25.857 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_lifecycle_invalid_status ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:33:25.857 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:33:28.260 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:33:28.261 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:33:28.921 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T17:33:29.161 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_lifecycle_set_date ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:33:29.161 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:33:33.183 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:33:33.183 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:33:35.303 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T17:33:35.752 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_lifecycle_set_invalid_date ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:33:35.752 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:33:38.741 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:33:38.741 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:33:39.007 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T17:33:39.289 INFO:teuthology.orchestra.run.smithi062.stderr:Check for valid x-amz-expiration header after PUT ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:33:39.289 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:33:42.192 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:33:42.192 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:33:44.982 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T17:33:45.245 INFO:teuthology.orchestra.run.smithi062.stderr:Check for valid x-amz-expiration header on HEAD request ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:33:45.245 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:33:48.105 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:33:48.106 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:33:53.751 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:33:53.751 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:33:53.985 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T17:33:54.252 INFO:teuthology.orchestra.run.smithi062.stderr:Check for valid x-amz-expiration header on GET request ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:33:54.252 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:33:56.939 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:33:56.939 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:34:01.456 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:34:01.457 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:34:01.685 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T17:34:02.032 INFO:teuthology.orchestra.run.smithi062.stderr:Check x-amz-expiration-header object tags interaction ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:34:02.032 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:34:05.119 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:34:05.120 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:34:13.062 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T17:34:13.312 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_lifecycle_set_noncurrent ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:34:13.312 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:34:19.767 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:34:19.767 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:34:22.819 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T17:34:23.487 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_lifecycle_set_deletemarker ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:34:23.487 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:34:26.283 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:34:26.283 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:34:29.305 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T17:34:29.745 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_lifecycle_set_filter ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:34:29.746 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:34:32.985 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:34:32.985 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:34:35.127 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T17:34:35.388 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_lifecycle_set_empty_filter ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:34:35.389 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:34:39.487 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:34:39.487 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:34:41.387 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T17:34:41.831 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_lifecycle_set_multipart ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:34:41.831 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:34:45.176 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:34:45.176 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:34:47.132 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T17:34:47.431 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_encrypted_transfer_1b ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:34:47.431 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:34:50.817 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:34:50.817 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:34:52.142 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T17:34:52.557 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_encrypted_transfer_1kb ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:34:52.558 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:34:55.393 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:34:55.393 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:34:56.803 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T17:34:57.114 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_encrypted_transfer_1MB ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:34:57.114 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:34:58.737 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:34:58.737 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:35:03.079 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T17:35:03.574 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_encrypted_transfer_13b ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:35:03.575 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:35:06.769 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:35:06.769 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:35:08.995 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T17:35:09.375 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_encryption_sse_c_method_head ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:35:09.376 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:35:12.624 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:35:12.624 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:35:15.792 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T17:35:16.167 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_encryption_sse_c_present ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:35:16.167 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:35:18.570 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:35:18.570 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:35:20.407 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T17:35:20.614 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_encryption_sse_c_other_key ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:35:20.615 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:35:24.202 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:35:24.203 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:35:26.518 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T17:35:26.766 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_encryption_sse_c_invalid_md5 ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:35:26.766 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:35:29.847 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:35:29.847 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:35:30.044 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T17:35:30.326 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_encryption_sse_c_no_md5 ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:35:30.327 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:35:32.669 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:35:32.670 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:35:33.156 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T17:35:33.435 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_encryption_sse_c_no_key ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:35:33.436 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:35:35.979 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:35:35.980 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:35:36.189 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T17:35:36.547 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_encryption_key_no_sse_c ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:35:36.548 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:35:40.182 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:35:40.183 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:35:40.367 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T17:35:40.619 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_encryption_sse_c_multipart_upload ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:35:40.619 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:35:44.244 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:35:44.244 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:36:05.584 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:05:10:46.240 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T17:36:05.606 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:05:10:46.262 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T17:36:05.642 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:05:10:46.247 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T17:36:05.649 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:05:10:46.254 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T17:36:05.651 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:05:10:46.257 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T17:36:05.653 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:05:10:46.259 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T17:36:05.749 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:05:10:46.354 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T17:36:05.761 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:05:10:46.366 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T17:36:05.802 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:05:10:46.457 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T17:37:36.417 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:37:36.417 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:37:59.866 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:05:12:40.521 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T17:37:59.879 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:05:12:40.534 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T17:37:59.883 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:05:12:40.488 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T17:37:59.886 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:05:12:40.491 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T17:37:59.888 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:05:12:40.493 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T17:37:59.891 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:05:12:40.497 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T17:37:59.990 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:05:12:40.595 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T17:37:59.994 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:05:12:40.599 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T17:38:00.010 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:05:12:40.666 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T17:38:37.286 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:38:37.287 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:39:10.606 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T17:39:10.910 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_encryption_sse_c_multipart_bad_download ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:39:10.911 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:39:13.919 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:39:13.920 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:40:36.963 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:40:36.963 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:40:37.494 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T17:40:37.844 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_encryption_sse_c_post_object_authenticated_request ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:40:37.844 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:40:40.055 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:40:40.055 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:40:41.867 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:40:41.867 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:40:42.292 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T17:40:42.648 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_sse_kms_method_head ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:40:42.648 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:40:45.760 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:40:45.760 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:40:48.445 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T17:40:48.734 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_sse_kms_present ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:40:48.735 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:40:51.990 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:40:51.990 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:40:53.810 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T17:40:54.251 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_sse_kms_no_key ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:40:54.252 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:40:57.239 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:40:57.239 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:40:57.574 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T17:40:57.891 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_sse_kms_not_declared ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:40:57.891 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:41:02.027 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:41:02.028 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:41:02.218 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T17:41:02.473 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_sse_kms_multipart_upload ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:41:02.473 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:41:05.917 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:41:05.917 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:42:58.207 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:42:58.208 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:43:00.063 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:43:00.063 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:43:12.069 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:05:17:52.724 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T17:43:12.077 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:05:17:52.682 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T17:43:12.078 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:05:17:52.733 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T17:43:12.078 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:05:17:52.683 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T17:43:12.081 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:05:17:52.687 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T17:43:12.084 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:05:17:52.689 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T17:43:12.310 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:05:17:52.915 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T17:43:12.324 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:05:17:52.979 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T17:43:12.348 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:05:17:52.953 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T17:44:08.197 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:44:08.197 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:44:11.111 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:44:11.111 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:44:27.463 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:05:19:08.118 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T17:44:27.469 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:05:19:08.124 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T17:44:27.530 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:05:19:08.135 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T17:44:27.531 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:05:19:08.136 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T17:44:27.532 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:05:19:08.137 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T17:44:27.548 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:05:19:08.152 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T17:44:27.565 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:05:19:08.221 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T17:44:27.579 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:05:19:08.184 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T17:44:27.619 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:05:19:08.224 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T17:44:48.114 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T17:44:48.543 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_sse_kms_multipart_invalid_chunks_1 ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:44:48.543 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:44:51.093 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:44:51.093 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:45:58.733 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T17:45:58.961 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_sse_kms_multipart_invalid_chunks_2 ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:45:58.962 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:46:01.770 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:46:01.770 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:47:16.161 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T17:47:16.651 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_sse_kms_post_object_authenticated_request ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:47:16.651 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:47:19.007 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:47:19.007 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:47:20.645 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:47:20.645 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:47:21.571 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T17:47:22.234 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_sse_kms_transfer_1b ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:47:22.235 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:47:25.039 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:47:25.039 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:47:26.866 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T17:47:27.154 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_sse_kms_transfer_1kb ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:47:27.154 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:47:30.081 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:47:30.081 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:47:31.676 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T17:47:32.254 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_sse_kms_transfer_1MB ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:47:32.254 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:47:35.360 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:47:35.360 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:47:39.557 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T17:47:39.962 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_sse_kms_transfer_13b ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:47:39.963 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:47:42.980 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:47:42.981 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:47:44.080 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T17:47:44.392 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_sse_kms_read_declare ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:47:44.392 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:47:47.016 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:47:47.016 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:47:48.351 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T17:47:48.644 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_bucket_policy ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:47:48.644 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:47:51.257 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:47:51.257 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:47:53.552 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:47:53.552 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:47:55.842 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T17:47:56.142 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_bucketv2_policy ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:47:56.142 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:47:59.304 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:47:59.304 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:48:01.758 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:48:01.759 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:48:02.043 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T17:48:02.262 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_bucket_policy_acl ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:48:02.262 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:48:04.565 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:48:04.565 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:48:08.709 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:48:08.709 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:48:11.210 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T17:48:11.505 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_bucketv2_policy_acl ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:48:11.505 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:48:14.921 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:48:14.921 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:48:19.023 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:48:19.023 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:48:21.204 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T17:48:21.482 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_bucket_policy_another_bucket ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:48:21.482 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:48:23.406 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:05:23:04.061 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T17:48:23.414 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:05:23:04.069 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T17:48:23.427 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:05:23:04.032 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T17:48:23.430 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:05:23:04.035 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T17:48:23.431 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:05:23:04.036 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T17:48:23.438 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:05:23:04.043 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T17:48:23.579 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:05:23:04.234 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T17:48:23.594 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:05:23:04.199 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T17:48:23.600 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:05:23:04.205 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T17:48:24.532 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:48:24.532 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:48:26.681 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:48:26.681 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:48:32.983 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:48:32.983 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:48:33.943 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:48:33.944 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:48:34.259 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T17:48:34.522 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_bucketv2_policy_another_bucket ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:48:34.522 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:48:36.767 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:48:36.767 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:48:38.815 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:48:38.816 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:48:42.442 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:48:42.442 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:48:43.360 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:48:43.360 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:48:43.775 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T17:48:44.019 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_get_obj_tagging ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:48:44.019 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:48:47.324 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:48:47.325 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:48:57.266 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:48:57.266 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:48:58.309 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T17:48:58.524 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_get_obj_head_tagging ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:48:58.524 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:49:01.272 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:49:01.273 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:49:10.709 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:49:10.709 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:49:12.183 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T17:49:12.424 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_put_max_tags ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:49:12.424 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:49:15.358 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:49:15.358 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:49:25.322 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:49:25.322 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:49:26.591 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T17:49:27.027 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_put_excess_tags ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:49:27.027 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:49:30.286 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:49:30.286 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:49:43.892 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:49:43.892 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:49:44.771 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T17:49:45.050 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_put_max_kvsize_tags ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:49:45.050 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:49:48.515 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:49:48.515 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:50:03.539 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:50:03.539 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:50:05.344 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T17:50:05.582 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_put_excess_key_tags ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:50:05.582 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:50:08.772 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:50:08.772 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:50:19.443 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:50:19.443 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:50:20.444 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T17:50:20.941 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_put_excess_val_tags ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:50:20.941 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:50:24.982 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:50:24.982 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:50:39.522 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:50:39.522 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:50:40.221 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T17:50:40.968 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_put_modify_tags ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:50:40.969 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:50:43.325 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:50:43.325 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:50:57.127 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:50:57.127 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:51:01.201 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T17:51:01.577 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_put_delete_tags ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:51:01.578 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:51:04.614 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:51:04.615 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:51:18.611 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:51:18.611 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:51:23.310 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T17:51:23.784 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_post_object_tags_anonymous_request ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:51:23.784 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:51:27.026 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:51:27.026 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:51:30.147 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T17:51:30.454 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_post_object_tags_authenticated_request ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:51:30.454 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:51:33.523 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:51:33.523 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:51:35.426 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:51:35.427 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:51:35.910 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T17:51:36.324 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_put_obj_with_tags ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:51:36.324 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:51:39.677 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:51:39.677 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:51:42.331 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T17:51:42.988 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_get_tags_acl_public ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:51:42.988 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:51:45.994 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:51:45.994 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:52:00.015 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:52:00.016 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:52:03.076 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:52:03.076 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:52:03.325 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T17:52:03.766 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_put_tags_acl_public ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:52:03.766 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:52:06.684 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:52:06.684 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:52:19.488 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:52:19.488 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:52:21.612 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:52:21.612 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:52:23.475 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T17:52:23.771 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_delete_tags_obj_public ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:52:23.771 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:52:26.943 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:52:26.943 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:52:38.953 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:52:38.953 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:52:41.707 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:52:41.708 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:52:42.623 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T17:52:43.083 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_versioning_bucket_atomic_upload_return_version_id ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:52:43.084 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:52:45.650 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:52:45.650 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:52:47.184 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:52:47.185 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:52:49.270 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:05:27:29.925 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T17:52:49.276 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:05:27:29.932 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T17:52:49.305 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:05:27:29.910 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T17:52:49.314 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:05:27:29.919 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T17:52:49.336 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:05:27:29.940 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T17:52:49.340 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:05:27:29.945 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T17:52:49.452 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:05:27:30.057 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T17:52:49.481 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:05:27:30.086 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T17:52:49.511 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:05:27:30.167 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T17:52:50.996 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:52:50.996 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:52:55.875 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:52:55.875 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:52:58.979 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:52:58.979 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:53:01.897 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T17:53:02.486 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_versioning_bucket_multipart_upload_return_version_id ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:53:02.486 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:53:05.648 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:53:05.648 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:53:06.962 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:53:06.962 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:53:34.571 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:05:28:15.226 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T17:53:34.582 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:05:28:15.238 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T17:53:34.585 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:05:28:15.190 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T17:53:34.590 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:05:28:15.195 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T17:53:34.590 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:05:28:15.195 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T17:53:34.594 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:05:28:15.199 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T17:53:34.640 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:05:28:15.245 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T17:53:34.646 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:05:28:15.302 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T17:53:34.647 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:05:28:15.252 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T17:54:08.548 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:54:08.663 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:55:22.515 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:55:22.515 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:55:25.562 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:55:25.563 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:56:35.125 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T17:56:35.745 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_bucket_policy_get_obj_existing_tag ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:56:35.745 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:56:43.603 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:56:43.604 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:56:49.699 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:56:49.699 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:56:50.342 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:56:50.342 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:56:51.242 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T17:56:51.946 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_bucket_policy_get_obj_tagging_existing_tag ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:56:51.946 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:57:00.548 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:57:00.548 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:57:05.394 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:57:05.394 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:57:08.355 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T17:57:08.715 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_bucket_policy_put_obj_tagging_existing_tag ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:57:08.715 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:57:14.715 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:57:14.715 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:57:19.048 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:57:19.048 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:57:22.960 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T17:57:23.453 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_bucket_policy_put_obj_copy_source ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:57:23.453 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:57:30.464 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:57:30.465 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:57:32.279 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:57:32.280 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:57:37.064 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:57:37.065 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:57:40.967 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T17:57:41.372 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_bucket_policy_put_obj_copy_source_meta ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:57:41.373 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:57:44.814 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:57:44.814 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:57:46.024 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:57:46.024 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:57:50.883 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:57:50.883 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:57:54.058 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T17:57:54.307 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_bucket_policy_put_obj_acl ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:57:54.307 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:57:56.589 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:57:56.590 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:57:57.540 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:57:57.540 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:57:58.629 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T17:57:59.097 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_bucket_policy_put_obj_grant ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:57:59.097 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:58:02.163 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:58:02.164 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:58:05.566 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:58:05.567 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:58:08.635 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:58:08.635 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:58:12.274 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T17:58:12.574 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_bucket_policy_get_obj_acl_existing_tag ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:58:12.574 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:58:18.942 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:58:18.942 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:58:23.577 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:58:23.578 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:58:25.357 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T17:58:25.674 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_lock ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:58:25.674 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:58:29.084 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T17:58:29.557 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_lock_invalid_bucket ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:58:29.557 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:58:31.556 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T17:58:31.808 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_lock_with_days_and_years ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:58:31.808 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:58:34.706 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T17:58:35.379 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_lock_invalid_days ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:58:35.379 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:58:37.767 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T17:58:38.266 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_lock_invalid_years ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:58:38.266 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:58:41.337 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T17:58:41.663 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_lock_invalid_status ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:58:41.663 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:58:43.931 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T17:58:44.383 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_object_lock_suspend_versioning ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:58:44.383 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:58:46.702 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:05:33:27.358 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T17:58:46.714 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:05:33:27.319 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T17:58:46.718 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:05:33:27.323 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T17:58:46.719 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:05:33:27.324 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T17:58:46.723 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:05:33:27.327 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T17:58:46.723 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:05:33:27.377 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T17:58:46.764 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T17:58:46.931 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:05:33:27.586 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T17:58:46.950 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:05:33:27.555 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T17:58:46.954 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:05:33:27.559 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T17:58:47.020 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_object_lock_get_obj_lock ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:58:47.020 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:58:50.539 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T17:58:50.896 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_object_lock_get_obj_lock_invalid_bucket ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:58:50.896 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:58:53.192 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T17:58:53.466 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_retention ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:58:53.466 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:59:02.932 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T17:59:03.328 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_retention_invalid_bucket ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:59:03.328 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:59:08.009 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T17:59:08.437 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_retention_invalid_mode ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:59:08.437 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:59:16.073 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T17:59:16.377 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_object_lock_get_obj_retention ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:59:16.377 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:59:26.758 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T17:59:27.051 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_object_lock_get_obj_retention_invalid_bucket ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:59:27.051 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:59:31.586 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T17:59:31.915 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_retention_versionid ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:59:31.916 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T17:59:48.635 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T17:59:48.915 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_retention_override_default_retention ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T17:59:48.915 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T18:00:03.175 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T18:00:03.484 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_retention_increase_period ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T18:00:03.485 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T18:00:20.085 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T18:00:20.640 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_retention_shorten_period ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T18:00:20.640 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T18:00:33.640 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T18:00:33.961 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_retention_shorten_period_bypass ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T18:00:33.961 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T18:00:49.735 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T18:00:50.308 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_object_lock_delete_object_with_retention ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T18:00:50.308 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T18:01:03.032 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T18:01:03.398 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_legal_hold ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T18:01:03.398 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T18:01:12.568 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T18:01:12.844 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_legal_hold_invalid_bucket ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T18:01:12.844 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T18:01:21.016 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T18:01:21.297 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_legal_hold_invalid_status ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T18:01:21.297 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T18:01:28.566 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T18:01:28.882 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_object_lock_get_legal_hold ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T18:01:28.882 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T18:01:40.782 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T18:01:41.018 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_object_lock_get_legal_hold_invalid_bucket ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T18:01:41.018 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T18:01:45.944 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T18:01:46.452 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_object_lock_delete_object_with_legal_hold_on ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T18:01:46.452 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T18:01:55.771 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T18:01:56.061 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_object_lock_delete_object_with_legal_hold_off ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T18:01:56.061 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T18:02:07.527 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T18:02:07.914 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_object_lock_get_obj_metadata ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T18:02:07.914 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T18:02:25.413 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T18:02:25.726 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_s3.test_object_lock_uploading_obj ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T18:02:25.726 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T18:02:37.530 INFO:teuthology.orchestra.run.smithi062.stderr:ok 2019-11-29T18:02:37.557 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.functional.test_utils.test_generate ... ok 2019-11-29T18:02:37.907 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T18:02:37.907 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T18:03:57.677 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:05:38:38.332 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T18:03:57.683 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:05:38:38.288 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T18:03:57.686 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:05:38:38.292 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T18:03:57.692 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:05:38:38.298 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T18:03:57.701 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:05:38:38.306 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T18:03:57.704 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:05:38:38.360 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T18:03:57.862 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:05:38:38.468 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T18:03:57.874 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:05:38:38.479 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T18:03:58.034 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:05:38:38.690 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T18:09:09.014 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:05:43:49.670 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T18:09:09.043 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:05:43:49.640 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T18:09:09.043 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:05:43:49.646 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T18:09:09.044 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:05:43:49.676 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T18:09:09.072 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:05:43:49.678 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T18:09:09.077 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:05:43:49.682 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T18:09:09.261 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:05:43:49.916 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T18:09:09.299 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:05:43:49.905 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T18:09:09.342 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:05:43:49.947 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T18:09:33.074 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:05:44:13.730 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T18:09:33.087 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:05:44:13.743 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T18:09:33.111 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:05:44:13.717 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T18:09:33.125 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:05:44:13.731 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T18:09:33.135 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:05:44:13.791 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T18:09:33.145 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:05:44:13.751 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T18:09:33.154 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:05:44:13.760 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T18:09:33.180 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:05:44:13.786 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T18:09:33.187 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:05:44:13.793 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T18:12:18.841 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:05:46:59.498 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T18:12:18.860 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:05:46:59.516 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T18:12:18.922 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:05:46:59.528 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T18:12:18.926 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:05:46:59.532 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T18:12:18.937 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:05:46:59.540 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T18:12:18.937 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:05:46:59.542 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T18:12:19.003 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:05:46:59.659 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T18:12:19.044 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:05:46:59.649 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T18:12:19.052 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:05:46:59.658 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T18:14:21.671 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:05:49:02.327 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T18:14:21.684 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:05:49:02.290 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T18:14:21.685 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:05:49:02.290 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T18:14:21.687 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:05:49:02.293 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T18:14:21.689 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:05:49:02.345 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T18:14:21.694 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:05:49:02.300 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T18:14:21.807 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:05:49:02.413 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T18:14:21.821 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:05:49:02.427 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T18:14:21.842 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:05:49:02.498 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T18:17:55.052 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:05:52:35.708 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T18:17:55.093 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:05:52:35.699 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T18:17:55.095 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:05:52:35.701 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T18:17:55.095 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:05:52:35.701 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T18:17:55.097 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:05:52:35.703 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T18:17:55.102 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:05:52:35.759 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T18:17:55.194 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:05:52:35.800 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T18:17:55.222 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:05:52:35.879 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T18:17:55.237 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:05:52:35.843 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T18:19:33.738 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:05:54:14.395 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T18:19:33.744 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:05:54:14.401 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T18:19:33.756 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:05:54:14.362 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T18:19:33.760 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:05:54:14.366 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T18:19:33.766 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:05:54:14.372 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T18:19:33.769 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:05:54:14.375 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T18:19:33.844 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:05:54:14.449 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T18:19:33.856 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:05:54:14.513 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T18:19:33.858 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:05:54:14.464 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T18:24:46.671 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:05:59:27.327 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T18:24:46.683 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:05:59:27.340 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T18:24:46.687 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:05:59:27.293 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T18:24:46.693 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:05:59:27.299 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T18:24:46.694 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:05:59:27.300 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T18:24:46.703 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:05:59:27.309 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T18:24:46.893 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:05:59:27.499 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T18:24:46.906 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:05:59:27.562 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T18:24:46.913 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:05:59:27.517 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T18:26:16.947 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:06:00:57.603 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T18:26:16.950 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:06:00:57.607 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T18:26:16.980 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:06:00:57.585 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T18:26:16.994 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:06:00:57.599 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T18:26:16.995 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:06:00:57.601 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T18:26:16.996 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:06:00:57.603 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T18:26:17.025 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:06:00:57.682 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T18:26:17.071 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:06:00:57.677 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T18:26:17.081 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:06:00:57.687 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T18:29:57.376 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:06:04:38.032 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T18:29:57.392 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:06:04:38.048 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T18:29:57.397 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:06:04:38.003 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T18:29:57.401 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:06:04:38.007 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T18:29:57.403 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:06:04:38.009 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T18:29:57.412 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:06:04:38.018 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T18:29:57.565 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:06:04:38.222 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T18:29:57.615 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:06:04:38.221 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T18:29:57.618 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:06:04:38.224 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T18:34:39.153 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:06:09:19.809 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T18:34:39.162 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:06:09:19.819 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T18:34:39.206 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:06:09:19.812 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T18:34:39.209 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:06:09:19.814 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T18:34:39.231 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:06:09:19.837 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T18:34:39.238 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:06:09:19.839 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T18:34:39.287 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:06:09:19.944 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T18:34:39.336 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:06:09:19.942 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T18:34:39.368 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:06:09:19.974 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T18:35:08.557 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:06:09:49.214 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T18:35:08.567 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:06:09:49.224 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T18:35:08.573 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:06:09:49.180 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T18:35:08.576 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:06:09:49.182 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T18:35:08.621 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:06:09:49.227 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T18:35:08.622 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:06:09:49.228 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T18:35:08.626 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:06:09:49.283 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T18:35:08.627 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:06:09:49.233 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T18:35:08.672 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:06:09:49.278 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T18:40:21.591 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:06:15:02.248 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T18:40:21.605 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:06:15:02.262 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T18:40:21.608 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:06:15:02.214 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T18:40:21.612 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:06:15:02.219 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T18:40:21.618 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:06:15:02.224 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T18:40:21.622 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:06:15:02.229 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T18:40:21.820 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:06:15:02.426 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T18:40:21.834 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:06:15:02.440 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T18:40:21.854 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:06:15:02.511 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T18:43:06.127 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:06:17:46.784 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T18:43:06.133 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:06:17:46.790 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T18:43:06.172 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:06:17:46.779 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T18:43:06.174 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:06:17:46.781 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T18:43:06.180 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:06:17:46.786 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T18:43:06.197 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:06:17:46.803 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T18:43:06.260 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:06:17:46.866 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T18:43:06.274 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:06:17:46.880 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T18:43:06.279 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:06:17:46.936 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T18:45:33.193 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:06:20:13.850 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T18:45:33.211 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:06:20:13.818 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T18:45:33.214 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:06:20:13.821 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T18:45:33.215 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:06:20:13.821 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T18:45:33.223 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:06:20:13.829 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T18:45:33.235 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:06:20:13.893 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T18:45:33.333 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:06:20:13.940 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T18:45:33.357 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:06:20:13.964 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T18:45:33.402 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:06:20:14.059 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T18:50:43.826 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:06:25:24.483 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T18:50:43.833 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:06:25:24.491 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T18:50:43.841 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:06:25:24.448 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T18:50:43.843 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:06:25:24.450 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T18:50:43.848 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:06:25:24.453 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T18:50:43.849 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:06:25:24.456 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T18:50:44.065 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:06:25:24.722 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T18:50:44.072 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:06:25:24.678 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T18:50:44.105 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:06:25:24.711 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T18:51:28.003 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:06:26:08.661 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T18:51:28.010 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:06:26:08.668 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T18:51:28.067 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:06:26:08.725 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T18:51:28.069 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:06:26:08.676 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T18:51:28.076 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:06:26:08.682 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T18:51:28.081 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:06:26:08.687 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T18:51:28.095 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:06:26:08.702 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T18:51:28.122 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:06:26:08.728 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T18:51:28.130 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:06:26:08.736 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T18:53:18.708 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:06:27:59.365 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T18:53:18.736 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:06:27:59.393 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T18:53:18.775 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:06:27:59.381 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T18:53:18.804 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:06:27:59.411 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T18:53:18.811 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:06:27:59.418 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T18:53:18.820 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:06:27:59.426 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T18:53:18.824 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:06:27:59.481 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T18:53:18.893 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:06:27:59.499 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T18:53:18.901 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:06:27:59.508 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T18:55:54.341 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:06:30:34.999 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T18:55:54.357 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:06:30:34.963 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T18:55:54.359 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:06:30:35.016 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T18:55:54.362 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:06:30:34.969 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T18:55:54.367 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:06:30:34.973 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T18:55:54.370 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:06:30:34.977 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T18:55:54.497 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:06:30:35.103 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T18:55:54.509 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:06:30:35.167 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T18:55:54.539 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:06:30:35.145 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T18:59:50.094 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:06:34:30.752 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T18:59:50.141 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:06:34:30.799 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T18:59:50.149 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:06:34:30.756 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T18:59:50.167 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:06:34:30.773 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T18:59:50.193 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:06:34:30.799 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T18:59:50.194 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:06:34:30.801 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T18:59:50.279 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:06:34:30.936 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T18:59:50.296 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:06:34:30.902 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T18:59:50.302 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:06:34:30.909 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T19:01:05.459 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:06:35:46.116 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T19:01:05.466 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:06:35:46.124 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T19:01:05.474 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:06:35:46.081 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T19:01:05.477 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:06:35:46.084 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T19:01:05.530 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:06:35:46.136 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T19:01:05.537 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:06:35:46.143 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T19:01:05.545 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:06:35:46.152 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T19:01:05.556 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:06:35:46.214 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T19:01:05.598 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:06:35:46.204 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T19:06:17.543 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:06:40:58.201 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T19:06:17.570 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:06:40:58.171 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T19:06:17.570 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:06:40:58.176 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T19:06:17.570 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:06:40:58.175 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T19:06:17.570 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:06:40:58.210 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T19:06:17.576 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:06:40:58.182 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T19:06:17.764 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:06:40:58.422 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T19:06:17.789 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:06:40:58.396 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T19:06:17.817 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:06:40:58.424 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T19:08:11.919 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:06:42:52.576 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T19:08:11.984 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:06:42:52.642 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T19:08:11.991 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:06:42:52.597 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T19:08:11.993 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:06:42:52.599 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T19:08:12.046 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:06:42:52.653 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T19:08:12.052 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:06:42:52.658 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T19:08:12.079 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:06:42:52.685 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T19:08:12.098 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:06:42:52.755 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T19:08:12.158 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:06:42:52.764 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T19:11:28.907 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:06:46:09.565 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T19:11:28.918 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:06:46:09.576 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T19:11:28.927 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:06:46:09.534 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T19:11:28.928 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:06:46:09.535 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T19:11:28.934 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:06:46:09.541 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T19:11:28.940 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:06:46:09.546 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T19:11:29.077 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:06:46:09.684 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T19:11:29.080 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:06:46:09.687 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T19:11:29.131 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:06:46:09.788 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T19:16:33.791 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:06:51:14.442 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T19:16:33.791 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:06:51:14.449 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T19:16:33.816 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:06:51:14.423 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T19:16:33.820 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:06:51:14.427 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T19:16:33.823 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:06:51:14.429 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T19:16:33.823 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:06:51:14.430 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T19:16:33.935 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:06:51:14.592 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T19:16:33.946 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:06:51:14.552 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T19:16:33.950 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:06:51:14.557 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T19:16:41.008 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:06:51:21.666 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T19:16:41.018 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:06:51:21.676 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T19:16:41.025 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:06:51:21.632 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T19:16:41.029 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:06:51:21.635 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T19:16:41.034 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:06:51:21.636 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T19:16:41.034 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:06:51:21.640 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T19:16:41.060 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:06:51:21.667 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T19:16:41.061 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:06:51:21.667 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T19:16:41.062 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:06:51:21.720 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T19:21:55.072 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:06:56:35.730 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T19:21:55.078 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:06:56:35.735 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T19:21:55.085 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:06:56:35.692 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T19:21:55.088 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:06:56:35.695 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T19:21:55.091 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:06:56:35.698 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T19:21:55.096 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:06:56:35.703 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T19:21:55.309 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:06:56:35.967 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T19:21:55.344 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:06:56:35.951 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T19:21:55.346 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:06:56:35.952 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T19:24:55.611 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:06:59:36.269 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T19:24:55.617 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:06:59:36.275 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T19:24:55.662 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:06:59:36.269 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T19:24:55.663 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:06:59:36.269 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T19:24:55.665 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:06:59:36.271 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T19:24:55.667 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:06:59:36.272 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T19:24:55.734 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:06:59:36.392 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T19:24:55.772 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:06:59:36.379 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T19:24:55.773 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:06:59:36.379 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T19:27:05.396 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:07:01:46.054 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T19:27:05.405 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:07:01:46.063 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T19:27:05.416 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:07:01:46.022 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T19:27:05.421 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:07:01:46.027 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T19:27:05.422 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:07:01:46.029 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T19:27:05.426 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:07:01:46.032 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T19:27:05.521 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:07:01:46.128 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T19:27:05.530 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:07:01:46.188 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T19:27:05.535 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:07:01:46.141 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T19:32:17.422 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:07:06:58.080 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T19:32:17.432 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:07:06:58.090 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T19:32:17.436 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:07:06:58.042 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T19:32:17.442 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:07:06:58.049 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T19:32:17.443 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:07:06:58.049 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T19:32:17.452 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:07:06:58.058 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T19:32:17.689 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:07:06:58.347 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T19:32:17.709 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:07:06:58.316 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T19:32:17.714 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:07:06:58.321 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T19:33:17.619 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:07:07:58.276 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T19:33:17.628 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:07:07:58.285 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T19:33:17.640 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:07:07:58.247 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T19:33:17.644 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:07:07:58.251 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T19:33:17.676 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:07:07:58.334 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T19:33:17.688 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:07:07:58.295 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T19:33:17.691 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:07:07:58.298 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T19:33:17.718 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:07:07:58.324 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T19:33:17.737 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:07:07:58.343 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T19:34:48.284 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:07:09:28.942 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T19:34:48.286 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:07:09:28.944 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T19:34:48.353 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:07:09:28.960 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T19:34:48.359 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:07:09:28.966 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T19:34:48.364 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:07:09:29.022 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T19:34:48.370 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:07:09:28.977 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T19:34:48.385 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:07:09:28.992 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T19:34:48.450 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:07:09:29.057 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T19:34:48.489 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:07:09:29.096 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T19:37:28.971 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:07:12:09.629 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T19:37:28.981 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:07:12:09.639 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T19:37:28.989 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:07:12:09.596 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T19:37:28.997 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:07:12:09.604 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T19:37:28.999 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:07:12:09.605 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T19:37:29.009 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:07:12:09.607 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T19:37:29.125 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:07:12:09.730 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T19:37:29.125 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:07:12:09.732 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T19:37:29.152 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:07:12:09.810 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T19:41:39.805 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:07:16:20.461 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T19:41:39.809 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:07:16:20.467 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T19:41:39.850 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:07:16:20.456 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T19:41:39.866 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:07:16:20.472 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T19:41:39.872 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:07:16:20.478 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T19:41:39.875 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:07:16:20.481 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T19:41:39.947 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:07:16:20.604 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T19:41:39.986 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:07:16:20.593 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T19:41:40.019 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:07:16:20.625 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T19:42:40.040 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:07:17:20.697 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T19:42:40.050 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:07:17:20.708 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T19:42:40.058 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:07:17:20.664 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T19:42:40.064 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:07:17:20.670 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T19:42:40.064 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:07:17:20.670 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T19:42:40.067 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:07:17:20.674 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T19:42:40.136 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:07:17:20.793 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T19:42:40.138 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:07:17:20.745 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T19:42:40.157 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:07:17:20.763 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T19:47:51.152 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:07:22:31.810 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T19:47:51.179 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:07:22:31.781 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T19:47:51.180 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:07:22:31.784 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T19:47:51.180 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:07:22:31.821 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T19:47:51.184 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:07:22:31.791 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T19:47:51.189 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:07:22:31.796 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T19:47:51.408 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:07:22:32.066 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T19:47:51.420 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:07:22:32.027 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T19:47:51.429 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:07:22:32.035 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T19:50:01.655 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:07:24:42.260 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T19:50:01.660 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:07:24:42.267 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T19:50:01.661 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:07:24:42.319 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T19:50:01.666 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:07:24:42.324 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T19:50:01.688 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:07:24:42.295 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T19:50:01.708 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:07:24:42.315 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T19:50:01.739 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:07:24:42.346 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T19:50:01.748 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:07:24:42.406 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T19:50:01.779 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:07:24:42.386 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T19:52:29.148 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T19:52:29.149 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T19:52:42.942 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi062.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-11-29T19:52:42.942 INFO:teuthology.orchestra.run.smithi062.stderr: SubjectAltNameWarning, 2019-11-29T19:52:46.406 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_load_graph ... ok 2019-11-29T19:52:46.418 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_descend_leaf_node ... ok 2019-11-29T19:52:46.418 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_descend_node ... ok 2019-11-29T19:52:46.419 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_descend_bad_node ... ok 2019-11-29T19:52:46.419 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_descend_nonexistant_child ... ok 2019-11-29T19:52:46.419 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_random_printable ... ok 2019-11-29T19:52:46.419 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_random_binary ... ok 2019-11-29T19:52:47.072 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_random_printable_no_whitespace ... ok 2019-11-29T19:52:47.276 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_random_binary_no_whitespace ... ok 2019-11-29T19:52:47.993 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_random_no_args ... ok 2019-11-29T19:52:48.040 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_random_no_charset ... ok 2019-11-29T19:52:48.076 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_random_exact_length ... ok 2019-11-29T19:52:48.077 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_random_bad_charset ... ok 2019-11-29T19:52:48.077 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_random_missing_length ... ok 2019-11-29T19:52:48.077 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_assemble_decision ... ok 2019-11-29T19:52:48.077 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_escape ... ok 2019-11-29T19:52:48.077 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_indirect ... ok 2019-11-29T19:52:48.077 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_indirect_double ... ok 2019-11-29T19:52:48.077 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_recursive ... ok 2019-11-29T19:52:48.078 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_recursive_mutual ... ok 2019-11-29T19:52:48.078 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_recursive_not_too_eager ... ok 2019-11-29T19:52:48.078 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_make_choice_unweighted_with_space ... ok 2019-11-29T19:52:48.087 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_weighted_choices ... ok 2019-11-29T19:52:48.088 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_null_choices ... ok 2019-11-29T19:52:48.088 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_weighted_null_choices ... ok 2019-11-29T19:52:48.088 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_null_child ... ok 2019-11-29T19:52:48.097 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_weighted_set ... ok 2019-11-29T19:52:48.097 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_header_presence ... ok 2019-11-29T19:52:48.098 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_duplicate_header ... ok 2019-11-29T19:52:48.098 INFO:teuthology.orchestra.run.smithi062.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_headers ... ok 2019-11-29T19:52:48.133 INFO:teuthology.orchestra.run.smithi062.stderr:test_realistic.TestFileValidator.test_new_file_is_valid ... ok 2019-11-29T19:52:48.168 INFO:teuthology.orchestra.run.smithi062.stderr:test_realistic.TestFileValidator.test_new_file_is_valid_on_several_calls ... ok 2019-11-29T19:52:48.168 INFO:teuthology.orchestra.run.smithi062.stderr:test_realistic.TestFileValidator.test_new_file_is_valid_when_size_is_1 ... ok 2019-11-29T19:52:48.412 INFO:teuthology.orchestra.run.smithi062.stderr:test_realistic.TestFiles.test_random_file_valid ... ok 2019-11-29T19:52:48.412 INFO:teuthology.orchestra.run.smithi062.stderr: 2019-11-29T19:52:48.413 INFO:teuthology.orchestra.run.smithi062.stderr:---------------------------------------------------------------------- 2019-11-29T19:52:48.413 INFO:teuthology.orchestra.run.smithi062.stderr:Ran 611 tests in 17530.603s 2019-11-29T19:52:48.413 INFO:teuthology.orchestra.run.smithi062.stderr: 2019-11-29T19:52:48.413 INFO:teuthology.orchestra.run.smithi062.stderr:OK (SKIP=75) 2019-11-29T19:52:48.491 DEBUG:tasks.s3tests:Scanning radosgw logs for leaked encryption keys... 2019-11-29T19:52:48.491 INFO:teuthology.orchestra.run.smithi062:> grep --binary-files=text pO3upElrwuEXSoFwCfnZPdSsmt/xWeFa0N9KgDijwVs= /var/log/ceph/rgw.ceph.client.0.log 2019-11-29T19:52:48.624 DEBUG:teuthology.orchestra.run:got remote process result: 1 2019-11-29T19:52:48.624 INFO:tasks.s3tests:Cleaning up boto... 2019-11-29T19:52:48.625 INFO:teuthology.orchestra.run.smithi062:> rm /home/ubuntu/cephtest/boto.cfg 2019-11-29T19:52:48.679 INFO:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid bar.client.0 --purge-data --cluster ceph 2019-11-29T19:52:48.795 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:48.791+0000 7fbc39667ec0 20 rados->read ofs=0 len=0 2019-11-29T19:52:48.831 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:48.827+0000 7fbc39667ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T19:52:48.831 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:48.827+0000 7fbc39667ec0 20 rados->read ofs=0 len=0 2019-11-29T19:52:48.845 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:48.841+0000 7fbc39667ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T19:52:48.845 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:48.841+0000 7fbc39667ec0 20 rados->read ofs=0 len=0 2019-11-29T19:52:48.854 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:48.850+0000 7fbc39667ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T19:52:48.855 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:48.850+0000 7fbc39667ec0 20 rados->read ofs=0 len=0 2019-11-29T19:52:48.874 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:48.869+0000 7fbc39667ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T19:52:49.211 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:49.207+0000 7fbc39667ec0 20 RGWRados::pool_iterate: got zone_info.7f922895-c6d7-4b1b-a19c-be3df5b5a899 2019-11-29T19:52:49.211 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:49.207+0000 7fbc39667ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-29T19:52:49.211 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:49.207+0000 7fbc39667ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-29T19:52:49.211 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:49.207+0000 7fbc39667ec0 20 RGWRados::pool_iterate: got zonegroup_info.76ba47ff-1c23-4409-aae0-24fe26589cae 2019-11-29T19:52:49.211 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:49.207+0000 7fbc39667ec0 20 rados->read ofs=0 len=0 2019-11-29T19:52:49.231 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:49.227+0000 7fbc39667ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T19:52:49.231 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:49.227+0000 7fbc39667ec0 20 rados->read ofs=0 len=0 2019-11-29T19:52:49.248 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:49.243+0000 7fbc39667ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-29T19:52:49.248 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:49.243+0000 7fbc39667ec0 20 rados->read ofs=0 len=0 2019-11-29T19:52:49.263 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:49.259+0000 7fbc39667ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T19:52:49.264 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:49.259+0000 7fbc39667ec0 20 rados->read ofs=0 len=0 2019-11-29T19:52:49.279 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:49.274+0000 7fbc39667ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-29T19:52:49.279 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:49.274+0000 7fbc39667ec0 20 rados->read ofs=0 len=0 2019-11-29T19:52:49.296 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:49.292+0000 7fbc39667ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T19:52:49.296 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:49.292+0000 7fbc39667ec0 10 cannot find current period zonegroup using local zonegroup 2019-11-29T19:52:49.296 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:49.292+0000 7fbc39667ec0 20 rados->read ofs=0 len=0 2019-11-29T19:52:49.313 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:49.309+0000 7fbc39667ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T19:52:49.313 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:49.309+0000 7fbc39667ec0 20 rados->read ofs=0 len=0 2019-11-29T19:52:49.335 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:49.331+0000 7fbc39667ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T19:52:49.335 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:49.331+0000 7fbc39667ec0 20 rados->read ofs=0 len=0 2019-11-29T19:52:49.350 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:49.346+0000 7fbc39667ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-29T19:52:49.351 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:49.346+0000 7fbc39667ec0 20 zonegroup default 2019-11-29T19:52:49.351 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:49.346+0000 7fbc39667ec0 20 rados->read ofs=0 len=0 2019-11-29T19:52:49.363 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:49.359+0000 7fbc39667ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T19:52:49.363 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:49.359+0000 7fbc39667ec0 10 Cannot find current period zone using local zone 2019-11-29T19:52:49.363 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:49.359+0000 7fbc39667ec0 20 rados->read ofs=0 len=0 2019-11-29T19:52:49.378 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:49.375+0000 7fbc39667ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T19:52:49.379 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:49.375+0000 7fbc39667ec0 20 rados->read ofs=0 len=0 2019-11-29T19:52:49.390 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:49.387+0000 7fbc39667ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T19:52:49.391 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:49.387+0000 7fbc39667ec0 20 rados->read ofs=0 len=0 2019-11-29T19:52:49.403 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:49.399+0000 7fbc39667ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-29T19:52:49.403 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:49.399+0000 7fbc39667ec0 20 zone default found 2019-11-29T19:52:49.403 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:49.399+0000 7fbc39667ec0 20 started sync module instance, tier type = 2019-11-29T19:52:49.403 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:49.399+0000 7fbc39667ec0 20 started zone id=7f922895-c6d7-4b1b-a19c-be3df5b5a899 (name=default) with tier type = 2019-11-29T19:52:49.822 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:49.819+0000 7fbc26894700 0 -- 172.21.15.62:0/2288045145 >> [v2:172.21.15.62:6800/10370,v1:172.21.15.62:6801/10370] conn(0x7fbc1001b550 msgr2=0x7fbc10033630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2019-11-29T19:52:49.911 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:49.908+0000 7fbc39667ec0 20 add_watcher() i=0 2019-11-29T19:52:49.912 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:49.908+0000 7fbc39667ec0 20 add_watcher() i=1 2019-11-29T19:52:49.912 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:49.908+0000 7fbc39667ec0 20 add_watcher() i=2 2019-11-29T19:52:49.912 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:49.908+0000 7fbc39667ec0 20 add_watcher() i=3 2019-11-29T19:52:49.912 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:49.908+0000 7fbc39667ec0 20 add_watcher() i=4 2019-11-29T19:52:49.912 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:49.908+0000 7fbc39667ec0 20 add_watcher() i=5 2019-11-29T19:52:49.912 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:49.908+0000 7fbc39667ec0 20 add_watcher() i=6 2019-11-29T19:52:49.945 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:49.942+0000 7fbc39667ec0 20 add_watcher() i=7 2019-11-29T19:52:49.946 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:49.942+0000 7fbc39667ec0 2 all 8 watchers are set, enabling cache 2019-11-29T19:52:49.946 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:49.942+0000 7fbbf77de700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-29T19:52:49.963 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:49.959+0000 7fbc26093700 0 -- 172.21.15.62:0/2503340782 >> v1:172.21.15.22:6789/0 conn(0x5604d299fe90 legacy=0x5604d29a2360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-29T19:52:51.540 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:51.536+0000 7fbb65ffb700 20 reqs_thread_entry: start 2019-11-29T19:52:51.540 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:51.536+0000 7fbb5f7fe700 20 reqs_thread_entry: start 2019-11-29T19:52:51.541 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:51.536+0000 7fbc39667ec0 20 init_complete bucket index max shards: 0 2019-11-29T19:52:51.541 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:51.537+0000 7fbb5dffb700 20 reqs_thread_entry: start 2019-11-29T19:52:51.541 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:51.537+0000 7fbc39667ec0 20 get_system_obj_state: rctx=0x7fffcb4ed268 obj=default.rgw.meta:users.uid:bar.client.0 state=0x5604d2a15950 s->prefetch_data=0 2019-11-29T19:52:51.541 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:51.537+0000 7fbc39667ec0 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2019-11-29T19:52:51.551 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:51.547+0000 7fbc39667ec0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x16 2019-11-29T19:52:51.551 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:51.547+0000 7fbc39667ec0 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-11-29T19:52:51.552 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:51.547+0000 7fbc39667ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-29T19:52:51.552 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:51.547+0000 7fbc39667ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-29T19:52:51.552 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:51.547+0000 7fbc39667ec0 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : type miss (requested=0x11, cached=0x16) 2019-11-29T19:52:51.552 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:51.547+0000 7fbc39667ec0 20 rados->read ofs=0 len=0 2019-11-29T19:52:51.562 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:51.558+0000 7fbc39667ec0 20 rados_obj.operate() r=0 bl.length=446 2019-11-29T19:52:51.563 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:51.558+0000 7fbc39667ec0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x11 2019-11-29T19:52:51.563 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:51.558+0000 7fbc39667ec0 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-11-29T19:52:51.582 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:51.578+0000 7fbc39667ec0 10 removing key index: VDQUOJLYDLVQIJHAPMSV 2019-11-29T19:52:51.582 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:51.578+0000 7fbc39667ec0 10 distributing notification oid=default.rgw.control:notify.6 bl.length()=170 2019-11-29T19:52:51.607 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:51.603+0000 7fbc07fff700 10 RGWWatcher::handle_notify() notify_id 579820585038 cookie 94578713057584 notifier 4640 bl.length()=170 2019-11-29T19:52:51.730 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:51.726+0000 7fbc39667ec0 10 removing email index: bar.client.0+test@test.test 2019-11-29T19:52:51.730 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:51.726+0000 7fbc39667ec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=178 2019-11-29T19:52:51.742 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:51.738+0000 7fbc07fff700 10 RGWWatcher::handle_notify() notify_id 579820585135 cookie 94578713046976 notifier 4640 bl.length()=178 2019-11-29T19:52:52.325 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:52.321+0000 7fbc39667ec0 10 removing user buckets index 2019-11-29T19:52:52.325 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:52.321+0000 7fbc39667ec0 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=169 2019-11-29T19:52:52.335 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:52.331+0000 7fbc07fff700 10 RGWWatcher::handle_notify() notify_id 579820585862 cookie 94578713048880 notifier 4640 bl.length()=169 2019-11-29T19:52:52.823 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:52.818+0000 7fbc39667ec0 10 removing user index: bar.client.0 2019-11-29T19:52:52.823 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:52.818+0000 7fbc39667ec0 10 removing default.rgw.meta+users.uid+bar.client.0 from cache 2019-11-29T19:52:52.823 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:52.818+0000 7fbc39667ec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=161 2019-11-29T19:52:52.946 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:52.942+0000 7fbc07fff700 10 RGWWatcher::handle_notify() notify_id 579820585136 cookie 94578713046976 notifier 4640 bl.length()=161 2019-11-29T19:52:52.947 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:52.943+0000 7fbc07fff700 10 RGWWatcher::handle_notify() notify_id 579820585137 cookie 94578713046976 notifier 4640 bl.length()=161 2019-11-29T19:52:53.690 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:53.687+0000 7fbc39667ec0 20 remove_watcher() i=0 2019-11-29T19:52:53.691 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:53.687+0000 7fbc39667ec0 2 removed watcher, disabling cache 2019-11-29T19:52:53.741 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:53.737+0000 7fbc39667ec0 20 remove_watcher() i=1 2019-11-29T19:52:53.783 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:53.779+0000 7fbc39667ec0 20 remove_watcher() i=2 2019-11-29T19:52:53.829 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:53.825+0000 7fbc39667ec0 20 remove_watcher() i=3 2019-11-29T19:52:53.883 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:53.880+0000 7fbc39667ec0 20 remove_watcher() i=4 2019-11-29T19:52:53.948 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:53.944+0000 7fbc39667ec0 20 remove_watcher() i=5 2019-11-29T19:52:54.018 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:54.014+0000 7fbc39667ec0 20 remove_watcher() i=6 2019-11-29T19:52:54.081 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:54.077+0000 7fbc39667ec0 20 remove_watcher() i=7 2019-11-29T19:52:54.091 INFO:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid foo.client.0 --purge-data --cluster ceph 2019-11-29T19:52:54.220 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:54.216+0000 7f0cc0837ec0 20 rados->read ofs=0 len=0 2019-11-29T19:52:54.252 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:54.248+0000 7f0cc0837ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T19:52:54.252 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:54.248+0000 7f0cc0837ec0 20 rados->read ofs=0 len=0 2019-11-29T19:52:54.268 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:54.264+0000 7f0cc0837ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T19:52:54.268 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:54.264+0000 7f0cc0837ec0 20 rados->read ofs=0 len=0 2019-11-29T19:52:54.280 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:54.277+0000 7f0cc0837ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T19:52:54.280 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:54.277+0000 7f0cc0837ec0 20 rados->read ofs=0 len=0 2019-11-29T19:52:54.297 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:54.293+0000 7f0cc0837ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T19:52:54.582 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:54.578+0000 7f0cc0837ec0 20 RGWRados::pool_iterate: got zone_info.7f922895-c6d7-4b1b-a19c-be3df5b5a899 2019-11-29T19:52:54.582 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:54.578+0000 7f0cc0837ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-29T19:52:54.582 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:54.578+0000 7f0cc0837ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-29T19:52:54.583 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:54.578+0000 7f0cc0837ec0 20 RGWRados::pool_iterate: got zonegroup_info.76ba47ff-1c23-4409-aae0-24fe26589cae 2019-11-29T19:52:54.584 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:54.578+0000 7f0cc0837ec0 20 rados->read ofs=0 len=0 2019-11-29T19:52:54.598 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:54.593+0000 7f0cc0837ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T19:52:54.599 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:54.593+0000 7f0cc0837ec0 20 rados->read ofs=0 len=0 2019-11-29T19:52:54.616 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:54.608+0000 7f0cc0837ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-29T19:52:54.616 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:54.608+0000 7f0cc0837ec0 20 rados->read ofs=0 len=0 2019-11-29T19:52:54.625 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:54.622+0000 7f0cc0837ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T19:52:54.626 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:54.622+0000 7f0cc0837ec0 20 rados->read ofs=0 len=0 2019-11-29T19:52:54.640 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:54.635+0000 7f0cc0837ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-29T19:52:54.641 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:54.635+0000 7f0cc0837ec0 20 rados->read ofs=0 len=0 2019-11-29T19:52:54.659 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:54.655+0000 7f0cc0837ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T19:52:54.659 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:54.655+0000 7f0cc0837ec0 10 cannot find current period zonegroup using local zonegroup 2019-11-29T19:52:54.659 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:54.655+0000 7f0cc0837ec0 20 rados->read ofs=0 len=0 2019-11-29T19:52:54.668 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:54.665+0000 7f0cc0837ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T19:52:54.669 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:54.665+0000 7f0cc0837ec0 20 rados->read ofs=0 len=0 2019-11-29T19:52:54.679 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:54.676+0000 7f0cc0837ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T19:52:54.679 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:54.676+0000 7f0cc0837ec0 20 rados->read ofs=0 len=0 2019-11-29T19:52:54.692 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:54.688+0000 7f0cc0837ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-29T19:52:54.692 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:54.688+0000 7f0cc0837ec0 20 zonegroup default 2019-11-29T19:52:54.692 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:54.688+0000 7f0cc0837ec0 20 rados->read ofs=0 len=0 2019-11-29T19:52:54.703 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:54.700+0000 7f0cc0837ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T19:52:54.703 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:54.700+0000 7f0cc0837ec0 10 Cannot find current period zone using local zone 2019-11-29T19:52:54.703 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:54.700+0000 7f0cc0837ec0 20 rados->read ofs=0 len=0 2019-11-29T19:52:54.713 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:54.709+0000 7f0cc0837ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T19:52:54.713 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:54.709+0000 7f0cc0837ec0 20 rados->read ofs=0 len=0 2019-11-29T19:52:54.722 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:54.719+0000 7f0cc0837ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T19:52:54.722 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:54.719+0000 7f0cc0837ec0 20 rados->read ofs=0 len=0 2019-11-29T19:52:54.731 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:54.728+0000 7f0cc0837ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-29T19:52:54.732 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:54.728+0000 7f0cc0837ec0 20 zone default found 2019-11-29T19:52:54.732 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:54.728+0000 7f0cc0837ec0 20 started sync module instance, tier type = 2019-11-29T19:52:54.732 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:54.728+0000 7f0cc0837ec0 20 started zone id=7f922895-c6d7-4b1b-a19c-be3df5b5a899 (name=default) with tier type = 2019-11-29T19:52:55.064 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:55.060+0000 7f0cc0837ec0 20 add_watcher() i=0 2019-11-29T19:52:55.064 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:55.060+0000 7f0cc0837ec0 20 add_watcher() i=1 2019-11-29T19:52:55.064 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:55.060+0000 7f0cc0837ec0 20 add_watcher() i=2 2019-11-29T19:52:55.064 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:55.060+0000 7f0cc0837ec0 20 add_watcher() i=3 2019-11-29T19:52:55.065 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:55.060+0000 7f0cc0837ec0 20 add_watcher() i=4 2019-11-29T19:52:55.065 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:55.060+0000 7f0cc0837ec0 20 add_watcher() i=5 2019-11-29T19:52:55.065 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:55.060+0000 7f0cc0837ec0 20 add_watcher() i=6 2019-11-29T19:52:55.104 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:55.100+0000 7f0cada64700 0 -- 172.21.15.62:0/1852442692 >> [v2:172.21.15.62:6800/10370,v1:172.21.15.62:6801/10370] conn(0x7f0ca4016570 msgr2=0x7f0ca4016980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-29T19:52:55.104 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:55.100+0000 7f0cc0837ec0 20 add_watcher() i=7 2019-11-29T19:52:55.104 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:55.100+0000 7f0cc0837ec0 2 all 8 watchers are set, enabling cache 2019-11-29T19:52:55.104 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:55.100+0000 7f0c7e7dc700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-29T19:52:55.125 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:55.122+0000 7f0cae265700 0 -- 172.21.15.62:0/324669961 >> v1:172.21.15.22:6789/0 conn(0x557fb1276850 legacy=0x557fb1276c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-29T19:52:56.915 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:56.911+0000 7f0bf4ff9700 20 reqs_thread_entry: start 2019-11-29T19:52:56.915 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:56.911+0000 7f0bee7fc700 20 reqs_thread_entry: start 2019-11-29T19:52:56.915 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:56.911+0000 7f0cc0837ec0 20 init_complete bucket index max shards: 0 2019-11-29T19:52:56.916 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:56.912+0000 7f0becff9700 20 reqs_thread_entry: start 2019-11-29T19:52:56.916 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:56.912+0000 7f0cc0837ec0 20 get_system_obj_state: rctx=0x7ffc650ebe38 obj=default.rgw.meta:users.uid:foo.client.0 state=0x557fb12f2110 s->prefetch_data=0 2019-11-29T19:52:56.916 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:56.912+0000 7f0cc0837ec0 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2019-11-29T19:52:56.931 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:56.928+0000 7f0cc0837ec0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x16 2019-11-29T19:52:56.932 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:56.928+0000 7f0cc0837ec0 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-11-29T19:52:56.932 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:56.928+0000 7f0cc0837ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-29T19:52:56.932 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:56.928+0000 7f0cc0837ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-29T19:52:56.932 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:56.928+0000 7f0cc0837ec0 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : type miss (requested=0x11, cached=0x16) 2019-11-29T19:52:56.932 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:56.928+0000 7f0cc0837ec0 20 rados->read ofs=0 len=0 2019-11-29T19:52:56.952 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:56.948+0000 7f0cc0837ec0 20 rados_obj.operate() r=0 bl.length=446 2019-11-29T19:52:56.952 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:56.948+0000 7f0cc0837ec0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x11 2019-11-29T19:52:56.952 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:56.948+0000 7f0cc0837ec0 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-11-29T19:52:57.009 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:57.006+0000 7f0cc0837ec0 10 removing key index: AVJXJSVQIWYDNWDCDMTS 2019-11-29T19:52:57.010 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:57.006+0000 7f0cc0837ec0 10 distributing notification oid=default.rgw.control:notify.5 bl.length()=170 2019-11-29T19:52:57.034 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:57.031+0000 7f0c8effd700 10 RGWWatcher::handle_notify() notify_id 579820585138 cookie 94006921278160 notifier 4652 bl.length()=170 2019-11-29T19:52:57.376 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:57.372+0000 7f0cc0837ec0 10 removing email index: foo.client.0+test@test.test 2019-11-29T19:52:57.376 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:57.372+0000 7f0cc0837ec0 10 distributing notification oid=default.rgw.control:notify.6 bl.length()=178 2019-11-29T19:52:57.388 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:57.384+0000 7f0c8effd700 10 RGWWatcher::handle_notify() notify_id 579820585039 cookie 94006921280880 notifier 4652 bl.length()=178 2019-11-29T19:52:57.484 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:57.481+0000 7f0cc0837ec0 10 removing user buckets index 2019-11-29T19:52:57.485 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:57.481+0000 7f0cc0837ec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=169 2019-11-29T19:52:57.497 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:57.494+0000 7f0c8effd700 10 RGWWatcher::handle_notify() notify_id 579820585139 cookie 94006921266816 notifier 4652 bl.length()=169 2019-11-29T19:52:57.913 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:57.909+0000 7f0cc0837ec0 10 removing user index: foo.client.0 2019-11-29T19:52:57.913 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:57.909+0000 7f0cc0837ec0 10 removing default.rgw.meta+users.uid+foo.client.0 from cache 2019-11-29T19:52:57.913 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:57.909+0000 7f0cc0837ec0 10 distributing notification oid=default.rgw.control:notify.0 bl.length()=161 2019-11-29T19:52:57.927 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:57.923+0000 7f0c8effd700 10 RGWWatcher::handle_notify() notify_id 579820585044 cookie 94006921264816 notifier 4652 bl.length()=161 2019-11-29T19:52:59.134 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:59.130+0000 7f0cc0837ec0 20 remove_watcher() i=0 2019-11-29T19:52:59.134 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:59.130+0000 7f0cc0837ec0 2 removed watcher, disabling cache 2019-11-29T19:52:59.202 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:59.199+0000 7f0cc0837ec0 20 remove_watcher() i=1 2019-11-29T19:52:59.273 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:59.269+0000 7f0cc0837ec0 20 remove_watcher() i=2 2019-11-29T19:52:59.335 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:59.331+0000 7f0cc0837ec0 20 remove_watcher() i=3 2019-11-29T19:52:59.382 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:59.379+0000 7f0cc0837ec0 20 remove_watcher() i=4 2019-11-29T19:52:59.437 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:59.430+0000 7f0cc0837ec0 20 remove_watcher() i=5 2019-11-29T19:52:59.487 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:59.484+0000 7f0cc0837ec0 20 remove_watcher() i=6 2019-11-29T19:52:59.530 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:59.526+0000 7f0cc0837ec0 20 remove_watcher() i=7 2019-11-29T19:52:59.540 INFO:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid 'testx$tenanteduser.client.0' --purge-data --cluster ceph 2019-11-29T19:52:59.662 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:59.649+0000 7f58cf2f5ec0 20 rados->read ofs=0 len=0 2019-11-29T19:52:59.691 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:59.684+0000 7f58cf2f5ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T19:52:59.691 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:59.684+0000 7f58cf2f5ec0 20 rados->read ofs=0 len=0 2019-11-29T19:52:59.702 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:59.699+0000 7f58cf2f5ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T19:52:59.703 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:59.699+0000 7f58cf2f5ec0 20 rados->read ofs=0 len=0 2019-11-29T19:52:59.720 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:59.715+0000 7f58cf2f5ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T19:52:59.720 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:59.715+0000 7f58cf2f5ec0 20 rados->read ofs=0 len=0 2019-11-29T19:52:59.748 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:52:59.741+0000 7f58cf2f5ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T19:53:00.088 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:00.084+0000 7f58cf2f5ec0 20 RGWRados::pool_iterate: got zone_info.7f922895-c6d7-4b1b-a19c-be3df5b5a899 2019-11-29T19:53:00.088 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:00.084+0000 7f58cf2f5ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-29T19:53:00.088 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:00.084+0000 7f58cf2f5ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-29T19:53:00.088 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:00.084+0000 7f58cf2f5ec0 20 RGWRados::pool_iterate: got zonegroup_info.76ba47ff-1c23-4409-aae0-24fe26589cae 2019-11-29T19:53:00.088 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:00.084+0000 7f58cf2f5ec0 20 rados->read ofs=0 len=0 2019-11-29T19:53:00.101 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:00.098+0000 7f58cf2f5ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T19:53:00.102 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:00.098+0000 7f58cf2f5ec0 20 rados->read ofs=0 len=0 2019-11-29T19:53:00.114 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:00.111+0000 7f58cf2f5ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-29T19:53:00.115 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:00.111+0000 7f58cf2f5ec0 20 rados->read ofs=0 len=0 2019-11-29T19:53:00.129 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:00.125+0000 7f58cf2f5ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T19:53:00.129 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:00.125+0000 7f58cf2f5ec0 20 rados->read ofs=0 len=0 2019-11-29T19:53:00.140 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:00.136+0000 7f58cf2f5ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-29T19:53:00.140 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:00.137+0000 7f58cf2f5ec0 20 rados->read ofs=0 len=0 2019-11-29T19:53:00.150 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:00.146+0000 7f58cf2f5ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T19:53:00.150 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:00.147+0000 7f58cf2f5ec0 10 cannot find current period zonegroup using local zonegroup 2019-11-29T19:53:00.150 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:00.147+0000 7f58cf2f5ec0 20 rados->read ofs=0 len=0 2019-11-29T19:53:00.169 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:00.165+0000 7f58cf2f5ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T19:53:00.169 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:00.165+0000 7f58cf2f5ec0 20 rados->read ofs=0 len=0 2019-11-29T19:53:00.185 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:00.182+0000 7f58cf2f5ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T19:53:00.185 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:00.182+0000 7f58cf2f5ec0 20 rados->read ofs=0 len=0 2019-11-29T19:53:00.193 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:00.189+0000 7f58cf2f5ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-29T19:53:00.193 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:00.189+0000 7f58cf2f5ec0 20 zonegroup default 2019-11-29T19:53:00.193 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:00.189+0000 7f58cf2f5ec0 20 rados->read ofs=0 len=0 2019-11-29T19:53:00.203 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:00.200+0000 7f58cf2f5ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T19:53:00.203 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:00.200+0000 7f58cf2f5ec0 10 Cannot find current period zone using local zone 2019-11-29T19:53:00.203 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:00.200+0000 7f58cf2f5ec0 20 rados->read ofs=0 len=0 2019-11-29T19:53:00.212 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:00.208+0000 7f58cf2f5ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T19:53:00.212 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:00.208+0000 7f58cf2f5ec0 20 rados->read ofs=0 len=0 2019-11-29T19:53:00.228 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:00.224+0000 7f58cf2f5ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T19:53:00.228 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:00.224+0000 7f58cf2f5ec0 20 rados->read ofs=0 len=0 2019-11-29T19:53:00.237 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:00.233+0000 7f58cf2f5ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-29T19:53:00.237 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:00.233+0000 7f58cf2f5ec0 20 zone default found 2019-11-29T19:53:00.237 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:00.233+0000 7f58cf2f5ec0 20 started sync module instance, tier type = 2019-11-29T19:53:00.237 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:00.233+0000 7f58cf2f5ec0 20 started zone id=7f922895-c6d7-4b1b-a19c-be3df5b5a899 (name=default) with tier type = 2019-11-29T19:53:00.607 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:00.603+0000 7f58cf2f5ec0 20 add_watcher() i=0 2019-11-29T19:53:00.608 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:00.603+0000 7f58cf2f5ec0 20 add_watcher() i=1 2019-11-29T19:53:00.608 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:00.603+0000 7f58cf2f5ec0 20 add_watcher() i=2 2019-11-29T19:53:00.608 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:00.603+0000 7f58cf2f5ec0 20 add_watcher() i=3 2019-11-29T19:53:00.608 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:00.603+0000 7f58cf2f5ec0 20 add_watcher() i=4 2019-11-29T19:53:00.608 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:00.603+0000 7f58cf2f5ec0 20 add_watcher() i=5 2019-11-29T19:53:00.608 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:00.603+0000 7f58cf2f5ec0 20 add_watcher() i=6 2019-11-29T19:53:00.641 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:00.638+0000 7f58cf2f5ec0 20 add_watcher() i=7 2019-11-29T19:53:00.641 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:00.638+0000 7f58cf2f5ec0 2 all 8 watchers are set, enabling cache 2019-11-29T19:53:00.642 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:00.638+0000 7f588cfe1700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-29T19:53:00.645 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:00.642+0000 7f58bc522700 0 -- 172.21.15.62:0/1123032668 >> v1:172.21.15.62:6789/0 conn(0x55d348992090 legacy=0x55d3489944b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-29T19:53:00.695 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:00.692+0000 7f58bbd21700 0 -- 172.21.15.62:0/3707212712 >> [v2:172.21.15.22:6818/9264,v1:172.21.15.22:6819/9264] conn(0x55d3489a8330 msgr2=0x55d3489aa750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-29T19:53:02.401 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:07:27:43.059 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T19:53:02.405 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:07:27:43.063 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T19:53:02.410 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:07:27:43.016 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T19:53:02.412 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:07:27:43.019 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T19:53:02.413 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:07:27:43.020 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T19:53:02.418 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:07:27:43.024 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T19:53:02.437 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:02.433+0000 7f57feffd700 20 reqs_thread_entry: start 2019-11-29T19:53:02.437 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:02.433+0000 7f57fcff9700 20 reqs_thread_entry: start 2019-11-29T19:53:02.437 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:02.433+0000 7f58cf2f5ec0 20 init_complete bucket index max shards: 0 2019-11-29T19:53:02.438 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:02.433+0000 7f57f2ffd700 20 reqs_thread_entry: start 2019-11-29T19:53:02.438 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:02.434+0000 7f58cf2f5ec0 20 get_system_obj_state: rctx=0x7ffee40da1e8 obj=default.rgw.meta:users.uid:testx$tenanteduser.client.0 state=0x55d348a11b70 s->prefetch_data=0 2019-11-29T19:53:02.438 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:02.434+0000 7f58cf2f5ec0 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2019-11-29T19:53:02.447 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:02.444+0000 7f58cf2f5ec0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x16 2019-11-29T19:53:02.448 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:02.444+0000 7f58cf2f5ec0 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2019-11-29T19:53:02.448 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:02.444+0000 7f58cf2f5ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-29T19:53:02.448 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:02.444+0000 7f58cf2f5ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-29T19:53:02.448 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:02.444+0000 7f58cf2f5ec0 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : type miss (requested=0x11, cached=0x16) 2019-11-29T19:53:02.448 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:02.444+0000 7f58cf2f5ec0 20 rados->read ofs=0 len=0 2019-11-29T19:53:02.457 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:02.453+0000 7f58cf2f5ec0 20 rados_obj.operate() r=0 bl.length=505 2019-11-29T19:53:02.457 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:02.453+0000 7f58cf2f5ec0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x11 2019-11-29T19:53:02.457 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:02.453+0000 7f58cf2f5ec0 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2019-11-29T19:53:02.469 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:02.466+0000 7f58cf2f5ec0 10 removing key index: HWGBIJVSGICBIIVGHYIN 2019-11-29T19:53:02.469 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:02.466+0000 7f58cf2f5ec0 10 distributing notification oid=default.rgw.control:notify.0 bl.length()=170 2019-11-29T19:53:02.479 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:02.476+0000 7f58a1ffb700 10 RGWWatcher::handle_notify() notify_id 579820585045 cookie 94365944374800 notifier 4667 bl.length()=170 2019-11-29T19:53:02.544 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:07:27:43.151 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T19:53:02.548 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:07:27:43.205 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T19:53:02.549 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:07:27:43.156 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T19:53:02.585 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:02.581+0000 7f58cf2f5ec0 10 removing email index: testx$tenanteduser.client.0+test@test.test 2019-11-29T19:53:02.585 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:02.581+0000 7f58cf2f5ec0 10 distributing notification oid=default.rgw.control:notify.7 bl.length()=193 2019-11-29T19:53:02.593 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:02.590+0000 7f58a1ffb700 10 RGWWatcher::handle_notify() notify_id 579820585046 cookie 94365944391968 notifier 4667 bl.length()=193 2019-11-29T19:53:02.667 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:02.663+0000 7f58cf2f5ec0 10 removing user buckets index 2019-11-29T19:53:02.667 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:02.663+0000 7f58cf2f5ec0 10 distributing notification oid=default.rgw.control:notify.6 bl.length()=184 2019-11-29T19:53:02.679 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:02.675+0000 7f58a1ffb700 10 RGWWatcher::handle_notify() notify_id 579820585040 cookie 94365944390288 notifier 4667 bl.length()=184 2019-11-29T19:53:02.762 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:02.758+0000 7f58cf2f5ec0 10 removing user index: testx$tenanteduser.client.0 2019-11-29T19:53:02.762 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:02.758+0000 7f58cf2f5ec0 10 removing default.rgw.meta+users.uid+testx$tenanteduser.client.0 from cache 2019-11-29T19:53:02.762 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:02.758+0000 7f58cf2f5ec0 10 distributing notification oid=default.rgw.control:notify.5 bl.length()=176 2019-11-29T19:53:02.773 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:02.769+0000 7f58a1ffb700 10 RGWWatcher::handle_notify() notify_id 579820585140 cookie 94365944387024 notifier 4667 bl.length()=176 2019-11-29T19:53:03.266 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:03.262+0000 7f58cf2f5ec0 20 remove_watcher() i=0 2019-11-29T19:53:03.266 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:03.262+0000 7f58cf2f5ec0 2 removed watcher, disabling cache 2019-11-29T19:53:03.330 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:03.327+0000 7f58cf2f5ec0 20 remove_watcher() i=1 2019-11-29T19:53:03.385 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:03.380+0000 7f58cf2f5ec0 20 remove_watcher() i=2 2019-11-29T19:53:03.425 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:03.422+0000 7f58cf2f5ec0 20 remove_watcher() i=3 2019-11-29T19:53:03.465 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:03.462+0000 7f58cf2f5ec0 20 remove_watcher() i=4 2019-11-29T19:53:03.504 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:03.500+0000 7f58cf2f5ec0 20 remove_watcher() i=5 2019-11-29T19:53:03.535 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:03.531+0000 7f58cf2f5ec0 20 remove_watcher() i=6 2019-11-29T19:53:03.580 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:03.576+0000 7f58cf2f5ec0 20 remove_watcher() i=7 2019-11-29T19:53:03.589 INFO:tasks.s3tests:Removing s3-tests... 2019-11-29T19:53:03.589 INFO:teuthology.orchestra.run.smithi062:> rm -rf /home/ubuntu/cephtest/s3-tests 2019-11-29T19:53:03.716 INFO:teuthology.run_tasks:Running task swift... 2019-11-29T19:53:03.742 INFO:tasks.swift:clients=['client.0'] 2019-11-29T19:53:03.742 INFO:tasks.swift:Downloading swift... 2019-11-29T19:53:03.742 INFO:teuthology.orchestra.run.smithi062:> git clone -b ceph-master git://git.ceph.com/git/swift.git /home/ubuntu/cephtest/swift 2019-11-29T19:53:03.831 INFO:teuthology.orchestra.run.smithi062.stdout:Cloning into '/home/ubuntu/cephtest/swift'... 2019-11-29T19:53:04.225 INFO:tasks.swift:Creating rgw users... 2019-11-29T19:53:04.226 INFO:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph user create --subuser foo.client.0:foo --display-name 'Mr. foo.client.0 foo' --secret YMkqAa95G9gUA13WNFojq1XezgRRttsMlTv0HZlr5fn8p24I1s9M9g== --email foo.client.0+test@test.test --key-type swift --access full 2019-11-29T19:53:04.402 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:04.398+0000 7f989c6e4ec0 20 rados->read ofs=0 len=0 2019-11-29T19:53:04.430 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:04.426+0000 7f989c6e4ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T19:53:04.430 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:04.427+0000 7f989c6e4ec0 20 rados->read ofs=0 len=0 2019-11-29T19:53:04.440 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:04.436+0000 7f989c6e4ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T19:53:04.440 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:04.436+0000 7f989c6e4ec0 20 rados->read ofs=0 len=0 2019-11-29T19:53:04.456 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:04.453+0000 7f989c6e4ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T19:53:04.456 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:04.453+0000 7f989c6e4ec0 20 rados->read ofs=0 len=0 2019-11-29T19:53:04.471 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:04.468+0000 7f989c6e4ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T19:53:04.753 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:04.740+0000 7f989c6e4ec0 20 RGWRados::pool_iterate: got zone_info.7f922895-c6d7-4b1b-a19c-be3df5b5a899 2019-11-29T19:53:04.754 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:04.740+0000 7f989c6e4ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-29T19:53:04.754 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:04.740+0000 7f989c6e4ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-29T19:53:04.754 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:04.740+0000 7f989c6e4ec0 20 RGWRados::pool_iterate: got zonegroup_info.76ba47ff-1c23-4409-aae0-24fe26589cae 2019-11-29T19:53:04.754 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:04.740+0000 7f989c6e4ec0 20 rados->read ofs=0 len=0 2019-11-29T19:53:04.764 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:04.754+0000 7f989c6e4ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T19:53:04.765 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:04.754+0000 7f989c6e4ec0 20 rados->read ofs=0 len=0 2019-11-29T19:53:04.776 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:04.765+0000 7f989c6e4ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-29T19:53:04.777 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:04.765+0000 7f989c6e4ec0 20 rados->read ofs=0 len=0 2019-11-29T19:53:04.788 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:04.775+0000 7f989c6e4ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T19:53:04.788 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:04.775+0000 7f989c6e4ec0 20 rados->read ofs=0 len=0 2019-11-29T19:53:04.800 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:04.790+0000 7f989c6e4ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-29T19:53:04.800 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:04.790+0000 7f989c6e4ec0 20 rados->read ofs=0 len=0 2019-11-29T19:53:04.816 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:04.808+0000 7f989c6e4ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T19:53:04.816 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:04.808+0000 7f989c6e4ec0 10 cannot find current period zonegroup using local zonegroup 2019-11-29T19:53:04.816 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:04.808+0000 7f989c6e4ec0 20 rados->read ofs=0 len=0 2019-11-29T19:53:04.826 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:04.816+0000 7f989c6e4ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T19:53:04.827 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:04.816+0000 7f989c6e4ec0 20 rados->read ofs=0 len=0 2019-11-29T19:53:04.861 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:04.825+0000 7f989c6e4ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T19:53:04.861 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:04.825+0000 7f989c6e4ec0 20 rados->read ofs=0 len=0 2019-11-29T19:53:04.861 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:04.842+0000 7f989c6e4ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-29T19:53:04.861 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:04.842+0000 7f989c6e4ec0 20 zonegroup default 2019-11-29T19:53:04.861 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:04.842+0000 7f989c6e4ec0 20 rados->read ofs=0 len=0 2019-11-29T19:53:04.862 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:04.851+0000 7f989c6e4ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T19:53:04.862 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:04.851+0000 7f989c6e4ec0 10 Cannot find current period zone using local zone 2019-11-29T19:53:04.862 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:04.851+0000 7f989c6e4ec0 20 rados->read ofs=0 len=0 2019-11-29T19:53:04.868 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:04.860+0000 7f989c6e4ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T19:53:04.876 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:04.860+0000 7f989c6e4ec0 20 rados->read ofs=0 len=0 2019-11-29T19:53:04.891 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:04.874+0000 7f989c6e4ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T19:53:04.891 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:04.874+0000 7f989c6e4ec0 20 rados->read ofs=0 len=0 2019-11-29T19:53:04.901 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:04.890+0000 7f989c6e4ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-29T19:53:04.901 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:04.890+0000 7f989c6e4ec0 20 zone default found 2019-11-29T19:53:04.901 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:04.890+0000 7f989c6e4ec0 20 started sync module instance, tier type = 2019-11-29T19:53:04.901 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:04.890+0000 7f989c6e4ec0 20 started zone id=7f922895-c6d7-4b1b-a19c-be3df5b5a899 (name=default) with tier type = 2019-11-29T19:53:05.331 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:05.328+0000 7f989c6e4ec0 20 add_watcher() i=0 2019-11-29T19:53:05.331 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:05.328+0000 7f989c6e4ec0 20 add_watcher() i=1 2019-11-29T19:53:05.332 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:05.328+0000 7f989c6e4ec0 20 add_watcher() i=2 2019-11-29T19:53:05.332 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:05.328+0000 7f989c6e4ec0 20 add_watcher() i=3 2019-11-29T19:53:05.332 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:05.328+0000 7f989c6e4ec0 20 add_watcher() i=4 2019-11-29T19:53:05.332 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:05.328+0000 7f989c6e4ec0 20 add_watcher() i=5 2019-11-29T19:53:05.340 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:05.338+0000 7f989c6e4ec0 20 add_watcher() i=6 2019-11-29T19:53:05.363 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:05.361+0000 7f989c6e4ec0 20 add_watcher() i=7 2019-11-29T19:53:05.364 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:05.361+0000 7f989c6e4ec0 2 all 8 watchers are set, enabling cache 2019-11-29T19:53:05.364 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:05.361+0000 7f985a7dc700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-29T19:53:05.367 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:05.365+0000 7f988a112700 0 -- 172.21.15.62:0/2981149498 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55b61b6b36b0 msgr2=0x55b61b6b3ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2019-11-29T19:53:05.422 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:05.420+0000 7f9889911700 0 -- 172.21.15.62:0/1939197032 >> [v2:172.21.15.22:6818/9264,v1:172.21.15.22:6819/9264] conn(0x55b61b6cbcf0 msgr2=0x55b61b6ce110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-29T19:53:07.587 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:07.583+0000 7f97d0ff9700 20 reqs_thread_entry: start 2019-11-29T19:53:07.587 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:07.583+0000 7f97ca7fc700 20 reqs_thread_entry: start 2019-11-29T19:53:07.587 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:07.583+0000 7f989c6e4ec0 20 init_complete bucket index max shards: 0 2019-11-29T19:53:07.588 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:07.583+0000 7f97c8ff9700 20 reqs_thread_entry: start 2019-11-29T19:53:07.588 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:07.583+0000 7f989c6e4ec0 20 get_system_obj_state: rctx=0x7ffcfcef57c8 obj=default.rgw.meta:users.uid:foo.client.0 state=0x55b61b735520 s->prefetch_data=0 2019-11-29T19:53:07.588 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:07.584+0000 7f989c6e4ec0 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2019-11-29T19:53:07.594 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:07.591+0000 7f989c6e4ec0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x0 2019-11-29T19:53:07.594 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:07.591+0000 7f989c6e4ec0 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-11-29T19:53:07.594 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:07.591+0000 7f989c6e4ec0 20 get_system_obj_state: rctx=0x7ffcfcef57d8 obj=default.rgw.meta:users.email:foo.client.0+test@test.test state=0x55b61b7372b0 s->prefetch_data=0 2019-11-29T19:53:07.595 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:07.591+0000 7f989c6e4ec0 10 cache get: name=default.rgw.meta+users.email+foo.client.0+test@test.test : miss 2019-11-29T19:53:07.600 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:07.596+0000 7f989c6e4ec0 10 cache put: name=default.rgw.meta+users.email+foo.client.0+test@test.test info.flags=0x0 2019-11-29T19:53:07.600 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:07.596+0000 7f989c6e4ec0 10 adding default.rgw.meta+users.email+foo.client.0+test@test.test to cache LRU end 2019-11-29T19:53:07.600 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:07.596+0000 7f989c6e4ec0 20 get_system_obj_state: rctx=0x7ffcfcef53e8 obj=default.rgw.meta:users.swift:foo.client.0:foo state=0x55b61b7372b0 s->prefetch_data=0 2019-11-29T19:53:07.600 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:07.596+0000 7f989c6e4ec0 10 cache get: name=default.rgw.meta+users.swift+foo.client.0:foo : miss 2019-11-29T19:53:07.611 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:07.607+0000 7f989c6e4ec0 10 cache put: name=default.rgw.meta+users.swift+foo.client.0:foo info.flags=0x0 2019-11-29T19:53:07.611 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:07.607+0000 7f989c6e4ec0 10 adding default.rgw.meta+users.swift+foo.client.0:foo to cache LRU end 2019-11-29T19:53:07.611 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:07.607+0000 7f989c6e4ec0 20 get_system_obj_state: rctx=0x7ffcfcef5568 obj=default.rgw.meta:users.swift:foo.client.0:foo state=0x55b61b737560 s->prefetch_data=0 2019-11-29T19:53:07.611 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:07.607+0000 7f989c6e4ec0 10 cache get: name=default.rgw.meta+users.swift+foo.client.0:foo : type miss (requested=0x6, cached=0x0) 2019-11-29T19:53:07.618 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:07.615+0000 7f989c6e4ec0 10 cache put: name=default.rgw.meta+users.swift+foo.client.0:foo info.flags=0x0 2019-11-29T19:53:07.618 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:07.615+0000 7f989c6e4ec0 10 moving default.rgw.meta+users.swift+foo.client.0:foo to cache LRU end 2019-11-29T19:53:07.672 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:07.669+0000 7f989c6e4ec0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2019-11-29T19:53:07.672 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:07.669+0000 7f989c6e4ec0 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-11-29T19:53:07.673 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:07.669+0000 7f989c6e4ec0 10 distributing notification oid=default.rgw.control:notify.0 bl.length()=612 2019-11-29T19:53:07.678 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:07.675+0000 7f986affd700 10 RGWWatcher::handle_notify() notify_id 579820585047 cookie 94240632353280 notifier 4676 bl.length()=612 2019-11-29T19:53:07.679 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:07.675+0000 7f986affd700 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2019-11-29T19:53:07.679 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:07.675+0000 7f986affd700 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-11-29T19:53:08.200 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:08.197+0000 7f989c6e4ec0 10 cache put: name=default.rgw.meta+users.email+foo.client.0+test@test.test info.flags=0x7 2019-11-29T19:53:08.201 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:08.197+0000 7f989c6e4ec0 10 moving default.rgw.meta+users.email+foo.client.0+test@test.test to cache LRU end 2019-11-29T19:53:08.201 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:08.197+0000 7f989c6e4ec0 10 distributing notification oid=default.rgw.control:notify.6 bl.length()=194 2019-11-29T19:53:08.213 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:08.209+0000 7f986affd700 10 RGWWatcher::handle_notify() notify_id 579820585041 cookie 94240632367456 notifier 4676 bl.length()=194 2019-11-29T19:53:08.214 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:08.209+0000 7f986affd700 10 cache put: name=default.rgw.meta+users.email+foo.client.0+test@test.test info.flags=0x7 2019-11-29T19:53:08.216 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:08.209+0000 7f986affd700 10 moving default.rgw.meta+users.email+foo.client.0+test@test.test to cache LRU end 2019-11-29T19:53:09.229 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:09.225+0000 7f989c6e4ec0 10 cache put: name=default.rgw.meta+users.swift+foo.client.0:foo info.flags=0x7 2019-11-29T19:53:09.229 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:09.225+0000 7f989c6e4ec0 10 moving default.rgw.meta+users.swift+foo.client.0:foo to cache LRU end 2019-11-29T19:53:09.229 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:09.225+0000 7f989c6e4ec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=183 2019-11-29T19:53:09.249 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:09.246+0000 7f986affd700 10 RGWWatcher::handle_notify() notify_id 579820585141 cookie 94240632356640 notifier 4676 bl.length()=183 2019-11-29T19:53:09.250 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:09.246+0000 7f986affd700 10 cache put: name=default.rgw.meta+users.swift+foo.client.0:foo info.flags=0x7 2019-11-29T19:53:09.250 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:09.246+0000 7f986affd700 10 moving default.rgw.meta+users.swift+foo.client.0:foo to cache LRU end 2019-11-29T19:53:09.781 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:09.778+0000 7f989c6e4ec0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2019-11-29T19:53:09.782 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:09.778+0000 7f989c6e4ec0 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-11-29T19:53:09.782 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:09.778+0000 7f989c6e4ec0 10 distributing notification oid=default.rgw.control:notify.0 bl.length()=636 2019-11-29T19:53:09.793 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:09.790+0000 7f986affd700 10 RGWWatcher::handle_notify() notify_id 579820585048 cookie 94240632353280 notifier 4676 bl.length()=636 2019-11-29T19:53:09.794 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:09.790+0000 7f986affd700 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2019-11-29T19:53:09.794 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:09.790+0000 7f986affd700 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-11-29T19:53:10.076 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2019-11-29T19:53:10.076 INFO:teuthology.orchestra.run.smithi062.stdout: "user_id": "foo.client.0", 2019-11-29T19:53:10.076 INFO:teuthology.orchestra.run.smithi062.stdout: "display_name": "Mr. foo.client.0 foo", 2019-11-29T19:53:10.076 INFO:teuthology.orchestra.run.smithi062.stdout: "email": "foo.client.0+test@test.test", 2019-11-29T19:53:10.076 INFO:teuthology.orchestra.run.smithi062.stdout: "suspended": 0, 2019-11-29T19:53:10.076 INFO:teuthology.orchestra.run.smithi062.stdout: "max_buckets": 1000, 2019-11-29T19:53:10.077 INFO:teuthology.orchestra.run.smithi062.stdout: "subusers": [ 2019-11-29T19:53:10.077 INFO:teuthology.orchestra.run.smithi062.stdout: { 2019-11-29T19:53:10.077 INFO:teuthology.orchestra.run.smithi062.stdout: "id": "foo.client.0:foo", 2019-11-29T19:53:10.077 INFO:teuthology.orchestra.run.smithi062.stdout: "permissions": "full-control" 2019-11-29T19:53:10.077 INFO:teuthology.orchestra.run.smithi062.stdout: } 2019-11-29T19:53:10.077 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2019-11-29T19:53:10.077 INFO:teuthology.orchestra.run.smithi062.stdout: "keys": [], 2019-11-29T19:53:10.078 INFO:teuthology.orchestra.run.smithi062.stdout: "swift_keys": [ 2019-11-29T19:53:10.078 INFO:teuthology.orchestra.run.smithi062.stdout: { 2019-11-29T19:53:10.078 INFO:teuthology.orchestra.run.smithi062.stdout: "user": "foo.client.0:foo", 2019-11-29T19:53:10.078 INFO:teuthology.orchestra.run.smithi062.stdout: "secret_key": "YMkqAa95G9gUA13WNFojq1XezgRRttsMlTv0HZlr5fn8p24I1s9M9g==" 2019-11-29T19:53:10.078 INFO:teuthology.orchestra.run.smithi062.stdout: } 2019-11-29T19:53:10.078 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2019-11-29T19:53:10.078 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": [], 2019-11-29T19:53:10.079 INFO:teuthology.orchestra.run.smithi062.stdout: "op_mask": "read, write, delete", 2019-11-29T19:53:10.079 INFO:teuthology.orchestra.run.smithi062.stdout: "default_placement": "", 2019-11-29T19:53:10.079 INFO:teuthology.orchestra.run.smithi062.stdout: "default_storage_class": "", 2019-11-29T19:53:10.079 INFO:teuthology.orchestra.run.smithi062.stdout: "placement_tags": [], 2019-11-29T19:53:10.079 INFO:teuthology.orchestra.run.smithi062.stdout: "bucket_quota": { 2019-11-29T19:53:10.079 INFO:teuthology.orchestra.run.smithi062.stdout: "enabled": false, 2019-11-29T19:53:10.079 INFO:teuthology.orchestra.run.smithi062.stdout: "check_on_raw": false, 2019-11-29T19:53:10.079 INFO:teuthology.orchestra.run.smithi062.stdout: "max_size": -1, 2019-11-29T19:53:10.080 INFO:teuthology.orchestra.run.smithi062.stdout: "max_size_kb": 0, 2019-11-29T19:53:10.080 INFO:teuthology.orchestra.run.smithi062.stdout: "max_objects": -1 2019-11-29T19:53:10.080 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2019-11-29T19:53:10.080 INFO:teuthology.orchestra.run.smithi062.stdout: "user_quota": { 2019-11-29T19:53:10.080 INFO:teuthology.orchestra.run.smithi062.stdout: "enabled": false, 2019-11-29T19:53:10.080 INFO:teuthology.orchestra.run.smithi062.stdout: "check_on_raw": false, 2019-11-29T19:53:10.080 INFO:teuthology.orchestra.run.smithi062.stdout: "max_size": -1, 2019-11-29T19:53:10.081 INFO:teuthology.orchestra.run.smithi062.stdout: "max_size_kb": 0, 2019-11-29T19:53:10.081 INFO:teuthology.orchestra.run.smithi062.stdout: "max_objects": -1 2019-11-29T19:53:10.081 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2019-11-29T19:53:10.081 INFO:teuthology.orchestra.run.smithi062.stdout: "temp_url_keys": [], 2019-11-29T19:53:10.082 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "rgw", 2019-11-29T19:53:10.082 INFO:teuthology.orchestra.run.smithi062.stdout: "mfa_ids": [] 2019-11-29T19:53:10.082 INFO:teuthology.orchestra.run.smithi062.stdout:} 2019-11-29T19:53:10.082 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T19:53:10.138 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:10.135+0000 7f989c6e4ec0 20 remove_watcher() i=0 2019-11-29T19:53:10.139 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:10.135+0000 7f989c6e4ec0 2 removed watcher, disabling cache 2019-11-29T19:53:10.196 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:10.192+0000 7f989c6e4ec0 20 remove_watcher() i=1 2019-11-29T19:53:10.245 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:10.242+0000 7f989c6e4ec0 20 remove_watcher() i=2 2019-11-29T19:53:10.292 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:10.288+0000 7f989c6e4ec0 20 remove_watcher() i=3 2019-11-29T19:53:10.343 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:10.339+0000 7f989c6e4ec0 20 remove_watcher() i=4 2019-11-29T19:53:10.377 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:10.374+0000 7f989c6e4ec0 20 remove_watcher() i=5 2019-11-29T19:53:10.415 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:10.411+0000 7f989c6e4ec0 20 remove_watcher() i=6 2019-11-29T19:53:10.454 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:10.451+0000 7f989c6e4ec0 20 remove_watcher() i=7 2019-11-29T19:53:10.462 INFO:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph user create --subuser bar.client.0:bar --display-name 'Mr. bar.client.0 bar' --secret dR7Ge8sGQxiuszzj9+hJrUNtl6dCFWFA/v4o+RN9zLXdlHzwgDYeJA== --email bar.client.0+test@test.test --key-type swift --access full 2019-11-29T19:53:10.591 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:10.588+0000 7feb59f5bec0 20 rados->read ofs=0 len=0 2019-11-29T19:53:10.627 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:10.624+0000 7feb59f5bec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T19:53:10.628 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:10.624+0000 7feb59f5bec0 20 rados->read ofs=0 len=0 2019-11-29T19:53:10.642 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:10.638+0000 7feb59f5bec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T19:53:10.642 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:10.638+0000 7feb59f5bec0 20 rados->read ofs=0 len=0 2019-11-29T19:53:10.656 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:10.652+0000 7feb59f5bec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T19:53:10.656 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:10.652+0000 7feb59f5bec0 20 rados->read ofs=0 len=0 2019-11-29T19:53:10.677 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:10.673+0000 7feb59f5bec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T19:53:10.929 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:10.919+0000 7feb59f5bec0 20 RGWRados::pool_iterate: got zone_info.7f922895-c6d7-4b1b-a19c-be3df5b5a899 2019-11-29T19:53:10.929 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:10.919+0000 7feb59f5bec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-29T19:53:10.929 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:10.919+0000 7feb59f5bec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-29T19:53:10.929 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:10.919+0000 7feb59f5bec0 20 RGWRados::pool_iterate: got zonegroup_info.76ba47ff-1c23-4409-aae0-24fe26589cae 2019-11-29T19:53:10.929 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:10.919+0000 7feb59f5bec0 20 rados->read ofs=0 len=0 2019-11-29T19:53:10.937 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:10.934+0000 7feb59f5bec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T19:53:10.938 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:10.934+0000 7feb59f5bec0 20 rados->read ofs=0 len=0 2019-11-29T19:53:10.948 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:10.944+0000 7feb59f5bec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-29T19:53:10.948 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:10.944+0000 7feb59f5bec0 20 rados->read ofs=0 len=0 2019-11-29T19:53:10.957 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:10.953+0000 7feb59f5bec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T19:53:10.957 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:10.953+0000 7feb59f5bec0 20 rados->read ofs=0 len=0 2019-11-29T19:53:10.972 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:10.968+0000 7feb59f5bec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-29T19:53:10.972 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:10.968+0000 7feb59f5bec0 20 rados->read ofs=0 len=0 2019-11-29T19:53:10.986 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:10.983+0000 7feb59f5bec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T19:53:10.986 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:10.983+0000 7feb59f5bec0 10 cannot find current period zonegroup using local zonegroup 2019-11-29T19:53:10.987 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:10.983+0000 7feb59f5bec0 20 rados->read ofs=0 len=0 2019-11-29T19:53:11.006 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:11.002+0000 7feb59f5bec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T19:53:11.006 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:11.002+0000 7feb59f5bec0 20 rados->read ofs=0 len=0 2019-11-29T19:53:11.016 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:11.012+0000 7feb59f5bec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T19:53:11.016 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:11.012+0000 7feb59f5bec0 20 rados->read ofs=0 len=0 2019-11-29T19:53:11.026 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:11.022+0000 7feb59f5bec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-29T19:53:11.026 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:11.022+0000 7feb59f5bec0 20 zonegroup default 2019-11-29T19:53:11.026 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:11.022+0000 7feb59f5bec0 20 rados->read ofs=0 len=0 2019-11-29T19:53:11.036 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:11.033+0000 7feb59f5bec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T19:53:11.036 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:11.033+0000 7feb59f5bec0 10 Cannot find current period zone using local zone 2019-11-29T19:53:11.037 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:11.033+0000 7feb59f5bec0 20 rados->read ofs=0 len=0 2019-11-29T19:53:11.044 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:11.040+0000 7feb59f5bec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T19:53:11.044 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:11.040+0000 7feb59f5bec0 20 rados->read ofs=0 len=0 2019-11-29T19:53:11.053 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:11.049+0000 7feb59f5bec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T19:53:11.053 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:11.049+0000 7feb59f5bec0 20 rados->read ofs=0 len=0 2019-11-29T19:53:11.064 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:11.060+0000 7feb59f5bec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-29T19:53:11.064 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:11.060+0000 7feb59f5bec0 20 zone default found 2019-11-29T19:53:11.064 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:11.060+0000 7feb59f5bec0 20 started sync module instance, tier type = 2019-11-29T19:53:11.064 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:11.060+0000 7feb59f5bec0 20 started zone id=7f922895-c6d7-4b1b-a19c-be3df5b5a899 (name=default) with tier type = 2019-11-29T19:53:11.434 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:11.430+0000 7feb59f5bec0 20 add_watcher() i=0 2019-11-29T19:53:11.435 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:11.431+0000 7feb59f5bec0 20 add_watcher() i=1 2019-11-29T19:53:11.435 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:11.431+0000 7feb59f5bec0 20 add_watcher() i=2 2019-11-29T19:53:11.435 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:11.431+0000 7feb59f5bec0 20 add_watcher() i=3 2019-11-29T19:53:11.435 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:11.431+0000 7feb59f5bec0 20 add_watcher() i=4 2019-11-29T19:53:11.435 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:11.431+0000 7feb59f5bec0 20 add_watcher() i=5 2019-11-29T19:53:11.435 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:11.431+0000 7feb59f5bec0 20 add_watcher() i=6 2019-11-29T19:53:11.470 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:11.467+0000 7feb59f5bec0 20 add_watcher() i=7 2019-11-29T19:53:11.471 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:11.467+0000 7feb59f5bec0 2 all 8 watchers are set, enabling cache 2019-11-29T19:53:11.471 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:11.467+0000 7feb16fed700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-29T19:53:11.475 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:11.471+0000 7feb46987700 0 -- 172.21.15.62:0/2264907035 >> v1:172.21.15.22:6789/0 conn(0x562b7c51e6c0 legacy=0x562b7c520bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-29T19:53:11.513 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:11.509+0000 7feb46987700 0 -- 172.21.15.62:0/1409085217 >> [v2:172.21.15.22:6818/9264,v1:172.21.15.22:6819/9264] conn(0x562b7c532dd0 msgr2=0x562b7c5351f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-29T19:53:13.213 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:13.209+0000 7fea857fa700 20 reqs_thread_entry: start 2019-11-29T19:53:13.213 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:13.210+0000 7fea7effd700 20 reqs_thread_entry: start 2019-11-29T19:53:13.214 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:13.210+0000 7feb59f5bec0 20 init_complete bucket index max shards: 0 2019-11-29T19:53:13.214 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:13.210+0000 7fea7d7fa700 20 reqs_thread_entry: start 2019-11-29T19:53:13.214 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:13.210+0000 7feb59f5bec0 20 get_system_obj_state: rctx=0x7ffca2f24178 obj=default.rgw.meta:users.uid:bar.client.0 state=0x562b7c59c6c0 s->prefetch_data=0 2019-11-29T19:53:13.214 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:13.210+0000 7feb59f5bec0 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2019-11-29T19:53:13.220 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:13.217+0000 7feb59f5bec0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x0 2019-11-29T19:53:13.221 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:13.217+0000 7feb59f5bec0 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-11-29T19:53:13.221 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:13.217+0000 7feb59f5bec0 20 get_system_obj_state: rctx=0x7ffca2f24188 obj=default.rgw.meta:users.email:bar.client.0+test@test.test state=0x562b7c59e450 s->prefetch_data=0 2019-11-29T19:53:13.221 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:13.217+0000 7feb59f5bec0 10 cache get: name=default.rgw.meta+users.email+bar.client.0+test@test.test : miss 2019-11-29T19:53:13.227 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:13.224+0000 7feb59f5bec0 10 cache put: name=default.rgw.meta+users.email+bar.client.0+test@test.test info.flags=0x0 2019-11-29T19:53:13.228 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:13.224+0000 7feb59f5bec0 10 adding default.rgw.meta+users.email+bar.client.0+test@test.test to cache LRU end 2019-11-29T19:53:13.228 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:13.224+0000 7feb59f5bec0 20 get_system_obj_state: rctx=0x7ffca2f23d98 obj=default.rgw.meta:users.swift:bar.client.0:bar state=0x562b7c59e450 s->prefetch_data=0 2019-11-29T19:53:13.228 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:13.224+0000 7feb59f5bec0 10 cache get: name=default.rgw.meta+users.swift+bar.client.0:bar : miss 2019-11-29T19:53:13.237 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:13.234+0000 7feb59f5bec0 10 cache put: name=default.rgw.meta+users.swift+bar.client.0:bar info.flags=0x0 2019-11-29T19:53:13.237 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:13.234+0000 7feb59f5bec0 10 adding default.rgw.meta+users.swift+bar.client.0:bar to cache LRU end 2019-11-29T19:53:13.238 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:13.234+0000 7feb59f5bec0 20 get_system_obj_state: rctx=0x7ffca2f23f18 obj=default.rgw.meta:users.swift:bar.client.0:bar state=0x562b7c59e700 s->prefetch_data=0 2019-11-29T19:53:13.239 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:13.234+0000 7feb59f5bec0 10 cache get: name=default.rgw.meta+users.swift+bar.client.0:bar : type miss (requested=0x6, cached=0x0) 2019-11-29T19:53:13.248 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:13.245+0000 7feb59f5bec0 10 cache put: name=default.rgw.meta+users.swift+bar.client.0:bar info.flags=0x0 2019-11-29T19:53:13.248 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:13.245+0000 7feb59f5bec0 10 moving default.rgw.meta+users.swift+bar.client.0:bar to cache LRU end 2019-11-29T19:53:13.293 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:13.290+0000 7feb59f5bec0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2019-11-29T19:53:13.294 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:13.290+0000 7feb59f5bec0 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-11-29T19:53:13.294 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:13.290+0000 7feb59f5bec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=612 2019-11-29T19:53:13.315 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:13.312+0000 7feb3cff9700 10 RGWWatcher::handle_notify() notify_id 579820585142 cookie 94744769236224 notifier 4691 bl.length()=612 2019-11-29T19:53:13.315 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:13.312+0000 7feb3cff9700 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2019-11-29T19:53:13.316 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:13.312+0000 7feb3cff9700 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-11-29T19:53:13.571 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:13.568+0000 7feb59f5bec0 10 cache put: name=default.rgw.meta+users.email+bar.client.0+test@test.test info.flags=0x7 2019-11-29T19:53:13.572 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:13.568+0000 7feb59f5bec0 10 moving default.rgw.meta+users.email+bar.client.0+test@test.test to cache LRU end 2019-11-29T19:53:13.572 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:13.568+0000 7feb59f5bec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=194 2019-11-29T19:53:13.587 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:13.583+0000 7feb3cff9700 10 RGWWatcher::handle_notify() notify_id 579820585143 cookie 94744769236224 notifier 4691 bl.length()=194 2019-11-29T19:53:13.587 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:13.583+0000 7feb3cff9700 10 cache put: name=default.rgw.meta+users.email+bar.client.0+test@test.test info.flags=0x7 2019-11-29T19:53:13.588 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:13.584+0000 7feb3cff9700 10 moving default.rgw.meta+users.email+bar.client.0+test@test.test to cache LRU end 2019-11-29T19:53:14.054 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:14.051+0000 7feb59f5bec0 10 cache put: name=default.rgw.meta+users.swift+bar.client.0:bar info.flags=0x7 2019-11-29T19:53:14.055 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:14.051+0000 7feb59f5bec0 10 moving default.rgw.meta+users.swift+bar.client.0:bar to cache LRU end 2019-11-29T19:53:14.055 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:14.051+0000 7feb59f5bec0 10 distributing notification oid=default.rgw.control:notify.5 bl.length()=183 2019-11-29T19:53:14.074 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:14.070+0000 7feb3cff9700 10 RGWWatcher::handle_notify() notify_id 579820585144 cookie 94744769245264 notifier 4691 bl.length()=183 2019-11-29T19:53:14.074 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:14.070+0000 7feb3cff9700 10 cache put: name=default.rgw.meta+users.swift+bar.client.0:bar info.flags=0x7 2019-11-29T19:53:14.074 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:14.070+0000 7feb3cff9700 10 moving default.rgw.meta+users.swift+bar.client.0:bar to cache LRU end 2019-11-29T19:53:14.329 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:14.325+0000 7feb59f5bec0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2019-11-29T19:53:14.329 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:14.325+0000 7feb59f5bec0 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-11-29T19:53:14.329 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:14.325+0000 7feb59f5bec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=636 2019-11-29T19:53:14.339 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:14.336+0000 7feb3cff9700 10 RGWWatcher::handle_notify() notify_id 579820585145 cookie 94744769236224 notifier 4691 bl.length()=636 2019-11-29T19:53:14.339 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:14.336+0000 7feb3cff9700 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2019-11-29T19:53:14.340 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:14.336+0000 7feb3cff9700 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-11-29T19:53:14.671 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2019-11-29T19:53:14.672 INFO:teuthology.orchestra.run.smithi062.stdout: "user_id": "bar.client.0", 2019-11-29T19:53:14.672 INFO:teuthology.orchestra.run.smithi062.stdout: "display_name": "Mr. bar.client.0 bar", 2019-11-29T19:53:14.672 INFO:teuthology.orchestra.run.smithi062.stdout: "email": "bar.client.0+test@test.test", 2019-11-29T19:53:14.673 INFO:teuthology.orchestra.run.smithi062.stdout: "suspended": 0, 2019-11-29T19:53:14.673 INFO:teuthology.orchestra.run.smithi062.stdout: "max_buckets": 1000, 2019-11-29T19:53:14.673 INFO:teuthology.orchestra.run.smithi062.stdout: "subusers": [ 2019-11-29T19:53:14.673 INFO:teuthology.orchestra.run.smithi062.stdout: { 2019-11-29T19:53:14.673 INFO:teuthology.orchestra.run.smithi062.stdout: "id": "bar.client.0:bar", 2019-11-29T19:53:14.673 INFO:teuthology.orchestra.run.smithi062.stdout: "permissions": "full-control" 2019-11-29T19:53:14.674 INFO:teuthology.orchestra.run.smithi062.stdout: } 2019-11-29T19:53:14.674 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2019-11-29T19:53:14.674 INFO:teuthology.orchestra.run.smithi062.stdout: "keys": [], 2019-11-29T19:53:14.674 INFO:teuthology.orchestra.run.smithi062.stdout: "swift_keys": [ 2019-11-29T19:53:14.674 INFO:teuthology.orchestra.run.smithi062.stdout: { 2019-11-29T19:53:14.674 INFO:teuthology.orchestra.run.smithi062.stdout: "user": "bar.client.0:bar", 2019-11-29T19:53:14.674 INFO:teuthology.orchestra.run.smithi062.stdout: "secret_key": "dR7Ge8sGQxiuszzj9+hJrUNtl6dCFWFA/v4o+RN9zLXdlHzwgDYeJA==" 2019-11-29T19:53:14.675 INFO:teuthology.orchestra.run.smithi062.stdout: } 2019-11-29T19:53:14.675 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2019-11-29T19:53:14.675 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": [], 2019-11-29T19:53:14.675 INFO:teuthology.orchestra.run.smithi062.stdout: "op_mask": "read, write, delete", 2019-11-29T19:53:14.675 INFO:teuthology.orchestra.run.smithi062.stdout: "default_placement": "", 2019-11-29T19:53:14.675 INFO:teuthology.orchestra.run.smithi062.stdout: "default_storage_class": "", 2019-11-29T19:53:14.675 INFO:teuthology.orchestra.run.smithi062.stdout: "placement_tags": [], 2019-11-29T19:53:14.675 INFO:teuthology.orchestra.run.smithi062.stdout: "bucket_quota": { 2019-11-29T19:53:14.676 INFO:teuthology.orchestra.run.smithi062.stdout: "enabled": false, 2019-11-29T19:53:14.676 INFO:teuthology.orchestra.run.smithi062.stdout: "check_on_raw": false, 2019-11-29T19:53:14.676 INFO:teuthology.orchestra.run.smithi062.stdout: "max_size": -1, 2019-11-29T19:53:14.676 INFO:teuthology.orchestra.run.smithi062.stdout: "max_size_kb": 0, 2019-11-29T19:53:14.676 INFO:teuthology.orchestra.run.smithi062.stdout: "max_objects": -1 2019-11-29T19:53:14.676 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2019-11-29T19:53:14.676 INFO:teuthology.orchestra.run.smithi062.stdout: "user_quota": { 2019-11-29T19:53:14.677 INFO:teuthology.orchestra.run.smithi062.stdout: "enabled": false, 2019-11-29T19:53:14.677 INFO:teuthology.orchestra.run.smithi062.stdout: "check_on_raw": false, 2019-11-29T19:53:14.677 INFO:teuthology.orchestra.run.smithi062.stdout: "max_size": -1, 2019-11-29T19:53:14.677 INFO:teuthology.orchestra.run.smithi062.stdout: "max_size_kb": 0, 2019-11-29T19:53:14.677 INFO:teuthology.orchestra.run.smithi062.stdout: "max_objects": -1 2019-11-29T19:53:14.677 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2019-11-29T19:53:14.677 INFO:teuthology.orchestra.run.smithi062.stdout: "temp_url_keys": [], 2019-11-29T19:53:14.677 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "rgw", 2019-11-29T19:53:14.678 INFO:teuthology.orchestra.run.smithi062.stdout: "mfa_ids": [] 2019-11-29T19:53:14.678 INFO:teuthology.orchestra.run.smithi062.stdout:} 2019-11-29T19:53:14.678 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T19:53:14.728 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:14.725+0000 7feb59f5bec0 20 remove_watcher() i=0 2019-11-29T19:53:14.728 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:14.725+0000 7feb59f5bec0 2 removed watcher, disabling cache 2019-11-29T19:53:14.792 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:14.788+0000 7feb59f5bec0 20 remove_watcher() i=1 2019-11-29T19:53:14.839 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:14.835+0000 7feb59f5bec0 20 remove_watcher() i=2 2019-11-29T19:53:14.899 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:14.895+0000 7feb59f5bec0 20 remove_watcher() i=3 2019-11-29T19:53:14.943 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:14.940+0000 7feb59f5bec0 20 remove_watcher() i=4 2019-11-29T19:53:15.009 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:15.005+0000 7feb59f5bec0 20 remove_watcher() i=5 2019-11-29T19:53:15.068 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:15.064+0000 7feb59f5bec0 20 remove_watcher() i=6 2019-11-29T19:53:15.121 INFO:teuthology.orchestra.run.smithi062.stderr:2019-11-29T19:53:15.118+0000 7feb59f5bec0 20 remove_watcher() i=7 2019-11-29T19:53:15.131 INFO:tasks.swift:Configuring testswift... 2019-11-29T19:53:15.131 INFO:teuthology.orchestra.run.smithi062:> cd /home/ubuntu/cephtest/swift && ./bootstrap 2019-11-29T19:53:17.566 INFO:teuthology.orchestra.run.smithi062.stdout:New python executable in /home/ubuntu/cephtest/swift/virtualenv/bin/python 2019-11-29T19:53:18.942 INFO:teuthology.orchestra.run.smithi062.stdout:Installing setuptools, pip, wheel...done. 2019-11-29T19:53:19.211 INFO:teuthology.orchestra.run.smithi062.stderr:Cache entry deserialization failed, entry ignored 2019-11-29T19:53:19.375 INFO:teuthology.orchestra.run.smithi062.stdout:Collecting pip 2019-11-29T19:53:19.498 INFO:teuthology.orchestra.run.smithi062.stdout: Using cached https://files.pythonhosted.org/packages/00/b6/9cfa56b4081ad13874b0c6f96af8ce16cfbc1cb06bedf8e9164ce5551ec1/pip-19.3.1-py2.py3-none-any.whl 2019-11-29T19:53:19.587 INFO:teuthology.orchestra.run.smithi062.stdout:Installing collected packages: pip 2019-11-29T19:53:19.587 INFO:teuthology.orchestra.run.smithi062.stdout: Found existing installation: pip 9.0.1 2019-11-29T19:53:19.690 INFO:teuthology.orchestra.run.smithi062.stdout: Uninstalling pip-9.0.1: 2019-11-29T19:53:19.768 INFO:teuthology.orchestra.run.smithi062.stdout: Successfully uninstalled pip-9.0.1 2019-11-29T19:53:20.642 INFO:teuthology.orchestra.run.smithi062.stdout:Successfully installed pip-19.3.1 2019-11-29T19:53:20.905 INFO:teuthology.orchestra.run.smithi062.stderr:DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support 2019-11-29T19:53:21.466 INFO:teuthology.orchestra.run.smithi062.stdout:Collecting setuptools==32.3.1 2019-11-29T19:53:21.469 INFO:teuthology.orchestra.run.smithi062.stdout: Using cached https://files.pythonhosted.org/packages/69/19/b1dff551058ce79d88b1e3688f1c735590d7ddf44d10681512133b35019f/setuptools-32.3.1-py2.py3-none-any.whl 2019-11-29T19:53:21.511 INFO:teuthology.orchestra.run.smithi062.stdout:Installing collected packages: setuptools 2019-11-29T19:53:21.511 INFO:teuthology.orchestra.run.smithi062.stdout: Found existing installation: setuptools 28.8.0 2019-11-29T19:53:21.531 INFO:teuthology.orchestra.run.smithi062.stdout: Uninstalling setuptools-28.8.0: 2019-11-29T19:53:21.545 INFO:teuthology.orchestra.run.smithi062.stdout: Successfully uninstalled setuptools-28.8.0 2019-11-29T19:53:21.716 INFO:teuthology.orchestra.run.smithi062.stdout:Successfully installed setuptools-32.3.1 2019-11-29T19:53:22.179 INFO:teuthology.orchestra.run.smithi062.stderr:DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support 2019-11-29T19:53:22.700 INFO:teuthology.orchestra.run.smithi062.stdout:Processing /home/ubuntu/.cache/pip/wheels/d9/45/dd/65f0b38450c47cf7e5312883deb97d065e030c5cca0a365030/PyYAML-5.1.2-cp27-cp27mu-linux_x86_64.whl 2019-11-29T19:53:22.765 INFO:teuthology.orchestra.run.smithi062.stdout:Collecting nose>=1.0.0 2019-11-29T19:53:22.767 INFO:teuthology.orchestra.run.smithi062.stdout: Using cached https://files.pythonhosted.org/packages/99/4f/13fb671119e65c4dce97c60e67d3fd9e6f7f809f2b307e2611f4701205cb/nose-1.3.7-py2-none-any.whl 2019-11-29T19:53:22.919 INFO:teuthology.orchestra.run.smithi062.stdout:Collecting boto>=2.0b4 2019-11-29T19:53:22.926 INFO:teuthology.orchestra.run.smithi062.stdout: Using cached https://files.pythonhosted.org/packages/23/10/c0b78c27298029e4454a472a1919bde20cb182dab1662cec7f2ca1dcc523/boto-2.49.0-py2.py3-none-any.whl 2019-11-29T19:53:23.073 INFO:teuthology.orchestra.run.smithi062.stdout:Processing /home/ubuntu/.cache/pip/wheels/56/0f/19/fbbf81e5764e6d8b74501c4357a88c14c94466ec777c03734c/bunch-1.0.1-cp27-none-any.whl 2019-11-29T19:53:23.446 INFO:teuthology.orchestra.run.smithi062.stdout:Collecting gevent>=0.14 2019-11-29T19:53:23.461 INFO:teuthology.orchestra.run.smithi062.stdout: Using cached https://files.pythonhosted.org/packages/e6/e9/3a693414f706e12abe60554cd73c5ae8f848b182ae58018f93d86c9eb418/gevent-1.4.0-cp27-cp27mu-manylinux1_x86_64.whl 2019-11-29T19:53:23.794 INFO:teuthology.orchestra.run.smithi062.stdout:Collecting isodate>=0.4.4 2019-11-29T19:53:23.796 INFO:teuthology.orchestra.run.smithi062.stdout: Using cached https://files.pythonhosted.org/packages/9b/9f/b36f7774ff5ea8e428fdcfc4bb332c39ee5b9362ddd3d40d9516a55221b2/isodate-0.6.0-py2.py3-none-any.whl 2019-11-29T19:53:23.861 INFO:teuthology.orchestra.run.smithi062.stdout:Collecting eventlet>=0.9.14 2019-11-29T19:53:23.918 INFO:teuthology.orchestra.run.smithi062.stdout: Downloading https://files.pythonhosted.org/packages/ef/01/83454d11bac9015f34e93cf11efcae169390ddf2df97cb73ca86de6465ed/eventlet-0.25.1-py2.py3-none-any.whl (222kB) 2019-11-29T19:53:24.128 INFO:teuthology.orchestra.run.smithi062.stdout:Collecting netifaces>=0.5 2019-11-29T19:53:24.139 INFO:teuthology.orchestra.run.smithi062.stdout: Downloading https://files.pythonhosted.org/packages/7e/02/ad1a92a72620cc17d448fe4dbdfbdf8fe1487ee7bfd82bb48308712c2f3c/netifaces-0.10.9-cp27-cp27mu-manylinux1_x86_64.whl 2019-11-29T19:53:24.254 INFO:teuthology.orchestra.run.smithi062.stdout:Collecting xattr<0.7.0,>=0.6 2019-11-29T19:53:24.266 INFO:teuthology.orchestra.run.smithi062.stdout: Downloading https://files.pythonhosted.org/packages/c5/80/b25d549ae4bf4f3e9635a331b759ffca2de4dd8a78dc5106d1ca92f5d08d/xattr-0.6.4.tar.gz 2019-11-29T19:53:24.674 INFO:teuthology.orchestra.run.smithi062.stdout:Collecting simplejson>=2.1.3 2019-11-29T19:53:24.684 INFO:teuthology.orchestra.run.smithi062.stdout: Downloading https://files.pythonhosted.org/packages/98/87/a7b98aa9256c8843f92878966dc3d8d914c14aad97e2c5ce4798d5743e07/simplejson-3.17.0.tar.gz (83kB) 2019-11-29T19:53:25.028 INFO:teuthology.orchestra.run.smithi062.stdout:Collecting WebOb==1.0 2019-11-29T19:53:25.039 INFO:teuthology.orchestra.run.smithi062.stdout: Downloading https://files.pythonhosted.org/packages/bc/eb/91b8dd8f3a8d3c3943bf27a2d322501ad8b227bf29f59e792c2eae092bc9/WebOb-1.0.tar.gz (210kB) 2019-11-29T19:53:25.469 INFO:teuthology.orchestra.run.smithi062.stdout:Collecting greenlet>=0.4.14; platform_python_implementation == "CPython" 2019-11-29T19:53:25.471 INFO:teuthology.orchestra.run.smithi062.stdout: Using cached https://files.pythonhosted.org/packages/8b/6e/f2d25875713ad0885c8d3c69269697406652e6f64e1a6bd8264f7a609327/greenlet-0.4.15-cp27-cp27mu-manylinux1_x86_64.whl 2019-11-29T19:53:25.534 INFO:teuthology.orchestra.run.smithi062.stdout:Collecting six 2019-11-29T19:53:25.536 INFO:teuthology.orchestra.run.smithi062.stdout: Using cached https://files.pythonhosted.org/packages/65/26/32b8464df2a97e6dd1b656ed26b2c194606c16fe163c695a992b36c11cdf/six-1.13.0-py2.py3-none-any.whl 2019-11-29T19:53:25.578 INFO:teuthology.orchestra.run.smithi062.stdout:Collecting monotonic>=1.4 2019-11-29T19:53:25.587 INFO:teuthology.orchestra.run.smithi062.stdout: Downloading https://files.pythonhosted.org/packages/ac/aa/063eca6a416f397bd99552c534c6d11d57f58f2e94c14780f3bbf818c4cf/monotonic-1.5-py2.py3-none-any.whl 2019-11-29T19:53:25.643 INFO:teuthology.orchestra.run.smithi062.stdout:Collecting dnspython>=1.15.0 2019-11-29T19:53:25.653 INFO:teuthology.orchestra.run.smithi062.stdout: Downloading https://files.pythonhosted.org/packages/ec/d3/3aa0e7213ef72b8585747aa0e271a9523e713813b9a20177ebe1e939deb0/dnspython-1.16.0-py2.py3-none-any.whl (188kB) 2019-11-29T19:53:25.769 INFO:teuthology.orchestra.run.smithi062.stdout:Collecting enum34; python_version < "3.4" 2019-11-29T19:53:25.775 INFO:teuthology.orchestra.run.smithi062.stdout: Downloading https://files.pythonhosted.org/packages/c5/db/e56e6b4bbac7c4a06de1c50de6fe1ef3810018ae11732a50f15f62c7d050/enum34-1.1.6-py2-none-any.whl 2019-11-29T19:53:25.810 INFO:teuthology.orchestra.run.smithi062.stdout:Building wheels for collected packages: xattr, simplejson, WebOb 2019-11-29T19:53:25.810 INFO:teuthology.orchestra.run.smithi062.stdout: Building wheel for xattr (setup.py): started 2019-11-29T19:53:26.288 INFO:teuthology.orchestra.run.smithi062.stdout: Building wheel for xattr (setup.py): finished with status 'done' 2019-11-29T19:53:26.288 INFO:teuthology.orchestra.run.smithi062.stdout: Created wheel for xattr: filename=xattr-0.6.4-cp27-cp27mu-linux_x86_64.whl size=24119 sha256=55fd8b42a25dbe9a3efac32721f5a4f8f24925277cc5fe07b7229ac3ad340ef5 2019-11-29T19:53:26.289 INFO:teuthology.orchestra.run.smithi062.stdout: Stored in directory: /home/ubuntu/.cache/pip/wheels/cb/2c/40/ea48345a21b521cdacebf61db13e3bf0c42c77ec664e3fe9e5 2019-11-29T19:53:26.293 INFO:teuthology.orchestra.run.smithi062.stdout: Building wheel for simplejson (setup.py): started 2019-11-29T19:53:27.281 INFO:teuthology.orchestra.run.smithi062.stdout: Building wheel for simplejson (setup.py): finished with status 'done' 2019-11-29T19:53:27.281 INFO:teuthology.orchestra.run.smithi062.stdout: Created wheel for simplejson: filename=simplejson-3.17.0-cp27-cp27mu-linux_x86_64.whl size=113117 sha256=e329eab486695c0dc47d3523a42a5f1ac9012eb5a29b26f33b2b547735da15f7 2019-11-29T19:53:27.282 INFO:teuthology.orchestra.run.smithi062.stdout: Stored in directory: /home/ubuntu/.cache/pip/wheels/86/c0/83/dcd0339abb2640544bb8e0938aab2d069cef55e5647ce6e097 2019-11-29T19:53:27.293 INFO:teuthology.orchestra.run.smithi062.stdout: Building wheel for WebOb (setup.py): started 2019-11-29T19:53:27.536 INFO:teuthology.orchestra.run.smithi062.stdout: Building wheel for WebOb (setup.py): finished with status 'done' 2019-11-29T19:53:27.536 INFO:teuthology.orchestra.run.smithi062.stdout: Created wheel for WebOb: filename=WebOb-1.0-cp27-none-any.whl size=58478 sha256=7bc3e38244e45e46fa7f26db84bfa989665cd3a7125383c592eecbfc42f048e4 2019-11-29T19:53:27.536 INFO:teuthology.orchestra.run.smithi062.stdout: Stored in directory: /home/ubuntu/.cache/pip/wheels/30/41/c0/8ff9e679d72e05f355e6e2ec87d026131538c953a3b12496eb 2019-11-29T19:53:27.543 INFO:teuthology.orchestra.run.smithi062.stdout:Successfully built xattr simplejson WebOb 2019-11-29T19:53:27.588 INFO:teuthology.orchestra.run.smithi062.stdout:Installing collected packages: PyYAML, nose, boto, bunch, greenlet, gevent, six, isodate, monotonic, dnspython, enum34, eventlet, netifaces, xattr, simplejson, WebOb 2019-11-29T19:53:29.208 INFO:teuthology.orchestra.run.smithi062.stdout:Successfully installed PyYAML-5.1.2 WebOb-1.0 boto-2.49.0 bunch-1.0.1 dnspython-1.16.0 enum34-1.1.6 eventlet-0.25.1 gevent-1.4.0 greenlet-0.4.15 isodate-0.6.0 monotonic-1.5 netifaces-0.10.9 nose-1.3.7 simplejson-3.17.0 six-1.13.0 xattr-0.6.4 2019-11-29T19:53:29.615 INFO:teuthology.orchestra.run.smithi062.stdout:running develop 2019-11-29T19:53:29.694 INFO:teuthology.orchestra.run.smithi062.stdout:running egg_info 2019-11-29T19:53:29.694 INFO:teuthology.orchestra.run.smithi062.stdout:creating swift.egg-info 2019-11-29T19:53:29.695 INFO:teuthology.orchestra.run.smithi062.stdout:writing swift.egg-info/PKG-INFO 2019-11-29T19:53:29.695 INFO:teuthology.orchestra.run.smithi062.stdout:writing top-level names to swift.egg-info/top_level.txt 2019-11-29T19:53:29.695 INFO:teuthology.orchestra.run.smithi062.stdout:writing dependency_links to swift.egg-info/dependency_links.txt 2019-11-29T19:53:29.702 INFO:teuthology.orchestra.run.smithi062.stdout:writing entry points to swift.egg-info/entry_points.txt 2019-11-29T19:53:29.702 INFO:teuthology.orchestra.run.smithi062.stdout:writing manifest file 'swift.egg-info/SOURCES.txt' 2019-11-29T19:53:29.708 INFO:teuthology.orchestra.run.smithi062.stdout:reading manifest file 'swift.egg-info/SOURCES.txt' 2019-11-29T19:53:29.708 INFO:teuthology.orchestra.run.smithi062.stdout:reading manifest template 'MANIFEST.in' 2019-11-29T19:53:29.708 INFO:teuthology.orchestra.run.smithi062.stderr:warning: no files found matching 'ChangeLog' 2019-11-29T19:53:29.714 INFO:teuthology.orchestra.run.smithi062.stdout:writing manifest file 'swift.egg-info/SOURCES.txt' 2019-11-29T19:53:29.716 INFO:teuthology.orchestra.run.smithi062.stdout:running build_ext 2019-11-29T19:53:29.716 INFO:teuthology.orchestra.run.smithi062.stdout:Creating /home/ubuntu/cephtest/swift/virtualenv/lib/python2.7/site-packages/swift.egg-link (link to .) 2019-11-29T19:53:29.717 INFO:teuthology.orchestra.run.smithi062.stdout:Adding swift 1.4.4 to easy-install.pth file 2019-11-29T19:53:29.742 INFO:teuthology.orchestra.run.smithi062.stdout:Installing swift script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-29T19:53:29.743 INFO:teuthology.orchestra.run.smithi062.stdout:Installing swift-account-auditor script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-29T19:53:29.747 INFO:teuthology.orchestra.run.smithi062.stdout:Installing swift-account-audit script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-29T19:53:29.748 INFO:teuthology.orchestra.run.smithi062.stdout:Installing swift-account-reaper script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-29T19:53:29.749 INFO:teuthology.orchestra.run.smithi062.stdout:Installing swift-account-replicator script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-29T19:53:29.751 INFO:teuthology.orchestra.run.smithi062.stdout:Installing swift-account-server script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-29T19:53:29.752 INFO:teuthology.orchestra.run.smithi062.stdout:Installing swift-container-auditor script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-29T19:53:29.753 INFO:teuthology.orchestra.run.smithi062.stdout:Installing swift-container-replicator script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-29T19:53:29.755 INFO:teuthology.orchestra.run.smithi062.stdout:Installing swift-container-sync script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-29T19:53:29.755 INFO:teuthology.orchestra.run.smithi062.stdout:Installing swift-container-server script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-29T19:53:29.756 INFO:teuthology.orchestra.run.smithi062.stdout:Installing swift-container-updater script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-29T19:53:29.759 INFO:teuthology.orchestra.run.smithi062.stdout:Installing swift-drive-audit script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-29T19:53:29.766 INFO:teuthology.orchestra.run.smithi062.stdout:Installing swift-get-nodes script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-29T19:53:29.767 INFO:teuthology.orchestra.run.smithi062.stdout:Installing swift-init script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-29T19:53:29.767 INFO:teuthology.orchestra.run.smithi062.stdout:Installing swift-object-auditor script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-29T19:53:29.767 INFO:teuthology.orchestra.run.smithi062.stdout:Installing swift-object-expirer script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-29T19:53:29.767 INFO:teuthology.orchestra.run.smithi062.stdout:Installing swift-object-info script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-29T19:53:29.767 INFO:teuthology.orchestra.run.smithi062.stdout:Installing swift-object-replicator script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-29T19:53:29.768 INFO:teuthology.orchestra.run.smithi062.stdout:Installing swift-object-server script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-29T19:53:29.768 INFO:teuthology.orchestra.run.smithi062.stdout:Installing swift-object-updater script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-29T19:53:29.768 INFO:teuthology.orchestra.run.smithi062.stdout:Installing swift-proxy-server script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-29T19:53:29.783 INFO:teuthology.orchestra.run.smithi062.stdout:Installing swift-ring-builder script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-29T19:53:29.784 INFO:teuthology.orchestra.run.smithi062.stdout:Installing swift-stats-populate script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-29T19:53:29.784 INFO:teuthology.orchestra.run.smithi062.stdout:Installing swift-stats-report script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-29T19:53:29.784 INFO:teuthology.orchestra.run.smithi062.stdout:Installing swift-dispersion-populate script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-29T19:53:29.784 INFO:teuthology.orchestra.run.smithi062.stdout:Installing swift-dispersion-report script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-29T19:53:29.785 INFO:teuthology.orchestra.run.smithi062.stdout:Installing swift-bench script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-29T19:53:29.793 INFO:teuthology.orchestra.run.smithi062.stdout:Installing swift-recon script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-29T19:53:29.793 INFO:teuthology.orchestra.run.smithi062.stdout:Installing swift-recon-cron script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-29T19:53:29.793 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-11-29T19:53:29.793 INFO:teuthology.orchestra.run.smithi062.stdout:Installed /home/ubuntu/cephtest/swift 2019-11-29T19:53:29.793 INFO:teuthology.orchestra.run.smithi062.stdout:Processing dependencies for swift==1.4.4 2019-11-29T19:53:29.794 INFO:teuthology.orchestra.run.smithi062.stdout:Finished processing dependencies for swift==1.4.4 2019-11-29T19:53:29.802 INFO:teuthology.orchestra.run.smithi062:> cat > /home/ubuntu/cephtest/archive/testswift.client.0.conf 2019-11-29T19:53:29.857 INFO:teuthology.orchestra.run.smithi062:> SWIFT_TEST_CONFIG_FILE=/home/ubuntu/cephtest/archive/testswift.client.0.conf /home/ubuntu/cephtest/swift/virtualenv/bin/nosetests -w /home/ubuntu/cephtest/swift/test/functional -v -a '!fails_on_rgw' 2019-11-29T19:54:09.079 INFO:teuthology.orchestra.run.smithi062.stderr:testAccountHead (test.functional.tests.TestAccount) ... ok 2019-11-29T19:54:25.495 INFO:teuthology.orchestra.run.smithi062.stderr:testContainerListing (test.functional.tests.TestAccount) ... ok 2019-11-29T19:58:14.929 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:07:32:55.586 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T19:58:14.941 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:07:32:55.599 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T19:58:14.944 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:07:32:55.550 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T19:58:14.946 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:07:32:55.553 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T19:58:14.948 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:07:32:55.555 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T19:58:14.949 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:07:32:55.556 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T19:58:15.145 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:07:32:55.752 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T19:58:15.164 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:07:32:55.771 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T19:58:15.181 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:07:32:55.839 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T19:58:23.447 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:07:33:04.105 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T19:58:23.489 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:07:33:04.096 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T19:58:23.496 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:07:33:04.102 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T19:58:23.497 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:07:33:04.155 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T19:58:23.498 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:07:33:04.104 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T19:58:23.519 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:07:33:04.125 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T19:58:23.528 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:07:33:04.135 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T19:58:23.530 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:07:33:04.188 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T19:58:23.557 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:07:33:04.164 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T19:59:39.602 INFO:teuthology.orchestra.run.smithi062.stderr:testContainerSerializedInfo (test.functional.tests.TestAccount) ... ok 2019-11-29T19:59:54.012 INFO:teuthology.orchestra.run.smithi062.stderr:testContainersOrderedByName (test.functional.tests.TestAccount) ... ok 2019-11-29T19:59:59.019 INFO:teuthology.orchestra.run.smithi062.stderr:testInvalidAuthToken (test.functional.tests.TestAccount) ... ok 2019-11-29T20:00:14.958 INFO:teuthology.orchestra.run.smithi062.stderr:testLastContainerMarker (test.functional.tests.TestAccount) ... ok 2019-11-29T20:00:37.066 INFO:teuthology.orchestra.run.smithi062.stderr:testListingLimit (test.functional.tests.TestAccount) ... ok 2019-11-29T20:01:34.226 INFO:teuthology.orchestra.run.smithi062.stderr:testMarkerLimitContainerList (test.functional.tests.TestAccount) ... ok 2019-11-29T20:01:35.050 INFO:teuthology.orchestra.run.smithi062.stderr:testPUT (test.functional.tests.TestAccount) ... ok 2019-11-29T20:03:24.709 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:07:38:05.367 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T20:03:24.714 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:07:38:05.373 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T20:03:24.725 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:07:38:05.332 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T20:03:24.728 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:07:38:05.335 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T20:03:24.731 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:07:38:05.338 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T20:03:24.736 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:07:38:05.343 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T20:03:24.955 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:07:38:05.562 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T20:03:24.957 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:07:38:05.564 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T20:03:24.977 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:07:38:05.635 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T20:06:45.420 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:07:41:26.078 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T20:06:45.430 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:07:41:26.088 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T20:06:45.433 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:07:41:26.040 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T20:06:45.440 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:07:41:26.047 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T20:06:45.472 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:07:41:26.079 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T20:06:45.474 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:07:41:26.081 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T20:06:45.528 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:07:41:26.135 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T20:06:45.554 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:07:41:26.212 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T20:06:45.566 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:07:41:26.173 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T20:08:35.260 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:07:43:15.918 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T20:08:35.269 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:07:43:15.926 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T20:08:35.299 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:07:43:15.895 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T20:08:35.299 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:07:43:15.896 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T20:08:35.299 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:07:43:15.900 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T20:08:35.303 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:07:43:15.903 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T20:08:35.378 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:07:43:16.035 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T20:08:35.409 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:07:43:16.016 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T20:08:35.418 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:07:43:16.024 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T20:09:00.897 INFO:teuthology.orchestra.run.smithi062.stderr:testGetRequest (test.functional.tests.TestAccountNoContainers) ... ok 2019-11-29T20:09:04.685 INFO:teuthology.orchestra.run.smithi062.stderr:testGetRequest (test.functional.tests.TestAccountNoContainersUTF8) ... ok 2019-11-29T20:09:34.530 INFO:teuthology.orchestra.run.smithi062.stderr:testAccountHead (test.functional.tests.TestAccountUTF8) ... ok 2019-11-29T20:09:47.311 INFO:teuthology.orchestra.run.smithi062.stderr:testContainerListing (test.functional.tests.TestAccountUTF8) ... ok 2019-11-29T20:13:46.791 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:07:48:27.449 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T20:13:46.799 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:07:48:27.457 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T20:13:46.807 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:07:48:27.414 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T20:13:46.811 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:07:48:27.418 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T20:13:46.813 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:07:48:27.420 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T20:13:46.818 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:07:48:27.425 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T20:13:47.055 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:07:48:27.713 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T20:13:47.056 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:07:48:27.662 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T20:13:47.079 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:07:48:27.686 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T20:15:07.719 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:07:49:48.377 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T20:15:07.730 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:07:49:48.388 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T20:15:07.772 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:07:49:48.379 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T20:15:07.774 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:07:49:48.381 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T20:15:07.774 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:07:49:48.381 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T20:15:07.821 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:07:49:48.428 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T20:15:07.844 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:07:49:48.451 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T20:15:07.857 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:07:49:48.515 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T20:15:07.875 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:07:49:48.482 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T20:15:17.991 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:07:49:58.649 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T20:15:18.033 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:07:49:58.691 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T20:15:18.071 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:07:49:58.729 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T20:15:18.071 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:07:49:58.678 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T20:15:18.084 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:07:49:58.683 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T20:15:18.085 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:07:49:58.688 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T20:15:18.086 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:07:49:58.693 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T20:15:18.100 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:07:49:58.707 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T20:15:18.110 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:07:49:58.717 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T20:16:39.577 INFO:teuthology.orchestra.run.smithi062.stderr:testContainerSerializedInfo (test.functional.tests.TestAccountUTF8) ... ok 2019-11-29T20:16:53.577 INFO:teuthology.orchestra.run.smithi062.stderr:testContainersOrderedByName (test.functional.tests.TestAccountUTF8) ... ok 2019-11-29T20:16:59.324 INFO:teuthology.orchestra.run.smithi062.stderr:testInvalidAuthToken (test.functional.tests.TestAccountUTF8) ... ok 2019-11-29T20:17:17.884 INFO:teuthology.orchestra.run.smithi062.stderr:testLastContainerMarker (test.functional.tests.TestAccountUTF8) ... ok 2019-11-29T20:17:39.430 INFO:teuthology.orchestra.run.smithi062.stderr:testListingLimit (test.functional.tests.TestAccountUTF8) ... ok 2019-11-29T20:18:57.825 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:07:53:38.483 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T20:18:57.834 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:07:53:38.492 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T20:18:57.838 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:07:53:38.445 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T20:18:57.843 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:07:53:38.449 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T20:18:57.844 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:07:53:38.451 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T20:18:57.856 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:07:53:38.463 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T20:18:57.985 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:07:53:38.592 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T20:18:58.011 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:07:53:38.669 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T20:18:58.015 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:07:53:38.622 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T20:19:17.025 INFO:teuthology.orchestra.run.smithi062.stderr:testMarkerLimitContainerList (test.functional.tests.TestAccountUTF8) ... ok 2019-11-29T20:19:17.545 INFO:teuthology.orchestra.run.smithi062.stderr:testPUT (test.functional.tests.TestAccountUTF8) ... ok 2019-11-29T20:23:30.027 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:07:58:10.684 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T20:23:30.030 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:07:58:10.688 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T20:23:30.052 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:07:58:10.659 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T20:23:30.068 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:07:58:10.675 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T20:23:30.070 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:07:58:10.677 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T20:23:30.072 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:07:58:10.679 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T20:23:30.197 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:07:58:10.856 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T20:23:30.237 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:07:58:10.844 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T20:23:30.244 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:07:58:10.851 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T20:24:09.870 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:07:58:50.528 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T20:24:09.877 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:07:58:50.535 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T20:24:09.885 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:07:58:50.492 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T20:24:09.891 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:07:58:50.498 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T20:24:09.892 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:07:58:50.499 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T20:24:09.905 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:07:58:50.512 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T20:24:09.942 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:07:58:50.600 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T20:24:09.943 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:07:58:50.550 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T20:24:09.954 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:07:58:50.561 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T20:28:43.359 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:28:43.345+0000 1694c700 -1 osd.7 135 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:28:01.079662+0000 front 2019-11-29T20:28:01.193856+0000 (oldest deadline 2019-11-29T20:28:43.278044+0000) 2019-11-29T20:28:44.249 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:28:44.220+0000 1694c700 -1 osd.4 135 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:28:00.204414+0000 front 2019-11-29T20:28:00.211257+0000 (oldest deadline 2019-11-29T20:28:43.660633+0000) 2019-11-29T20:28:44.391 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:28:44.384+0000 1694c700 -1 osd.7 135 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:28:01.079662+0000 front 2019-11-29T20:28:01.193856+0000 (oldest deadline 2019-11-29T20:28:43.278044+0000) 2019-11-29T20:28:44.482 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:28:44.473+0000 1694c700 -1 osd.2 135 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:28:02.686349+0000 front 2019-11-29T20:28:02.943988+0000 (oldest deadline 2019-11-29T20:28:43.423054+0000) 2019-11-29T20:28:44.618 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:28:44.609+0000 1694c700 -1 osd.1 135 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:27:59.565314+0000 front 2019-11-29T20:27:59.720744+0000 (oldest deadline 2019-11-29T20:28:44.231177+0000) 2019-11-29T20:28:45.045 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:28:45.036+0000 1694c700 -1 osd.6 135 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:27:58.642130+0000 front 2019-11-29T20:27:58.733316+0000 (oldest deadline 2019-11-29T20:28:44.261957+0000) 2019-11-29T20:28:45.215 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:28:45.200+0000 1694c700 -1 osd.5 135 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:28:02.943432+0000 front 2019-11-29T20:28:03.207548+0000 (oldest deadline 2019-11-29T20:28:44.379300+0000) 2019-11-29T20:28:45.295 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:28:45.289+0000 1694c700 -1 osd.4 135 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:28:00.204414+0000 front 2019-11-29T20:28:00.211257+0000 (oldest deadline 2019-11-29T20:28:43.660633+0000) 2019-11-29T20:28:45.392 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:28:45.374+0000 1694c700 -1 osd.7 135 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:28:01.079662+0000 front 2019-11-29T20:28:01.193856+0000 (oldest deadline 2019-11-29T20:28:43.278044+0000) 2019-11-29T20:28:45.498 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:28:45.492+0000 1694c700 -1 osd.2 135 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:28:02.686349+0000 front 2019-11-29T20:28:02.943988+0000 (oldest deadline 2019-11-29T20:28:43.423054+0000) 2019-11-29T20:28:45.628 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:28:45.621+0000 1694c700 -1 osd.1 135 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:27:59.565314+0000 front 2019-11-29T20:27:59.720744+0000 (oldest deadline 2019-11-29T20:28:44.231177+0000) 2019-11-29T20:28:45.906 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:28:45.893+0000 1694c700 -1 osd.0 135 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:27:59.914000+0000 front 2019-11-29T20:27:59.920946+0000 (oldest deadline 2019-11-29T20:28:45.101133+0000) 2019-11-29T20:28:46.011 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:28:46.005+0000 1694c700 -1 osd.6 135 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:27:58.642130+0000 front 2019-11-29T20:27:58.733316+0000 (oldest deadline 2019-11-29T20:28:44.261957+0000) 2019-11-29T20:28:46.243 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:28:46.237+0000 1694c700 -1 osd.5 135 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:28:02.943432+0000 front 2019-11-29T20:28:03.207548+0000 (oldest deadline 2019-11-29T20:28:44.379300+0000) 2019-11-29T20:28:46.324 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:28:46.319+0000 1694c700 -1 osd.4 135 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:28:00.204414+0000 front 2019-11-29T20:28:00.211257+0000 (oldest deadline 2019-11-29T20:28:43.660633+0000) 2019-11-29T20:28:46.387 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:28:46.382+0000 1694c700 -1 osd.7 135 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:28:01.079662+0000 front 2019-11-29T20:28:01.193856+0000 (oldest deadline 2019-11-29T20:28:43.278044+0000) 2019-11-29T20:28:46.645 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:28:46.640+0000 1694c700 -1 osd.1 135 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:27:59.565314+0000 front 2019-11-29T20:27:59.720744+0000 (oldest deadline 2019-11-29T20:28:44.231177+0000) 2019-11-29T20:29:12.501 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:08:03:53.159 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T20:29:12.505 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:08:03:53.163 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T20:29:12.517 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:08:03:53.123 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T20:29:12.521 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:08:03:53.128 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T20:29:12.522 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:08:03:53.129 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T20:29:12.524 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:08:03:53.131 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T20:29:12.714 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:08:03:53.372 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T20:29:12.728 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:08:03:53.335 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T20:29:12.729 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:08:03:53.336 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T20:29:43.887 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:29:43.882+0000 1694c700 -1 osd.2 138 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:29:03.159835+0000 front 2019-11-29T20:29:00.306022+0000 (oldest deadline 2019-11-29T20:29:43.136553+0000) 2019-11-29T20:29:44.690 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:29:44.685+0000 1694c700 -1 osd.0 138 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:28:59.453698+0000 front 2019-11-29T20:28:59.454919+0000 (oldest deadline 2019-11-29T20:29:44.096137+0000) 2019-11-29T20:29:44.875 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:29:44.857+0000 1694c700 -1 osd.2 138 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:29:03.159835+0000 front 2019-11-29T20:29:00.306022+0000 (oldest deadline 2019-11-29T20:29:43.136553+0000) 2019-11-29T20:29:45.239 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:29:45.233+0000 1694c700 -1 osd.1 138 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:29:02.479388+0000 front 2019-11-29T20:29:02.800815+0000 (oldest deadline 2019-11-29T20:29:44.590580+0000) 2019-11-29T20:29:45.702 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:29:45.696+0000 1694c700 -1 osd.0 138 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:28:59.453698+0000 front 2019-11-29T20:28:59.454919+0000 (oldest deadline 2019-11-29T20:29:44.096137+0000) 2019-11-29T20:29:45.928 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:29:45.923+0000 1694c700 -1 osd.2 138 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:29:03.159835+0000 front 2019-11-29T20:29:00.306022+0000 (oldest deadline 2019-11-29T20:29:43.136553+0000) 2019-11-29T20:29:46.109 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:29:46.105+0000 1694c700 -1 osd.4 138 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:29:01.778006+0000 front 2019-11-29T20:29:01.818020+0000 (oldest deadline 2019-11-29T20:29:45.623855+0000) 2019-11-29T20:29:46.224 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:29:46.220+0000 1694c700 -1 osd.1 138 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:29:02.479388+0000 front 2019-11-29T20:29:02.800815+0000 (oldest deadline 2019-11-29T20:29:44.590580+0000) 2019-11-29T20:29:46.752 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:29:46.738+0000 1694c700 -1 osd.0 138 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:28:59.453698+0000 front 2019-11-29T20:28:59.454919+0000 (oldest deadline 2019-11-29T20:29:44.096137+0000) 2019-11-29T20:29:46.903 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:29:46.898+0000 1694c700 -1 osd.2 138 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:29:03.159835+0000 front 2019-11-29T20:29:00.306022+0000 (oldest deadline 2019-11-29T20:29:43.136553+0000) 2019-11-29T20:29:46.904 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:29:46.899+0000 1694c700 -1 osd.7 138 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:29:01.462356+0000 front 2019-11-29T20:29:01.469178+0000 (oldest deadline 2019-11-29T20:29:46.781422+0000) 2019-11-29T20:29:47.147 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:29:47.141+0000 1694c700 -1 osd.4 138 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:29:01.778006+0000 front 2019-11-29T20:29:01.818020+0000 (oldest deadline 2019-11-29T20:29:45.623855+0000) 2019-11-29T20:29:47.197 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:29:47.185+0000 1694c700 -1 osd.1 138 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:29:02.479388+0000 front 2019-11-29T20:29:02.800815+0000 (oldest deadline 2019-11-29T20:29:44.590580+0000) 2019-11-29T20:29:47.929 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:29:47.925+0000 1694c700 -1 osd.2 138 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:29:03.159835+0000 front 2019-11-29T20:29:00.306022+0000 (oldest deadline 2019-11-29T20:29:43.136553+0000) 2019-11-29T20:29:47.953 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:29:47.949+0000 1694c700 -1 osd.7 138 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:29:01.462356+0000 front 2019-11-29T20:29:01.469178+0000 (oldest deadline 2019-11-29T20:29:46.781422+0000) 2019-11-29T20:29:59.480 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:29:59.472+0000 114ab700 -1 osd.4 141 build_incremental_map_msg missing incremental map 141 2019-11-29T20:29:59.598 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:29:59.592+0000 124ad700 -1 osd.6 141 build_incremental_map_msg missing incremental map 141 2019-11-29T20:29:59.605 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:29:59.599+0000 124ad700 -1 osd.6 141 build_incremental_map_msg missing incremental map 141 2019-11-29T20:29:59.732 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:29:59.727+0000 11cac700 -1 osd.4 141 build_incremental_map_msg missing incremental map 141 2019-11-29T20:31:04.575 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:31:04.500+0000 31783700 -1 osd.5 147 build_incremental_map_msg missing incremental map 147 2019-11-29T20:31:04.937 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:31:04.892+0000 31783700 -1 osd.5 147 build_incremental_map_msg missing incremental map 147 2019-11-29T20:31:04.948 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:31:04.925+0000 36f8e700 -1 osd.5 147 build_incremental_map_msg missing incremental map 147 2019-11-29T20:31:05.025 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:31:05.017+0000 31f84700 -1 osd.5 147 build_incremental_map_msg missing incremental map 147 2019-11-29T20:31:32.714 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:31:32.264+0000 1694c700 -1 osd.3 147 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:129962 7.5 7:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected e145) 2019-11-29T20:31:33.411 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:31:33.241+0000 1694c700 -1 osd.3 147 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:129962 7.5 7:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected e145) 2019-11-29T20:31:52.085 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:08:06:32.743 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T20:31:52.092 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:08:06:32.751 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T20:31:52.107 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:08:06:32.714 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T20:31:52.117 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:08:06:32.724 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T20:31:52.124 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:08:06:32.731 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T20:31:52.153 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:08:06:32.760 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T20:31:52.244 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:08:06:32.903 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T20:31:52.267 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:08:06:32.874 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T20:31:52.305 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:08:06:32.912 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T20:32:26.491 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:32:26.485+0000 1694c700 -1 osd.1 147 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:31:42.665256+0000 front 2019-11-29T20:31:42.856895+0000 (oldest deadline 2019-11-29T20:32:26.463586+0000) 2019-11-29T20:32:27.037 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:32:27.031+0000 1694c700 -1 osd.4 147 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:31:41.070755+0000 front 2019-11-29T20:31:41.385133+0000 (oldest deadline 2019-11-29T20:32:26.341986+0000) 2019-11-29T20:32:27.478 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:32:27.470+0000 1694c700 -1 osd.1 147 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:31:42.665256+0000 front 2019-11-29T20:31:42.856895+0000 (oldest deadline 2019-11-29T20:32:26.463586+0000) 2019-11-29T20:32:28.008 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:32:28.003+0000 1694c700 -1 osd.4 147 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:31:41.070755+0000 front 2019-11-29T20:31:41.385133+0000 (oldest deadline 2019-11-29T20:32:26.341986+0000) 2019-11-29T20:32:28.090 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:32:28.084+0000 1694c700 -1 osd.6 147 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:31:42.887333+0000 front 2019-11-29T20:31:42.757960+0000 (oldest deadline 2019-11-29T20:32:27.949729+0000) 2019-11-29T20:32:28.500 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:32:28.494+0000 1694c700 -1 osd.1 147 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:31:42.665256+0000 front 2019-11-29T20:31:42.856895+0000 (oldest deadline 2019-11-29T20:32:26.463586+0000) 2019-11-29T20:32:28.987 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:32:28.981+0000 1694c700 -1 osd.4 147 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:31:41.070755+0000 front 2019-11-29T20:31:41.385133+0000 (oldest deadline 2019-11-29T20:32:26.341986+0000) 2019-11-29T20:32:29.090 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:32:29.074+0000 1694c700 -1 osd.6 147 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:31:42.887333+0000 front 2019-11-29T20:31:42.757960+0000 (oldest deadline 2019-11-29T20:32:27.949729+0000) 2019-11-29T20:32:29.476 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:32:29.471+0000 1694c700 -1 osd.1 147 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:31:42.665256+0000 front 2019-11-29T20:31:42.856895+0000 (oldest deadline 2019-11-29T20:32:26.463586+0000) 2019-11-29T20:32:29.805 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:32:29.800+0000 1694c700 -1 osd.0 147 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:31:44.534246+0000 front 2019-11-29T20:31:44.485366+0000 (oldest deadline 2019-11-29T20:32:29.097896+0000) 2019-11-29T20:32:29.985 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:32:29.980+0000 1694c700 -1 osd.4 147 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:31:41.070755+0000 front 2019-11-29T20:31:41.385133+0000 (oldest deadline 2019-11-29T20:32:26.341986+0000) 2019-11-29T20:32:30.064 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:32:30.058+0000 1694c700 -1 osd.6 147 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:31:42.887333+0000 front 2019-11-29T20:31:42.757960+0000 (oldest deadline 2019-11-29T20:32:27.949729+0000) 2019-11-29T20:32:30.074 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:32:30.068+0000 1694c700 -1 osd.7 147 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:31:44.158274+0000 front 2019-11-29T20:31:44.130766+0000 (oldest deadline 2019-11-29T20:32:29.301884+0000) 2019-11-29T20:32:30.445 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:32:30.439+0000 1694c700 -1 osd.1 147 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:31:42.665256+0000 front 2019-11-29T20:31:42.856895+0000 (oldest deadline 2019-11-29T20:32:26.463586+0000) 2019-11-29T20:32:30.774 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:32:30.767+0000 1694c700 -1 osd.0 147 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:31:44.534246+0000 front 2019-11-29T20:31:44.485366+0000 (oldest deadline 2019-11-29T20:32:29.097896+0000) 2019-11-29T20:32:31.037 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:32:31.031+0000 1694c700 -1 osd.4 147 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:31:41.070755+0000 front 2019-11-29T20:31:41.385133+0000 (oldest deadline 2019-11-29T20:32:26.341986+0000) 2019-11-29T20:32:31.065 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:32:31.059+0000 1694c700 -1 osd.6 147 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:31:42.887333+0000 front 2019-11-29T20:31:42.757960+0000 (oldest deadline 2019-11-29T20:32:27.949729+0000) 2019-11-29T20:32:31.097 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:32:31.092+0000 1694c700 -1 osd.7 147 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:31:44.158274+0000 front 2019-11-29T20:31:44.130766+0000 (oldest deadline 2019-11-29T20:32:29.301884+0000) 2019-11-29T20:32:31.177 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:32:31.171+0000 1694c700 -1 osd.5 147 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:31:44.681930+0000 front 2019-11-29T20:31:44.695420+0000 (oldest deadline 2019-11-29T20:32:30.416719+0000) 2019-11-29T20:32:31.452 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:32:31.446+0000 1694c700 -1 osd.1 147 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:31:42.665256+0000 front 2019-11-29T20:31:42.856895+0000 (oldest deadline 2019-11-29T20:32:26.463586+0000) 2019-11-29T20:32:31.633 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:32:31.627+0000 1694c700 -1 osd.2 147 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:31:45.443426+0000 front 2019-11-29T20:31:45.464191+0000 (oldest deadline 2019-11-29T20:32:30.724690+0000) 2019-11-29T20:32:31.762 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:32:31.758+0000 1694c700 -1 osd.0 147 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:31:44.534246+0000 front 2019-11-29T20:31:44.485366+0000 (oldest deadline 2019-11-29T20:32:29.097896+0000) 2019-11-29T20:32:32.027 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:32:32.020+0000 1694c700 -1 osd.4 147 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:31:41.070755+0000 front 2019-11-29T20:31:41.385133+0000 (oldest deadline 2019-11-29T20:32:26.341986+0000) 2019-11-29T20:32:32.108 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:32:32.102+0000 1694c700 -1 osd.6 147 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:31:42.887333+0000 front 2019-11-29T20:31:42.757960+0000 (oldest deadline 2019-11-29T20:32:27.949729+0000) 2019-11-29T20:32:32.130 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:32:32.125+0000 1694c700 -1 osd.7 147 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:31:44.158274+0000 front 2019-11-29T20:31:44.130766+0000 (oldest deadline 2019-11-29T20:32:29.301884+0000) 2019-11-29T20:32:32.187 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:32:32.177+0000 1694c700 -1 osd.5 147 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:31:44.681930+0000 front 2019-11-29T20:31:44.695420+0000 (oldest deadline 2019-11-29T20:32:30.416719+0000) 2019-11-29T20:32:32.451 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:32:32.441+0000 1694c700 -1 osd.1 147 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:31:42.665256+0000 front 2019-11-29T20:31:42.856895+0000 (oldest deadline 2019-11-29T20:32:26.463586+0000) 2019-11-29T20:32:32.758 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:32:32.752+0000 1694c700 -1 osd.0 147 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:31:44.534246+0000 front 2019-11-29T20:31:44.485366+0000 (oldest deadline 2019-11-29T20:32:29.097896+0000) 2019-11-29T20:32:33.124 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:32:33.117+0000 1694c700 -1 osd.6 147 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:31:42.887333+0000 front 2019-11-29T20:31:42.757960+0000 (oldest deadline 2019-11-29T20:32:27.949729+0000) 2019-11-29T20:33:28.567 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:08:08:09.226 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T20:33:28.574 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:08:08:09.233 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T20:33:28.591 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:08:08:09.198 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T20:33:28.591 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:08:08:09.198 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T20:33:28.594 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:08:08:09.201 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T20:33:28.597 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:08:08:09.203 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T20:33:28.691 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:08:08:09.349 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T20:33:28.703 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:08:08:09.310 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T20:33:28.728 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:08:08:09.335 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T20:33:29.953 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:33:29.949+0000 1694c700 -1 osd.2 150 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:32:47.097822+0000 front 2019-11-29T20:32:46.783153+0000 (oldest deadline 2019-11-29T20:33:29.624024+0000) 2019-11-29T20:33:30.102 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:33:30.095+0000 1694c700 -1 osd.6 150 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:32:47.420538+0000 front 2019-11-29T20:32:46.043553+0000 (oldest deadline 2019-11-29T20:33:29.922799+0000) 2019-11-29T20:33:31.000 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:33:30.994+0000 1694c700 -1 osd.2 150 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:32:47.097822+0000 front 2019-11-29T20:32:46.783153+0000 (oldest deadline 2019-11-29T20:33:29.624024+0000) 2019-11-29T20:33:31.088 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:33:31.083+0000 1694c700 -1 osd.6 150 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:32:47.420538+0000 front 2019-11-29T20:32:46.043553+0000 (oldest deadline 2019-11-29T20:33:29.922799+0000) 2019-11-29T20:33:31.132 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:33:31.125+0000 1694c700 -1 osd.0 150 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:32:46.748921+0000 front 2019-11-29T20:32:46.556908+0000 (oldest deadline 2019-11-29T20:33:30.657848+0000) 2019-11-29T20:33:31.990 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:33:31.985+0000 1694c700 -1 osd.2 150 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:32:47.097822+0000 front 2019-11-29T20:32:46.783153+0000 (oldest deadline 2019-11-29T20:33:29.624024+0000) 2019-11-29T20:33:32.059 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:33:32.055+0000 1694c700 -1 osd.6 150 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:32:47.420538+0000 front 2019-11-29T20:32:46.043553+0000 (oldest deadline 2019-11-29T20:33:29.922799+0000) 2019-11-29T20:33:32.183 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:33:32.178+0000 1694c700 -1 osd.0 150 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:32:46.748921+0000 front 2019-11-29T20:32:46.556908+0000 (oldest deadline 2019-11-29T20:33:30.657848+0000) 2019-11-29T20:33:32.627 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:33:32.622+0000 1694c700 -1 osd.1 150 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:32:46.493407+0000 front 2019-11-29T20:32:46.491663+0000 (oldest deadline 2019-11-29T20:33:32.346608+0000) 2019-11-29T20:33:32.876 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:33:32.870+0000 1694c700 -1 osd.7 150 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:32:48.280985+0000 front 2019-11-29T20:32:47.389221+0000 (oldest deadline 2019-11-29T20:33:32.667277+0000) 2019-11-29T20:33:32.981 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:33:32.974+0000 1694c700 -1 osd.2 150 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:32:47.097822+0000 front 2019-11-29T20:32:46.783153+0000 (oldest deadline 2019-11-29T20:33:29.624024+0000) 2019-11-29T20:33:33.108 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:33:33.096+0000 1694c700 -1 osd.6 150 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:32:47.420538+0000 front 2019-11-29T20:32:46.043553+0000 (oldest deadline 2019-11-29T20:33:29.922799+0000) 2019-11-29T20:33:33.181 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:33:33.176+0000 1694c700 -1 osd.0 150 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:32:46.748921+0000 front 2019-11-29T20:32:46.556908+0000 (oldest deadline 2019-11-29T20:33:30.657848+0000) 2019-11-29T20:33:33.655 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:33:33.650+0000 1694c700 -1 osd.1 150 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:32:46.493407+0000 front 2019-11-29T20:32:46.491663+0000 (oldest deadline 2019-11-29T20:33:32.346608+0000) 2019-11-29T20:33:33.688 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:33:33.683+0000 1694c700 -1 osd.4 150 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:32:48.262852+0000 front 2019-11-29T20:32:48.426742+0000 (oldest deadline 2019-11-29T20:33:33.536122+0000) 2019-11-29T20:33:33.920 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:33:33.915+0000 1694c700 -1 osd.7 150 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:32:48.280985+0000 front 2019-11-29T20:32:47.389221+0000 (oldest deadline 2019-11-29T20:33:32.667277+0000) 2019-11-29T20:33:34.016 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:33:34.011+0000 1694c700 -1 osd.2 150 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:32:47.097822+0000 front 2019-11-29T20:32:46.783153+0000 (oldest deadline 2019-11-29T20:33:29.624024+0000) 2019-11-29T20:33:34.131 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:33:34.126+0000 1694c700 -1 osd.6 150 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:32:47.420538+0000 front 2019-11-29T20:32:46.043553+0000 (oldest deadline 2019-11-29T20:33:29.922799+0000) 2019-11-29T20:33:34.149 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:33:34.144+0000 1694c700 -1 osd.0 150 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:32:46.748921+0000 front 2019-11-29T20:32:46.556908+0000 (oldest deadline 2019-11-29T20:33:30.657848+0000) 2019-11-29T20:33:34.615 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:33:34.610+0000 1694c700 -1 osd.1 150 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:32:46.493407+0000 front 2019-11-29T20:32:46.491663+0000 (oldest deadline 2019-11-29T20:33:32.346608+0000) 2019-11-29T20:33:34.724 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:33:34.718+0000 1694c700 -1 osd.4 150 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:32:48.262852+0000 front 2019-11-29T20:32:48.426742+0000 (oldest deadline 2019-11-29T20:33:33.536122+0000) 2019-11-29T20:33:34.957 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:33:34.951+0000 1694c700 -1 osd.7 150 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:32:48.280985+0000 front 2019-11-29T20:32:47.389221+0000 (oldest deadline 2019-11-29T20:33:32.667277+0000) 2019-11-29T20:33:34.980 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:33:34.975+0000 1694c700 -1 osd.2 150 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:32:47.097822+0000 front 2019-11-29T20:32:46.783153+0000 (oldest deadline 2019-11-29T20:33:29.624024+0000) 2019-11-29T20:33:35.135 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:33:35.129+0000 1694c700 -1 osd.6 150 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:32:47.420538+0000 front 2019-11-29T20:32:46.043553+0000 (oldest deadline 2019-11-29T20:33:29.922799+0000) 2019-11-29T20:33:35.172 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:33:35.167+0000 1694c700 -1 osd.0 150 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:32:46.748921+0000 front 2019-11-29T20:32:46.556908+0000 (oldest deadline 2019-11-29T20:33:30.657848+0000) 2019-11-29T20:33:35.577 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:33:35.569+0000 1694c700 -1 osd.1 150 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:32:46.493407+0000 front 2019-11-29T20:32:46.491663+0000 (oldest deadline 2019-11-29T20:33:32.346608+0000) 2019-11-29T20:33:35.703 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:33:35.698+0000 1694c700 -1 osd.4 150 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:32:48.262852+0000 front 2019-11-29T20:32:48.426742+0000 (oldest deadline 2019-11-29T20:33:33.536122+0000) 2019-11-29T20:33:35.911 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:33:35.905+0000 1694c700 -1 osd.7 150 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:32:48.280985+0000 front 2019-11-29T20:32:47.389221+0000 (oldest deadline 2019-11-29T20:33:32.667277+0000) 2019-11-29T20:33:35.966 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:33:35.961+0000 1694c700 -1 osd.2 150 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:32:47.097822+0000 front 2019-11-29T20:32:46.783153+0000 (oldest deadline 2019-11-29T20:33:29.624024+0000) 2019-11-29T20:33:36.118 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:33:36.113+0000 1694c700 -1 osd.6 150 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:32:47.420538+0000 front 2019-11-29T20:32:46.043553+0000 (oldest deadline 2019-11-29T20:33:29.922799+0000) 2019-11-29T20:33:36.133 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:33:36.127+0000 1694c700 -1 osd.0 150 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:32:46.748921+0000 front 2019-11-29T20:32:46.556908+0000 (oldest deadline 2019-11-29T20:33:30.657848+0000) 2019-11-29T20:33:36.544 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:33:36.532+0000 1694c700 -1 osd.1 150 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:32:46.493407+0000 front 2019-11-29T20:32:46.491663+0000 (oldest deadline 2019-11-29T20:33:32.346608+0000) 2019-11-29T20:33:36.693 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:33:36.686+0000 1694c700 -1 osd.4 150 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:32:48.262852+0000 front 2019-11-29T20:32:48.426742+0000 (oldest deadline 2019-11-29T20:33:33.536122+0000) 2019-11-29T20:33:36.951 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:33:36.947+0000 1694c700 -1 osd.7 150 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:32:48.280985+0000 front 2019-11-29T20:32:47.389221+0000 (oldest deadline 2019-11-29T20:33:32.667277+0000) 2019-11-29T20:33:37.006 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:33:37.002+0000 1694c700 -1 osd.2 150 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:32:47.097822+0000 front 2019-11-29T20:32:46.783153+0000 (oldest deadline 2019-11-29T20:33:29.624024+0000) 2019-11-29T20:33:37.103 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:33:37.098+0000 1694c700 -1 osd.6 150 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:32:47.420538+0000 front 2019-11-29T20:32:46.043553+0000 (oldest deadline 2019-11-29T20:33:29.922799+0000) 2019-11-29T20:33:37.136 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:33:37.131+0000 1694c700 -1 osd.0 150 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:32:46.748921+0000 front 2019-11-29T20:32:46.556908+0000 (oldest deadline 2019-11-29T20:33:30.657848+0000) 2019-11-29T20:33:37.559 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:33:37.543+0000 1694c700 -1 osd.1 150 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:32:46.493407+0000 front 2019-11-29T20:32:46.491663+0000 (oldest deadline 2019-11-29T20:33:32.346608+0000) 2019-11-29T20:33:37.913 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:33:37.909+0000 1694c700 -1 osd.7 150 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:32:48.280985+0000 front 2019-11-29T20:32:47.389221+0000 (oldest deadline 2019-11-29T20:33:32.667277+0000) 2019-11-29T20:33:38.106 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:33:38.101+0000 1694c700 -1 osd.6 150 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:32:47.420538+0000 front 2019-11-29T20:32:46.043553+0000 (oldest deadline 2019-11-29T20:33:29.922799+0000) 2019-11-29T20:33:46.389 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:33:46.364+0000 31783700 -1 osd.3 154 build_incremental_map_msg missing incremental map 154 2019-11-29T20:33:46.441 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:33:46.381+0000 31783700 -1 osd.3 154 build_incremental_map_msg missing incremental map 154 2019-11-29T20:33:46.576 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:33:46.559+0000 37f90700 -1 osd.3 154 build_incremental_map_msg missing incremental map 154 2019-11-29T20:35:17.860 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:35:17.565+0000 1694c700 -1 osd.3 159 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4325.0:117981 7.5 7:a8fbb3d4:::pubsub.user.foo.client.0.bucket.%ed%88%8e%ed%88%8d%e8%94%88%e5%98%86%eb%8c%8c%e5%98%87%e3%9c%86%e1%a0%84%e5%98%85%e5%98%87%eb%8c%8e%e5%98%85%e3%9c%84%eb%8c%8d%e1%a0%84%2f7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.612:head [getxattrs,stat] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected e157) 2019-11-29T20:35:18.530 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:35:18.525+0000 1694c700 -1 osd.3 159 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4325.0:117981 7.5 7:a8fbb3d4:::pubsub.user.foo.client.0.bucket.%ed%88%8e%ed%88%8d%e8%94%88%e5%98%86%eb%8c%8c%e5%98%87%e3%9c%86%e1%a0%84%e5%98%85%e5%98%87%eb%8c%8e%e5%98%85%e3%9c%84%eb%8c%8d%e1%a0%84%2f7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.612:head [getxattrs,stat] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected e157) 2019-11-29T20:36:12.258 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:36:12.239+0000 1694c700 -1 osd.5 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:28.740169+0000 front 2019-11-29T20:35:28.809330+0000 (oldest deadline 2019-11-29T20:36:11.450275+0000) 2019-11-29T20:36:13.143 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:36:13.135+0000 1694c700 -1 osd.0 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:28.927299+0000 front 2019-11-29T20:35:28.867976+0000 (oldest deadline 2019-11-29T20:36:12.335540+0000) 2019-11-29T20:36:13.217 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:36:13.210+0000 1694c700 -1 osd.5 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:28.740169+0000 front 2019-11-29T20:35:28.809330+0000 (oldest deadline 2019-11-29T20:36:11.450275+0000) 2019-11-29T20:36:13.440 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:36:13.435+0000 1694c700 -1 osd.2 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:27.700391+0000 front 2019-11-29T20:35:27.730257+0000 (oldest deadline 2019-11-29T20:36:12.963730+0000) 2019-11-29T20:36:13.809 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:36:13.803+0000 1694c700 -1 osd.7 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:27.778562+0000 front 2019-11-29T20:35:27.780429+0000 (oldest deadline 2019-11-29T20:36:13.648567+0000) 2019-11-29T20:36:13.883 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:36:13.876+0000 1694c700 -1 osd.1 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:28.519035+0000 front 2019-11-29T20:35:28.517910+0000 (oldest deadline 2019-11-29T20:36:13.751478+0000) 2019-11-29T20:36:14.152 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:36:14.146+0000 1694c700 -1 osd.0 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:28.927299+0000 front 2019-11-29T20:35:28.867976+0000 (oldest deadline 2019-11-29T20:36:12.335540+0000) 2019-11-29T20:36:14.245 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:36:14.238+0000 1694c700 -1 osd.5 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:28.740169+0000 front 2019-11-29T20:35:28.809330+0000 (oldest deadline 2019-11-29T20:36:11.450275+0000) 2019-11-29T20:36:14.429 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:36:14.423+0000 1694c700 -1 osd.2 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:27.700391+0000 front 2019-11-29T20:35:27.730257+0000 (oldest deadline 2019-11-29T20:36:12.963730+0000) 2019-11-29T20:36:14.521 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:36:14.515+0000 1694c700 -1 osd.6 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:29.066312+0000 front 2019-11-29T20:35:29.196983+0000 (oldest deadline 2019-11-29T20:36:13.743031+0000) 2019-11-29T20:36:14.550 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:36:14.544+0000 1694c700 -1 osd.4 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:29.648047+0000 front 2019-11-29T20:35:29.347157+0000 (oldest deadline 2019-11-29T20:36:13.901776+0000) 2019-11-29T20:36:14.790 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:36:14.780+0000 1694c700 -1 osd.7 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:27.778562+0000 front 2019-11-29T20:35:27.780429+0000 (oldest deadline 2019-11-29T20:36:13.648567+0000) 2019-11-29T20:36:14.838 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:36:14.831+0000 1694c700 -1 osd.1 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:28.519035+0000 front 2019-11-29T20:35:28.517910+0000 (oldest deadline 2019-11-29T20:36:13.751478+0000) 2019-11-29T20:36:15.169 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:36:15.164+0000 1694c700 -1 osd.0 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:28.927299+0000 front 2019-11-29T20:35:28.867976+0000 (oldest deadline 2019-11-29T20:36:12.335540+0000) 2019-11-29T20:36:15.226 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:36:15.219+0000 1694c700 -1 osd.5 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:28.740169+0000 front 2019-11-29T20:35:28.809330+0000 (oldest deadline 2019-11-29T20:36:11.450275+0000) 2019-11-29T20:36:15.412 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:36:15.407+0000 1694c700 -1 osd.2 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:27.700391+0000 front 2019-11-29T20:35:27.730257+0000 (oldest deadline 2019-11-29T20:36:12.963730+0000) 2019-11-29T20:36:15.559 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:36:15.552+0000 1694c700 -1 osd.6 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:29.066312+0000 front 2019-11-29T20:35:29.196983+0000 (oldest deadline 2019-11-29T20:36:13.743031+0000) 2019-11-29T20:36:15.565 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:36:15.559+0000 1694c700 -1 osd.4 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:29.648047+0000 front 2019-11-29T20:35:29.347157+0000 (oldest deadline 2019-11-29T20:36:13.901776+0000) 2019-11-29T20:36:15.835 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:36:15.828+0000 1694c700 -1 osd.7 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:27.778562+0000 front 2019-11-29T20:35:27.780429+0000 (oldest deadline 2019-11-29T20:36:13.648567+0000) 2019-11-29T20:36:15.866 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:36:15.861+0000 1694c700 -1 osd.1 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:28.519035+0000 front 2019-11-29T20:35:28.517910+0000 (oldest deadline 2019-11-29T20:36:13.751478+0000) 2019-11-29T20:36:16.175 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:36:16.171+0000 1694c700 -1 osd.0 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:28.927299+0000 front 2019-11-29T20:35:28.867976+0000 (oldest deadline 2019-11-29T20:36:12.335540+0000) 2019-11-29T20:36:16.253 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:36:16.246+0000 1694c700 -1 osd.5 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:28.740169+0000 front 2019-11-29T20:35:28.809330+0000 (oldest deadline 2019-11-29T20:36:11.450275+0000) 2019-11-29T20:36:16.401 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:36:16.395+0000 1694c700 -1 osd.2 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:27.700391+0000 front 2019-11-29T20:35:27.730257+0000 (oldest deadline 2019-11-29T20:36:12.963730+0000) 2019-11-29T20:36:16.525 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:36:16.518+0000 1694c700 -1 osd.6 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:29.066312+0000 front 2019-11-29T20:35:29.196983+0000 (oldest deadline 2019-11-29T20:36:13.743031+0000) 2019-11-29T20:36:16.589 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:36:16.582+0000 1694c700 -1 osd.4 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:29.648047+0000 front 2019-11-29T20:35:29.347157+0000 (oldest deadline 2019-11-29T20:36:13.901776+0000) 2019-11-29T20:36:16.830 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:36:16.822+0000 1694c700 -1 osd.7 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:27.778562+0000 front 2019-11-29T20:35:27.780429+0000 (oldest deadline 2019-11-29T20:36:13.648567+0000) 2019-11-29T20:36:16.919 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:36:16.912+0000 1694c700 -1 osd.1 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:28.519035+0000 front 2019-11-29T20:35:28.517910+0000 (oldest deadline 2019-11-29T20:36:13.751478+0000) 2019-11-29T20:36:17.224 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:36:17.219+0000 1694c700 -1 osd.0 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:28.927299+0000 front 2019-11-29T20:35:28.867976+0000 (oldest deadline 2019-11-29T20:36:12.335540+0000) 2019-11-29T20:36:17.278 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:36:17.271+0000 1694c700 -1 osd.5 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:28.740169+0000 front 2019-11-29T20:35:28.809330+0000 (oldest deadline 2019-11-29T20:36:11.450275+0000) 2019-11-29T20:36:17.369 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:36:17.361+0000 1694c700 -1 osd.2 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:27.700391+0000 front 2019-11-29T20:35:27.730257+0000 (oldest deadline 2019-11-29T20:36:12.963730+0000) 2019-11-29T20:36:17.541 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:36:17.535+0000 1694c700 -1 osd.6 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:29.066312+0000 front 2019-11-29T20:35:29.196983+0000 (oldest deadline 2019-11-29T20:36:13.743031+0000) 2019-11-29T20:36:17.580 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:36:17.571+0000 1694c700 -1 osd.4 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:29.648047+0000 front 2019-11-29T20:35:29.347157+0000 (oldest deadline 2019-11-29T20:36:13.901776+0000) 2019-11-29T20:36:17.812 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:36:17.804+0000 1694c700 -1 osd.7 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:27.778562+0000 front 2019-11-29T20:35:27.780429+0000 (oldest deadline 2019-11-29T20:36:13.648567+0000) 2019-11-29T20:36:17.879 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:36:17.873+0000 1694c700 -1 osd.1 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:28.519035+0000 front 2019-11-29T20:35:28.517910+0000 (oldest deadline 2019-11-29T20:36:13.751478+0000) 2019-11-29T20:36:18.234 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:36:18.228+0000 1694c700 -1 osd.0 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:28.927299+0000 front 2019-11-29T20:35:28.867976+0000 (oldest deadline 2019-11-29T20:36:12.335540+0000) 2019-11-29T20:36:18.306 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:36:18.301+0000 1694c700 -1 osd.5 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:28.740169+0000 front 2019-11-29T20:35:28.809330+0000 (oldest deadline 2019-11-29T20:36:11.450275+0000) 2019-11-29T20:36:18.326 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:36:18.322+0000 1694c700 -1 osd.2 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:27.700391+0000 front 2019-11-29T20:35:27.730257+0000 (oldest deadline 2019-11-29T20:36:12.963730+0000) 2019-11-29T20:36:18.549 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:36:18.537+0000 1694c700 -1 osd.6 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:29.066312+0000 front 2019-11-29T20:35:29.196983+0000 (oldest deadline 2019-11-29T20:36:13.743031+0000) 2019-11-29T20:36:18.568 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:36:18.562+0000 1694c700 -1 osd.4 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:29.648047+0000 front 2019-11-29T20:35:29.347157+0000 (oldest deadline 2019-11-29T20:36:13.901776+0000) 2019-11-29T20:36:18.823 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:36:18.817+0000 1694c700 -1 osd.7 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:27.778562+0000 front 2019-11-29T20:35:27.780429+0000 (oldest deadline 2019-11-29T20:36:13.648567+0000) 2019-11-29T20:36:18.935 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:36:18.927+0000 1694c700 -1 osd.1 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:28.519035+0000 front 2019-11-29T20:35:28.517910+0000 (oldest deadline 2019-11-29T20:36:13.751478+0000) 2019-11-29T20:36:19.215 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:36:19.210+0000 1694c700 -1 osd.0 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:28.927299+0000 front 2019-11-29T20:35:28.867976+0000 (oldest deadline 2019-11-29T20:36:12.335540+0000) 2019-11-29T20:36:19.284 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:36:19.273+0000 1694c700 -1 osd.5 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:28.740169+0000 front 2019-11-29T20:35:28.809330+0000 (oldest deadline 2019-11-29T20:36:11.450275+0000) 2019-11-29T20:36:19.372 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:36:19.365+0000 1694c700 -1 osd.2 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:27.700391+0000 front 2019-11-29T20:35:27.730257+0000 (oldest deadline 2019-11-29T20:36:12.963730+0000) 2019-11-29T20:36:19.573 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:36:19.567+0000 1694c700 -1 osd.6 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:29.066312+0000 front 2019-11-29T20:35:29.196983+0000 (oldest deadline 2019-11-29T20:36:13.743031+0000) 2019-11-29T20:36:19.611 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:36:19.603+0000 1694c700 -1 osd.4 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:29.648047+0000 front 2019-11-29T20:35:29.347157+0000 (oldest deadline 2019-11-29T20:36:13.901776+0000) 2019-11-29T20:36:19.823 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:36:19.817+0000 1694c700 -1 osd.7 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:27.778562+0000 front 2019-11-29T20:35:27.780429+0000 (oldest deadline 2019-11-29T20:36:13.648567+0000) 2019-11-29T20:36:19.965 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:36:19.957+0000 1694c700 -1 osd.1 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:28.519035+0000 front 2019-11-29T20:35:28.517910+0000 (oldest deadline 2019-11-29T20:36:13.751478+0000) 2019-11-29T20:36:20.211 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:36:20.205+0000 1694c700 -1 osd.0 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:28.927299+0000 front 2019-11-29T20:35:28.867976+0000 (oldest deadline 2019-11-29T20:36:12.335540+0000) 2019-11-29T20:36:20.309 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:36:20.304+0000 1694c700 -1 osd.5 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:28.740169+0000 front 2019-11-29T20:35:28.809330+0000 (oldest deadline 2019-11-29T20:36:11.450275+0000) 2019-11-29T20:36:20.333 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:36:20.329+0000 1694c700 -1 osd.2 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:27.700391+0000 front 2019-11-29T20:35:27.730257+0000 (oldest deadline 2019-11-29T20:36:12.963730+0000) 2019-11-29T20:36:20.580 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:36:20.575+0000 1694c700 -1 osd.6 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:29.066312+0000 front 2019-11-29T20:35:29.196983+0000 (oldest deadline 2019-11-29T20:36:13.743031+0000) 2019-11-29T20:36:20.592 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:36:20.586+0000 1694c700 -1 osd.4 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:29.648047+0000 front 2019-11-29T20:35:29.347157+0000 (oldest deadline 2019-11-29T20:36:13.901776+0000) 2019-11-29T20:36:20.868 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:36:20.859+0000 1694c700 -1 osd.7 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:27.778562+0000 front 2019-11-29T20:35:27.780429+0000 (oldest deadline 2019-11-29T20:36:13.648567+0000) 2019-11-29T20:36:20.929 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:36:20.922+0000 1694c700 -1 osd.1 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:28.519035+0000 front 2019-11-29T20:35:28.517910+0000 (oldest deadline 2019-11-29T20:36:13.751478+0000) 2019-11-29T20:36:21.257 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:36:21.251+0000 1694c700 -1 osd.0 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:28.927299+0000 front 2019-11-29T20:35:28.867976+0000 (oldest deadline 2019-11-29T20:36:12.335540+0000) 2019-11-29T20:36:21.324 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:36:21.317+0000 1694c700 -1 osd.2 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:27.700391+0000 front 2019-11-29T20:35:27.730257+0000 (oldest deadline 2019-11-29T20:36:12.963730+0000) 2019-11-29T20:36:21.335 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:36:21.329+0000 1694c700 -1 osd.5 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:28.740169+0000 front 2019-11-29T20:35:28.809330+0000 (oldest deadline 2019-11-29T20:36:11.450275+0000) 2019-11-29T20:36:21.545 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:36:21.534+0000 1694c700 -1 osd.6 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:29.066312+0000 front 2019-11-29T20:35:29.196983+0000 (oldest deadline 2019-11-29T20:36:13.743031+0000) 2019-11-29T20:36:21.564 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:36:21.558+0000 1694c700 -1 osd.4 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:29.648047+0000 front 2019-11-29T20:35:29.347157+0000 (oldest deadline 2019-11-29T20:36:13.901776+0000) 2019-11-29T20:36:21.884 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:36:21.877+0000 1694c700 -1 osd.1 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:28.519035+0000 front 2019-11-29T20:35:28.517910+0000 (oldest deadline 2019-11-29T20:36:13.751478+0000) 2019-11-29T20:36:21.886 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:36:21.880+0000 1694c700 -1 osd.7 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:27.778562+0000 front 2019-11-29T20:35:27.780429+0000 (oldest deadline 2019-11-29T20:36:13.648567+0000) 2019-11-29T20:36:22.303 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:36:22.297+0000 1694c700 -1 osd.2 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:27.700391+0000 front 2019-11-29T20:35:27.730257+0000 (oldest deadline 2019-11-29T20:36:12.963730+0000) 2019-11-29T20:36:22.304 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:36:22.298+0000 1694c700 -1 osd.0 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:28.927299+0000 front 2019-11-29T20:35:28.867976+0000 (oldest deadline 2019-11-29T20:36:12.335540+0000) 2019-11-29T20:36:22.332 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:36:22.326+0000 1694c700 -1 osd.5 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:28.740169+0000 front 2019-11-29T20:35:28.809330+0000 (oldest deadline 2019-11-29T20:36:11.450275+0000) 2019-11-29T20:36:22.518 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:36:22.511+0000 1694c700 -1 osd.6 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:29.066312+0000 front 2019-11-29T20:35:29.196983+0000 (oldest deadline 2019-11-29T20:36:13.743031+0000) 2019-11-29T20:36:22.563 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:36:22.554+0000 1694c700 -1 osd.4 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:29.648047+0000 front 2019-11-29T20:35:29.347157+0000 (oldest deadline 2019-11-29T20:36:13.901776+0000) 2019-11-29T20:36:22.844 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:36:22.839+0000 1694c700 -1 osd.7 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:27.778562+0000 front 2019-11-29T20:35:27.780429+0000 (oldest deadline 2019-11-29T20:36:13.648567+0000) 2019-11-29T20:36:22.919 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:36:22.914+0000 1694c700 -1 osd.1 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:28.519035+0000 front 2019-11-29T20:35:28.517910+0000 (oldest deadline 2019-11-29T20:36:13.751478+0000) 2019-11-29T20:36:23.283 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:36:23.277+0000 1694c700 -1 osd.0 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:28.927299+0000 front 2019-11-29T20:35:28.867976+0000 (oldest deadline 2019-11-29T20:36:12.335540+0000) 2019-11-29T20:36:23.302 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:36:23.295+0000 1694c700 -1 osd.2 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:27.700391+0000 front 2019-11-29T20:35:27.730257+0000 (oldest deadline 2019-11-29T20:36:12.963730+0000) 2019-11-29T20:36:23.353 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:36:23.347+0000 1694c700 -1 osd.5 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:28.740169+0000 front 2019-11-29T20:35:28.809330+0000 (oldest deadline 2019-11-29T20:36:11.450275+0000) 2019-11-29T20:36:23.531 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:36:23.524+0000 1694c700 -1 osd.4 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:29.648047+0000 front 2019-11-29T20:35:29.347157+0000 (oldest deadline 2019-11-29T20:36:13.901776+0000) 2019-11-29T20:36:23.537 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:36:23.531+0000 1694c700 -1 osd.6 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:29.066312+0000 front 2019-11-29T20:35:29.196983+0000 (oldest deadline 2019-11-29T20:36:13.743031+0000) 2019-11-29T20:36:23.829 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:36:23.823+0000 1694c700 -1 osd.7 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:27.778562+0000 front 2019-11-29T20:35:27.780429+0000 (oldest deadline 2019-11-29T20:36:13.648567+0000) 2019-11-29T20:36:23.874 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:36:23.869+0000 1694c700 -1 osd.1 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:28.519035+0000 front 2019-11-29T20:35:28.517910+0000 (oldest deadline 2019-11-29T20:36:13.751478+0000) 2019-11-29T20:36:24.309 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:36:24.304+0000 1694c700 -1 osd.0 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:28.927299+0000 front 2019-11-29T20:35:28.867976+0000 (oldest deadline 2019-11-29T20:36:12.335540+0000) 2019-11-29T20:36:24.343 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:36:24.332+0000 1694c700 -1 osd.5 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:28.740169+0000 front 2019-11-29T20:35:28.809330+0000 (oldest deadline 2019-11-29T20:36:11.450275+0000) 2019-11-29T20:36:24.347 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:36:24.342+0000 1694c700 -1 osd.2 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:27.700391+0000 front 2019-11-29T20:35:27.730257+0000 (oldest deadline 2019-11-29T20:36:12.963730+0000) 2019-11-29T20:36:24.515 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:36:24.510+0000 1694c700 -1 osd.6 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:29.066312+0000 front 2019-11-29T20:35:29.196983+0000 (oldest deadline 2019-11-29T20:36:13.743031+0000) 2019-11-29T20:36:24.566 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:36:24.559+0000 1694c700 -1 osd.4 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:29.648047+0000 front 2019-11-29T20:35:29.347157+0000 (oldest deadline 2019-11-29T20:36:13.901776+0000) 2019-11-29T20:36:24.856 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:36:24.851+0000 1694c700 -1 osd.1 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:28.519035+0000 front 2019-11-29T20:35:28.517910+0000 (oldest deadline 2019-11-29T20:36:13.751478+0000) 2019-11-29T20:36:24.860 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:36:24.855+0000 1694c700 -1 osd.7 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:27.778562+0000 front 2019-11-29T20:35:27.780429+0000 (oldest deadline 2019-11-29T20:36:13.648567+0000) 2019-11-29T20:36:25.316 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:36:25.310+0000 1694c700 -1 osd.0 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:28.927299+0000 front 2019-11-29T20:35:28.867976+0000 (oldest deadline 2019-11-29T20:36:12.335540+0000) 2019-11-29T20:36:25.386 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:36:25.380+0000 1694c700 -1 osd.5 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:28.740169+0000 front 2019-11-29T20:35:28.809330+0000 (oldest deadline 2019-11-29T20:36:11.450275+0000) 2019-11-29T20:36:25.396 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:36:25.389+0000 1694c700 -1 osd.2 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:27.700391+0000 front 2019-11-29T20:35:27.730257+0000 (oldest deadline 2019-11-29T20:36:12.963730+0000) 2019-11-29T20:36:25.471 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:36:25.465+0000 1694c700 -1 osd.6 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:29.066312+0000 front 2019-11-29T20:35:29.196983+0000 (oldest deadline 2019-11-29T20:36:13.743031+0000) 2019-11-29T20:36:25.550 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:36:25.545+0000 1694c700 -1 osd.4 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:29.648047+0000 front 2019-11-29T20:35:29.347157+0000 (oldest deadline 2019-11-29T20:36:13.901776+0000) 2019-11-29T20:36:25.906 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:36:25.899+0000 1694c700 -1 osd.1 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:28.519035+0000 front 2019-11-29T20:35:28.517910+0000 (oldest deadline 2019-11-29T20:36:13.751478+0000) 2019-11-29T20:36:25.912 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:36:25.904+0000 1694c700 -1 osd.7 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:27.778562+0000 front 2019-11-29T20:35:27.780429+0000 (oldest deadline 2019-11-29T20:36:13.648567+0000) 2019-11-29T20:36:26.333 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:36:26.328+0000 1694c700 -1 osd.0 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:28.927299+0000 front 2019-11-29T20:35:28.867976+0000 (oldest deadline 2019-11-29T20:36:12.335540+0000) 2019-11-29T20:36:26.350 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:36:26.345+0000 1694c700 -1 osd.5 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:28.740169+0000 front 2019-11-29T20:35:28.809330+0000 (oldest deadline 2019-11-29T20:36:11.450275+0000) 2019-11-29T20:36:26.384 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:36:26.379+0000 1694c700 -1 osd.2 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:27.700391+0000 front 2019-11-29T20:35:27.730257+0000 (oldest deadline 2019-11-29T20:36:12.963730+0000) 2019-11-29T20:36:26.520 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:36:26.513+0000 1694c700 -1 osd.6 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:29.066312+0000 front 2019-11-29T20:35:29.196983+0000 (oldest deadline 2019-11-29T20:36:13.743031+0000) 2019-11-29T20:36:26.563 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:36:26.557+0000 1694c700 -1 osd.4 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:29.648047+0000 front 2019-11-29T20:35:29.347157+0000 (oldest deadline 2019-11-29T20:36:13.901776+0000) 2019-11-29T20:36:26.866 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:36:26.860+0000 1694c700 -1 osd.1 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:28.519035+0000 front 2019-11-29T20:35:28.517910+0000 (oldest deadline 2019-11-29T20:36:13.751478+0000) 2019-11-29T20:36:26.958 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:36:26.953+0000 1694c700 -1 osd.7 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:27.778562+0000 front 2019-11-29T20:35:27.780429+0000 (oldest deadline 2019-11-29T20:36:13.648567+0000) 2019-11-29T20:36:27.345 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:36:27.333+0000 1694c700 -1 osd.5 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:28.740169+0000 front 2019-11-29T20:35:28.809330+0000 (oldest deadline 2019-11-29T20:36:11.450275+0000) 2019-11-29T20:36:27.360 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:36:27.355+0000 1694c700 -1 osd.0 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:28.927299+0000 front 2019-11-29T20:35:28.867976+0000 (oldest deadline 2019-11-29T20:36:12.335540+0000) 2019-11-29T20:36:27.424 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:36:27.418+0000 1694c700 -1 osd.2 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:27.700391+0000 front 2019-11-29T20:35:27.730257+0000 (oldest deadline 2019-11-29T20:36:12.963730+0000) 2019-11-29T20:36:27.564 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:36:27.558+0000 1694c700 -1 osd.6 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:29.066312+0000 front 2019-11-29T20:35:29.196983+0000 (oldest deadline 2019-11-29T20:36:13.743031+0000) 2019-11-29T20:36:27.580 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:36:27.575+0000 1694c700 -1 osd.4 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:29.648047+0000 front 2019-11-29T20:35:29.347157+0000 (oldest deadline 2019-11-29T20:36:13.901776+0000) 2019-11-29T20:36:27.826 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:36:27.821+0000 1694c700 -1 osd.1 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:28.519035+0000 front 2019-11-29T20:35:28.517910+0000 (oldest deadline 2019-11-29T20:36:13.751478+0000) 2019-11-29T20:36:27.973 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:36:27.967+0000 1694c700 -1 osd.7 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:27.778562+0000 front 2019-11-29T20:35:27.780429+0000 (oldest deadline 2019-11-29T20:36:13.648567+0000) 2019-11-29T20:36:28.382 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:36:28.377+0000 1694c700 -1 osd.0 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:28.927299+0000 front 2019-11-29T20:35:28.867976+0000 (oldest deadline 2019-11-29T20:36:12.335540+0000) 2019-11-29T20:36:28.392 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:36:28.385+0000 1694c700 -1 osd.5 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:28.740169+0000 front 2019-11-29T20:35:28.809330+0000 (oldest deadline 2019-11-29T20:36:11.450275+0000) 2019-11-29T20:36:28.437 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:36:28.431+0000 1694c700 -1 osd.2 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:27.700391+0000 front 2019-11-29T20:35:27.730257+0000 (oldest deadline 2019-11-29T20:36:12.963730+0000) 2019-11-29T20:36:28.543 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:36:28.538+0000 1694c700 -1 osd.6 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:29.066312+0000 front 2019-11-29T20:35:29.196983+0000 (oldest deadline 2019-11-29T20:36:13.743031+0000) 2019-11-29T20:36:28.621 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:36:28.616+0000 1694c700 -1 osd.4 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:29.648047+0000 front 2019-11-29T20:35:29.347157+0000 (oldest deadline 2019-11-29T20:36:13.901776+0000) 2019-11-29T20:36:28.820 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:36:28.815+0000 1694c700 -1 osd.1 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:28.519035+0000 front 2019-11-29T20:35:28.517910+0000 (oldest deadline 2019-11-29T20:36:13.751478+0000) 2019-11-29T20:36:29.017 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:36:29.011+0000 1694c700 -1 osd.7 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:27.778562+0000 front 2019-11-29T20:35:27.780429+0000 (oldest deadline 2019-11-29T20:36:13.648567+0000) 2019-11-29T20:36:29.344 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:36:29.339+0000 1694c700 -1 osd.5 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:28.740169+0000 front 2019-11-29T20:35:28.809330+0000 (oldest deadline 2019-11-29T20:36:11.450275+0000) 2019-11-29T20:36:29.401 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:36:29.393+0000 1694c700 -1 osd.0 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:28.927299+0000 front 2019-11-29T20:35:28.867976+0000 (oldest deadline 2019-11-29T20:36:12.335540+0000) 2019-11-29T20:36:29.406 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:36:29.396+0000 1694c700 -1 osd.2 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:27.700391+0000 front 2019-11-29T20:35:27.730257+0000 (oldest deadline 2019-11-29T20:36:12.963730+0000) 2019-11-29T20:36:29.506 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:36:29.496+0000 1694c700 -1 osd.6 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:29.066312+0000 front 2019-11-29T20:35:29.196983+0000 (oldest deadline 2019-11-29T20:36:13.743031+0000) 2019-11-29T20:36:29.673 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:36:29.667+0000 1694c700 -1 osd.4 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:29.648047+0000 front 2019-11-29T20:35:29.347157+0000 (oldest deadline 2019-11-29T20:36:13.901776+0000) 2019-11-29T20:36:29.839 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:36:29.833+0000 1694c700 -1 osd.1 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:28.519035+0000 front 2019-11-29T20:35:28.517910+0000 (oldest deadline 2019-11-29T20:36:13.751478+0000) 2019-11-29T20:36:30.038 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:36:30.032+0000 1694c700 -1 osd.7 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:27.778562+0000 front 2019-11-29T20:35:27.780429+0000 (oldest deadline 2019-11-29T20:36:13.648567+0000) 2019-11-29T20:36:30.309 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:36:30.304+0000 1694c700 -1 osd.5 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:28.740169+0000 front 2019-11-29T20:35:28.809330+0000 (oldest deadline 2019-11-29T20:36:11.450275+0000) 2019-11-29T20:36:30.399 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:36:30.395+0000 1694c700 -1 osd.0 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:28.927299+0000 front 2019-11-29T20:35:28.867976+0000 (oldest deadline 2019-11-29T20:36:12.335540+0000) 2019-11-29T20:36:30.423 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:36:30.418+0000 1694c700 -1 osd.2 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:27.700391+0000 front 2019-11-29T20:35:27.730257+0000 (oldest deadline 2019-11-29T20:36:12.963730+0000) 2019-11-29T20:36:30.467 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:36:30.462+0000 1694c700 -1 osd.6 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:29.066312+0000 front 2019-11-29T20:35:29.196983+0000 (oldest deadline 2019-11-29T20:36:13.743031+0000) 2019-11-29T20:36:30.635 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:36:30.630+0000 1694c700 -1 osd.4 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:29.648047+0000 front 2019-11-29T20:35:29.347157+0000 (oldest deadline 2019-11-29T20:36:13.901776+0000) 2019-11-29T20:36:30.804 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:36:30.799+0000 1694c700 -1 osd.1 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:28.519035+0000 front 2019-11-29T20:35:28.517910+0000 (oldest deadline 2019-11-29T20:36:13.751478+0000) 2019-11-29T20:36:31.039 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:36:31.033+0000 1694c700 -1 osd.7 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:27.778562+0000 front 2019-11-29T20:35:27.780429+0000 (oldest deadline 2019-11-29T20:36:13.648567+0000) 2019-11-29T20:36:31.300 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:36:31.295+0000 1694c700 -1 osd.5 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:28.740169+0000 front 2019-11-29T20:35:28.809330+0000 (oldest deadline 2019-11-29T20:36:11.450275+0000) 2019-11-29T20:36:31.446 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:36:31.440+0000 1694c700 -1 osd.0 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:28.927299+0000 front 2019-11-29T20:35:28.867976+0000 (oldest deadline 2019-11-29T20:36:12.335540+0000) 2019-11-29T20:36:31.483 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:36:31.472+0000 1694c700 -1 osd.2 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:27.700391+0000 front 2019-11-29T20:35:27.730257+0000 (oldest deadline 2019-11-29T20:36:12.963730+0000) 2019-11-29T20:36:31.519 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:36:31.513+0000 1694c700 -1 osd.6 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:29.066312+0000 front 2019-11-29T20:35:29.196983+0000 (oldest deadline 2019-11-29T20:36:13.743031+0000) 2019-11-29T20:36:31.652 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:36:31.645+0000 1694c700 -1 osd.4 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:29.648047+0000 front 2019-11-29T20:35:29.347157+0000 (oldest deadline 2019-11-29T20:36:13.901776+0000) 2019-11-29T20:36:31.760 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:36:31.754+0000 1694c700 -1 osd.1 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:28.519035+0000 front 2019-11-29T20:35:28.517910+0000 (oldest deadline 2019-11-29T20:36:13.751478+0000) 2019-11-29T20:36:32.016 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:36:32.010+0000 1694c700 -1 osd.7 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:27.778562+0000 front 2019-11-29T20:35:27.780429+0000 (oldest deadline 2019-11-29T20:36:13.648567+0000) 2019-11-29T20:36:32.304 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:36:32.299+0000 1694c700 -1 osd.5 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:28.740169+0000 front 2019-11-29T20:35:28.809330+0000 (oldest deadline 2019-11-29T20:36:11.450275+0000) 2019-11-29T20:36:32.402 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:36:32.397+0000 1694c700 -1 osd.0 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:28.927299+0000 front 2019-11-29T20:35:28.867976+0000 (oldest deadline 2019-11-29T20:36:12.335540+0000) 2019-11-29T20:36:32.482 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:36:32.477+0000 1694c700 -1 osd.2 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:27.700391+0000 front 2019-11-29T20:35:27.730257+0000 (oldest deadline 2019-11-29T20:36:12.963730+0000) 2019-11-29T20:36:32.507 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:36:32.501+0000 1694c700 -1 osd.6 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:29.066312+0000 front 2019-11-29T20:35:29.196983+0000 (oldest deadline 2019-11-29T20:36:13.743031+0000) 2019-11-29T20:36:32.636 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:36:32.631+0000 1694c700 -1 osd.4 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:29.648047+0000 front 2019-11-29T20:35:29.347157+0000 (oldest deadline 2019-11-29T20:36:13.901776+0000) 2019-11-29T20:36:32.810 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:36:32.805+0000 1694c700 -1 osd.1 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:28.519035+0000 front 2019-11-29T20:35:28.517910+0000 (oldest deadline 2019-11-29T20:36:13.751478+0000) 2019-11-29T20:36:33.018 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:36:33.012+0000 1694c700 -1 osd.7 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:27.778562+0000 front 2019-11-29T20:35:27.780429+0000 (oldest deadline 2019-11-29T20:36:13.648567+0000) 2019-11-29T20:36:33.545 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:36:33.541+0000 1694c700 -1 osd.6 159 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:35:29.066312+0000 front 2019-11-29T20:35:29.196983+0000 (oldest deadline 2019-11-29T20:36:13.743031+0000) 2019-11-29T20:37:26.297 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:37:26.145+0000 11cac700 -1 osd.6 163 build_incremental_map_msg missing incremental map 163 2019-11-29T20:37:31.177 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:37:31.172+0000 1694c700 -1 osd.2 165 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:36:49.474345+0000 front 2019-11-29T20:36:49.901441+0000 (oldest deadline 2019-11-29T20:37:30.483085+0000) 2019-11-29T20:37:31.726 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:37:31.719+0000 1694c700 -1 osd.4 165 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:36:48.969130+0000 front 2019-11-29T20:36:48.942858+0000 (oldest deadline 2019-11-29T20:37:31.442367+0000) 2019-11-29T20:37:31.942 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:37:31.927+0000 1694c700 -1 osd.1 165 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:36:47.587635+0000 front 2019-11-29T20:36:48.109320+0000 (oldest deadline 2019-11-29T20:37:30.950861+0000) 2019-11-29T20:37:32.008 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:37:32.004+0000 1694c700 -1 osd.7 165 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:36:48.262679+0000 front 2019-11-29T20:36:48.263267+0000 (oldest deadline 2019-11-29T20:37:31.116004+0000) 2019-11-29T20:37:32.192 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:37:32.187+0000 1694c700 -1 osd.2 165 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:36:49.474345+0000 front 2019-11-29T20:36:49.901441+0000 (oldest deadline 2019-11-29T20:37:30.483085+0000) 2019-11-29T20:37:32.659 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:37:32.655+0000 1694c700 -1 osd.0 165 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:36:49.513432+0000 front 2019-11-29T20:36:48.924759+0000 (oldest deadline 2019-11-29T20:37:31.739453+0000) 2019-11-29T20:37:32.781 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:37:32.770+0000 1694c700 -1 osd.4 165 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:36:48.969130+0000 front 2019-11-29T20:36:48.942858+0000 (oldest deadline 2019-11-29T20:37:31.442367+0000) 2019-11-29T20:37:32.918 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:37:32.913+0000 1694c700 -1 osd.1 165 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:36:47.587635+0000 front 2019-11-29T20:36:48.109320+0000 (oldest deadline 2019-11-29T20:37:30.950861+0000) 2019-11-29T20:37:33.025 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:37:33.019+0000 1694c700 -1 osd.7 165 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:36:48.262679+0000 front 2019-11-29T20:36:48.263267+0000 (oldest deadline 2019-11-29T20:37:31.116004+0000) 2019-11-29T20:37:33.075 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:08:12:13.733 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T20:37:33.088 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:08:12:13.746 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T20:37:33.097 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:08:12:13.704 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T20:37:33.101 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:08:12:13.707 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T20:37:33.104 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:08:12:13.711 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T20:37:33.107 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:08:12:13.714 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T20:37:33.244 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:37:33.237+0000 1694c700 -1 osd.2 165 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:36:49.474345+0000 front 2019-11-29T20:36:49.901441+0000 (oldest deadline 2019-11-29T20:37:30.483085+0000) 2019-11-29T20:37:33.360 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:08:12:13.966 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T20:37:33.372 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:08:12:13.979 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T20:37:33.373 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:08:12:14.032 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T20:37:33.649 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:37:33.645+0000 1694c700 -1 osd.0 165 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:36:49.513432+0000 front 2019-11-29T20:36:48.924759+0000 (oldest deadline 2019-11-29T20:37:31.739453+0000) 2019-11-29T20:37:33.730 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:37:33.725+0000 1694c700 -1 osd.4 165 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:36:48.969130+0000 front 2019-11-29T20:36:48.942858+0000 (oldest deadline 2019-11-29T20:37:31.442367+0000) 2019-11-29T20:37:33.891 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:37:33.885+0000 1694c700 -1 osd.1 165 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:36:47.587635+0000 front 2019-11-29T20:36:48.109320+0000 (oldest deadline 2019-11-29T20:37:30.950861+0000) 2019-11-29T20:37:33.986 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:37:33.982+0000 1694c700 -1 osd.7 165 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:36:48.262679+0000 front 2019-11-29T20:36:48.263267+0000 (oldest deadline 2019-11-29T20:37:31.116004+0000) 2019-11-29T20:37:34.247 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:37:34.242+0000 1694c700 -1 osd.2 165 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:36:49.474345+0000 front 2019-11-29T20:36:49.901441+0000 (oldest deadline 2019-11-29T20:37:30.483085+0000) 2019-11-29T20:37:34.658 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:37:34.653+0000 1694c700 -1 osd.0 165 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:36:49.513432+0000 front 2019-11-29T20:36:48.924759+0000 (oldest deadline 2019-11-29T20:37:31.739453+0000) 2019-11-29T20:37:34.695 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:37:34.688+0000 1694c700 -1 osd.4 165 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:36:48.969130+0000 front 2019-11-29T20:36:48.942858+0000 (oldest deadline 2019-11-29T20:37:31.442367+0000) 2019-11-29T20:37:34.880 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:37:34.873+0000 1694c700 -1 osd.1 165 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:36:47.587635+0000 front 2019-11-29T20:36:48.109320+0000 (oldest deadline 2019-11-29T20:37:30.950861+0000) 2019-11-29T20:37:34.953 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:37:34.949+0000 1694c700 -1 osd.6 165 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:36:48.948458+0000 front 2019-11-29T20:36:48.548895+0000 (oldest deadline 2019-11-29T20:37:34.354077+0000) 2019-11-29T20:37:34.994 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:37:34.990+0000 1694c700 -1 osd.7 165 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:36:48.262679+0000 front 2019-11-29T20:36:48.263267+0000 (oldest deadline 2019-11-29T20:37:31.116004+0000) 2019-11-29T20:37:35.274 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:37:35.268+0000 1694c700 -1 osd.2 165 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:36:49.474345+0000 front 2019-11-29T20:36:49.901441+0000 (oldest deadline 2019-11-29T20:37:30.483085+0000) 2019-11-29T20:37:35.644 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:37:35.638+0000 1694c700 -1 osd.0 165 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:36:49.513432+0000 front 2019-11-29T20:36:48.924759+0000 (oldest deadline 2019-11-29T20:37:31.739453+0000) 2019-11-29T20:37:35.717 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:37:35.712+0000 1694c700 -1 osd.4 165 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:36:48.969130+0000 front 2019-11-29T20:36:48.942858+0000 (oldest deadline 2019-11-29T20:37:31.442367+0000) 2019-11-29T20:37:35.914 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:37:35.910+0000 1694c700 -1 osd.1 165 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:36:47.587635+0000 front 2019-11-29T20:36:48.109320+0000 (oldest deadline 2019-11-29T20:37:30.950861+0000) 2019-11-29T20:37:35.947 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:37:35.942+0000 1694c700 -1 osd.6 165 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:36:48.948458+0000 front 2019-11-29T20:36:48.548895+0000 (oldest deadline 2019-11-29T20:37:34.354077+0000) 2019-11-29T20:37:36.017 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:37:36.012+0000 1694c700 -1 osd.7 165 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:36:48.262679+0000 front 2019-11-29T20:36:48.263267+0000 (oldest deadline 2019-11-29T20:37:31.116004+0000) 2019-11-29T20:37:36.307 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:37:36.302+0000 1694c700 -1 osd.2 165 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:36:49.474345+0000 front 2019-11-29T20:36:49.901441+0000 (oldest deadline 2019-11-29T20:37:30.483085+0000) 2019-11-29T20:37:36.664 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:37:36.659+0000 1694c700 -1 osd.0 165 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:36:49.513432+0000 front 2019-11-29T20:36:48.924759+0000 (oldest deadline 2019-11-29T20:37:31.739453+0000) 2019-11-29T20:37:36.698 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:37:36.693+0000 1694c700 -1 osd.4 165 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:36:48.969130+0000 front 2019-11-29T20:36:48.942858+0000 (oldest deadline 2019-11-29T20:37:31.442367+0000) 2019-11-29T20:37:36.921 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:37:36.914+0000 1694c700 -1 osd.1 165 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:36:47.587635+0000 front 2019-11-29T20:36:48.109320+0000 (oldest deadline 2019-11-29T20:37:30.950861+0000) 2019-11-29T20:37:36.989 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:37:36.983+0000 1694c700 -1 osd.6 165 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:36:48.948458+0000 front 2019-11-29T20:36:48.548895+0000 (oldest deadline 2019-11-29T20:37:34.354077+0000) 2019-11-29T20:37:36.996 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:37:36.991+0000 1694c700 -1 osd.7 165 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:36:48.262679+0000 front 2019-11-29T20:36:48.263267+0000 (oldest deadline 2019-11-29T20:37:31.116004+0000) 2019-11-29T20:37:37.312 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:37:37.307+0000 1694c700 -1 osd.2 165 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:36:49.474345+0000 front 2019-11-29T20:36:49.901441+0000 (oldest deadline 2019-11-29T20:37:30.483085+0000) 2019-11-29T20:37:37.620 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:37:37.615+0000 1694c700 -1 osd.0 165 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:36:49.513432+0000 front 2019-11-29T20:36:48.924759+0000 (oldest deadline 2019-11-29T20:37:31.739453+0000) 2019-11-29T20:37:37.751 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:37:37.746+0000 1694c700 -1 osd.4 165 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:36:48.969130+0000 front 2019-11-29T20:36:48.942858+0000 (oldest deadline 2019-11-29T20:37:31.442367+0000) 2019-11-29T20:37:37.929 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:37:37.923+0000 1694c700 -1 osd.1 165 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:36:47.587635+0000 front 2019-11-29T20:36:48.109320+0000 (oldest deadline 2019-11-29T20:37:30.950861+0000) 2019-11-29T20:37:38.016 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:37:38.010+0000 1694c700 -1 osd.7 165 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:36:48.262679+0000 front 2019-11-29T20:36:48.263267+0000 (oldest deadline 2019-11-29T20:37:31.116004+0000) 2019-11-29T20:37:38.029 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:37:38.024+0000 1694c700 -1 osd.6 165 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:36:48.948458+0000 front 2019-11-29T20:36:48.548895+0000 (oldest deadline 2019-11-29T20:37:34.354077+0000) 2019-11-29T20:37:38.341 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:37:38.329+0000 1694c700 -1 osd.2 165 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:36:49.474345+0000 front 2019-11-29T20:36:49.901441+0000 (oldest deadline 2019-11-29T20:37:30.483085+0000) 2019-11-29T20:37:38.594 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:37:38.589+0000 1694c700 -1 osd.0 165 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:36:49.513432+0000 front 2019-11-29T20:36:48.924759+0000 (oldest deadline 2019-11-29T20:37:31.739453+0000) 2019-11-29T20:37:38.759 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:37:38.755+0000 1694c700 -1 osd.4 165 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:36:48.969130+0000 front 2019-11-29T20:36:48.942858+0000 (oldest deadline 2019-11-29T20:37:31.442367+0000) 2019-11-29T20:37:38.885 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:37:38.879+0000 1694c700 -1 osd.1 165 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:36:47.587635+0000 front 2019-11-29T20:36:48.109320+0000 (oldest deadline 2019-11-29T20:37:30.950861+0000) 2019-11-29T20:37:39.016 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:37:39.011+0000 1694c700 -1 osd.6 165 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:36:48.948458+0000 front 2019-11-29T20:36:48.548895+0000 (oldest deadline 2019-11-29T20:37:34.354077+0000) 2019-11-29T20:37:39.058 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:37:39.052+0000 1694c700 -1 osd.7 165 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:36:48.262679+0000 front 2019-11-29T20:36:48.263267+0000 (oldest deadline 2019-11-29T20:37:31.116004+0000) 2019-11-29T20:37:39.318 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:37:39.312+0000 1694c700 -1 osd.2 165 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:36:49.474345+0000 front 2019-11-29T20:36:49.901441+0000 (oldest deadline 2019-11-29T20:37:30.483085+0000) 2019-11-29T20:37:39.642 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:37:39.636+0000 1694c700 -1 osd.0 165 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:36:49.513432+0000 front 2019-11-29T20:36:48.924759+0000 (oldest deadline 2019-11-29T20:37:31.739453+0000) 2019-11-29T20:37:39.800 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:37:39.794+0000 1694c700 -1 osd.4 165 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:36:48.969130+0000 front 2019-11-29T20:36:48.942858+0000 (oldest deadline 2019-11-29T20:37:31.442367+0000) 2019-11-29T20:37:39.938 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:37:39.932+0000 1694c700 -1 osd.1 165 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:36:47.587635+0000 front 2019-11-29T20:36:48.109320+0000 (oldest deadline 2019-11-29T20:37:30.950861+0000) 2019-11-29T20:37:39.999 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:37:39.994+0000 1694c700 -1 osd.6 165 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:36:48.948458+0000 front 2019-11-29T20:36:48.548895+0000 (oldest deadline 2019-11-29T20:37:34.354077+0000) 2019-11-29T20:37:40.022 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:37:40.017+0000 1694c700 -1 osd.7 165 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:36:48.262679+0000 front 2019-11-29T20:36:48.263267+0000 (oldest deadline 2019-11-29T20:37:31.116004+0000) 2019-11-29T20:37:40.276 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:37:40.269+0000 1694c700 -1 osd.2 165 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:36:49.474345+0000 front 2019-11-29T20:36:49.901441+0000 (oldest deadline 2019-11-29T20:37:30.483085+0000) 2019-11-29T20:37:40.681 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:37:40.676+0000 1694c700 -1 osd.0 165 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:36:49.513432+0000 front 2019-11-29T20:36:48.924759+0000 (oldest deadline 2019-11-29T20:37:31.739453+0000) 2019-11-29T20:37:40.781 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:37:40.772+0000 1694c700 -1 osd.4 165 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:36:48.969130+0000 front 2019-11-29T20:36:48.942858+0000 (oldest deadline 2019-11-29T20:37:31.442367+0000) 2019-11-29T20:37:40.957 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:37:40.952+0000 1694c700 -1 osd.1 165 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:36:47.587635+0000 front 2019-11-29T20:36:48.109320+0000 (oldest deadline 2019-11-29T20:37:30.950861+0000) 2019-11-29T20:37:41.015 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:37:41.010+0000 1694c700 -1 osd.6 165 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:36:48.948458+0000 front 2019-11-29T20:36:48.548895+0000 (oldest deadline 2019-11-29T20:37:34.354077+0000) 2019-11-29T20:37:41.019 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:37:41.014+0000 1694c700 -1 osd.7 165 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:36:48.262679+0000 front 2019-11-29T20:36:48.263267+0000 (oldest deadline 2019-11-29T20:37:31.116004+0000) 2019-11-29T20:37:41.243 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:37:41.237+0000 1694c700 -1 osd.2 165 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:36:49.474345+0000 front 2019-11-29T20:36:49.901441+0000 (oldest deadline 2019-11-29T20:37:30.483085+0000) 2019-11-29T20:37:41.715 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:37:41.709+0000 1694c700 -1 osd.0 165 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:36:49.513432+0000 front 2019-11-29T20:36:48.924759+0000 (oldest deadline 2019-11-29T20:37:31.739453+0000) 2019-11-29T20:37:41.795 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:37:41.789+0000 1694c700 -1 osd.4 165 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:36:48.969130+0000 front 2019-11-29T20:36:48.942858+0000 (oldest deadline 2019-11-29T20:37:31.442367+0000) 2019-11-29T20:37:41.918 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:37:41.913+0000 1694c700 -1 osd.1 165 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:36:47.587635+0000 front 2019-11-29T20:36:48.109320+0000 (oldest deadline 2019-11-29T20:37:30.950861+0000) 2019-11-29T20:37:42.040 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:37:42.034+0000 1694c700 -1 osd.7 165 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:36:48.262679+0000 front 2019-11-29T20:36:48.263267+0000 (oldest deadline 2019-11-29T20:37:31.116004+0000) 2019-11-29T20:37:42.060 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:37:42.055+0000 1694c700 -1 osd.6 165 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:36:48.948458+0000 front 2019-11-29T20:36:48.548895+0000 (oldest deadline 2019-11-29T20:37:34.354077+0000) 2019-11-29T20:37:42.298 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:37:42.293+0000 1694c700 -1 osd.2 165 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:36:49.474345+0000 front 2019-11-29T20:36:49.901441+0000 (oldest deadline 2019-11-29T20:37:30.483085+0000) 2019-11-29T20:37:42.700 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:37:42.695+0000 1694c700 -1 osd.0 165 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:36:49.513432+0000 front 2019-11-29T20:36:48.924759+0000 (oldest deadline 2019-11-29T20:37:31.739453+0000) 2019-11-29T20:37:42.755 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:37:42.748+0000 1694c700 -1 osd.4 165 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:36:48.969130+0000 front 2019-11-29T20:36:48.942858+0000 (oldest deadline 2019-11-29T20:37:31.442367+0000) 2019-11-29T20:37:42.945 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:37:42.940+0000 1694c700 -1 osd.1 165 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:36:47.587635+0000 front 2019-11-29T20:36:48.109320+0000 (oldest deadline 2019-11-29T20:37:30.950861+0000) 2019-11-29T20:37:43.068 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:37:43.063+0000 1694c700 -1 osd.6 165 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:36:48.948458+0000 front 2019-11-29T20:36:48.548895+0000 (oldest deadline 2019-11-29T20:37:34.354077+0000) 2019-11-29T20:37:43.077 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:37:43.073+0000 1694c700 -1 osd.7 165 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:36:48.262679+0000 front 2019-11-29T20:36:48.263267+0000 (oldest deadline 2019-11-29T20:37:31.116004+0000) 2019-11-29T20:37:43.322 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:37:43.317+0000 1694c700 -1 osd.2 165 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:36:49.474345+0000 front 2019-11-29T20:36:49.901441+0000 (oldest deadline 2019-11-29T20:37:30.483085+0000) 2019-11-29T20:37:43.699 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:37:43.693+0000 1694c700 -1 osd.0 165 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:36:49.513432+0000 front 2019-11-29T20:36:48.924759+0000 (oldest deadline 2019-11-29T20:37:31.739453+0000) 2019-11-29T20:37:43.712 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:37:43.706+0000 1694c700 -1 osd.4 165 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:36:48.969130+0000 front 2019-11-29T20:36:48.942858+0000 (oldest deadline 2019-11-29T20:37:31.442367+0000) 2019-11-29T20:37:43.985 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:37:43.980+0000 1694c700 -1 osd.1 165 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:36:47.587635+0000 front 2019-11-29T20:36:48.109320+0000 (oldest deadline 2019-11-29T20:37:30.950861+0000) 2019-11-29T20:37:44.065 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:37:44.060+0000 1694c700 -1 osd.7 165 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:36:48.262679+0000 front 2019-11-29T20:36:48.263267+0000 (oldest deadline 2019-11-29T20:37:31.116004+0000) 2019-11-29T20:37:44.118 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:37:44.114+0000 1694c700 -1 osd.6 165 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:36:48.948458+0000 front 2019-11-29T20:36:48.548895+0000 (oldest deadline 2019-11-29T20:37:34.354077+0000) 2019-11-29T20:37:44.313 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:37:44.307+0000 1694c700 -1 osd.2 165 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:36:49.474345+0000 front 2019-11-29T20:36:49.901441+0000 (oldest deadline 2019-11-29T20:37:30.483085+0000) 2019-11-29T20:37:44.725 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:37:44.720+0000 1694c700 -1 osd.4 165 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:36:48.969130+0000 front 2019-11-29T20:36:48.942858+0000 (oldest deadline 2019-11-29T20:37:31.442367+0000) 2019-11-29T20:37:44.741 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:37:44.735+0000 1694c700 -1 osd.0 165 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:36:49.513432+0000 front 2019-11-29T20:36:48.924759+0000 (oldest deadline 2019-11-29T20:37:31.739453+0000) 2019-11-29T20:37:44.995 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:37:44.990+0000 1694c700 -1 osd.1 165 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:36:47.587635+0000 front 2019-11-29T20:36:48.109320+0000 (oldest deadline 2019-11-29T20:37:30.950861+0000) 2019-11-29T20:37:45.028 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:37:45.023+0000 1694c700 -1 osd.7 165 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:36:48.262679+0000 front 2019-11-29T20:36:48.263267+0000 (oldest deadline 2019-11-29T20:37:31.116004+0000) 2019-11-29T20:37:45.083 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:37:45.078+0000 1694c700 -1 osd.6 165 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:36:48.948458+0000 front 2019-11-29T20:36:48.548895+0000 (oldest deadline 2019-11-29T20:37:34.354077+0000) 2019-11-29T20:37:45.349 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:37:45.344+0000 1694c700 -1 osd.2 165 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:36:49.474345+0000 front 2019-11-29T20:36:49.901441+0000 (oldest deadline 2019-11-29T20:37:30.483085+0000) 2019-11-29T20:37:45.735 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:37:45.729+0000 1694c700 -1 osd.0 165 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:36:49.513432+0000 front 2019-11-29T20:36:48.924759+0000 (oldest deadline 2019-11-29T20:37:31.739453+0000) 2019-11-29T20:37:45.754 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:37:45.749+0000 1694c700 -1 osd.4 165 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:36:48.969130+0000 front 2019-11-29T20:36:48.942858+0000 (oldest deadline 2019-11-29T20:37:31.442367+0000) 2019-11-29T20:37:46.027 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:37:46.018+0000 1694c700 -1 osd.1 165 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:36:47.587635+0000 front 2019-11-29T20:36:48.109320+0000 (oldest deadline 2019-11-29T20:37:30.950861+0000) 2019-11-29T20:37:46.060 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:37:46.055+0000 1694c700 -1 osd.6 165 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:36:48.948458+0000 front 2019-11-29T20:36:48.548895+0000 (oldest deadline 2019-11-29T20:37:34.354077+0000) 2019-11-29T20:37:46.081 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:37:46.076+0000 1694c700 -1 osd.7 165 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:36:48.262679+0000 front 2019-11-29T20:36:48.263267+0000 (oldest deadline 2019-11-29T20:37:31.116004+0000) 2019-11-29T20:37:46.378 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:37:46.374+0000 1694c700 -1 osd.2 165 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:36:49.474345+0000 front 2019-11-29T20:36:49.901441+0000 (oldest deadline 2019-11-29T20:37:30.483085+0000) 2019-11-29T20:37:46.699 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:37:46.694+0000 1694c700 -1 osd.0 165 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:36:49.513432+0000 front 2019-11-29T20:36:48.924759+0000 (oldest deadline 2019-11-29T20:37:31.739453+0000) 2019-11-29T20:37:46.735 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:37:46.730+0000 1694c700 -1 osd.4 165 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:36:48.969130+0000 front 2019-11-29T20:36:48.942858+0000 (oldest deadline 2019-11-29T20:37:31.442367+0000) 2019-11-29T20:37:47.036 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:37:47.030+0000 1694c700 -1 osd.6 165 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:36:48.948458+0000 front 2019-11-29T20:36:48.548895+0000 (oldest deadline 2019-11-29T20:37:34.354077+0000) 2019-11-29T20:37:47.036 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:37:47.032+0000 1694c700 -1 osd.7 165 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:36:48.262679+0000 front 2019-11-29T20:36:48.263267+0000 (oldest deadline 2019-11-29T20:37:31.116004+0000) 2019-11-29T20:37:47.060 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:37:47.055+0000 1694c700 -1 osd.1 165 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:36:47.587635+0000 front 2019-11-29T20:36:48.109320+0000 (oldest deadline 2019-11-29T20:37:30.950861+0000) 2019-11-29T20:37:47.367 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:37:47.362+0000 1694c700 -1 osd.2 165 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:36:49.474345+0000 front 2019-11-29T20:36:49.901441+0000 (oldest deadline 2019-11-29T20:37:30.483085+0000) 2019-11-29T20:37:47.661 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:37:47.655+0000 1694c700 -1 osd.0 165 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:36:49.513432+0000 front 2019-11-29T20:36:48.924759+0000 (oldest deadline 2019-11-29T20:37:31.739453+0000) 2019-11-29T20:37:47.766 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:37:47.761+0000 1694c700 -1 osd.4 165 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:36:48.969130+0000 front 2019-11-29T20:36:48.942858+0000 (oldest deadline 2019-11-29T20:37:31.442367+0000) 2019-11-29T20:37:48.006 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:37:48.000+0000 1694c700 -1 osd.6 165 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:36:48.948458+0000 front 2019-11-29T20:36:48.548895+0000 (oldest deadline 2019-11-29T20:37:34.354077+0000) 2019-11-29T20:37:48.032 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:37:48.026+0000 1694c700 -1 osd.7 165 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:36:48.262679+0000 front 2019-11-29T20:36:48.263267+0000 (oldest deadline 2019-11-29T20:37:31.116004+0000) 2019-11-29T20:37:48.109 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:37:48.104+0000 1694c700 -1 osd.1 165 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:36:47.587635+0000 front 2019-11-29T20:36:48.109320+0000 (oldest deadline 2019-11-29T20:37:30.950861+0000) 2019-11-29T20:37:48.413 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:37:48.408+0000 1694c700 -1 osd.2 165 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:36:49.474345+0000 front 2019-11-29T20:36:49.901441+0000 (oldest deadline 2019-11-29T20:37:30.483085+0000) 2019-11-29T20:37:48.642 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:37:48.638+0000 1694c700 -1 osd.0 165 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:36:49.513432+0000 front 2019-11-29T20:36:48.924759+0000 (oldest deadline 2019-11-29T20:37:31.739453+0000) 2019-11-29T20:37:48.774 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:37:48.769+0000 1694c700 -1 osd.4 165 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:36:48.969130+0000 front 2019-11-29T20:36:48.942858+0000 (oldest deadline 2019-11-29T20:37:31.442367+0000) 2019-11-29T20:37:48.971 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:37:48.967+0000 1694c700 -1 osd.6 165 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:36:48.948458+0000 front 2019-11-29T20:36:48.548895+0000 (oldest deadline 2019-11-29T20:37:34.354077+0000) 2019-11-29T20:37:49.743 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:37:49.737+0000 1694c700 -1 osd.4 165 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:36:48.969130+0000 front 2019-11-29T20:36:48.942858+0000 (oldest deadline 2019-11-29T20:37:31.442367+0000) 2019-11-29T20:37:50.014 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:37:50.003+0000 1694c700 -1 osd.6 165 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:36:48.948458+0000 front 2019-11-29T20:36:48.548895+0000 (oldest deadline 2019-11-29T20:37:34.354077+0000) 2019-11-29T20:39:29.501 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:08:14:10.159 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T20:39:29.517 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:08:14:10.175 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T20:39:29.592 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:08:14:10.199 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T20:39:29.597 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:08:14:10.204 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T20:39:29.623 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:08:14:10.230 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T20:39:29.627 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:08:14:10.234 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T20:39:29.691 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:08:14:10.349 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T20:39:29.813 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:08:14:10.420 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T20:39:29.835 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:08:14:10.442 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T20:39:50.338 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:39:50.332+0000 1694c700 -1 osd.5 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:09.990839+0000 front 2019-11-29T20:39:10.031507+0000 (oldest deadline 2019-11-29T20:39:49.563985+0000) 2019-11-29T20:39:50.639 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:39:50.633+0000 1694c700 -1 osd.6 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:05.410961+0000 front 2019-11-29T20:39:05.386228+0000 (oldest deadline 2019-11-29T20:39:50.616276+0000) 2019-11-29T20:39:51.371 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:39:51.362+0000 1694c700 -1 osd.5 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:09.990839+0000 front 2019-11-29T20:39:10.031507+0000 (oldest deadline 2019-11-29T20:39:49.563985+0000) 2019-11-29T20:39:51.540 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:39:51.534+0000 1694c700 -1 osd.1 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:08.336126+0000 front 2019-11-29T20:39:08.324133+0000 (oldest deadline 2019-11-29T20:39:50.836784+0000) 2019-11-29T20:39:51.585 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:39:51.579+0000 1694c700 -1 osd.2 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:05.497932+0000 front 2019-11-29T20:39:05.562300+0000 (oldest deadline 2019-11-29T20:39:51.293509+0000) 2019-11-29T20:39:51.634 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:39:51.627+0000 1694c700 -1 osd.6 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:05.410961+0000 front 2019-11-29T20:39:05.386228+0000 (oldest deadline 2019-11-29T20:39:50.616276+0000) 2019-11-29T20:39:52.088 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:39:52.079+0000 1694c700 -1 osd.0 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:09.835477+0000 front 2019-11-29T20:39:09.987447+0000 (oldest deadline 2019-11-29T20:39:51.889232+0000) 2019-11-29T20:39:52.354 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:39:52.347+0000 1694c700 -1 osd.5 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:09.990839+0000 front 2019-11-29T20:39:10.031507+0000 (oldest deadline 2019-11-29T20:39:49.563985+0000) 2019-11-29T20:39:52.585 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:39:52.579+0000 1694c700 -1 osd.2 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:05.497932+0000 front 2019-11-29T20:39:05.562300+0000 (oldest deadline 2019-11-29T20:39:51.293509+0000) 2019-11-29T20:39:52.589 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:39:52.582+0000 1694c700 -1 osd.1 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:08.336126+0000 front 2019-11-29T20:39:08.324133+0000 (oldest deadline 2019-11-29T20:39:50.836784+0000) 2019-11-29T20:39:52.641 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:39:52.635+0000 1694c700 -1 osd.6 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:05.410961+0000 front 2019-11-29T20:39:05.386228+0000 (oldest deadline 2019-11-29T20:39:50.616276+0000) 2019-11-29T20:39:53.053 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:39:53.047+0000 1694c700 -1 osd.0 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:09.835477+0000 front 2019-11-29T20:39:09.987447+0000 (oldest deadline 2019-11-29T20:39:51.889232+0000) 2019-11-29T20:39:53.128 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:39:53.121+0000 1694c700 -1 osd.4 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:09.124907+0000 front 2019-11-29T20:39:09.147862+0000 (oldest deadline 2019-11-29T20:39:53.022359+0000) 2019-11-29T20:39:53.399 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:39:53.392+0000 1694c700 -1 osd.5 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:09.990839+0000 front 2019-11-29T20:39:10.031507+0000 (oldest deadline 2019-11-29T20:39:49.563985+0000) 2019-11-29T20:39:53.554 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:39:53.549+0000 1694c700 -1 osd.2 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:05.497932+0000 front 2019-11-29T20:39:05.562300+0000 (oldest deadline 2019-11-29T20:39:51.293509+0000) 2019-11-29T20:39:53.611 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:39:53.605+0000 1694c700 -1 osd.1 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:08.336126+0000 front 2019-11-29T20:39:08.324133+0000 (oldest deadline 2019-11-29T20:39:50.836784+0000) 2019-11-29T20:39:53.623 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:39:53.615+0000 1694c700 -1 osd.6 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:05.410961+0000 front 2019-11-29T20:39:05.386228+0000 (oldest deadline 2019-11-29T20:39:50.616276+0000) 2019-11-29T20:39:54.040 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:39:54.035+0000 1694c700 -1 osd.0 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:09.835477+0000 front 2019-11-29T20:39:09.987447+0000 (oldest deadline 2019-11-29T20:39:51.889232+0000) 2019-11-29T20:39:54.148 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:39:54.141+0000 1694c700 -1 osd.4 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:09.124907+0000 front 2019-11-29T20:39:09.147862+0000 (oldest deadline 2019-11-29T20:39:53.022359+0000) 2019-11-29T20:39:54.440 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:39:54.434+0000 1694c700 -1 osd.5 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:09.990839+0000 front 2019-11-29T20:39:10.031507+0000 (oldest deadline 2019-11-29T20:39:49.563985+0000) 2019-11-29T20:39:54.467 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:39:54.461+0000 1694c700 -1 osd.7 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:08.748987+0000 front 2019-11-29T20:39:08.587376+0000 (oldest deadline 2019-11-29T20:39:54.179470+0000) 2019-11-29T20:39:54.550 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:39:54.545+0000 1694c700 -1 osd.2 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:05.497932+0000 front 2019-11-29T20:39:05.562300+0000 (oldest deadline 2019-11-29T20:39:51.293509+0000) 2019-11-29T20:39:54.588 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:39:54.581+0000 1694c700 -1 osd.6 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:05.410961+0000 front 2019-11-29T20:39:05.386228+0000 (oldest deadline 2019-11-29T20:39:50.616276+0000) 2019-11-29T20:39:54.658 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:39:54.653+0000 1694c700 -1 osd.1 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:08.336126+0000 front 2019-11-29T20:39:08.324133+0000 (oldest deadline 2019-11-29T20:39:50.836784+0000) 2019-11-29T20:39:55.093 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:39:55.088+0000 1694c700 -1 osd.0 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:09.835477+0000 front 2019-11-29T20:39:09.987447+0000 (oldest deadline 2019-11-29T20:39:51.889232+0000) 2019-11-29T20:39:55.112 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:39:55.106+0000 1694c700 -1 osd.4 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:09.124907+0000 front 2019-11-29T20:39:09.147862+0000 (oldest deadline 2019-11-29T20:39:53.022359+0000) 2019-11-29T20:39:55.482 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:39:55.475+0000 1694c700 -1 osd.7 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:08.748987+0000 front 2019-11-29T20:39:08.587376+0000 (oldest deadline 2019-11-29T20:39:54.179470+0000) 2019-11-29T20:39:55.484 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:39:55.478+0000 1694c700 -1 osd.5 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:09.990839+0000 front 2019-11-29T20:39:10.031507+0000 (oldest deadline 2019-11-29T20:39:49.563985+0000) 2019-11-29T20:39:55.525 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:39:55.519+0000 1694c700 -1 osd.2 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:05.497932+0000 front 2019-11-29T20:39:05.562300+0000 (oldest deadline 2019-11-29T20:39:51.293509+0000) 2019-11-29T20:39:55.571 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:39:55.565+0000 1694c700 -1 osd.6 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:05.410961+0000 front 2019-11-29T20:39:05.386228+0000 (oldest deadline 2019-11-29T20:39:50.616276+0000) 2019-11-29T20:39:55.655 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:39:55.649+0000 1694c700 -1 osd.1 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:08.336126+0000 front 2019-11-29T20:39:08.324133+0000 (oldest deadline 2019-11-29T20:39:50.836784+0000) 2019-11-29T20:39:56.087 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:39:56.081+0000 1694c700 -1 osd.0 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:09.835477+0000 front 2019-11-29T20:39:09.987447+0000 (oldest deadline 2019-11-29T20:39:51.889232+0000) 2019-11-29T20:39:56.130 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:39:56.124+0000 1694c700 -1 osd.4 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:09.124907+0000 front 2019-11-29T20:39:09.147862+0000 (oldest deadline 2019-11-29T20:39:53.022359+0000) 2019-11-29T20:39:56.526 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:39:56.520+0000 1694c700 -1 osd.2 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:05.497932+0000 front 2019-11-29T20:39:05.562300+0000 (oldest deadline 2019-11-29T20:39:51.293509+0000) 2019-11-29T20:39:56.530 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:39:56.522+0000 1694c700 -1 osd.5 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:09.990839+0000 front 2019-11-29T20:39:10.031507+0000 (oldest deadline 2019-11-29T20:39:49.563985+0000) 2019-11-29T20:39:56.627 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:39:56.622+0000 1694c700 -1 osd.6 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:05.410961+0000 front 2019-11-29T20:39:05.386228+0000 (oldest deadline 2019-11-29T20:39:50.616276+0000) 2019-11-29T20:39:56.641 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:39:56.637+0000 1694c700 -1 osd.1 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:08.336126+0000 front 2019-11-29T20:39:08.324133+0000 (oldest deadline 2019-11-29T20:39:50.836784+0000) 2019-11-29T20:39:57.108 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:39:57.103+0000 1694c700 -1 osd.0 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:09.835477+0000 front 2019-11-29T20:39:09.987447+0000 (oldest deadline 2019-11-29T20:39:51.889232+0000) 2019-11-29T20:39:57.139 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:39:57.133+0000 1694c700 -1 osd.4 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:09.124907+0000 front 2019-11-29T20:39:09.147862+0000 (oldest deadline 2019-11-29T20:39:53.022359+0000) 2019-11-29T20:39:57.500 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:39:57.494+0000 1694c700 -1 osd.5 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:09.990839+0000 front 2019-11-29T20:39:10.031507+0000 (oldest deadline 2019-11-29T20:39:49.563985+0000) 2019-11-29T20:39:57.545 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:39:57.539+0000 1694c700 -1 osd.2 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:05.497932+0000 front 2019-11-29T20:39:05.562300+0000 (oldest deadline 2019-11-29T20:39:51.293509+0000) 2019-11-29T20:39:57.636 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:39:57.631+0000 1694c700 -1 osd.1 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:08.336126+0000 front 2019-11-29T20:39:08.324133+0000 (oldest deadline 2019-11-29T20:39:50.836784+0000) 2019-11-29T20:39:57.674 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:39:57.668+0000 1694c700 -1 osd.6 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:05.410961+0000 front 2019-11-29T20:39:05.386228+0000 (oldest deadline 2019-11-29T20:39:50.616276+0000) 2019-11-29T20:39:58.110 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:39:58.105+0000 1694c700 -1 osd.0 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:09.835477+0000 front 2019-11-29T20:39:09.987447+0000 (oldest deadline 2019-11-29T20:39:51.889232+0000) 2019-11-29T20:39:58.119 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:39:58.113+0000 1694c700 -1 osd.4 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:09.124907+0000 front 2019-11-29T20:39:09.147862+0000 (oldest deadline 2019-11-29T20:39:53.022359+0000) 2019-11-29T20:39:58.460 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:39:58.454+0000 1694c700 -1 osd.5 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:09.990839+0000 front 2019-11-29T20:39:10.031507+0000 (oldest deadline 2019-11-29T20:39:49.563985+0000) 2019-11-29T20:39:58.557 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:39:58.551+0000 1694c700 -1 osd.2 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:05.497932+0000 front 2019-11-29T20:39:05.562300+0000 (oldest deadline 2019-11-29T20:39:51.293509+0000) 2019-11-29T20:39:58.647 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:39:58.642+0000 1694c700 -1 osd.6 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:05.410961+0000 front 2019-11-29T20:39:05.386228+0000 (oldest deadline 2019-11-29T20:39:50.616276+0000) 2019-11-29T20:39:58.675 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:39:58.670+0000 1694c700 -1 osd.1 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:08.336126+0000 front 2019-11-29T20:39:08.324133+0000 (oldest deadline 2019-11-29T20:39:50.836784+0000) 2019-11-29T20:39:59.117 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:39:59.111+0000 1694c700 -1 osd.0 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:09.835477+0000 front 2019-11-29T20:39:09.987447+0000 (oldest deadline 2019-11-29T20:39:51.889232+0000) 2019-11-29T20:39:59.165 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:39:59.152+0000 1694c700 -1 osd.4 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:09.124907+0000 front 2019-11-29T20:39:09.147862+0000 (oldest deadline 2019-11-29T20:39:53.022359+0000) 2019-11-29T20:39:59.419 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:39:59.413+0000 1694c700 -1 osd.5 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:09.990839+0000 front 2019-11-29T20:39:10.031507+0000 (oldest deadline 2019-11-29T20:39:49.563985+0000) 2019-11-29T20:39:59.566 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:39:59.559+0000 1694c700 -1 osd.2 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:05.497932+0000 front 2019-11-29T20:39:05.562300+0000 (oldest deadline 2019-11-29T20:39:51.293509+0000) 2019-11-29T20:39:59.630 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:39:59.624+0000 1694c700 -1 osd.6 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:05.410961+0000 front 2019-11-29T20:39:05.386228+0000 (oldest deadline 2019-11-29T20:39:50.616276+0000) 2019-11-29T20:39:59.717 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:39:59.713+0000 1694c700 -1 osd.1 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:08.336126+0000 front 2019-11-29T20:39:08.324133+0000 (oldest deadline 2019-11-29T20:39:50.836784+0000) 2019-11-29T20:40:00.119 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:40:00.113+0000 1694c700 -1 osd.0 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:09.835477+0000 front 2019-11-29T20:39:09.987447+0000 (oldest deadline 2019-11-29T20:39:51.889232+0000) 2019-11-29T20:40:00.175 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:40:00.166+0000 1694c700 -1 osd.4 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:09.124907+0000 front 2019-11-29T20:39:09.147862+0000 (oldest deadline 2019-11-29T20:39:53.022359+0000) 2019-11-29T20:40:00.459 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:40:00.454+0000 1694c700 -1 osd.5 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:09.990839+0000 front 2019-11-29T20:39:10.031507+0000 (oldest deadline 2019-11-29T20:39:49.563985+0000) 2019-11-29T20:40:00.532 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:40:00.525+0000 1694c700 -1 osd.2 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:05.497932+0000 front 2019-11-29T20:39:05.562300+0000 (oldest deadline 2019-11-29T20:39:51.293509+0000) 2019-11-29T20:40:00.660 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:40:00.655+0000 1694c700 -1 osd.6 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:05.410961+0000 front 2019-11-29T20:39:05.386228+0000 (oldest deadline 2019-11-29T20:39:50.616276+0000) 2019-11-29T20:40:00.716 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:40:00.711+0000 1694c700 -1 osd.1 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:08.336126+0000 front 2019-11-29T20:39:08.324133+0000 (oldest deadline 2019-11-29T20:39:50.836784+0000) 2019-11-29T20:40:01.137 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:40:01.130+0000 1694c700 -1 osd.0 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:09.835477+0000 front 2019-11-29T20:39:09.987447+0000 (oldest deadline 2019-11-29T20:39:51.889232+0000) 2019-11-29T20:40:01.214 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:40:01.207+0000 1694c700 -1 osd.4 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:09.124907+0000 front 2019-11-29T20:39:09.147862+0000 (oldest deadline 2019-11-29T20:39:53.022359+0000) 2019-11-29T20:40:01.437 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:40:01.431+0000 1694c700 -1 osd.5 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:09.990839+0000 front 2019-11-29T20:39:10.031507+0000 (oldest deadline 2019-11-29T20:39:49.563985+0000) 2019-11-29T20:40:01.493 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:40:01.487+0000 1694c700 -1 osd.2 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:05.497932+0000 front 2019-11-29T20:39:05.562300+0000 (oldest deadline 2019-11-29T20:39:51.293509+0000) 2019-11-29T20:40:01.648 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:40:01.642+0000 1694c700 -1 osd.6 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:05.410961+0000 front 2019-11-29T20:39:05.386228+0000 (oldest deadline 2019-11-29T20:39:50.616276+0000) 2019-11-29T20:40:01.681 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:40:01.676+0000 1694c700 -1 osd.1 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:08.336126+0000 front 2019-11-29T20:39:08.324133+0000 (oldest deadline 2019-11-29T20:39:50.836784+0000) 2019-11-29T20:40:02.091 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:40:02.085+0000 1694c700 -1 osd.0 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:09.835477+0000 front 2019-11-29T20:39:09.987447+0000 (oldest deadline 2019-11-29T20:39:51.889232+0000) 2019-11-29T20:40:02.262 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:40:02.255+0000 1694c700 -1 osd.4 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:09.124907+0000 front 2019-11-29T20:39:09.147862+0000 (oldest deadline 2019-11-29T20:39:53.022359+0000) 2019-11-29T20:40:02.470 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:40:02.465+0000 1694c700 -1 osd.5 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:09.990839+0000 front 2019-11-29T20:39:10.031507+0000 (oldest deadline 2019-11-29T20:39:49.563985+0000) 2019-11-29T20:40:02.479 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:40:02.474+0000 1694c700 -1 osd.2 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:05.497932+0000 front 2019-11-29T20:39:05.562300+0000 (oldest deadline 2019-11-29T20:39:51.293509+0000) 2019-11-29T20:40:02.621 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:40:02.615+0000 1694c700 -1 osd.6 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:05.410961+0000 front 2019-11-29T20:39:05.386228+0000 (oldest deadline 2019-11-29T20:39:50.616276+0000) 2019-11-29T20:40:02.644 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:40:02.640+0000 1694c700 -1 osd.1 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:08.336126+0000 front 2019-11-29T20:39:08.324133+0000 (oldest deadline 2019-11-29T20:39:50.836784+0000) 2019-11-29T20:40:03.075 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:40:03.070+0000 1694c700 -1 osd.0 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:09.835477+0000 front 2019-11-29T20:39:09.987447+0000 (oldest deadline 2019-11-29T20:39:51.889232+0000) 2019-11-29T20:40:03.301 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:40:03.295+0000 1694c700 -1 osd.4 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:09.124907+0000 front 2019-11-29T20:39:09.147862+0000 (oldest deadline 2019-11-29T20:39:53.022359+0000) 2019-11-29T20:40:03.436 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:40:03.429+0000 1694c700 -1 osd.2 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:05.497932+0000 front 2019-11-29T20:39:05.562300+0000 (oldest deadline 2019-11-29T20:39:51.293509+0000) 2019-11-29T20:40:03.458 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:40:03.453+0000 1694c700 -1 osd.5 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:09.990839+0000 front 2019-11-29T20:39:10.031507+0000 (oldest deadline 2019-11-29T20:39:49.563985+0000) 2019-11-29T20:40:03.593 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:40:03.587+0000 1694c700 -1 osd.6 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:05.410961+0000 front 2019-11-29T20:39:05.386228+0000 (oldest deadline 2019-11-29T20:39:50.616276+0000) 2019-11-29T20:40:03.612 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:40:03.605+0000 1694c700 -1 osd.1 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:08.336126+0000 front 2019-11-29T20:39:08.324133+0000 (oldest deadline 2019-11-29T20:39:50.836784+0000) 2019-11-29T20:40:04.079 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:40:04.073+0000 1694c700 -1 osd.0 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:09.835477+0000 front 2019-11-29T20:39:09.987447+0000 (oldest deadline 2019-11-29T20:39:51.889232+0000) 2019-11-29T20:40:04.310 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:40:04.303+0000 1694c700 -1 osd.4 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:09.124907+0000 front 2019-11-29T20:39:09.147862+0000 (oldest deadline 2019-11-29T20:39:53.022359+0000) 2019-11-29T20:40:04.480 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:40:04.475+0000 1694c700 -1 osd.5 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:09.990839+0000 front 2019-11-29T20:39:10.031507+0000 (oldest deadline 2019-11-29T20:39:49.563985+0000) 2019-11-29T20:40:04.487 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:40:04.481+0000 1694c700 -1 osd.2 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:05.497932+0000 front 2019-11-29T20:39:05.562300+0000 (oldest deadline 2019-11-29T20:39:51.293509+0000) 2019-11-29T20:40:04.596 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:40:04.591+0000 1694c700 -1 osd.6 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:05.410961+0000 front 2019-11-29T20:39:05.386228+0000 (oldest deadline 2019-11-29T20:39:50.616276+0000) 2019-11-29T20:40:04.642 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:40:04.637+0000 1694c700 -1 osd.1 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:08.336126+0000 front 2019-11-29T20:39:08.324133+0000 (oldest deadline 2019-11-29T20:39:50.836784+0000) 2019-11-29T20:40:05.125 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:40:05.120+0000 1694c700 -1 osd.0 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:09.835477+0000 front 2019-11-29T20:39:09.987447+0000 (oldest deadline 2019-11-29T20:39:51.889232+0000) 2019-11-29T20:40:05.328 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:40:05.323+0000 1694c700 -1 osd.4 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:09.124907+0000 front 2019-11-29T20:39:09.147862+0000 (oldest deadline 2019-11-29T20:39:53.022359+0000) 2019-11-29T20:40:05.479 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:40:05.472+0000 1694c700 -1 osd.5 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:09.990839+0000 front 2019-11-29T20:39:10.031507+0000 (oldest deadline 2019-11-29T20:39:49.563985+0000) 2019-11-29T20:40:05.528 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:40:05.524+0000 1694c700 -1 osd.2 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:05.497932+0000 front 2019-11-29T20:39:05.562300+0000 (oldest deadline 2019-11-29T20:39:51.293509+0000) 2019-11-29T20:40:05.578 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:40:05.572+0000 1694c700 -1 osd.6 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:05.410961+0000 front 2019-11-29T20:39:05.386228+0000 (oldest deadline 2019-11-29T20:39:50.616276+0000) 2019-11-29T20:40:05.641 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:40:05.635+0000 1694c700 -1 osd.1 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:08.336126+0000 front 2019-11-29T20:39:08.324133+0000 (oldest deadline 2019-11-29T20:39:50.836784+0000) 2019-11-29T20:40:06.180 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:40:06.172+0000 1694c700 -1 osd.0 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:09.835477+0000 front 2019-11-29T20:39:09.987447+0000 (oldest deadline 2019-11-29T20:39:51.889232+0000) 2019-11-29T20:40:06.327 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:40:06.322+0000 1694c700 -1 osd.4 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:09.124907+0000 front 2019-11-29T20:39:09.147862+0000 (oldest deadline 2019-11-29T20:39:53.022359+0000) 2019-11-29T20:40:06.491 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:40:06.484+0000 1694c700 -1 osd.2 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:05.497932+0000 front 2019-11-29T20:39:05.562300+0000 (oldest deadline 2019-11-29T20:39:51.293509+0000) 2019-11-29T20:40:06.514 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:40:06.509+0000 1694c700 -1 osd.5 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:09.990839+0000 front 2019-11-29T20:39:10.031507+0000 (oldest deadline 2019-11-29T20:39:49.563985+0000) 2019-11-29T20:40:06.623 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:40:06.618+0000 1694c700 -1 osd.6 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:05.410961+0000 front 2019-11-29T20:39:05.386228+0000 (oldest deadline 2019-11-29T20:39:50.616276+0000) 2019-11-29T20:40:06.641 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:40:06.636+0000 1694c700 -1 osd.1 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:08.336126+0000 front 2019-11-29T20:39:08.324133+0000 (oldest deadline 2019-11-29T20:39:50.836784+0000) 2019-11-29T20:40:07.212 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:40:07.206+0000 1694c700 -1 osd.0 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:09.835477+0000 front 2019-11-29T20:39:09.987447+0000 (oldest deadline 2019-11-29T20:39:51.889232+0000) 2019-11-29T20:40:07.343 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:40:07.336+0000 1694c700 -1 osd.4 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:09.124907+0000 front 2019-11-29T20:39:09.147862+0000 (oldest deadline 2019-11-29T20:39:53.022359+0000) 2019-11-29T20:40:07.493 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:40:07.487+0000 1694c700 -1 osd.2 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:05.497932+0000 front 2019-11-29T20:39:05.562300+0000 (oldest deadline 2019-11-29T20:39:51.293509+0000) 2019-11-29T20:40:07.541 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:40:07.534+0000 1694c700 -1 osd.5 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:09.990839+0000 front 2019-11-29T20:39:10.031507+0000 (oldest deadline 2019-11-29T20:39:49.563985+0000) 2019-11-29T20:40:07.622 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:40:07.616+0000 1694c700 -1 osd.6 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:05.410961+0000 front 2019-11-29T20:39:05.386228+0000 (oldest deadline 2019-11-29T20:39:50.616276+0000) 2019-11-29T20:40:07.694 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:40:07.688+0000 1694c700 -1 osd.1 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:08.336126+0000 front 2019-11-29T20:39:08.324133+0000 (oldest deadline 2019-11-29T20:39:50.836784+0000) 2019-11-29T20:40:08.182 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:40:08.177+0000 1694c700 -1 osd.0 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:09.835477+0000 front 2019-11-29T20:39:09.987447+0000 (oldest deadline 2019-11-29T20:39:51.889232+0000) 2019-11-29T20:40:08.381 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:40:08.375+0000 1694c700 -1 osd.4 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:09.124907+0000 front 2019-11-29T20:39:09.147862+0000 (oldest deadline 2019-11-29T20:39:53.022359+0000) 2019-11-29T20:40:08.513 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:40:08.508+0000 1694c700 -1 osd.2 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:05.497932+0000 front 2019-11-29T20:39:05.562300+0000 (oldest deadline 2019-11-29T20:39:51.293509+0000) 2019-11-29T20:40:08.536 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:40:08.530+0000 1694c700 -1 osd.5 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:09.990839+0000 front 2019-11-29T20:39:10.031507+0000 (oldest deadline 2019-11-29T20:39:49.563985+0000) 2019-11-29T20:40:08.668 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:40:08.662+0000 1694c700 -1 osd.6 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:05.410961+0000 front 2019-11-29T20:39:05.386228+0000 (oldest deadline 2019-11-29T20:39:50.616276+0000) 2019-11-29T20:40:08.698 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:40:08.693+0000 1694c700 -1 osd.1 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:08.336126+0000 front 2019-11-29T20:39:08.324133+0000 (oldest deadline 2019-11-29T20:39:50.836784+0000) 2019-11-29T20:40:09.203 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:40:09.198+0000 1694c700 -1 osd.0 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:09.835477+0000 front 2019-11-29T20:39:09.987447+0000 (oldest deadline 2019-11-29T20:39:51.889232+0000) 2019-11-29T20:40:09.421 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:40:09.415+0000 1694c700 -1 osd.4 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:09.124907+0000 front 2019-11-29T20:39:09.147862+0000 (oldest deadline 2019-11-29T20:39:53.022359+0000) 2019-11-29T20:40:09.494 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:40:09.489+0000 1694c700 -1 osd.5 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:09.990839+0000 front 2019-11-29T20:39:10.031507+0000 (oldest deadline 2019-11-29T20:39:49.563985+0000) 2019-11-29T20:40:09.552 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:40:09.547+0000 1694c700 -1 osd.2 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:05.497932+0000 front 2019-11-29T20:39:05.562300+0000 (oldest deadline 2019-11-29T20:39:51.293509+0000) 2019-11-29T20:40:09.675 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:40:09.668+0000 1694c700 -1 osd.1 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:08.336126+0000 front 2019-11-29T20:39:08.324133+0000 (oldest deadline 2019-11-29T20:39:50.836784+0000) 2019-11-29T20:40:09.704 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:40:09.699+0000 1694c700 -1 osd.6 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:05.410961+0000 front 2019-11-29T20:39:05.386228+0000 (oldest deadline 2019-11-29T20:39:50.616276+0000) 2019-11-29T20:40:10.211 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:40:10.205+0000 1694c700 -1 osd.0 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:09.835477+0000 front 2019-11-29T20:39:09.987447+0000 (oldest deadline 2019-11-29T20:39:51.889232+0000) 2019-11-29T20:40:10.415 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:40:10.407+0000 1694c700 -1 osd.4 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:09.124907+0000 front 2019-11-29T20:39:09.147862+0000 (oldest deadline 2019-11-29T20:39:53.022359+0000) 2019-11-29T20:40:10.504 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:40:10.498+0000 1694c700 -1 osd.5 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:09.990839+0000 front 2019-11-29T20:39:10.031507+0000 (oldest deadline 2019-11-29T20:39:49.563985+0000) 2019-11-29T20:40:10.565 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:40:10.560+0000 1694c700 -1 osd.2 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:05.497932+0000 front 2019-11-29T20:39:05.562300+0000 (oldest deadline 2019-11-29T20:39:51.293509+0000) 2019-11-29T20:40:10.686 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:40:10.681+0000 1694c700 -1 osd.1 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:08.336126+0000 front 2019-11-29T20:39:08.324133+0000 (oldest deadline 2019-11-29T20:39:50.836784+0000) 2019-11-29T20:40:10.711 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:40:10.705+0000 1694c700 -1 osd.6 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:05.410961+0000 front 2019-11-29T20:39:05.386228+0000 (oldest deadline 2019-11-29T20:39:50.616276+0000) 2019-11-29T20:40:11.255 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:40:11.248+0000 1694c700 -1 osd.0 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:09.835477+0000 front 2019-11-29T20:39:09.987447+0000 (oldest deadline 2019-11-29T20:39:51.889232+0000) 2019-11-29T20:40:11.415 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:40:11.410+0000 1694c700 -1 osd.4 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:09.124907+0000 front 2019-11-29T20:39:09.147862+0000 (oldest deadline 2019-11-29T20:39:53.022359+0000) 2019-11-29T20:40:11.548 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:40:11.542+0000 1694c700 -1 osd.5 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:09.990839+0000 front 2019-11-29T20:39:10.031507+0000 (oldest deadline 2019-11-29T20:39:49.563985+0000) 2019-11-29T20:40:11.577 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:40:11.570+0000 1694c700 -1 osd.2 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:05.497932+0000 front 2019-11-29T20:39:05.562300+0000 (oldest deadline 2019-11-29T20:39:51.293509+0000) 2019-11-29T20:40:11.704 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:40:11.698+0000 1694c700 -1 osd.1 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:08.336126+0000 front 2019-11-29T20:39:08.324133+0000 (oldest deadline 2019-11-29T20:39:50.836784+0000) 2019-11-29T20:40:11.735 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:40:11.728+0000 1694c700 -1 osd.6 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:05.410961+0000 front 2019-11-29T20:39:05.386228+0000 (oldest deadline 2019-11-29T20:39:50.616276+0000) 2019-11-29T20:40:12.262 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:40:12.257+0000 1694c700 -1 osd.0 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:09.835477+0000 front 2019-11-29T20:39:09.987447+0000 (oldest deadline 2019-11-29T20:39:51.889232+0000) 2019-11-29T20:40:12.449 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:40:12.444+0000 1694c700 -1 osd.4 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:09.124907+0000 front 2019-11-29T20:39:09.147862+0000 (oldest deadline 2019-11-29T20:39:53.022359+0000) 2019-11-29T20:40:12.516 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:40:12.511+0000 1694c700 -1 osd.5 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:09.990839+0000 front 2019-11-29T20:39:10.031507+0000 (oldest deadline 2019-11-29T20:39:49.563985+0000) 2019-11-29T20:40:12.534 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:40:12.528+0000 1694c700 -1 osd.2 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:05.497932+0000 front 2019-11-29T20:39:05.562300+0000 (oldest deadline 2019-11-29T20:39:51.293509+0000) 2019-11-29T20:40:12.697 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:40:12.692+0000 1694c700 -1 osd.1 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:08.336126+0000 front 2019-11-29T20:39:08.324133+0000 (oldest deadline 2019-11-29T20:39:50.836784+0000) 2019-11-29T20:40:12.750 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:40:12.745+0000 1694c700 -1 osd.6 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:05.410961+0000 front 2019-11-29T20:39:05.386228+0000 (oldest deadline 2019-11-29T20:39:50.616276+0000) 2019-11-29T20:40:13.247 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:40:13.241+0000 1694c700 -1 osd.0 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:09.835477+0000 front 2019-11-29T20:39:09.987447+0000 (oldest deadline 2019-11-29T20:39:51.889232+0000) 2019-11-29T20:40:13.414 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:40:13.408+0000 1694c700 -1 osd.4 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:09.124907+0000 front 2019-11-29T20:39:09.147862+0000 (oldest deadline 2019-11-29T20:39:53.022359+0000) 2019-11-29T20:40:13.510 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:40:13.504+0000 1694c700 -1 osd.5 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:09.990839+0000 front 2019-11-29T20:39:10.031507+0000 (oldest deadline 2019-11-29T20:39:49.563985+0000) 2019-11-29T20:40:13.540 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:40:13.534+0000 1694c700 -1 osd.2 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:05.497932+0000 front 2019-11-29T20:39:05.562300+0000 (oldest deadline 2019-11-29T20:39:51.293509+0000) 2019-11-29T20:40:13.694 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:40:13.688+0000 1694c700 -1 osd.1 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:08.336126+0000 front 2019-11-29T20:39:08.324133+0000 (oldest deadline 2019-11-29T20:39:50.836784+0000) 2019-11-29T20:40:13.741 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:40:13.735+0000 1694c700 -1 osd.6 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:05.410961+0000 front 2019-11-29T20:39:05.386228+0000 (oldest deadline 2019-11-29T20:39:50.616276+0000) 2019-11-29T20:40:14.280 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:40:14.275+0000 1694c700 -1 osd.0 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:09.835477+0000 front 2019-11-29T20:39:09.987447+0000 (oldest deadline 2019-11-29T20:39:51.889232+0000) 2019-11-29T20:40:14.440 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:40:14.434+0000 1694c700 -1 osd.4 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:09.124907+0000 front 2019-11-29T20:39:09.147862+0000 (oldest deadline 2019-11-29T20:39:53.022359+0000) 2019-11-29T20:40:14.508 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:40:14.503+0000 1694c700 -1 osd.5 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:09.990839+0000 front 2019-11-29T20:39:10.031507+0000 (oldest deadline 2019-11-29T20:39:49.563985+0000) 2019-11-29T20:40:14.521 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:40:14.515+0000 1694c700 -1 osd.2 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:05.497932+0000 front 2019-11-29T20:39:05.562300+0000 (oldest deadline 2019-11-29T20:39:51.293509+0000) 2019-11-29T20:40:14.668 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:40:14.663+0000 1694c700 -1 osd.1 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:08.336126+0000 front 2019-11-29T20:39:08.324133+0000 (oldest deadline 2019-11-29T20:39:50.836784+0000) 2019-11-29T20:40:14.730 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:40:14.725+0000 1694c700 -1 osd.6 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:05.410961+0000 front 2019-11-29T20:39:05.386228+0000 (oldest deadline 2019-11-29T20:39:50.616276+0000) 2019-11-29T20:40:14.793 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:08:14:55.451 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T20:40:14.805 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:08:14:55.463 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T20:40:14.830 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:08:14:55.436 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T20:40:14.839 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:08:14:55.446 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T20:40:14.872 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:08:14:55.479 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T20:40:14.877 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:08:14:55.484 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T20:40:14.903 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:08:14:55.559 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T20:40:14.922 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:08:14:55.529 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T20:40:14.941 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:08:14:55.548 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T20:40:15.284 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:40:15.279+0000 1694c700 -1 osd.0 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:09.835477+0000 front 2019-11-29T20:39:09.987447+0000 (oldest deadline 2019-11-29T20:39:51.889232+0000) 2019-11-29T20:40:15.402 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:40:15.397+0000 1694c700 -1 osd.4 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:09.124907+0000 front 2019-11-29T20:39:09.147862+0000 (oldest deadline 2019-11-29T20:39:53.022359+0000) 2019-11-29T20:40:15.491 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:40:15.486+0000 1694c700 -1 osd.2 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:05.497932+0000 front 2019-11-29T20:39:05.562300+0000 (oldest deadline 2019-11-29T20:39:51.293509+0000) 2019-11-29T20:40:15.515 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:40:15.511+0000 1694c700 -1 osd.5 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:09.990839+0000 front 2019-11-29T20:39:10.031507+0000 (oldest deadline 2019-11-29T20:39:49.563985+0000) 2019-11-29T20:40:15.654 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:40:15.650+0000 1694c700 -1 osd.1 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:08.336126+0000 front 2019-11-29T20:39:08.324133+0000 (oldest deadline 2019-11-29T20:39:50.836784+0000) 2019-11-29T20:40:15.734 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:40:15.729+0000 1694c700 -1 osd.6 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:05.410961+0000 front 2019-11-29T20:39:05.386228+0000 (oldest deadline 2019-11-29T20:39:50.616276+0000) 2019-11-29T20:40:16.297 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:40:16.292+0000 1694c700 -1 osd.0 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:09.835477+0000 front 2019-11-29T20:39:09.987447+0000 (oldest deadline 2019-11-29T20:39:51.889232+0000) 2019-11-29T20:40:16.387 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:40:16.382+0000 1694c700 -1 osd.4 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:09.124907+0000 front 2019-11-29T20:39:09.147862+0000 (oldest deadline 2019-11-29T20:39:53.022359+0000) 2019-11-29T20:40:16.472 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:40:16.468+0000 1694c700 -1 osd.5 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:09.990839+0000 front 2019-11-29T20:39:10.031507+0000 (oldest deadline 2019-11-29T20:39:49.563985+0000) 2019-11-29T20:40:16.516 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:40:16.510+0000 1694c700 -1 osd.2 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:05.497932+0000 front 2019-11-29T20:39:05.562300+0000 (oldest deadline 2019-11-29T20:39:51.293509+0000) 2019-11-29T20:40:16.622 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:40:16.617+0000 1694c700 -1 osd.1 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:08.336126+0000 front 2019-11-29T20:39:08.324133+0000 (oldest deadline 2019-11-29T20:39:50.836784+0000) 2019-11-29T20:40:16.699 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:40:16.695+0000 1694c700 -1 osd.6 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:05.410961+0000 front 2019-11-29T20:39:05.386228+0000 (oldest deadline 2019-11-29T20:39:50.616276+0000) 2019-11-29T20:40:17.297 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:40:17.290+0000 1694c700 -1 osd.0 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:09.835477+0000 front 2019-11-29T20:39:09.987447+0000 (oldest deadline 2019-11-29T20:39:51.889232+0000) 2019-11-29T20:40:17.352 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:40:17.346+0000 1694c700 -1 osd.4 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:09.124907+0000 front 2019-11-29T20:39:09.147862+0000 (oldest deadline 2019-11-29T20:39:53.022359+0000) 2019-11-29T20:40:17.440 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:40:17.434+0000 1694c700 -1 osd.5 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:09.990839+0000 front 2019-11-29T20:39:10.031507+0000 (oldest deadline 2019-11-29T20:39:49.563985+0000) 2019-11-29T20:40:17.561 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:40:17.554+0000 1694c700 -1 osd.2 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:05.497932+0000 front 2019-11-29T20:39:05.562300+0000 (oldest deadline 2019-11-29T20:39:51.293509+0000) 2019-11-29T20:40:17.578 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:40:17.571+0000 1694c700 -1 osd.1 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:08.336126+0000 front 2019-11-29T20:39:08.324133+0000 (oldest deadline 2019-11-29T20:39:50.836784+0000) 2019-11-29T20:40:17.707 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:40:17.702+0000 1694c700 -1 osd.6 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:05.410961+0000 front 2019-11-29T20:39:05.386228+0000 (oldest deadline 2019-11-29T20:39:50.616276+0000) 2019-11-29T20:40:18.331 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:40:18.322+0000 1694c700 -1 osd.0 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:09.835477+0000 front 2019-11-29T20:39:09.987447+0000 (oldest deadline 2019-11-29T20:39:51.889232+0000) 2019-11-29T20:40:18.363 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:40:18.357+0000 1694c700 -1 osd.4 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:09.124907+0000 front 2019-11-29T20:39:09.147862+0000 (oldest deadline 2019-11-29T20:39:53.022359+0000) 2019-11-29T20:40:18.408 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:40:18.401+0000 1694c700 -1 osd.5 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:09.990839+0000 front 2019-11-29T20:39:10.031507+0000 (oldest deadline 2019-11-29T20:39:49.563985+0000) 2019-11-29T20:40:18.537 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:40:18.531+0000 1694c700 -1 osd.2 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:05.497932+0000 front 2019-11-29T20:39:05.562300+0000 (oldest deadline 2019-11-29T20:39:51.293509+0000) 2019-11-29T20:40:18.539 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:40:18.532+0000 1694c700 -1 osd.1 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:08.336126+0000 front 2019-11-29T20:39:08.324133+0000 (oldest deadline 2019-11-29T20:39:50.836784+0000) 2019-11-29T20:40:18.669 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:40:18.663+0000 1694c700 -1 osd.6 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:05.410961+0000 front 2019-11-29T20:39:05.386228+0000 (oldest deadline 2019-11-29T20:39:50.616276+0000) 2019-11-29T20:40:19.348 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:40:19.342+0000 1694c700 -1 osd.0 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:09.835477+0000 front 2019-11-29T20:39:09.987447+0000 (oldest deadline 2019-11-29T20:39:51.889232+0000) 2019-11-29T20:40:19.382 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:40:19.376+0000 1694c700 -1 osd.4 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:09.124907+0000 front 2019-11-29T20:39:09.147862+0000 (oldest deadline 2019-11-29T20:39:53.022359+0000) 2019-11-29T20:40:19.455 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:40:19.449+0000 1694c700 -1 osd.5 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:09.990839+0000 front 2019-11-29T20:39:10.031507+0000 (oldest deadline 2019-11-29T20:39:49.563985+0000) 2019-11-29T20:40:19.528 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:40:19.523+0000 1694c700 -1 osd.2 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:05.497932+0000 front 2019-11-29T20:39:05.562300+0000 (oldest deadline 2019-11-29T20:39:51.293509+0000) 2019-11-29T20:40:19.541 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:40:19.535+0000 1694c700 -1 osd.1 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:08.336126+0000 front 2019-11-29T20:39:08.324133+0000 (oldest deadline 2019-11-29T20:39:50.836784+0000) 2019-11-29T20:40:19.670 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:40:19.660+0000 1694c700 -1 osd.6 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:05.410961+0000 front 2019-11-29T20:39:05.386228+0000 (oldest deadline 2019-11-29T20:39:50.616276+0000) 2019-11-29T20:40:20.339 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:40:20.333+0000 1694c700 -1 osd.0 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:09.835477+0000 front 2019-11-29T20:39:09.987447+0000 (oldest deadline 2019-11-29T20:39:51.889232+0000) 2019-11-29T20:40:20.422 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:40:20.415+0000 1694c700 -1 osd.5 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:09.990839+0000 front 2019-11-29T20:39:10.031507+0000 (oldest deadline 2019-11-29T20:39:49.563985+0000) 2019-11-29T20:40:20.432 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:40:20.426+0000 1694c700 -1 osd.4 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:09.124907+0000 front 2019-11-29T20:39:09.147862+0000 (oldest deadline 2019-11-29T20:39:53.022359+0000) 2019-11-29T20:40:20.496 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:40:20.489+0000 1694c700 -1 osd.1 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:08.336126+0000 front 2019-11-29T20:39:08.324133+0000 (oldest deadline 2019-11-29T20:39:50.836784+0000) 2019-11-29T20:40:20.543 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:40:20.539+0000 1694c700 -1 osd.2 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:05.497932+0000 front 2019-11-29T20:39:05.562300+0000 (oldest deadline 2019-11-29T20:39:51.293509+0000) 2019-11-29T20:40:20.662 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:40:20.653+0000 1694c700 -1 osd.6 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:05.410961+0000 front 2019-11-29T20:39:05.386228+0000 (oldest deadline 2019-11-29T20:39:50.616276+0000) 2019-11-29T20:40:21.344 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:40:21.339+0000 1694c700 -1 osd.0 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:09.835477+0000 front 2019-11-29T20:39:09.987447+0000 (oldest deadline 2019-11-29T20:39:51.889232+0000) 2019-11-29T20:40:21.411 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:40:21.405+0000 1694c700 -1 osd.5 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:09.990839+0000 front 2019-11-29T20:39:10.031507+0000 (oldest deadline 2019-11-29T20:39:49.563985+0000) 2019-11-29T20:40:21.427 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:40:21.421+0000 1694c700 -1 osd.4 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:09.124907+0000 front 2019-11-29T20:39:09.147862+0000 (oldest deadline 2019-11-29T20:39:53.022359+0000) 2019-11-29T20:40:21.510 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:40:21.505+0000 1694c700 -1 osd.2 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:05.497932+0000 front 2019-11-29T20:39:05.562300+0000 (oldest deadline 2019-11-29T20:39:51.293509+0000) 2019-11-29T20:40:21.534 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:40:21.530+0000 1694c700 -1 osd.1 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:08.336126+0000 front 2019-11-29T20:39:08.324133+0000 (oldest deadline 2019-11-29T20:39:50.836784+0000) 2019-11-29T20:40:21.623 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:40:21.618+0000 1694c700 -1 osd.6 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:05.410961+0000 front 2019-11-29T20:39:05.386228+0000 (oldest deadline 2019-11-29T20:39:50.616276+0000) 2019-11-29T20:40:22.332 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:40:22.327+0000 1694c700 -1 osd.0 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:09.835477+0000 front 2019-11-29T20:39:09.987447+0000 (oldest deadline 2019-11-29T20:39:51.889232+0000) 2019-11-29T20:40:22.394 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:40:22.389+0000 1694c700 -1 osd.4 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:09.124907+0000 front 2019-11-29T20:39:09.147862+0000 (oldest deadline 2019-11-29T20:39:53.022359+0000) 2019-11-29T20:40:22.453 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:40:22.448+0000 1694c700 -1 osd.5 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:09.990839+0000 front 2019-11-29T20:39:10.031507+0000 (oldest deadline 2019-11-29T20:39:49.563985+0000) 2019-11-29T20:40:22.552 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:40:22.547+0000 1694c700 -1 osd.2 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:05.497932+0000 front 2019-11-29T20:39:05.562300+0000 (oldest deadline 2019-11-29T20:39:51.293509+0000) 2019-11-29T20:40:22.581 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:40:22.576+0000 1694c700 -1 osd.1 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:08.336126+0000 front 2019-11-29T20:39:08.324133+0000 (oldest deadline 2019-11-29T20:39:50.836784+0000) 2019-11-29T20:40:22.681 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:40:22.676+0000 1694c700 -1 osd.6 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:05.410961+0000 front 2019-11-29T20:39:05.386228+0000 (oldest deadline 2019-11-29T20:39:50.616276+0000) 2019-11-29T20:40:23.351 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:40:23.344+0000 1694c700 -1 osd.0 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:09.835477+0000 front 2019-11-29T20:39:09.987447+0000 (oldest deadline 2019-11-29T20:39:51.889232+0000) 2019-11-29T20:40:23.391 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:40:23.385+0000 1694c700 -1 osd.4 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:09.124907+0000 front 2019-11-29T20:39:09.147862+0000 (oldest deadline 2019-11-29T20:39:53.022359+0000) 2019-11-29T20:40:23.494 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:40:23.488+0000 1694c700 -1 osd.5 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:09.990839+0000 front 2019-11-29T20:39:10.031507+0000 (oldest deadline 2019-11-29T20:39:49.563985+0000) 2019-11-29T20:40:23.591 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:40:23.584+0000 1694c700 -1 osd.1 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:08.336126+0000 front 2019-11-29T20:39:08.324133+0000 (oldest deadline 2019-11-29T20:39:50.836784+0000) 2019-11-29T20:40:23.608 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:40:23.600+0000 1694c700 -1 osd.2 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:05.497932+0000 front 2019-11-29T20:39:05.562300+0000 (oldest deadline 2019-11-29T20:39:51.293509+0000) 2019-11-29T20:40:23.730 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:40:23.723+0000 1694c700 -1 osd.6 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:05.410961+0000 front 2019-11-29T20:39:05.386228+0000 (oldest deadline 2019-11-29T20:39:50.616276+0000) 2019-11-29T20:40:24.353 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:40:24.347+0000 1694c700 -1 osd.0 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:09.835477+0000 front 2019-11-29T20:39:09.987447+0000 (oldest deadline 2019-11-29T20:39:51.889232+0000) 2019-11-29T20:40:24.412 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:40:24.406+0000 1694c700 -1 osd.4 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:09.124907+0000 front 2019-11-29T20:39:09.147862+0000 (oldest deadline 2019-11-29T20:39:53.022359+0000) 2019-11-29T20:40:24.466 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:40:24.461+0000 1694c700 -1 osd.5 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:09.990839+0000 front 2019-11-29T20:39:10.031507+0000 (oldest deadline 2019-11-29T20:39:49.563985+0000) 2019-11-29T20:40:24.567 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:40:24.562+0000 1694c700 -1 osd.1 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:08.336126+0000 front 2019-11-29T20:39:08.324133+0000 (oldest deadline 2019-11-29T20:39:50.836784+0000) 2019-11-29T20:40:24.594 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:40:24.589+0000 1694c700 -1 osd.2 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:05.497932+0000 front 2019-11-29T20:39:05.562300+0000 (oldest deadline 2019-11-29T20:39:51.293509+0000) 2019-11-29T20:40:24.702 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:40:24.697+0000 1694c700 -1 osd.6 172 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:39:05.410961+0000 front 2019-11-29T20:39:05.386228+0000 (oldest deadline 2019-11-29T20:39:50.616276+0000) 2019-11-29T20:40:24.810 INFO:tasks.ceph.mon.b.smithi022.stderr:2019-11-29T20:40:24.788+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 3 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.62:6823/10369,v1:172.21.15.62:6825/10369] for 41sec e172 v172) 2019-11-29T20:41:23.238 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:41:23.233+0000 1694c700 -1 osd.1 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.181623+0000 front 2019-11-29T20:40:39.179238+0000 (oldest deadline 2019-11-29T20:41:23.168319+0000) 2019-11-29T20:41:24.080 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:41:24.075+0000 1694c700 -1 osd.4 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.942641+0000 front 2019-11-29T20:40:39.994353+0000 (oldest deadline 2019-11-29T20:41:23.428761+0000) 2019-11-29T20:41:24.205 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:41:24.199+0000 1694c700 -1 osd.1 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.181623+0000 front 2019-11-29T20:40:39.179238+0000 (oldest deadline 2019-11-29T20:41:23.168319+0000) 2019-11-29T20:41:24.595 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:41:24.590+0000 1694c700 -1 osd.0 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.649026+0000 front 2019-11-29T20:40:39.653540+0000 (oldest deadline 2019-11-29T20:41:24.562335+0000) 2019-11-29T20:41:25.094 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:41:25.089+0000 1694c700 -1 osd.4 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.942641+0000 front 2019-11-29T20:40:39.994353+0000 (oldest deadline 2019-11-29T20:41:23.428761+0000) 2019-11-29T20:41:25.152 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:41:25.147+0000 1694c700 -1 osd.6 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:42.002671+0000 front 2019-11-29T20:40:41.396593+0000 (oldest deadline 2019-11-29T20:41:24.686719+0000) 2019-11-29T20:41:25.207 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:41:25.202+0000 1694c700 -1 osd.1 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.181623+0000 front 2019-11-29T20:40:39.179238+0000 (oldest deadline 2019-11-29T20:41:23.168319+0000) 2019-11-29T20:41:25.207 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:41:25.202+0000 1694c700 -1 osd.2 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.652764+0000 front 2019-11-29T20:40:39.626851+0000 (oldest deadline 2019-11-29T20:41:24.996522+0000) 2019-11-29T20:41:25.557 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:41:25.549+0000 1694c700 -1 osd.0 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.649026+0000 front 2019-11-29T20:40:39.653540+0000 (oldest deadline 2019-11-29T20:41:24.562335+0000) 2019-11-29T20:41:26.120 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:41:26.114+0000 1694c700 -1 osd.4 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.942641+0000 front 2019-11-29T20:40:39.994353+0000 (oldest deadline 2019-11-29T20:41:23.428761+0000) 2019-11-29T20:41:26.181 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:41:26.176+0000 1694c700 -1 osd.2 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.652764+0000 front 2019-11-29T20:40:39.626851+0000 (oldest deadline 2019-11-29T20:41:24.996522+0000) 2019-11-29T20:41:26.182 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:41:26.177+0000 1694c700 -1 osd.6 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:42.002671+0000 front 2019-11-29T20:40:41.396593+0000 (oldest deadline 2019-11-29T20:41:24.686719+0000) 2019-11-29T20:41:26.194 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:41:26.188+0000 1694c700 -1 osd.1 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.181623+0000 front 2019-11-29T20:40:39.179238+0000 (oldest deadline 2019-11-29T20:41:23.168319+0000) 2019-11-29T20:41:26.569 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:41:26.558+0000 1694c700 -1 osd.0 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.649026+0000 front 2019-11-29T20:40:39.653540+0000 (oldest deadline 2019-11-29T20:41:24.562335+0000) 2019-11-29T20:41:27.145 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:41:27.140+0000 1694c700 -1 osd.4 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.942641+0000 front 2019-11-29T20:40:39.994353+0000 (oldest deadline 2019-11-29T20:41:23.428761+0000) 2019-11-29T20:41:27.154 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:41:27.149+0000 1694c700 -1 osd.6 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:42.002671+0000 front 2019-11-29T20:40:41.396593+0000 (oldest deadline 2019-11-29T20:41:24.686719+0000) 2019-11-29T20:41:27.213 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:41:27.208+0000 1694c700 -1 osd.1 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.181623+0000 front 2019-11-29T20:40:39.179238+0000 (oldest deadline 2019-11-29T20:41:23.168319+0000) 2019-11-29T20:41:27.224 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:41:27.219+0000 1694c700 -1 osd.2 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.652764+0000 front 2019-11-29T20:40:39.626851+0000 (oldest deadline 2019-11-29T20:41:24.996522+0000) 2019-11-29T20:41:27.608 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:41:27.602+0000 1694c700 -1 osd.0 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.649026+0000 front 2019-11-29T20:40:39.653540+0000 (oldest deadline 2019-11-29T20:41:24.562335+0000) 2019-11-29T20:41:28.117 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:41:28.112+0000 1694c700 -1 osd.4 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.942641+0000 front 2019-11-29T20:40:39.994353+0000 (oldest deadline 2019-11-29T20:41:23.428761+0000) 2019-11-29T20:41:28.181 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:41:28.176+0000 1694c700 -1 osd.6 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:42.002671+0000 front 2019-11-29T20:40:41.396593+0000 (oldest deadline 2019-11-29T20:41:24.686719+0000) 2019-11-29T20:41:28.206 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:41:28.201+0000 1694c700 -1 osd.1 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.181623+0000 front 2019-11-29T20:40:39.179238+0000 (oldest deadline 2019-11-29T20:41:23.168319+0000) 2019-11-29T20:41:28.240 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:41:28.234+0000 1694c700 -1 osd.2 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.652764+0000 front 2019-11-29T20:40:39.626851+0000 (oldest deadline 2019-11-29T20:41:24.996522+0000) 2019-11-29T20:41:28.585 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:41:28.578+0000 1694c700 -1 osd.0 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.649026+0000 front 2019-11-29T20:40:39.653540+0000 (oldest deadline 2019-11-29T20:41:24.562335+0000) 2019-11-29T20:41:29.073 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:41:29.067+0000 1694c700 -1 osd.4 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.942641+0000 front 2019-11-29T20:40:39.994353+0000 (oldest deadline 2019-11-29T20:41:23.428761+0000) 2019-11-29T20:41:29.201 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:41:29.195+0000 1694c700 -1 osd.1 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.181623+0000 front 2019-11-29T20:40:39.179238+0000 (oldest deadline 2019-11-29T20:41:23.168319+0000) 2019-11-29T20:41:29.201 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:41:29.196+0000 1694c700 -1 osd.6 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:42.002671+0000 front 2019-11-29T20:40:41.396593+0000 (oldest deadline 2019-11-29T20:41:24.686719+0000) 2019-11-29T20:41:29.245 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:41:29.239+0000 1694c700 -1 osd.2 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.652764+0000 front 2019-11-29T20:40:39.626851+0000 (oldest deadline 2019-11-29T20:41:24.996522+0000) 2019-11-29T20:41:29.594 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:41:29.589+0000 1694c700 -1 osd.0 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.649026+0000 front 2019-11-29T20:40:39.653540+0000 (oldest deadline 2019-11-29T20:41:24.562335+0000) 2019-11-29T20:41:30.111 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:41:30.104+0000 1694c700 -1 osd.4 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.942641+0000 front 2019-11-29T20:40:39.994353+0000 (oldest deadline 2019-11-29T20:41:23.428761+0000) 2019-11-29T20:41:30.214 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:41:30.209+0000 1694c700 -1 osd.6 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:42.002671+0000 front 2019-11-29T20:40:41.396593+0000 (oldest deadline 2019-11-29T20:41:24.686719+0000) 2019-11-29T20:41:30.223 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:41:30.219+0000 1694c700 -1 osd.1 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.181623+0000 front 2019-11-29T20:40:39.179238+0000 (oldest deadline 2019-11-29T20:41:23.168319+0000) 2019-11-29T20:41:30.241 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:41:30.236+0000 1694c700 -1 osd.2 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.652764+0000 front 2019-11-29T20:40:39.626851+0000 (oldest deadline 2019-11-29T20:41:24.996522+0000) 2019-11-29T20:41:30.640 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:41:30.634+0000 1694c700 -1 osd.0 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.649026+0000 front 2019-11-29T20:40:39.653540+0000 (oldest deadline 2019-11-29T20:41:24.562335+0000) 2019-11-29T20:41:31.142 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:41:31.138+0000 1694c700 -1 osd.4 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.942641+0000 front 2019-11-29T20:40:39.994353+0000 (oldest deadline 2019-11-29T20:41:23.428761+0000) 2019-11-29T20:41:31.183 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:41:31.178+0000 1694c700 -1 osd.6 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:42.002671+0000 front 2019-11-29T20:40:41.396593+0000 (oldest deadline 2019-11-29T20:41:24.686719+0000) 2019-11-29T20:41:31.199 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:41:31.194+0000 1694c700 -1 osd.2 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.652764+0000 front 2019-11-29T20:40:39.626851+0000 (oldest deadline 2019-11-29T20:41:24.996522+0000) 2019-11-29T20:41:31.268 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:41:31.263+0000 1694c700 -1 osd.1 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.181623+0000 front 2019-11-29T20:40:39.179238+0000 (oldest deadline 2019-11-29T20:41:23.168319+0000) 2019-11-29T20:41:31.619 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:41:31.613+0000 1694c700 -1 osd.0 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.649026+0000 front 2019-11-29T20:40:39.653540+0000 (oldest deadline 2019-11-29T20:41:24.562335+0000) 2019-11-29T20:41:32.186 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:41:32.181+0000 1694c700 -1 osd.4 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.942641+0000 front 2019-11-29T20:40:39.994353+0000 (oldest deadline 2019-11-29T20:41:23.428761+0000) 2019-11-29T20:41:32.206 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:41:32.202+0000 1694c700 -1 osd.6 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:42.002671+0000 front 2019-11-29T20:40:41.396593+0000 (oldest deadline 2019-11-29T20:41:24.686719+0000) 2019-11-29T20:41:32.207 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:41:32.201+0000 1694c700 -1 osd.2 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.652764+0000 front 2019-11-29T20:40:39.626851+0000 (oldest deadline 2019-11-29T20:41:24.996522+0000) 2019-11-29T20:41:32.223 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:41:32.217+0000 1694c700 -1 osd.1 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.181623+0000 front 2019-11-29T20:40:39.179238+0000 (oldest deadline 2019-11-29T20:41:23.168319+0000) 2019-11-29T20:41:32.613 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:41:32.607+0000 1694c700 -1 osd.0 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.649026+0000 front 2019-11-29T20:40:39.653540+0000 (oldest deadline 2019-11-29T20:41:24.562335+0000) 2019-11-29T20:41:33.168 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:41:33.163+0000 1694c700 -1 osd.6 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:42.002671+0000 front 2019-11-29T20:40:41.396593+0000 (oldest deadline 2019-11-29T20:41:24.686719+0000) 2019-11-29T20:41:33.170 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:41:33.162+0000 1694c700 -1 osd.4 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.942641+0000 front 2019-11-29T20:40:39.994353+0000 (oldest deadline 2019-11-29T20:41:23.428761+0000) 2019-11-29T20:41:33.190 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:41:33.184+0000 1694c700 -1 osd.2 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.652764+0000 front 2019-11-29T20:40:39.626851+0000 (oldest deadline 2019-11-29T20:41:24.996522+0000) 2019-11-29T20:41:33.236 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:41:33.231+0000 1694c700 -1 osd.1 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.181623+0000 front 2019-11-29T20:40:39.179238+0000 (oldest deadline 2019-11-29T20:41:23.168319+0000) 2019-11-29T20:41:33.639 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:41:33.634+0000 1694c700 -1 osd.0 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.649026+0000 front 2019-11-29T20:40:39.653540+0000 (oldest deadline 2019-11-29T20:41:24.562335+0000) 2019-11-29T20:41:34.185 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:41:34.179+0000 1694c700 -1 osd.4 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.942641+0000 front 2019-11-29T20:40:39.994353+0000 (oldest deadline 2019-11-29T20:41:23.428761+0000) 2019-11-29T20:41:34.194 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:41:34.188+0000 1694c700 -1 osd.2 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.652764+0000 front 2019-11-29T20:40:39.626851+0000 (oldest deadline 2019-11-29T20:41:24.996522+0000) 2019-11-29T20:41:34.200 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:41:34.195+0000 1694c700 -1 osd.6 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:42.002671+0000 front 2019-11-29T20:40:41.396593+0000 (oldest deadline 2019-11-29T20:41:24.686719+0000) 2019-11-29T20:41:34.238 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:41:34.233+0000 1694c700 -1 osd.1 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.181623+0000 front 2019-11-29T20:40:39.179238+0000 (oldest deadline 2019-11-29T20:41:23.168319+0000) 2019-11-29T20:41:34.547 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:08:16:15.205 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T20:41:34.554 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:08:16:15.212 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T20:41:34.567 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:08:16:15.174 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T20:41:34.570 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:08:16:15.177 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T20:41:34.573 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:08:16:15.180 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T20:41:34.586 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:08:16:15.193 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T20:41:34.618 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:41:34.613+0000 1694c700 -1 osd.0 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.649026+0000 front 2019-11-29T20:40:39.653540+0000 (oldest deadline 2019-11-29T20:41:24.562335+0000) 2019-11-29T20:41:34.689 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:08:16:15.295 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T20:41:34.707 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:08:16:15.365 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T20:41:34.726 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:08:16:15.333 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T20:41:35.188 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:41:35.183+0000 1694c700 -1 osd.4 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.942641+0000 front 2019-11-29T20:40:39.994353+0000 (oldest deadline 2019-11-29T20:41:23.428761+0000) 2019-11-29T20:41:35.203 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:41:35.198+0000 1694c700 -1 osd.2 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.652764+0000 front 2019-11-29T20:40:39.626851+0000 (oldest deadline 2019-11-29T20:41:24.996522+0000) 2019-11-29T20:41:35.231 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:41:35.226+0000 1694c700 -1 osd.1 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.181623+0000 front 2019-11-29T20:40:39.179238+0000 (oldest deadline 2019-11-29T20:41:23.168319+0000) 2019-11-29T20:41:35.248 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:41:35.243+0000 1694c700 -1 osd.6 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:42.002671+0000 front 2019-11-29T20:40:41.396593+0000 (oldest deadline 2019-11-29T20:41:24.686719+0000) 2019-11-29T20:41:35.668 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:41:35.663+0000 1694c700 -1 osd.0 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.649026+0000 front 2019-11-29T20:40:39.653540+0000 (oldest deadline 2019-11-29T20:41:24.562335+0000) 2019-11-29T20:41:36.143 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:41:36.137+0000 1694c700 -1 osd.4 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.942641+0000 front 2019-11-29T20:40:39.994353+0000 (oldest deadline 2019-11-29T20:41:23.428761+0000) 2019-11-29T20:41:36.224 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:41:36.218+0000 1694c700 -1 osd.2 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.652764+0000 front 2019-11-29T20:40:39.626851+0000 (oldest deadline 2019-11-29T20:41:24.996522+0000) 2019-11-29T20:41:36.231 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:41:36.224+0000 1694c700 -1 osd.6 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:42.002671+0000 front 2019-11-29T20:40:41.396593+0000 (oldest deadline 2019-11-29T20:41:24.686719+0000) 2019-11-29T20:41:36.263 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:41:36.257+0000 1694c700 -1 osd.1 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.181623+0000 front 2019-11-29T20:40:39.179238+0000 (oldest deadline 2019-11-29T20:41:23.168319+0000) 2019-11-29T20:41:36.624 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:41:36.619+0000 1694c700 -1 osd.0 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.649026+0000 front 2019-11-29T20:40:39.653540+0000 (oldest deadline 2019-11-29T20:41:24.562335+0000) 2019-11-29T20:41:37.036 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:41:37.031+0000 1694c700 -1 osd.3 179 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:118560 7.5 7.2bcddf15 (undecoded) ondisk+retry+read+known_if_redirected e176) 2019-11-29T20:41:37.179 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:41:37.174+0000 1694c700 -1 osd.4 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.942641+0000 front 2019-11-29T20:40:39.994353+0000 (oldest deadline 2019-11-29T20:41:23.428761+0000) 2019-11-29T20:41:37.220 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:41:37.216+0000 1694c700 -1 osd.2 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.652764+0000 front 2019-11-29T20:40:39.626851+0000 (oldest deadline 2019-11-29T20:41:24.996522+0000) 2019-11-29T20:41:37.221 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:41:37.216+0000 1694c700 -1 osd.6 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:42.002671+0000 front 2019-11-29T20:40:41.396593+0000 (oldest deadline 2019-11-29T20:41:24.686719+0000) 2019-11-29T20:41:37.245 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:41:37.240+0000 1694c700 -1 osd.1 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.181623+0000 front 2019-11-29T20:40:39.179238+0000 (oldest deadline 2019-11-29T20:41:23.168319+0000) 2019-11-29T20:41:37.597 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:41:37.592+0000 1694c700 -1 osd.0 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.649026+0000 front 2019-11-29T20:40:39.653540+0000 (oldest deadline 2019-11-29T20:41:24.562335+0000) 2019-11-29T20:41:38.003 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:41:37.999+0000 1694c700 -1 osd.3 179 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:118560 7.5 7.2bcddf15 (undecoded) ondisk+retry+read+known_if_redirected e176) 2019-11-29T20:41:38.036 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:41:38.030+0000 1694c700 -1 osd.7 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:40.308450+0000 front 2019-11-29T20:40:39.815265+0000 (oldest deadline 2019-11-29T20:41:37.758286+0000) 2019-11-29T20:41:38.194 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:41:38.188+0000 1694c700 -1 osd.4 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.942641+0000 front 2019-11-29T20:40:39.994353+0000 (oldest deadline 2019-11-29T20:41:23.428761+0000) 2019-11-29T20:41:38.239 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:41:38.233+0000 1694c700 -1 osd.1 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.181623+0000 front 2019-11-29T20:40:39.179238+0000 (oldest deadline 2019-11-29T20:41:23.168319+0000) 2019-11-29T20:41:38.249 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:41:38.244+0000 1694c700 -1 osd.6 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:42.002671+0000 front 2019-11-29T20:40:41.396593+0000 (oldest deadline 2019-11-29T20:41:24.686719+0000) 2019-11-29T20:41:38.259 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:41:38.253+0000 1694c700 -1 osd.2 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.652764+0000 front 2019-11-29T20:40:39.626851+0000 (oldest deadline 2019-11-29T20:41:24.996522+0000) 2019-11-29T20:41:38.586 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:41:38.581+0000 1694c700 -1 osd.0 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.649026+0000 front 2019-11-29T20:40:39.653540+0000 (oldest deadline 2019-11-29T20:41:24.562335+0000) 2019-11-29T20:41:38.973 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:41:38.965+0000 1694c700 -1 osd.3 179 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:118560 7.5 7.2bcddf15 (undecoded) ondisk+retry+read+known_if_redirected e176) 2019-11-29T20:41:39.056 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:41:39.050+0000 1694c700 -1 osd.7 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:40.308450+0000 front 2019-11-29T20:40:39.815265+0000 (oldest deadline 2019-11-29T20:41:37.758286+0000) 2019-11-29T20:41:39.160 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:41:39.154+0000 1694c700 -1 osd.4 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.942641+0000 front 2019-11-29T20:40:39.994353+0000 (oldest deadline 2019-11-29T20:41:23.428761+0000) 2019-11-29T20:41:39.211 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:41:39.205+0000 1694c700 -1 osd.1 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.181623+0000 front 2019-11-29T20:40:39.179238+0000 (oldest deadline 2019-11-29T20:41:23.168319+0000) 2019-11-29T20:41:39.218 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:41:39.213+0000 1694c700 -1 osd.2 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.652764+0000 front 2019-11-29T20:40:39.626851+0000 (oldest deadline 2019-11-29T20:41:24.996522+0000) 2019-11-29T20:41:39.279 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:41:39.273+0000 1694c700 -1 osd.6 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:42.002671+0000 front 2019-11-29T20:40:41.396593+0000 (oldest deadline 2019-11-29T20:41:24.686719+0000) 2019-11-29T20:41:39.580 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:41:39.574+0000 1694c700 -1 osd.0 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.649026+0000 front 2019-11-29T20:40:39.653540+0000 (oldest deadline 2019-11-29T20:41:24.562335+0000) 2019-11-29T20:41:39.987 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:41:39.983+0000 1694c700 -1 osd.3 179 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:118560 7.5 7.2bcddf15 (undecoded) ondisk+retry+read+known_if_redirected e176) 2019-11-29T20:41:40.064 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:41:40.059+0000 1694c700 -1 osd.7 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:40.308450+0000 front 2019-11-29T20:40:39.815265+0000 (oldest deadline 2019-11-29T20:41:37.758286+0000) 2019-11-29T20:41:40.197 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:41:40.191+0000 1694c700 -1 osd.4 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.942641+0000 front 2019-11-29T20:40:39.994353+0000 (oldest deadline 2019-11-29T20:41:23.428761+0000) 2019-11-29T20:41:40.209 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:41:40.203+0000 1694c700 -1 osd.1 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.181623+0000 front 2019-11-29T20:40:39.179238+0000 (oldest deadline 2019-11-29T20:41:23.168319+0000) 2019-11-29T20:41:40.238 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:41:40.231+0000 1694c700 -1 osd.2 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.652764+0000 front 2019-11-29T20:40:39.626851+0000 (oldest deadline 2019-11-29T20:41:24.996522+0000) 2019-11-29T20:41:40.302 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:41:40.296+0000 1694c700 -1 osd.6 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:42.002671+0000 front 2019-11-29T20:40:41.396593+0000 (oldest deadline 2019-11-29T20:41:24.686719+0000) 2019-11-29T20:41:40.573 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:41:40.569+0000 1694c700 -1 osd.0 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.649026+0000 front 2019-11-29T20:40:39.653540+0000 (oldest deadline 2019-11-29T20:41:24.562335+0000) 2019-11-29T20:41:41.016 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:41:41.011+0000 1694c700 -1 osd.3 179 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:118560 7.5 7.2bcddf15 (undecoded) ondisk+retry+read+known_if_redirected e176) 2019-11-29T20:41:41.078 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:41:41.073+0000 1694c700 -1 osd.7 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:40.308450+0000 front 2019-11-29T20:40:39.815265+0000 (oldest deadline 2019-11-29T20:41:37.758286+0000) 2019-11-29T20:41:41.185 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:41:41.179+0000 1694c700 -1 osd.1 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.181623+0000 front 2019-11-29T20:40:39.179238+0000 (oldest deadline 2019-11-29T20:41:23.168319+0000) 2019-11-29T20:41:41.242 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:41:41.237+0000 1694c700 -1 osd.4 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.942641+0000 front 2019-11-29T20:40:39.994353+0000 (oldest deadline 2019-11-29T20:41:23.428761+0000) 2019-11-29T20:41:41.273 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:41:41.268+0000 1694c700 -1 osd.2 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.652764+0000 front 2019-11-29T20:40:39.626851+0000 (oldest deadline 2019-11-29T20:41:24.996522+0000) 2019-11-29T20:41:41.345 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:41:41.340+0000 1694c700 -1 osd.6 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:42.002671+0000 front 2019-11-29T20:40:41.396593+0000 (oldest deadline 2019-11-29T20:41:24.686719+0000) 2019-11-29T20:41:41.618 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:41:41.612+0000 1694c700 -1 osd.0 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.649026+0000 front 2019-11-29T20:40:39.653540+0000 (oldest deadline 2019-11-29T20:41:24.562335+0000) 2019-11-29T20:41:41.990 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:41:41.972+0000 1694c700 -1 osd.3 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:41:01.084857+0000 (oldest deadline 2019-11-29T20:41:41.084857+0000) 2019-11-29T20:41:41.995 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:41:41.990+0000 1694c700 -1 osd.3 179 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4325.0:118560 7.5 7.2bcddf15 (undecoded) ondisk+retry+read+known_if_redirected e176) 2019-11-29T20:41:42.042 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:41:42.036+0000 1694c700 -1 osd.7 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:40.308450+0000 front 2019-11-29T20:40:39.815265+0000 (oldest deadline 2019-11-29T20:41:37.758286+0000) 2019-11-29T20:41:42.200 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:41:42.195+0000 1694c700 -1 osd.1 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.181623+0000 front 2019-11-29T20:40:39.179238+0000 (oldest deadline 2019-11-29T20:41:23.168319+0000) 2019-11-29T20:41:42.253 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:41:42.249+0000 1694c700 -1 osd.2 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.652764+0000 front 2019-11-29T20:40:39.626851+0000 (oldest deadline 2019-11-29T20:41:24.996522+0000) 2019-11-29T20:41:42.255 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:41:42.250+0000 1694c700 -1 osd.4 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.942641+0000 front 2019-11-29T20:40:39.994353+0000 (oldest deadline 2019-11-29T20:41:23.428761+0000) 2019-11-29T20:41:42.359 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:41:42.354+0000 1694c700 -1 osd.6 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:42.002671+0000 front 2019-11-29T20:40:41.396593+0000 (oldest deadline 2019-11-29T20:41:24.686719+0000) 2019-11-29T20:41:42.575 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:41:42.570+0000 1694c700 -1 osd.0 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.649026+0000 front 2019-11-29T20:40:39.653540+0000 (oldest deadline 2019-11-29T20:41:24.562335+0000) 2019-11-29T20:41:43.010 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:41:43.003+0000 1694c700 -1 osd.3 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:41:01.084857+0000 (oldest deadline 2019-11-29T20:41:41.084857+0000) 2019-11-29T20:41:43.011 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:41:43.006+0000 1694c700 -1 osd.3 179 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4325.0:118560 7.5 7.2bcddf15 (undecoded) ondisk+retry+read+known_if_redirected e176) 2019-11-29T20:41:43.050 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:41:43.045+0000 1694c700 -1 osd.7 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:40.308450+0000 front 2019-11-29T20:40:39.815265+0000 (oldest deadline 2019-11-29T20:41:37.758286+0000) 2019-11-29T20:41:43.214 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:41:43.209+0000 1694c700 -1 osd.1 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.181623+0000 front 2019-11-29T20:40:39.179238+0000 (oldest deadline 2019-11-29T20:41:23.168319+0000) 2019-11-29T20:41:43.229 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:41:43.224+0000 1694c700 -1 osd.2 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.652764+0000 front 2019-11-29T20:40:39.626851+0000 (oldest deadline 2019-11-29T20:41:24.996522+0000) 2019-11-29T20:41:43.297 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:41:43.292+0000 1694c700 -1 osd.4 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.942641+0000 front 2019-11-29T20:40:39.994353+0000 (oldest deadline 2019-11-29T20:41:23.428761+0000) 2019-11-29T20:41:43.348 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:41:43.342+0000 1694c700 -1 osd.6 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:42.002671+0000 front 2019-11-29T20:40:41.396593+0000 (oldest deadline 2019-11-29T20:41:24.686719+0000) 2019-11-29T20:41:43.570 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:41:43.564+0000 1694c700 -1 osd.0 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.649026+0000 front 2019-11-29T20:40:39.653540+0000 (oldest deadline 2019-11-29T20:41:24.562335+0000) 2019-11-29T20:41:43.993 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:41:43.987+0000 1694c700 -1 osd.3 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:41:01.084857+0000 (oldest deadline 2019-11-29T20:41:41.084857+0000) 2019-11-29T20:41:43.994 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:41:43.989+0000 1694c700 -1 osd.3 179 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4325.0:118560 7.5 7.2bcddf15 (undecoded) ondisk+retry+read+known_if_redirected e176) 2019-11-29T20:41:44.025 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:41:44.020+0000 1694c700 -1 osd.7 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:40.308450+0000 front 2019-11-29T20:40:39.815265+0000 (oldest deadline 2019-11-29T20:41:37.758286+0000) 2019-11-29T20:41:44.258 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:41:44.254+0000 1694c700 -1 osd.1 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.181623+0000 front 2019-11-29T20:40:39.179238+0000 (oldest deadline 2019-11-29T20:41:23.168319+0000) 2019-11-29T20:41:44.261 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:41:44.256+0000 1694c700 -1 osd.2 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.652764+0000 front 2019-11-29T20:40:39.626851+0000 (oldest deadline 2019-11-29T20:41:24.996522+0000) 2019-11-29T20:41:44.297 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:41:44.292+0000 1694c700 -1 osd.4 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.942641+0000 front 2019-11-29T20:40:39.994353+0000 (oldest deadline 2019-11-29T20:41:23.428761+0000) 2019-11-29T20:41:44.324 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:41:44.319+0000 1694c700 -1 osd.6 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:42.002671+0000 front 2019-11-29T20:40:41.396593+0000 (oldest deadline 2019-11-29T20:41:24.686719+0000) 2019-11-29T20:41:44.530 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:41:44.525+0000 1694c700 -1 osd.0 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.649026+0000 front 2019-11-29T20:40:39.653540+0000 (oldest deadline 2019-11-29T20:41:24.562335+0000) 2019-11-29T20:41:45.017 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:41:45.004+0000 1694c700 -1 osd.3 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:41:01.084857+0000 (oldest deadline 2019-11-29T20:41:41.084857+0000) 2019-11-29T20:41:45.019 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:41:45.013+0000 1694c700 -1 osd.3 179 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4325.0:118560 7.5 7.2bcddf15 (undecoded) ondisk+retry+read+known_if_redirected e176) 2019-11-29T20:41:45.079 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:41:45.074+0000 1694c700 -1 osd.7 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:40.308450+0000 front 2019-11-29T20:40:39.815265+0000 (oldest deadline 2019-11-29T20:41:37.758286+0000) 2019-11-29T20:41:45.256 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:41:45.251+0000 1694c700 -1 osd.2 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.652764+0000 front 2019-11-29T20:40:39.626851+0000 (oldest deadline 2019-11-29T20:41:24.996522+0000) 2019-11-29T20:41:45.276 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:41:45.271+0000 1694c700 -1 osd.1 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.181623+0000 front 2019-11-29T20:40:39.179238+0000 (oldest deadline 2019-11-29T20:41:23.168319+0000) 2019-11-29T20:41:45.313 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:41:45.308+0000 1694c700 -1 osd.6 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:42.002671+0000 front 2019-11-29T20:40:41.396593+0000 (oldest deadline 2019-11-29T20:41:24.686719+0000) 2019-11-29T20:41:45.343 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:41:45.338+0000 1694c700 -1 osd.4 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.942641+0000 front 2019-11-29T20:40:39.994353+0000 (oldest deadline 2019-11-29T20:41:23.428761+0000) 2019-11-29T20:41:45.580 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:41:45.574+0000 1694c700 -1 osd.0 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.649026+0000 front 2019-11-29T20:40:39.653540+0000 (oldest deadline 2019-11-29T20:41:24.562335+0000) 2019-11-29T20:41:46.021 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:41:46.015+0000 1694c700 -1 osd.3 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:41:01.084857+0000 (oldest deadline 2019-11-29T20:41:41.084857+0000) 2019-11-29T20:41:46.022 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:41:46.017+0000 1694c700 -1 osd.3 179 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4325.0:118560 7.5 7.2bcddf15 (undecoded) ondisk+retry+read+known_if_redirected e176) 2019-11-29T20:41:46.058 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:41:46.053+0000 1694c700 -1 osd.7 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:40.308450+0000 front 2019-11-29T20:40:39.815265+0000 (oldest deadline 2019-11-29T20:41:37.758286+0000) 2019-11-29T20:41:46.287 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:41:46.282+0000 1694c700 -1 osd.2 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.652764+0000 front 2019-11-29T20:40:39.626851+0000 (oldest deadline 2019-11-29T20:41:24.996522+0000) 2019-11-29T20:41:46.310 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:41:46.305+0000 1694c700 -1 osd.6 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:42.002671+0000 front 2019-11-29T20:40:41.396593+0000 (oldest deadline 2019-11-29T20:41:24.686719+0000) 2019-11-29T20:41:46.319 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:41:46.314+0000 1694c700 -1 osd.1 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.181623+0000 front 2019-11-29T20:40:39.179238+0000 (oldest deadline 2019-11-29T20:41:23.168319+0000) 2019-11-29T20:41:46.330 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:41:46.326+0000 1694c700 -1 osd.4 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.942641+0000 front 2019-11-29T20:40:39.994353+0000 (oldest deadline 2019-11-29T20:41:23.428761+0000) 2019-11-29T20:41:46.547 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:41:46.542+0000 1694c700 -1 osd.0 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.649026+0000 front 2019-11-29T20:40:39.653540+0000 (oldest deadline 2019-11-29T20:41:24.562335+0000) 2019-11-29T20:41:47.027 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:41:47.021+0000 1694c700 -1 osd.3 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:41:01.084857+0000 (oldest deadline 2019-11-29T20:41:41.084857+0000) 2019-11-29T20:41:47.037 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:41:47.024+0000 1694c700 -1 osd.3 179 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4325.0:118560 7.5 7.2bcddf15 (undecoded) ondisk+retry+read+known_if_redirected e176) 2019-11-29T20:41:47.051 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:41:47.044+0000 1694c700 -1 osd.7 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:40.308450+0000 front 2019-11-29T20:40:39.815265+0000 (oldest deadline 2019-11-29T20:41:37.758286+0000) 2019-11-29T20:41:47.283 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:41:47.278+0000 1694c700 -1 osd.2 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.652764+0000 front 2019-11-29T20:40:39.626851+0000 (oldest deadline 2019-11-29T20:41:24.996522+0000) 2019-11-29T20:41:47.317 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:41:47.311+0000 1694c700 -1 osd.1 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.181623+0000 front 2019-11-29T20:40:39.179238+0000 (oldest deadline 2019-11-29T20:41:23.168319+0000) 2019-11-29T20:41:47.341 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:41:47.336+0000 1694c700 -1 osd.6 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:42.002671+0000 front 2019-11-29T20:40:41.396593+0000 (oldest deadline 2019-11-29T20:41:24.686719+0000) 2019-11-29T20:41:47.377 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:41:47.371+0000 1694c700 -1 osd.4 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.942641+0000 front 2019-11-29T20:40:39.994353+0000 (oldest deadline 2019-11-29T20:41:23.428761+0000) 2019-11-29T20:41:47.512 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:41:47.507+0000 1694c700 -1 osd.0 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.649026+0000 front 2019-11-29T20:40:39.653540+0000 (oldest deadline 2019-11-29T20:41:24.562335+0000) 2019-11-29T20:41:48.017 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:41:48.012+0000 1694c700 -1 osd.7 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:40.308450+0000 front 2019-11-29T20:40:39.815265+0000 (oldest deadline 2019-11-29T20:41:37.758286+0000) 2019-11-29T20:41:48.082 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:41:48.077+0000 1694c700 -1 osd.3 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:41:01.084857+0000 (oldest deadline 2019-11-29T20:41:41.084857+0000) 2019-11-29T20:41:48.085 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:41:48.081+0000 1694c700 -1 osd.3 179 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4325.0:118560 7.5 7.2bcddf15 (undecoded) ondisk+retry+read+known_if_redirected e176) 2019-11-29T20:41:48.252 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:41:48.247+0000 1694c700 -1 osd.2 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.652764+0000 front 2019-11-29T20:40:39.626851+0000 (oldest deadline 2019-11-29T20:41:24.996522+0000) 2019-11-29T20:41:48.315 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:41:48.310+0000 1694c700 -1 osd.1 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.181623+0000 front 2019-11-29T20:40:39.179238+0000 (oldest deadline 2019-11-29T20:41:23.168319+0000) 2019-11-29T20:41:48.322 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:41:48.317+0000 1694c700 -1 osd.6 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:42.002671+0000 front 2019-11-29T20:40:41.396593+0000 (oldest deadline 2019-11-29T20:41:24.686719+0000) 2019-11-29T20:41:48.335 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:41:48.330+0000 1694c700 -1 osd.4 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.942641+0000 front 2019-11-29T20:40:39.994353+0000 (oldest deadline 2019-11-29T20:41:23.428761+0000) 2019-11-29T20:41:48.479 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:41:48.474+0000 1694c700 -1 osd.0 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.649026+0000 front 2019-11-29T20:40:39.653540+0000 (oldest deadline 2019-11-29T20:41:24.562335+0000) 2019-11-29T20:41:49.059 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:41:49.054+0000 1694c700 -1 osd.7 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:40.308450+0000 front 2019-11-29T20:40:39.815265+0000 (oldest deadline 2019-11-29T20:41:37.758286+0000) 2019-11-29T20:41:49.134 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:41:49.127+0000 1694c700 -1 osd.3 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:41:01.084857+0000 (oldest deadline 2019-11-29T20:41:41.084857+0000) 2019-11-29T20:41:49.135 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:41:49.130+0000 1694c700 -1 osd.3 179 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4325.0:118560 7.5 7.2bcddf15 (undecoded) ondisk+retry+read+known_if_redirected e176) 2019-11-29T20:41:49.298 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:41:49.292+0000 1694c700 -1 osd.1 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.181623+0000 front 2019-11-29T20:40:39.179238+0000 (oldest deadline 2019-11-29T20:41:23.168319+0000) 2019-11-29T20:41:49.301 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:41:49.295+0000 1694c700 -1 osd.2 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.652764+0000 front 2019-11-29T20:40:39.626851+0000 (oldest deadline 2019-11-29T20:41:24.996522+0000) 2019-11-29T20:41:49.306 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:41:49.300+0000 1694c700 -1 osd.4 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.942641+0000 front 2019-11-29T20:40:39.994353+0000 (oldest deadline 2019-11-29T20:41:23.428761+0000) 2019-11-29T20:41:49.375 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:41:49.370+0000 1694c700 -1 osd.6 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:42.002671+0000 front 2019-11-29T20:40:41.396593+0000 (oldest deadline 2019-11-29T20:41:24.686719+0000) 2019-11-29T20:41:49.454 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:41:49.449+0000 1694c700 -1 osd.0 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.649026+0000 front 2019-11-29T20:40:39.653540+0000 (oldest deadline 2019-11-29T20:41:24.562335+0000) 2019-11-29T20:41:50.022 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:41:50.016+0000 1694c700 -1 osd.7 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:40.308450+0000 front 2019-11-29T20:40:39.815265+0000 (oldest deadline 2019-11-29T20:41:37.758286+0000) 2019-11-29T20:41:50.151 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:41:50.146+0000 1694c700 -1 osd.3 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:41:01.084857+0000 (oldest deadline 2019-11-29T20:41:41.084857+0000) 2019-11-29T20:41:50.155 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:41:50.150+0000 1694c700 -1 osd.3 179 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4325.0:118560 7.5 7.2bcddf15 (undecoded) ondisk+retry+read+known_if_redirected e176) 2019-11-29T20:41:50.306 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:41:50.301+0000 1694c700 -1 osd.2 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.652764+0000 front 2019-11-29T20:40:39.626851+0000 (oldest deadline 2019-11-29T20:41:24.996522+0000) 2019-11-29T20:41:50.323 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:41:50.318+0000 1694c700 -1 osd.1 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.181623+0000 front 2019-11-29T20:40:39.179238+0000 (oldest deadline 2019-11-29T20:41:23.168319+0000) 2019-11-29T20:41:50.354 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:41:50.348+0000 1694c700 -1 osd.4 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.942641+0000 front 2019-11-29T20:40:39.994353+0000 (oldest deadline 2019-11-29T20:41:23.428761+0000) 2019-11-29T20:41:50.364 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:41:50.357+0000 1694c700 -1 osd.6 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:42.002671+0000 front 2019-11-29T20:40:41.396593+0000 (oldest deadline 2019-11-29T20:41:24.686719+0000) 2019-11-29T20:41:50.496 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:41:50.492+0000 1694c700 -1 osd.0 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.649026+0000 front 2019-11-29T20:40:39.653540+0000 (oldest deadline 2019-11-29T20:41:24.562335+0000) 2019-11-29T20:41:50.995 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:41:50.990+0000 1694c700 -1 osd.7 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:40.308450+0000 front 2019-11-29T20:40:39.815265+0000 (oldest deadline 2019-11-29T20:41:37.758286+0000) 2019-11-29T20:41:51.121 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:41:51.115+0000 1694c700 -1 osd.3 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:41:01.084857+0000 (oldest deadline 2019-11-29T20:41:41.084857+0000) 2019-11-29T20:41:51.122 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:41:51.117+0000 1694c700 -1 osd.3 179 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4325.0:118560 7.5 7.2bcddf15 (undecoded) ondisk+retry+read+known_if_redirected e176) 2019-11-29T20:41:51.319 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:41:51.314+0000 1694c700 -1 osd.2 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.652764+0000 front 2019-11-29T20:40:39.626851+0000 (oldest deadline 2019-11-29T20:41:24.996522+0000) 2019-11-29T20:41:51.329 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:41:51.325+0000 1694c700 -1 osd.4 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.942641+0000 front 2019-11-29T20:40:39.994353+0000 (oldest deadline 2019-11-29T20:41:23.428761+0000) 2019-11-29T20:41:51.347 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:41:51.343+0000 1694c700 -1 osd.6 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:42.002671+0000 front 2019-11-29T20:40:41.396593+0000 (oldest deadline 2019-11-29T20:41:24.686719+0000) 2019-11-29T20:41:51.350 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:41:51.345+0000 1694c700 -1 osd.1 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.181623+0000 front 2019-11-29T20:40:39.179238+0000 (oldest deadline 2019-11-29T20:41:23.168319+0000) 2019-11-29T20:41:51.507 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:41:51.501+0000 1694c700 -1 osd.0 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.649026+0000 front 2019-11-29T20:40:39.653540+0000 (oldest deadline 2019-11-29T20:41:24.562335+0000) 2019-11-29T20:41:51.997 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:41:51.991+0000 1694c700 -1 osd.7 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:40.308450+0000 front 2019-11-29T20:40:39.815265+0000 (oldest deadline 2019-11-29T20:41:37.758286+0000) 2019-11-29T20:41:52.137 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:41:52.130+0000 1694c700 -1 osd.3 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:41:01.084857+0000 (oldest deadline 2019-11-29T20:41:41.084857+0000) 2019-11-29T20:41:52.138 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:41:52.132+0000 1694c700 -1 osd.3 179 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4325.0:118560 7.5 7.2bcddf15 (undecoded) ondisk+retry+read+known_if_redirected e176) 2019-11-29T20:41:52.288 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:41:52.279+0000 1694c700 -1 osd.2 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.652764+0000 front 2019-11-29T20:40:39.626851+0000 (oldest deadline 2019-11-29T20:41:24.996522+0000) 2019-11-29T20:41:52.313 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:41:52.301+0000 1694c700 -1 osd.4 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.942641+0000 front 2019-11-29T20:40:39.994353+0000 (oldest deadline 2019-11-29T20:41:23.428761+0000) 2019-11-29T20:41:52.352 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:41:52.343+0000 1694c700 -1 osd.1 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.181623+0000 front 2019-11-29T20:40:39.179238+0000 (oldest deadline 2019-11-29T20:41:23.168319+0000) 2019-11-29T20:41:52.366 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:41:52.358+0000 1694c700 -1 osd.6 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:42.002671+0000 front 2019-11-29T20:40:41.396593+0000 (oldest deadline 2019-11-29T20:41:24.686719+0000) 2019-11-29T20:41:52.521 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:41:52.515+0000 1694c700 -1 osd.0 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.649026+0000 front 2019-11-29T20:40:39.653540+0000 (oldest deadline 2019-11-29T20:41:24.562335+0000) 2019-11-29T20:41:52.984 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:41:52.975+0000 1694c700 -1 osd.7 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:40.308450+0000 front 2019-11-29T20:40:39.815265+0000 (oldest deadline 2019-11-29T20:41:37.758286+0000) 2019-11-29T20:41:53.150 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:41:53.144+0000 1694c700 -1 osd.3 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:41:01.084857+0000 (oldest deadline 2019-11-29T20:41:41.084857+0000) 2019-11-29T20:41:53.151 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:41:53.146+0000 1694c700 -1 osd.3 179 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4325.0:118560 7.5 7.2bcddf15 (undecoded) ondisk+retry+read+known_if_redirected e176) 2019-11-29T20:41:53.279 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:41:53.273+0000 1694c700 -1 osd.2 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.652764+0000 front 2019-11-29T20:40:39.626851+0000 (oldest deadline 2019-11-29T20:41:24.996522+0000) 2019-11-29T20:41:53.321 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:41:53.314+0000 1694c700 -1 osd.1 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.181623+0000 front 2019-11-29T20:40:39.179238+0000 (oldest deadline 2019-11-29T20:41:23.168319+0000) 2019-11-29T20:41:53.338 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:41:53.332+0000 1694c700 -1 osd.6 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:42.002671+0000 front 2019-11-29T20:40:41.396593+0000 (oldest deadline 2019-11-29T20:41:24.686719+0000) 2019-11-29T20:41:53.342 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:41:53.337+0000 1694c700 -1 osd.4 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.942641+0000 front 2019-11-29T20:40:39.994353+0000 (oldest deadline 2019-11-29T20:41:23.428761+0000) 2019-11-29T20:41:53.550 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:41:53.545+0000 1694c700 -1 osd.0 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.649026+0000 front 2019-11-29T20:40:39.653540+0000 (oldest deadline 2019-11-29T20:41:24.562335+0000) 2019-11-29T20:41:54.012 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:41:54.007+0000 1694c700 -1 osd.7 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:40.308450+0000 front 2019-11-29T20:40:39.815265+0000 (oldest deadline 2019-11-29T20:41:37.758286+0000) 2019-11-29T20:41:54.195 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:41:54.190+0000 1694c700 -1 osd.3 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:41:01.084857+0000 (oldest deadline 2019-11-29T20:41:41.084857+0000) 2019-11-29T20:41:54.199 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:41:54.194+0000 1694c700 -1 osd.3 179 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4325.0:118560 7.5 7.2bcddf15 (undecoded) ondisk+retry+read+known_if_redirected e176) 2019-11-29T20:41:54.298 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:41:54.294+0000 1694c700 -1 osd.1 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.181623+0000 front 2019-11-29T20:40:39.179238+0000 (oldest deadline 2019-11-29T20:41:23.168319+0000) 2019-11-29T20:41:54.311 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:41:54.306+0000 1694c700 -1 osd.2 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.652764+0000 front 2019-11-29T20:40:39.626851+0000 (oldest deadline 2019-11-29T20:41:24.996522+0000) 2019-11-29T20:41:54.320 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:41:54.314+0000 1694c700 -1 osd.6 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:42.002671+0000 front 2019-11-29T20:40:41.396593+0000 (oldest deadline 2019-11-29T20:41:24.686719+0000) 2019-11-29T20:41:54.338 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:41:54.333+0000 1694c700 -1 osd.4 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.942641+0000 front 2019-11-29T20:40:39.994353+0000 (oldest deadline 2019-11-29T20:41:23.428761+0000) 2019-11-29T20:41:54.518 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:41:54.514+0000 1694c700 -1 osd.0 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.649026+0000 front 2019-11-29T20:40:39.653540+0000 (oldest deadline 2019-11-29T20:41:24.562335+0000) 2019-11-29T20:41:54.979 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:41:54.974+0000 1694c700 -1 osd.7 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:40.308450+0000 front 2019-11-29T20:40:39.815265+0000 (oldest deadline 2019-11-29T20:41:37.758286+0000) 2019-11-29T20:41:55.245 INFO:tasks.ceph.mon.b.smithi022.stderr:2019-11-29T20:41:55.241+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.22:6818/9264,v1:172.21.15.22:6819/9264] for 44sec e179 v179) 2019-11-29T20:41:55.245 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:41:55.240+0000 1694c700 -1 osd.3 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:41:01.084857+0000 (oldest deadline 2019-11-29T20:41:41.084857+0000) 2019-11-29T20:41:55.249 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:41:55.244+0000 1694c700 -1 osd.3 179 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4325.0:118560 7.5 7.2bcddf15 (undecoded) ondisk+retry+read+known_if_redirected e176) 2019-11-29T20:41:55.266 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:41:55.260+0000 1694c700 -1 osd.2 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.652764+0000 front 2019-11-29T20:40:39.626851+0000 (oldest deadline 2019-11-29T20:41:24.996522+0000) 2019-11-29T20:41:55.294 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:41:55.287+0000 1694c700 -1 osd.1 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.181623+0000 front 2019-11-29T20:40:39.179238+0000 (oldest deadline 2019-11-29T20:41:23.168319+0000) 2019-11-29T20:41:55.357 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:41:55.351+0000 1694c700 -1 osd.4 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.942641+0000 front 2019-11-29T20:40:39.994353+0000 (oldest deadline 2019-11-29T20:41:23.428761+0000) 2019-11-29T20:41:55.362 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:41:55.357+0000 1694c700 -1 osd.6 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:42.002671+0000 front 2019-11-29T20:40:41.396593+0000 (oldest deadline 2019-11-29T20:41:24.686719+0000) 2019-11-29T20:41:55.566 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:41:55.560+0000 1694c700 -1 osd.0 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.649026+0000 front 2019-11-29T20:40:39.653540+0000 (oldest deadline 2019-11-29T20:41:24.562335+0000) 2019-11-29T20:41:55.959 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:41:55.953+0000 1694c700 -1 osd.7 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:40.308450+0000 front 2019-11-29T20:40:39.815265+0000 (oldest deadline 2019-11-29T20:41:37.758286+0000) 2019-11-29T20:41:56.248 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:41:56.243+0000 1694c700 -1 osd.2 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.652764+0000 front 2019-11-29T20:40:39.626851+0000 (oldest deadline 2019-11-29T20:41:24.996522+0000) 2019-11-29T20:41:56.259 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:41:56.254+0000 1694c700 -1 osd.3 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:41:01.084857+0000 (oldest deadline 2019-11-29T20:41:41.084857+0000) 2019-11-29T20:41:56.261 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:41:56.256+0000 1694c700 -1 osd.3 179 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4325.0:118560 7.5 7.2bcddf15 (undecoded) ondisk+retry+read+known_if_redirected e176) 2019-11-29T20:41:56.324 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:41:56.319+0000 1694c700 -1 osd.1 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.181623+0000 front 2019-11-29T20:40:39.179238+0000 (oldest deadline 2019-11-29T20:41:23.168319+0000) 2019-11-29T20:41:56.350 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:41:56.344+0000 1694c700 -1 osd.6 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:42.002671+0000 front 2019-11-29T20:40:41.396593+0000 (oldest deadline 2019-11-29T20:41:24.686719+0000) 2019-11-29T20:41:56.394 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:41:56.389+0000 1694c700 -1 osd.4 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.942641+0000 front 2019-11-29T20:40:39.994353+0000 (oldest deadline 2019-11-29T20:41:23.428761+0000) 2019-11-29T20:41:56.543 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:41:56.538+0000 1694c700 -1 osd.0 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.649026+0000 front 2019-11-29T20:40:39.653540+0000 (oldest deadline 2019-11-29T20:41:24.562335+0000) 2019-11-29T20:41:56.955 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:41:56.949+0000 1694c700 -1 osd.7 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:40.308450+0000 front 2019-11-29T20:40:39.815265+0000 (oldest deadline 2019-11-29T20:41:37.758286+0000) 2019-11-29T20:41:57.218 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:41:57.212+0000 1694c700 -1 osd.2 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.652764+0000 front 2019-11-29T20:40:39.626851+0000 (oldest deadline 2019-11-29T20:41:24.996522+0000) 2019-11-29T20:41:57.287 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:41:57.280+0000 1694c700 -1 osd.3 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:41:01.084857+0000 (oldest deadline 2019-11-29T20:41:41.084857+0000) 2019-11-29T20:41:57.288 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:41:57.282+0000 1694c700 -1 osd.3 179 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4325.0:118560 7.5 7.2bcddf15 (undecoded) ondisk+retry+read+known_if_redirected e176) 2019-11-29T20:41:57.314 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:41:57.308+0000 1694c700 -1 osd.6 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:42.002671+0000 front 2019-11-29T20:40:41.396593+0000 (oldest deadline 2019-11-29T20:41:24.686719+0000) 2019-11-29T20:41:57.340 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:41:57.333+0000 1694c700 -1 osd.1 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.181623+0000 front 2019-11-29T20:40:39.179238+0000 (oldest deadline 2019-11-29T20:41:23.168319+0000) 2019-11-29T20:41:57.449 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:41:57.442+0000 1694c700 -1 osd.4 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.942641+0000 front 2019-11-29T20:40:39.994353+0000 (oldest deadline 2019-11-29T20:41:23.428761+0000) 2019-11-29T20:41:57.557 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:41:57.550+0000 1694c700 -1 osd.0 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.649026+0000 front 2019-11-29T20:40:39.653540+0000 (oldest deadline 2019-11-29T20:41:24.562335+0000) 2019-11-29T20:41:57.922 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:41:57.915+0000 1694c700 -1 osd.7 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:40.308450+0000 front 2019-11-29T20:40:39.815265+0000 (oldest deadline 2019-11-29T20:41:37.758286+0000) 2019-11-29T20:41:58.229 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:41:58.224+0000 1694c700 -1 osd.2 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.652764+0000 front 2019-11-29T20:40:39.626851+0000 (oldest deadline 2019-11-29T20:41:24.996522+0000) 2019-11-29T20:41:58.268 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:41:58.263+0000 1694c700 -1 osd.3 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:41:01.084857+0000 (oldest deadline 2019-11-29T20:41:41.084857+0000) 2019-11-29T20:41:58.269 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:41:58.264+0000 1694c700 -1 osd.3 179 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4325.0:118560 7.5 7.2bcddf15 (undecoded) ondisk+retry+read+known_if_redirected e176) 2019-11-29T20:41:58.345 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:41:58.338+0000 1694c700 -1 osd.6 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:42.002671+0000 front 2019-11-29T20:40:41.396593+0000 (oldest deadline 2019-11-29T20:41:24.686719+0000) 2019-11-29T20:41:58.371 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:41:58.365+0000 1694c700 -1 osd.1 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.181623+0000 front 2019-11-29T20:40:39.179238+0000 (oldest deadline 2019-11-29T20:41:23.168319+0000) 2019-11-29T20:41:58.428 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:41:58.423+0000 1694c700 -1 osd.4 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.942641+0000 front 2019-11-29T20:40:39.994353+0000 (oldest deadline 2019-11-29T20:41:23.428761+0000) 2019-11-29T20:41:58.580 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:41:58.574+0000 1694c700 -1 osd.0 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.649026+0000 front 2019-11-29T20:40:39.653540+0000 (oldest deadline 2019-11-29T20:41:24.562335+0000) 2019-11-29T20:41:58.904 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:41:58.898+0000 1694c700 -1 osd.7 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:40.308450+0000 front 2019-11-29T20:40:39.815265+0000 (oldest deadline 2019-11-29T20:41:37.758286+0000) 2019-11-29T20:41:59.275 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:41:59.270+0000 1694c700 -1 osd.2 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.652764+0000 front 2019-11-29T20:40:39.626851+0000 (oldest deadline 2019-11-29T20:41:24.996522+0000) 2019-11-29T20:41:59.291 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:41:59.287+0000 1694c700 -1 osd.3 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:41:01.084857+0000 (oldest deadline 2019-11-29T20:41:41.084857+0000) 2019-11-29T20:41:59.293 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:41:59.289+0000 1694c700 -1 osd.3 179 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4325.0:118560 7.5 7.2bcddf15 (undecoded) ondisk+retry+read+known_if_redirected e176) 2019-11-29T20:41:59.330 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:41:59.326+0000 1694c700 -1 osd.1 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.181623+0000 front 2019-11-29T20:40:39.179238+0000 (oldest deadline 2019-11-29T20:41:23.168319+0000) 2019-11-29T20:41:59.344 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:41:59.338+0000 1694c700 -1 osd.6 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:42.002671+0000 front 2019-11-29T20:40:41.396593+0000 (oldest deadline 2019-11-29T20:41:24.686719+0000) 2019-11-29T20:41:59.467 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:41:59.460+0000 1694c700 -1 osd.4 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.942641+0000 front 2019-11-29T20:40:39.994353+0000 (oldest deadline 2019-11-29T20:41:23.428761+0000) 2019-11-29T20:41:59.556 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:41:59.545+0000 1694c700 -1 osd.0 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.649026+0000 front 2019-11-29T20:40:39.653540+0000 (oldest deadline 2019-11-29T20:41:24.562335+0000) 2019-11-29T20:41:59.863 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:41:59.857+0000 1694c700 -1 osd.7 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:40.308450+0000 front 2019-11-29T20:40:39.815265+0000 (oldest deadline 2019-11-29T20:41:37.758286+0000) 2019-11-29T20:42:00.253 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:42:00.248+0000 1694c700 -1 osd.3 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:41:01.084857+0000 (oldest deadline 2019-11-29T20:41:41.084857+0000) 2019-11-29T20:42:00.256 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:42:00.252+0000 1694c700 -1 osd.3 179 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4325.0:118560 7.5 7.2bcddf15 (undecoded) ondisk+retry+read+known_if_redirected e176) 2019-11-29T20:42:00.270 INFO:tasks.ceph.mon.b.smithi022.stderr:2019-11-29T20:42:00.259+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.22:6818/9264,v1:172.21.15.22:6819/9264] for 44sec e179 v179) 2019-11-29T20:42:00.315 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:42:00.310+0000 1694c700 -1 osd.2 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.652764+0000 front 2019-11-29T20:40:39.626851+0000 (oldest deadline 2019-11-29T20:41:24.996522+0000) 2019-11-29T20:42:00.361 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:42:00.355+0000 1694c700 -1 osd.6 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:42.002671+0000 front 2019-11-29T20:40:41.396593+0000 (oldest deadline 2019-11-29T20:41:24.686719+0000) 2019-11-29T20:42:00.374 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:42:00.370+0000 1694c700 -1 osd.1 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.181623+0000 front 2019-11-29T20:40:39.179238+0000 (oldest deadline 2019-11-29T20:41:23.168319+0000) 2019-11-29T20:42:00.452 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:42:00.446+0000 1694c700 -1 osd.4 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.942641+0000 front 2019-11-29T20:40:39.994353+0000 (oldest deadline 2019-11-29T20:41:23.428761+0000) 2019-11-29T20:42:00.583 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:42:00.578+0000 1694c700 -1 osd.0 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.649026+0000 front 2019-11-29T20:40:39.653540+0000 (oldest deadline 2019-11-29T20:41:24.562335+0000) 2019-11-29T20:42:00.857 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:42:00.852+0000 1694c700 -1 osd.7 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:40.308450+0000 front 2019-11-29T20:40:39.815265+0000 (oldest deadline 2019-11-29T20:41:37.758286+0000) 2019-11-29T20:42:01.285 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:42:01.280+0000 1694c700 -1 osd.3 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:41:01.084857+0000 (oldest deadline 2019-11-29T20:41:41.084857+0000) 2019-11-29T20:42:01.288 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:42:01.284+0000 1694c700 -1 osd.3 179 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4325.0:118560 7.5 7.2bcddf15 (undecoded) ondisk+retry+read+known_if_redirected e176) 2019-11-29T20:42:01.323 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:42:01.317+0000 1694c700 -1 osd.2 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.652764+0000 front 2019-11-29T20:40:39.626851+0000 (oldest deadline 2019-11-29T20:41:24.996522+0000) 2019-11-29T20:42:01.389 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:42:01.381+0000 1694c700 -1 osd.6 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:42.002671+0000 front 2019-11-29T20:40:41.396593+0000 (oldest deadline 2019-11-29T20:41:24.686719+0000) 2019-11-29T20:42:01.411 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:42:01.407+0000 1694c700 -1 osd.1 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.181623+0000 front 2019-11-29T20:40:39.179238+0000 (oldest deadline 2019-11-29T20:41:23.168319+0000) 2019-11-29T20:42:01.491 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:42:01.485+0000 1694c700 -1 osd.4 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.942641+0000 front 2019-11-29T20:40:39.994353+0000 (oldest deadline 2019-11-29T20:41:23.428761+0000) 2019-11-29T20:42:01.609 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:42:01.604+0000 1694c700 -1 osd.0 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.649026+0000 front 2019-11-29T20:40:39.653540+0000 (oldest deadline 2019-11-29T20:41:24.562335+0000) 2019-11-29T20:42:01.825 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:42:01.819+0000 1694c700 -1 osd.7 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:40.308450+0000 front 2019-11-29T20:40:39.815265+0000 (oldest deadline 2019-11-29T20:41:37.758286+0000) 2019-11-29T20:42:02.314 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:42:02.308+0000 1694c700 -1 osd.3 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:41:01.084857+0000 (oldest deadline 2019-11-29T20:41:41.084857+0000) 2019-11-29T20:42:02.315 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:42:02.310+0000 1694c700 -1 osd.3 179 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4325.0:118560 7.5 7.2bcddf15 (undecoded) ondisk+retry+read+known_if_redirected e176) 2019-11-29T20:42:02.315 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:42:02.310+0000 1694c700 -1 osd.2 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.652764+0000 front 2019-11-29T20:40:39.626851+0000 (oldest deadline 2019-11-29T20:41:24.996522+0000) 2019-11-29T20:42:02.365 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:42:02.359+0000 1694c700 -1 osd.6 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:42.002671+0000 front 2019-11-29T20:40:41.396593+0000 (oldest deadline 2019-11-29T20:41:24.686719+0000) 2019-11-29T20:42:02.371 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:42:02.366+0000 1694c700 -1 osd.1 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.181623+0000 front 2019-11-29T20:40:39.179238+0000 (oldest deadline 2019-11-29T20:41:23.168319+0000) 2019-11-29T20:42:02.477 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:42:02.471+0000 1694c700 -1 osd.4 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.942641+0000 front 2019-11-29T20:40:39.994353+0000 (oldest deadline 2019-11-29T20:41:23.428761+0000) 2019-11-29T20:42:02.621 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:42:02.616+0000 1694c700 -1 osd.0 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.649026+0000 front 2019-11-29T20:40:39.653540+0000 (oldest deadline 2019-11-29T20:41:24.562335+0000) 2019-11-29T20:42:02.836 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:42:02.829+0000 1694c700 -1 osd.7 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:40.308450+0000 front 2019-11-29T20:40:39.815265+0000 (oldest deadline 2019-11-29T20:41:37.758286+0000) 2019-11-29T20:42:03.288 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:42:03.283+0000 1694c700 -1 osd.2 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.652764+0000 front 2019-11-29T20:40:39.626851+0000 (oldest deadline 2019-11-29T20:41:24.996522+0000) 2019-11-29T20:42:03.320 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:42:03.313+0000 1694c700 -1 osd.6 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:42.002671+0000 front 2019-11-29T20:40:41.396593+0000 (oldest deadline 2019-11-29T20:41:24.686719+0000) 2019-11-29T20:42:03.352 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:42:03.346+0000 1694c700 -1 osd.3 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:41:01.084857+0000 (oldest deadline 2019-11-29T20:41:41.084857+0000) 2019-11-29T20:42:03.353 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:42:03.348+0000 1694c700 -1 osd.3 179 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4325.0:118560 7.5 7.2bcddf15 (undecoded) ondisk+retry+read+known_if_redirected e176) 2019-11-29T20:42:03.412 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:42:03.407+0000 1694c700 -1 osd.1 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.181623+0000 front 2019-11-29T20:40:39.179238+0000 (oldest deadline 2019-11-29T20:41:23.168319+0000) 2019-11-29T20:42:03.501 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:42:03.493+0000 1694c700 -1 osd.4 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.942641+0000 front 2019-11-29T20:40:39.994353+0000 (oldest deadline 2019-11-29T20:41:23.428761+0000) 2019-11-29T20:42:03.582 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:42:03.576+0000 1694c700 -1 osd.0 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.649026+0000 front 2019-11-29T20:40:39.653540+0000 (oldest deadline 2019-11-29T20:41:24.562335+0000) 2019-11-29T20:42:03.814 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:42:03.807+0000 1694c700 -1 osd.7 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:40.308450+0000 front 2019-11-29T20:40:39.815265+0000 (oldest deadline 2019-11-29T20:41:37.758286+0000) 2019-11-29T20:42:04.246 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:42:04.241+0000 1694c700 -1 osd.2 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.652764+0000 front 2019-11-29T20:40:39.626851+0000 (oldest deadline 2019-11-29T20:41:24.996522+0000) 2019-11-29T20:42:04.307 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:42:04.301+0000 1694c700 -1 osd.3 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:41:01.084857+0000 (oldest deadline 2019-11-29T20:41:41.084857+0000) 2019-11-29T20:42:04.307 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:42:04.303+0000 1694c700 -1 osd.3 179 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4325.0:118560 7.5 7.2bcddf15 (undecoded) ondisk+retry+read+known_if_redirected e176) 2019-11-29T20:42:04.360 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:42:04.353+0000 1694c700 -1 osd.6 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:42.002671+0000 front 2019-11-29T20:40:41.396593+0000 (oldest deadline 2019-11-29T20:41:24.686719+0000) 2019-11-29T20:42:04.402 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:42:04.396+0000 1694c700 -1 osd.1 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.181623+0000 front 2019-11-29T20:40:39.179238+0000 (oldest deadline 2019-11-29T20:41:23.168319+0000) 2019-11-29T20:42:04.458 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:42:04.452+0000 1694c700 -1 osd.4 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.942641+0000 front 2019-11-29T20:40:39.994353+0000 (oldest deadline 2019-11-29T20:41:23.428761+0000) 2019-11-29T20:42:04.582 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:42:04.575+0000 1694c700 -1 osd.0 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.649026+0000 front 2019-11-29T20:40:39.653540+0000 (oldest deadline 2019-11-29T20:41:24.562335+0000) 2019-11-29T20:42:04.846 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:42:04.841+0000 1694c700 -1 osd.7 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:40.308450+0000 front 2019-11-29T20:40:39.815265+0000 (oldest deadline 2019-11-29T20:41:37.758286+0000) 2019-11-29T20:42:05.273 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:42:05.268+0000 1694c700 -1 osd.3 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:41:01.084857+0000 (oldest deadline 2019-11-29T20:41:41.084857+0000) 2019-11-29T20:42:05.274 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:42:05.269+0000 1694c700 -1 osd.3 179 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4325.0:118560 7.5 7.2bcddf15 (undecoded) ondisk+retry+read+known_if_redirected e176) 2019-11-29T20:42:05.290 INFO:tasks.ceph.mon.b.smithi022.stderr:2019-11-29T20:42:05.282+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.22:6818/9264,v1:172.21.15.22:6819/9264] for 44sec e179 v179) 2019-11-29T20:42:05.291 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:42:05.286+0000 1694c700 -1 osd.2 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.652764+0000 front 2019-11-29T20:40:39.626851+0000 (oldest deadline 2019-11-29T20:41:24.996522+0000) 2019-11-29T20:42:05.321 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:42:05.315+0000 1694c700 -1 osd.6 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:42.002671+0000 front 2019-11-29T20:40:41.396593+0000 (oldest deadline 2019-11-29T20:41:24.686719+0000) 2019-11-29T20:42:05.379 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:42:05.373+0000 1694c700 -1 osd.1 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.181623+0000 front 2019-11-29T20:40:39.179238+0000 (oldest deadline 2019-11-29T20:41:23.168319+0000) 2019-11-29T20:42:05.453 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:42:05.447+0000 1694c700 -1 osd.4 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.942641+0000 front 2019-11-29T20:40:39.994353+0000 (oldest deadline 2019-11-29T20:41:23.428761+0000) 2019-11-29T20:42:05.557 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:42:05.551+0000 1694c700 -1 osd.0 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.649026+0000 front 2019-11-29T20:40:39.653540+0000 (oldest deadline 2019-11-29T20:41:24.562335+0000) 2019-11-29T20:42:05.827 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:42:05.821+0000 1694c700 -1 osd.7 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:40.308450+0000 front 2019-11-29T20:40:39.815265+0000 (oldest deadline 2019-11-29T20:41:37.758286+0000) 2019-11-29T20:42:06.277 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:42:06.271+0000 1694c700 -1 osd.3 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:41:01.084857+0000 (oldest deadline 2019-11-29T20:41:41.084857+0000) 2019-11-29T20:42:06.278 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:42:06.273+0000 1694c700 -1 osd.3 179 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4325.0:118560 7.5 7.2bcddf15 (undecoded) ondisk+retry+read+known_if_redirected e176) 2019-11-29T20:42:06.299 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:42:06.293+0000 1694c700 -1 osd.2 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.652764+0000 front 2019-11-29T20:40:39.626851+0000 (oldest deadline 2019-11-29T20:41:24.996522+0000) 2019-11-29T20:42:06.354 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:42:06.349+0000 1694c700 -1 osd.1 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.181623+0000 front 2019-11-29T20:40:39.179238+0000 (oldest deadline 2019-11-29T20:41:23.168319+0000) 2019-11-29T20:42:06.355 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:42:06.347+0000 1694c700 -1 osd.6 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:42.002671+0000 front 2019-11-29T20:40:41.396593+0000 (oldest deadline 2019-11-29T20:41:24.686719+0000) 2019-11-29T20:42:06.482 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:42:06.475+0000 1694c700 -1 osd.4 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.942641+0000 front 2019-11-29T20:40:39.994353+0000 (oldest deadline 2019-11-29T20:41:23.428761+0000) 2019-11-29T20:42:06.521 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:42:06.515+0000 1694c700 -1 osd.0 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.649026+0000 front 2019-11-29T20:40:39.653540+0000 (oldest deadline 2019-11-29T20:41:24.562335+0000) 2019-11-29T20:42:06.872 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:42:06.866+0000 1694c700 -1 osd.7 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:40.308450+0000 front 2019-11-29T20:40:39.815265+0000 (oldest deadline 2019-11-29T20:41:37.758286+0000) 2019-11-29T20:42:07.297 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:42:07.292+0000 1694c700 -1 osd.2 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.652764+0000 front 2019-11-29T20:40:39.626851+0000 (oldest deadline 2019-11-29T20:41:24.996522+0000) 2019-11-29T20:42:07.321 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:42:07.315+0000 1694c700 -1 osd.3 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:41:01.084857+0000 (oldest deadline 2019-11-29T20:41:41.084857+0000) 2019-11-29T20:42:07.328 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:42:07.317+0000 1694c700 -1 osd.3 179 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4325.0:118560 7.5 7.2bcddf15 (undecoded) ondisk+retry+read+known_if_redirected e176) 2019-11-29T20:42:07.390 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:42:07.385+0000 1694c700 -1 osd.1 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.181623+0000 front 2019-11-29T20:40:39.179238+0000 (oldest deadline 2019-11-29T20:41:23.168319+0000) 2019-11-29T20:42:07.397 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:42:07.391+0000 1694c700 -1 osd.6 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:42.002671+0000 front 2019-11-29T20:40:41.396593+0000 (oldest deadline 2019-11-29T20:41:24.686719+0000) 2019-11-29T20:42:07.482 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:42:07.475+0000 1694c700 -1 osd.4 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.942641+0000 front 2019-11-29T20:40:39.994353+0000 (oldest deadline 2019-11-29T20:41:23.428761+0000) 2019-11-29T20:42:07.508 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:42:07.503+0000 1694c700 -1 osd.0 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.649026+0000 front 2019-11-29T20:40:39.653540+0000 (oldest deadline 2019-11-29T20:41:24.562335+0000) 2019-11-29T20:42:07.833 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:42:07.826+0000 1694c700 -1 osd.7 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:40.308450+0000 front 2019-11-29T20:40:39.815265+0000 (oldest deadline 2019-11-29T20:41:37.758286+0000) 2019-11-29T20:42:08.264 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:42:08.258+0000 1694c700 -1 osd.2 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.652764+0000 front 2019-11-29T20:40:39.626851+0000 (oldest deadline 2019-11-29T20:41:24.996522+0000) 2019-11-29T20:42:08.363 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:42:08.358+0000 1694c700 -1 osd.3 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:41:01.084857+0000 (oldest deadline 2019-11-29T20:41:41.084857+0000) 2019-11-29T20:42:08.366 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:42:08.361+0000 1694c700 -1 osd.3 179 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4325.0:118560 7.5 7.2bcddf15 (undecoded) ondisk+retry+read+known_if_redirected e176) 2019-11-29T20:42:08.373 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:42:08.367+0000 1694c700 -1 osd.6 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:42.002671+0000 front 2019-11-29T20:40:41.396593+0000 (oldest deadline 2019-11-29T20:41:24.686719+0000) 2019-11-29T20:42:08.389 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:42:08.384+0000 1694c700 -1 osd.1 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.181623+0000 front 2019-11-29T20:40:39.179238+0000 (oldest deadline 2019-11-29T20:41:23.168319+0000) 2019-11-29T20:42:08.461 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:42:08.455+0000 1694c700 -1 osd.4 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.942641+0000 front 2019-11-29T20:40:39.994353+0000 (oldest deadline 2019-11-29T20:41:23.428761+0000) 2019-11-29T20:42:08.535 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:42:08.530+0000 1694c700 -1 osd.0 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.649026+0000 front 2019-11-29T20:40:39.653540+0000 (oldest deadline 2019-11-29T20:41:24.562335+0000) 2019-11-29T20:42:08.813 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:42:08.807+0000 1694c700 -1 osd.7 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:40.308450+0000 front 2019-11-29T20:40:39.815265+0000 (oldest deadline 2019-11-29T20:41:37.758286+0000) 2019-11-29T20:42:09.250 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:42:09.244+0000 1694c700 -1 osd.2 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.652764+0000 front 2019-11-29T20:40:39.626851+0000 (oldest deadline 2019-11-29T20:41:24.996522+0000) 2019-11-29T20:42:09.347 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:42:09.341+0000 1694c700 -1 osd.6 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:42.002671+0000 front 2019-11-29T20:40:41.396593+0000 (oldest deadline 2019-11-29T20:41:24.686719+0000) 2019-11-29T20:42:09.394 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:42:09.387+0000 1694c700 -1 osd.3 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:41:01.084857+0000 (oldest deadline 2019-11-29T20:41:41.084857+0000) 2019-11-29T20:42:09.394 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:42:09.389+0000 1694c700 -1 osd.3 179 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4325.0:118560 7.5 7.2bcddf15 (undecoded) ondisk+retry+read+known_if_redirected e176) 2019-11-29T20:42:09.409 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:42:09.403+0000 1694c700 -1 osd.1 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.181623+0000 front 2019-11-29T20:40:39.179238+0000 (oldest deadline 2019-11-29T20:41:23.168319+0000) 2019-11-29T20:42:09.462 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:42:09.455+0000 1694c700 -1 osd.4 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.942641+0000 front 2019-11-29T20:40:39.994353+0000 (oldest deadline 2019-11-29T20:41:23.428761+0000) 2019-11-29T20:42:09.555 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:42:09.549+0000 1694c700 -1 osd.0 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.649026+0000 front 2019-11-29T20:40:39.653540+0000 (oldest deadline 2019-11-29T20:41:24.562335+0000) 2019-11-29T20:42:09.799 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:42:09.793+0000 1694c700 -1 osd.7 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:40.308450+0000 front 2019-11-29T20:40:39.815265+0000 (oldest deadline 2019-11-29T20:41:37.758286+0000) 2019-11-29T20:42:10.272 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:42:10.267+0000 1694c700 -1 osd.2 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.652764+0000 front 2019-11-29T20:40:39.626851+0000 (oldest deadline 2019-11-29T20:41:24.996522+0000) 2019-11-29T20:42:10.319 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:42:10.313+0000 1694c700 -1 osd.6 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:42.002671+0000 front 2019-11-29T20:40:41.396593+0000 (oldest deadline 2019-11-29T20:41:24.686719+0000) 2019-11-29T20:42:10.352 INFO:tasks.ceph.mon.b.smithi022.stderr:2019-11-29T20:42:10.346+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.22:6818/9264,v1:172.21.15.22:6819/9264] for 44sec e179 v179) 2019-11-29T20:42:10.366 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:42:10.359+0000 1694c700 -1 osd.3 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:41:01.084857+0000 (oldest deadline 2019-11-29T20:41:41.084857+0000) 2019-11-29T20:42:10.367 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:42:10.361+0000 1694c700 -1 osd.3 179 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4325.0:118560 7.5 7.2bcddf15 (undecoded) ondisk+retry+read+known_if_redirected e176) 2019-11-29T20:42:10.389 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:42:10.385+0000 1694c700 -1 osd.1 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.181623+0000 front 2019-11-29T20:40:39.179238+0000 (oldest deadline 2019-11-29T20:41:23.168319+0000) 2019-11-29T20:42:10.505 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:42:10.499+0000 1694c700 -1 osd.4 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.942641+0000 front 2019-11-29T20:40:39.994353+0000 (oldest deadline 2019-11-29T20:41:23.428761+0000) 2019-11-29T20:42:10.542 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:42:10.537+0000 1694c700 -1 osd.0 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.649026+0000 front 2019-11-29T20:40:39.653540+0000 (oldest deadline 2019-11-29T20:41:24.562335+0000) 2019-11-29T20:42:10.806 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:42:10.800+0000 1694c700 -1 osd.7 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:40.308450+0000 front 2019-11-29T20:40:39.815265+0000 (oldest deadline 2019-11-29T20:41:37.758286+0000) 2019-11-29T20:42:11.253 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:42:11.243+0000 1694c700 -1 osd.2 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.652764+0000 front 2019-11-29T20:40:39.626851+0000 (oldest deadline 2019-11-29T20:41:24.996522+0000) 2019-11-29T20:42:11.279 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:42:11.274+0000 1694c700 -1 osd.6 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:42.002671+0000 front 2019-11-29T20:40:41.396593+0000 (oldest deadline 2019-11-29T20:41:24.686719+0000) 2019-11-29T20:42:11.381 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:42:11.375+0000 1694c700 -1 osd.1 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.181623+0000 front 2019-11-29T20:40:39.179238+0000 (oldest deadline 2019-11-29T20:41:23.168319+0000) 2019-11-29T20:42:11.412 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:42:11.407+0000 1694c700 -1 osd.3 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:41:01.084857+0000 (oldest deadline 2019-11-29T20:41:41.084857+0000) 2019-11-29T20:42:11.415 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:42:11.411+0000 1694c700 -1 osd.3 179 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4325.0:118560 7.5 7.2bcddf15 (undecoded) ondisk+retry+read+known_if_redirected e176) 2019-11-29T20:42:11.534 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:42:11.523+0000 1694c700 -1 osd.4 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.942641+0000 front 2019-11-29T20:40:39.994353+0000 (oldest deadline 2019-11-29T20:41:23.428761+0000) 2019-11-29T20:42:11.577 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:42:11.572+0000 1694c700 -1 osd.0 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.649026+0000 front 2019-11-29T20:40:39.653540+0000 (oldest deadline 2019-11-29T20:41:24.562335+0000) 2019-11-29T20:42:11.794 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:42:11.785+0000 1694c700 -1 osd.7 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:40.308450+0000 front 2019-11-29T20:40:39.815265+0000 (oldest deadline 2019-11-29T20:41:37.758286+0000) 2019-11-29T20:42:12.212 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:42:12.207+0000 1694c700 -1 osd.2 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.652764+0000 front 2019-11-29T20:40:39.626851+0000 (oldest deadline 2019-11-29T20:41:24.996522+0000) 2019-11-29T20:42:12.243 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:42:12.237+0000 1694c700 -1 osd.6 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:42.002671+0000 front 2019-11-29T20:40:41.396593+0000 (oldest deadline 2019-11-29T20:41:24.686719+0000) 2019-11-29T20:42:12.412 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:42:12.406+0000 1694c700 -1 osd.1 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.181623+0000 front 2019-11-29T20:40:39.179238+0000 (oldest deadline 2019-11-29T20:41:23.168319+0000) 2019-11-29T20:42:12.417 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:42:12.411+0000 1694c700 -1 osd.3 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:41:01.084857+0000 (oldest deadline 2019-11-29T20:41:41.084857+0000) 2019-11-29T20:42:12.418 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:42:12.413+0000 1694c700 -1 osd.3 179 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4325.0:118560 7.5 7.2bcddf15 (undecoded) ondisk+retry+read+known_if_redirected e176) 2019-11-29T20:42:12.557 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:42:12.552+0000 1694c700 -1 osd.4 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.942641+0000 front 2019-11-29T20:40:39.994353+0000 (oldest deadline 2019-11-29T20:41:23.428761+0000) 2019-11-29T20:42:12.570 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:42:12.565+0000 1694c700 -1 osd.0 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.649026+0000 front 2019-11-29T20:40:39.653540+0000 (oldest deadline 2019-11-29T20:41:24.562335+0000) 2019-11-29T20:42:12.831 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:42:12.824+0000 1694c700 -1 osd.7 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:40.308450+0000 front 2019-11-29T20:40:39.815265+0000 (oldest deadline 2019-11-29T20:41:37.758286+0000) 2019-11-29T20:42:13.229 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:42:13.224+0000 1694c700 -1 osd.2 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.652764+0000 front 2019-11-29T20:40:39.626851+0000 (oldest deadline 2019-11-29T20:41:24.996522+0000) 2019-11-29T20:42:13.245 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:42:13.239+0000 1694c700 -1 osd.6 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:42.002671+0000 front 2019-11-29T20:40:41.396593+0000 (oldest deadline 2019-11-29T20:41:24.686719+0000) 2019-11-29T20:42:13.436 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:42:13.430+0000 1694c700 -1 osd.1 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.181623+0000 front 2019-11-29T20:40:39.179238+0000 (oldest deadline 2019-11-29T20:41:23.168319+0000) 2019-11-29T20:42:13.443 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:42:13.437+0000 1694c700 -1 osd.3 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:41:01.084857+0000 (oldest deadline 2019-11-29T20:41:41.084857+0000) 2019-11-29T20:42:13.444 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:42:13.439+0000 1694c700 -1 osd.3 179 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4325.0:118560 7.5 7.2bcddf15 (undecoded) ondisk+retry+read+known_if_redirected e176) 2019-11-29T20:42:13.562 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:42:13.553+0000 1694c700 -1 osd.4 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.942641+0000 front 2019-11-29T20:40:39.994353+0000 (oldest deadline 2019-11-29T20:41:23.428761+0000) 2019-11-29T20:42:13.562 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:42:13.555+0000 1694c700 -1 osd.0 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.649026+0000 front 2019-11-29T20:40:39.653540+0000 (oldest deadline 2019-11-29T20:41:24.562335+0000) 2019-11-29T20:42:13.867 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:42:13.861+0000 1694c700 -1 osd.7 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:40.308450+0000 front 2019-11-29T20:40:39.815265+0000 (oldest deadline 2019-11-29T20:41:37.758286+0000) 2019-11-29T20:42:14.223 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:42:14.218+0000 1694c700 -1 osd.2 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.652764+0000 front 2019-11-29T20:40:39.626851+0000 (oldest deadline 2019-11-29T20:41:24.996522+0000) 2019-11-29T20:42:14.270 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:42:14.265+0000 1694c700 -1 osd.6 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:42.002671+0000 front 2019-11-29T20:40:41.396593+0000 (oldest deadline 2019-11-29T20:41:24.686719+0000) 2019-11-29T20:42:14.413 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:42:14.407+0000 1694c700 -1 osd.1 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.181623+0000 front 2019-11-29T20:40:39.179238+0000 (oldest deadline 2019-11-29T20:41:23.168319+0000) 2019-11-29T20:42:14.432 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:42:14.427+0000 1694c700 -1 osd.3 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:41:01.084857+0000 (oldest deadline 2019-11-29T20:41:41.084857+0000) 2019-11-29T20:42:14.434 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:42:14.431+0000 1694c700 -1 osd.3 179 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4325.0:118560 7.5 7.2bcddf15 (undecoded) ondisk+retry+read+known_if_redirected e176) 2019-11-29T20:42:14.584 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:42:14.579+0000 1694c700 -1 osd.0 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.649026+0000 front 2019-11-29T20:40:39.653540+0000 (oldest deadline 2019-11-29T20:41:24.562335+0000) 2019-11-29T20:42:14.601 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:42:14.595+0000 1694c700 -1 osd.4 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.942641+0000 front 2019-11-29T20:40:39.994353+0000 (oldest deadline 2019-11-29T20:41:23.428761+0000) 2019-11-29T20:42:14.881 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:42:14.875+0000 1694c700 -1 osd.7 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:40.308450+0000 front 2019-11-29T20:40:39.815265+0000 (oldest deadline 2019-11-29T20:41:37.758286+0000) 2019-11-29T20:42:15.250 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:42:15.245+0000 1694c700 -1 osd.2 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.652764+0000 front 2019-11-29T20:40:39.626851+0000 (oldest deadline 2019-11-29T20:41:24.996522+0000) 2019-11-29T20:42:15.262 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:42:15.256+0000 1694c700 -1 osd.6 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:42.002671+0000 front 2019-11-29T20:40:41.396593+0000 (oldest deadline 2019-11-29T20:41:24.686719+0000) 2019-11-29T20:42:15.413 INFO:tasks.ceph.mon.b.smithi022.stderr:2019-11-29T20:42:15.404+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.22:6818/9264,v1:172.21.15.22:6819/9264] for 44sec e179 v179) 2019-11-29T20:42:15.421 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:42:15.415+0000 1694c700 -1 osd.1 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.181623+0000 front 2019-11-29T20:40:39.179238+0000 (oldest deadline 2019-11-29T20:41:23.168319+0000) 2019-11-29T20:42:15.442 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:42:15.437+0000 1694c700 -1 osd.3 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:41:01.084857+0000 (oldest deadline 2019-11-29T20:41:41.084857+0000) 2019-11-29T20:42:15.442 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:42:15.438+0000 1694c700 -1 osd.3 179 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4325.0:118560 7.5 7.2bcddf15 (undecoded) ondisk+retry+read+known_if_redirected e176) 2019-11-29T20:42:15.679 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:42:15.669+0000 1694c700 -1 osd.4 179 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:40:39.942641+0000 front 2019-11-29T20:40:39.994353+0000 (oldest deadline 2019-11-29T20:41:23.428761+0000) 2019-11-29T20:43:43.650 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:43:43.643+0000 1694c700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:01.492162+0000 front 2019-11-29T20:43:01.708241+0000 (oldest deadline 2019-11-29T20:43:43.049045+0000) 2019-11-29T20:43:43.721 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:43:43.715+0000 1694c700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:42:59.453503+0000 front 2019-11-29T20:42:59.339587+0000 (oldest deadline 2019-11-29T20:43:43.553795+0000) 2019-11-29T20:43:44.604 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:43:44.595+0000 1694c700 -1 osd.6 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:01.491601+0000 front 2019-11-29T20:43:01.622989+0000 (oldest deadline 2019-11-29T20:43:43.730020+0000) 2019-11-29T20:43:44.665 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:43:44.658+0000 1694c700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:01.492162+0000 front 2019-11-29T20:43:01.708241+0000 (oldest deadline 2019-11-29T20:43:43.049045+0000) 2019-11-29T20:43:44.692 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:43:44.684+0000 1694c700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:42:59.453503+0000 front 2019-11-29T20:42:59.339587+0000 (oldest deadline 2019-11-29T20:43:43.553795+0000) 2019-11-29T20:43:45.114 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:43:45.109+0000 1694c700 -1 osd.1 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:00.297663+0000 front 2019-11-29T20:42:59.998179+0000 (oldest deadline 2019-11-29T20:43:44.676368+0000) 2019-11-29T20:43:45.618 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:43:45.611+0000 1694c700 -1 osd.6 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:01.491601+0000 front 2019-11-29T20:43:01.622989+0000 (oldest deadline 2019-11-29T20:43:43.730020+0000) 2019-11-29T20:43:45.664 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:43:45.657+0000 1694c700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:01.492162+0000 front 2019-11-29T20:43:01.708241+0000 (oldest deadline 2019-11-29T20:43:43.049045+0000) 2019-11-29T20:43:45.743 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:43:45.737+0000 1694c700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:42:59.453503+0000 front 2019-11-29T20:42:59.339587+0000 (oldest deadline 2019-11-29T20:43:43.553795+0000) 2019-11-29T20:43:46.161 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:43:46.155+0000 1694c700 -1 osd.1 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:00.297663+0000 front 2019-11-29T20:42:59.998179+0000 (oldest deadline 2019-11-29T20:43:44.676368+0000) 2019-11-29T20:43:46.496 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:43:46.489+0000 1694c700 -1 osd.2 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:00.850455+0000 front 2019-11-29T20:43:00.726057+0000 (oldest deadline 2019-11-29T20:43:46.441615+0000) 2019-11-29T20:43:46.619 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:43:46.611+0000 1694c700 -1 osd.6 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:01.491601+0000 front 2019-11-29T20:43:01.622989+0000 (oldest deadline 2019-11-29T20:43:43.730020+0000) 2019-11-29T20:43:46.639 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:43:46.632+0000 1694c700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:01.492162+0000 front 2019-11-29T20:43:01.708241+0000 (oldest deadline 2019-11-29T20:43:43.049045+0000) 2019-11-29T20:43:46.709 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:43:46.702+0000 1694c700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:42:59.453503+0000 front 2019-11-29T20:42:59.339587+0000 (oldest deadline 2019-11-29T20:43:43.553795+0000) 2019-11-29T20:43:46.746 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:43:46.741+0000 1694c700 -1 osd.0 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:01.638801+0000 front 2019-11-29T20:43:01.766271+0000 (oldest deadline 2019-11-29T20:43:46.194752+0000) 2019-11-29T20:43:47.194 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:43:47.186+0000 1694c700 -1 osd.1 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:00.297663+0000 front 2019-11-29T20:42:59.998179+0000 (oldest deadline 2019-11-29T20:43:44.676368+0000) 2019-11-29T20:43:47.452 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:43:47.447+0000 1694c700 -1 osd.2 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:00.850455+0000 front 2019-11-29T20:43:00.726057+0000 (oldest deadline 2019-11-29T20:43:46.441615+0000) 2019-11-29T20:43:47.667 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:43:47.659+0000 1694c700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:01.492162+0000 front 2019-11-29T20:43:01.708241+0000 (oldest deadline 2019-11-29T20:43:43.049045+0000) 2019-11-29T20:43:47.670 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:43:47.663+0000 1694c700 -1 osd.6 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:01.491601+0000 front 2019-11-29T20:43:01.622989+0000 (oldest deadline 2019-11-29T20:43:43.730020+0000) 2019-11-29T20:43:47.701 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:43:47.694+0000 1694c700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:42:59.453503+0000 front 2019-11-29T20:42:59.339587+0000 (oldest deadline 2019-11-29T20:43:43.553795+0000) 2019-11-29T20:43:47.716 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:43:47.711+0000 1694c700 -1 osd.0 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:01.638801+0000 front 2019-11-29T20:43:01.766271+0000 (oldest deadline 2019-11-29T20:43:46.194752+0000) 2019-11-29T20:43:48.161 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:43:48.155+0000 1694c700 -1 osd.1 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:00.297663+0000 front 2019-11-29T20:42:59.998179+0000 (oldest deadline 2019-11-29T20:43:44.676368+0000) 2019-11-29T20:43:48.487 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:43:48.482+0000 1694c700 -1 osd.2 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:00.850455+0000 front 2019-11-29T20:43:00.726057+0000 (oldest deadline 2019-11-29T20:43:46.441615+0000) 2019-11-29T20:43:48.663 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:43:48.657+0000 1694c700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:01.492162+0000 front 2019-11-29T20:43:01.708241+0000 (oldest deadline 2019-11-29T20:43:43.049045+0000) 2019-11-29T20:43:48.694 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:43:48.689+0000 1694c700 -1 osd.6 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:01.491601+0000 front 2019-11-29T20:43:01.622989+0000 (oldest deadline 2019-11-29T20:43:43.730020+0000) 2019-11-29T20:43:48.748 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:43:48.741+0000 1694c700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:42:59.453503+0000 front 2019-11-29T20:42:59.339587+0000 (oldest deadline 2019-11-29T20:43:43.553795+0000) 2019-11-29T20:43:48.759 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:43:48.754+0000 1694c700 -1 osd.0 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:01.638801+0000 front 2019-11-29T20:43:01.766271+0000 (oldest deadline 2019-11-29T20:43:46.194752+0000) 2019-11-29T20:43:49.123 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:43:49.117+0000 1694c700 -1 osd.1 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:00.297663+0000 front 2019-11-29T20:42:59.998179+0000 (oldest deadline 2019-11-29T20:43:44.676368+0000) 2019-11-29T20:43:49.530 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:43:49.525+0000 1694c700 -1 osd.2 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:00.850455+0000 front 2019-11-29T20:43:00.726057+0000 (oldest deadline 2019-11-29T20:43:46.441615+0000) 2019-11-29T20:43:49.709 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:43:49.704+0000 1694c700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:01.492162+0000 front 2019-11-29T20:43:01.708241+0000 (oldest deadline 2019-11-29T20:43:43.049045+0000) 2019-11-29T20:43:49.730 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:43:49.725+0000 1694c700 -1 osd.6 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:01.491601+0000 front 2019-11-29T20:43:01.622989+0000 (oldest deadline 2019-11-29T20:43:43.730020+0000) 2019-11-29T20:43:49.765 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:43:49.761+0000 1694c700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:42:59.453503+0000 front 2019-11-29T20:42:59.339587+0000 (oldest deadline 2019-11-29T20:43:43.553795+0000) 2019-11-29T20:43:49.773 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:43:49.768+0000 1694c700 -1 osd.0 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:01.638801+0000 front 2019-11-29T20:43:01.766271+0000 (oldest deadline 2019-11-29T20:43:46.194752+0000) 2019-11-29T20:43:50.081 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:43:50.075+0000 1694c700 -1 osd.1 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:00.297663+0000 front 2019-11-29T20:42:59.998179+0000 (oldest deadline 2019-11-29T20:43:44.676368+0000) 2019-11-29T20:43:50.541 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:43:50.536+0000 1694c700 -1 osd.2 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:00.850455+0000 front 2019-11-29T20:43:00.726057+0000 (oldest deadline 2019-11-29T20:43:46.441615+0000) 2019-11-29T20:43:50.680 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:43:50.676+0000 1694c700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:01.492162+0000 front 2019-11-29T20:43:01.708241+0000 (oldest deadline 2019-11-29T20:43:43.049045+0000) 2019-11-29T20:43:50.727 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:43:50.722+0000 1694c700 -1 osd.6 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:01.491601+0000 front 2019-11-29T20:43:01.622989+0000 (oldest deadline 2019-11-29T20:43:43.730020+0000) 2019-11-29T20:43:50.773 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:43:50.769+0000 1694c700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:42:59.453503+0000 front 2019-11-29T20:42:59.339587+0000 (oldest deadline 2019-11-29T20:43:43.553795+0000) 2019-11-29T20:43:50.789 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:43:50.784+0000 1694c700 -1 osd.0 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:01.638801+0000 front 2019-11-29T20:43:01.766271+0000 (oldest deadline 2019-11-29T20:43:46.194752+0000) 2019-11-29T20:43:51.138 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:43:51.130+0000 1694c700 -1 osd.1 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:00.297663+0000 front 2019-11-29T20:42:59.998179+0000 (oldest deadline 2019-11-29T20:43:44.676368+0000) 2019-11-29T20:43:51.519 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:43:51.513+0000 1694c700 -1 osd.2 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:00.850455+0000 front 2019-11-29T20:43:00.726057+0000 (oldest deadline 2019-11-29T20:43:46.441615+0000) 2019-11-29T20:43:51.668 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:43:51.661+0000 1694c700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:01.492162+0000 front 2019-11-29T20:43:01.708241+0000 (oldest deadline 2019-11-29T20:43:43.049045+0000) 2019-11-29T20:43:51.745 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:43:51.739+0000 1694c700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:42:59.453503+0000 front 2019-11-29T20:42:59.339587+0000 (oldest deadline 2019-11-29T20:43:43.553795+0000) 2019-11-29T20:43:51.748 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:43:51.743+0000 1694c700 -1 osd.6 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:01.491601+0000 front 2019-11-29T20:43:01.622989+0000 (oldest deadline 2019-11-29T20:43:43.730020+0000) 2019-11-29T20:43:51.810 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:43:51.804+0000 1694c700 -1 osd.0 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:01.638801+0000 front 2019-11-29T20:43:01.766271+0000 (oldest deadline 2019-11-29T20:43:46.194752+0000) 2019-11-29T20:43:52.118 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:43:52.111+0000 1694c700 -1 osd.1 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:00.297663+0000 front 2019-11-29T20:42:59.998179+0000 (oldest deadline 2019-11-29T20:43:44.676368+0000) 2019-11-29T20:43:52.568 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:43:52.560+0000 1694c700 -1 osd.2 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:00.850455+0000 front 2019-11-29T20:43:00.726057+0000 (oldest deadline 2019-11-29T20:43:46.441615+0000) 2019-11-29T20:43:52.666 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:43:52.660+0000 1694c700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:01.492162+0000 front 2019-11-29T20:43:01.708241+0000 (oldest deadline 2019-11-29T20:43:43.049045+0000) 2019-11-29T20:43:52.714 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:43:52.708+0000 1694c700 -1 osd.6 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:01.491601+0000 front 2019-11-29T20:43:01.622989+0000 (oldest deadline 2019-11-29T20:43:43.730020+0000) 2019-11-29T20:43:52.768 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:43:52.761+0000 1694c700 -1 osd.0 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:01.638801+0000 front 2019-11-29T20:43:01.766271+0000 (oldest deadline 2019-11-29T20:43:46.194752+0000) 2019-11-29T20:43:52.790 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:43:52.781+0000 1694c700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:42:59.453503+0000 front 2019-11-29T20:42:59.339587+0000 (oldest deadline 2019-11-29T20:43:43.553795+0000) 2019-11-29T20:43:53.151 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:43:53.145+0000 1694c700 -1 osd.1 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:00.297663+0000 front 2019-11-29T20:42:59.998179+0000 (oldest deadline 2019-11-29T20:43:44.676368+0000) 2019-11-29T20:43:53.582 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:43:53.577+0000 1694c700 -1 osd.2 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:00.850455+0000 front 2019-11-29T20:43:00.726057+0000 (oldest deadline 2019-11-29T20:43:46.441615+0000) 2019-11-29T20:43:53.715 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:43:53.708+0000 1694c700 -1 osd.6 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:01.491601+0000 front 2019-11-29T20:43:01.622989+0000 (oldest deadline 2019-11-29T20:43:43.730020+0000) 2019-11-29T20:43:53.716 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:43:53.709+0000 1694c700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:01.492162+0000 front 2019-11-29T20:43:01.708241+0000 (oldest deadline 2019-11-29T20:43:43.049045+0000) 2019-11-29T20:43:53.747 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:43:53.741+0000 1694c700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:42:59.453503+0000 front 2019-11-29T20:42:59.339587+0000 (oldest deadline 2019-11-29T20:43:43.553795+0000) 2019-11-29T20:43:53.793 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:43:53.788+0000 1694c700 -1 osd.0 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:01.638801+0000 front 2019-11-29T20:43:01.766271+0000 (oldest deadline 2019-11-29T20:43:46.194752+0000) 2019-11-29T20:43:54.177 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:43:54.172+0000 1694c700 -1 osd.1 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:00.297663+0000 front 2019-11-29T20:42:59.998179+0000 (oldest deadline 2019-11-29T20:43:44.676368+0000) 2019-11-29T20:43:54.597 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:43:54.593+0000 1694c700 -1 osd.2 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:00.850455+0000 front 2019-11-29T20:43:00.726057+0000 (oldest deadline 2019-11-29T20:43:46.441615+0000) 2019-11-29T20:43:54.684 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:43:54.677+0000 1694c700 -1 osd.6 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:01.491601+0000 front 2019-11-29T20:43:01.622989+0000 (oldest deadline 2019-11-29T20:43:43.730020+0000) 2019-11-29T20:43:54.707 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:43:54.701+0000 1694c700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:42:59.453503+0000 front 2019-11-29T20:42:59.339587+0000 (oldest deadline 2019-11-29T20:43:43.553795+0000) 2019-11-29T20:43:54.711 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:43:54.705+0000 1694c700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:01.492162+0000 front 2019-11-29T20:43:01.708241+0000 (oldest deadline 2019-11-29T20:43:43.049045+0000) 2019-11-29T20:43:54.789 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:43:54.779+0000 1694c700 -1 osd.0 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:01.638801+0000 front 2019-11-29T20:43:01.766271+0000 (oldest deadline 2019-11-29T20:43:46.194752+0000) 2019-11-29T20:43:55.222 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:43:55.216+0000 1694c700 -1 osd.1 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:00.297663+0000 front 2019-11-29T20:42:59.998179+0000 (oldest deadline 2019-11-29T20:43:44.676368+0000) 2019-11-29T20:43:55.593 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:43:55.587+0000 1694c700 -1 osd.2 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:00.850455+0000 front 2019-11-29T20:43:00.726057+0000 (oldest deadline 2019-11-29T20:43:46.441615+0000) 2019-11-29T20:43:55.706 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:43:55.700+0000 1694c700 -1 osd.6 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:01.491601+0000 front 2019-11-29T20:43:01.622989+0000 (oldest deadline 2019-11-29T20:43:43.730020+0000) 2019-11-29T20:43:55.712 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:43:55.706+0000 1694c700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:42:59.453503+0000 front 2019-11-29T20:42:59.339587+0000 (oldest deadline 2019-11-29T20:43:43.553795+0000) 2019-11-29T20:43:55.719 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:43:55.713+0000 1694c700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:01.492162+0000 front 2019-11-29T20:43:01.708241+0000 (oldest deadline 2019-11-29T20:43:43.049045+0000) 2019-11-29T20:43:55.802 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:43:55.795+0000 1694c700 -1 osd.0 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:01.638801+0000 front 2019-11-29T20:43:01.766271+0000 (oldest deadline 2019-11-29T20:43:46.194752+0000) 2019-11-29T20:43:56.227 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:43:56.221+0000 1694c700 -1 osd.1 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:00.297663+0000 front 2019-11-29T20:42:59.998179+0000 (oldest deadline 2019-11-29T20:43:44.676368+0000) 2019-11-29T20:43:56.560 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:43:56.554+0000 1694c700 -1 osd.2 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:00.850455+0000 front 2019-11-29T20:43:00.726057+0000 (oldest deadline 2019-11-29T20:43:46.441615+0000) 2019-11-29T20:43:56.664 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:43:56.658+0000 1694c700 -1 osd.6 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:01.491601+0000 front 2019-11-29T20:43:01.622989+0000 (oldest deadline 2019-11-29T20:43:43.730020+0000) 2019-11-29T20:43:56.711 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:43:56.705+0000 1694c700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:01.492162+0000 front 2019-11-29T20:43:01.708241+0000 (oldest deadline 2019-11-29T20:43:43.049045+0000) 2019-11-29T20:43:56.753 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:43:56.745+0000 1694c700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:42:59.453503+0000 front 2019-11-29T20:42:59.339587+0000 (oldest deadline 2019-11-29T20:43:43.553795+0000) 2019-11-29T20:43:56.785 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:43:56.781+0000 1694c700 -1 osd.0 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:01.638801+0000 front 2019-11-29T20:43:01.766271+0000 (oldest deadline 2019-11-29T20:43:46.194752+0000) 2019-11-29T20:43:57.256 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:43:57.250+0000 1694c700 -1 osd.1 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:00.297663+0000 front 2019-11-29T20:42:59.998179+0000 (oldest deadline 2019-11-29T20:43:44.676368+0000) 2019-11-29T20:43:57.593 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:43:57.587+0000 1694c700 -1 osd.2 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:00.850455+0000 front 2019-11-29T20:43:00.726057+0000 (oldest deadline 2019-11-29T20:43:46.441615+0000) 2019-11-29T20:43:57.687 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:43:57.677+0000 1694c700 -1 osd.6 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:01.491601+0000 front 2019-11-29T20:43:01.622989+0000 (oldest deadline 2019-11-29T20:43:43.730020+0000) 2019-11-29T20:43:57.737 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:43:57.732+0000 1694c700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:01.492162+0000 front 2019-11-29T20:43:01.708241+0000 (oldest deadline 2019-11-29T20:43:43.049045+0000) 2019-11-29T20:43:57.744 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:43:57.739+0000 1694c700 -1 osd.0 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:01.638801+0000 front 2019-11-29T20:43:01.766271+0000 (oldest deadline 2019-11-29T20:43:46.194752+0000) 2019-11-29T20:43:57.800 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:43:57.794+0000 1694c700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:42:59.453503+0000 front 2019-11-29T20:42:59.339587+0000 (oldest deadline 2019-11-29T20:43:43.553795+0000) 2019-11-29T20:43:58.229 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:43:58.223+0000 1694c700 -1 osd.1 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:00.297663+0000 front 2019-11-29T20:42:59.998179+0000 (oldest deadline 2019-11-29T20:43:44.676368+0000) 2019-11-29T20:43:58.566 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:43:58.559+0000 1694c700 -1 osd.2 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:00.850455+0000 front 2019-11-29T20:43:00.726057+0000 (oldest deadline 2019-11-29T20:43:46.441615+0000) 2019-11-29T20:43:58.714 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:43:58.708+0000 1694c700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:01.492162+0000 front 2019-11-29T20:43:01.708241+0000 (oldest deadline 2019-11-29T20:43:43.049045+0000) 2019-11-29T20:43:58.716 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:43:58.710+0000 1694c700 -1 osd.6 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:01.491601+0000 front 2019-11-29T20:43:01.622989+0000 (oldest deadline 2019-11-29T20:43:43.730020+0000) 2019-11-29T20:43:58.787 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:43:58.781+0000 1694c700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:42:59.453503+0000 front 2019-11-29T20:42:59.339587+0000 (oldest deadline 2019-11-29T20:43:43.553795+0000) 2019-11-29T20:43:58.791 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:43:58.786+0000 1694c700 -1 osd.0 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:01.638801+0000 front 2019-11-29T20:43:01.766271+0000 (oldest deadline 2019-11-29T20:43:46.194752+0000) 2019-11-29T20:43:59.265 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:43:59.259+0000 1694c700 -1 osd.1 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:00.297663+0000 front 2019-11-29T20:42:59.998179+0000 (oldest deadline 2019-11-29T20:43:44.676368+0000) 2019-11-29T20:43:59.607 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:43:59.601+0000 1694c700 -1 osd.2 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:00.850455+0000 front 2019-11-29T20:43:00.726057+0000 (oldest deadline 2019-11-29T20:43:46.441615+0000) 2019-11-29T20:43:59.695 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:43:59.689+0000 1694c700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:01.492162+0000 front 2019-11-29T20:43:01.708241+0000 (oldest deadline 2019-11-29T20:43:43.049045+0000) 2019-11-29T20:43:59.752 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:43:59.746+0000 1694c700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:42:59.453503+0000 front 2019-11-29T20:42:59.339587+0000 (oldest deadline 2019-11-29T20:43:43.553795+0000) 2019-11-29T20:43:59.770 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:43:59.764+0000 1694c700 -1 osd.0 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:01.638801+0000 front 2019-11-29T20:43:01.766271+0000 (oldest deadline 2019-11-29T20:43:46.194752+0000) 2019-11-29T20:43:59.770 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:43:59.764+0000 1694c700 -1 osd.6 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:01.491601+0000 front 2019-11-29T20:43:01.622989+0000 (oldest deadline 2019-11-29T20:43:43.730020+0000) 2019-11-29T20:44:00.294 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:44:00.290+0000 1694c700 -1 osd.1 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:00.297663+0000 front 2019-11-29T20:42:59.998179+0000 (oldest deadline 2019-11-29T20:43:44.676368+0000) 2019-11-29T20:44:00.596 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:44:00.590+0000 1694c700 -1 osd.2 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:00.850455+0000 front 2019-11-29T20:43:00.726057+0000 (oldest deadline 2019-11-29T20:43:46.441615+0000) 2019-11-29T20:44:00.720 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:44:00.715+0000 1694c700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:01.492162+0000 front 2019-11-29T20:43:01.708241+0000 (oldest deadline 2019-11-29T20:43:43.049045+0000) 2019-11-29T20:44:00.740 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:44:00.734+0000 1694c700 -1 osd.6 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:01.491601+0000 front 2019-11-29T20:43:01.622989+0000 (oldest deadline 2019-11-29T20:43:43.730020+0000) 2019-11-29T20:44:00.780 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:44:00.775+0000 1694c700 -1 osd.0 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:01.638801+0000 front 2019-11-29T20:43:01.766271+0000 (oldest deadline 2019-11-29T20:43:46.194752+0000) 2019-11-29T20:44:00.799 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:44:00.793+0000 1694c700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:42:59.453503+0000 front 2019-11-29T20:42:59.339587+0000 (oldest deadline 2019-11-29T20:43:43.553795+0000) 2019-11-29T20:44:01.336 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:44:01.331+0000 1694c700 -1 osd.1 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:00.297663+0000 front 2019-11-29T20:42:59.998179+0000 (oldest deadline 2019-11-29T20:43:44.676368+0000) 2019-11-29T20:44:01.597 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:44:01.591+0000 1694c700 -1 osd.2 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:00.850455+0000 front 2019-11-29T20:43:00.726057+0000 (oldest deadline 2019-11-29T20:43:46.441615+0000) 2019-11-29T20:44:01.700 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:44:01.694+0000 1694c700 -1 osd.6 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:01.491601+0000 front 2019-11-29T20:43:01.622989+0000 (oldest deadline 2019-11-29T20:43:43.730020+0000) 2019-11-29T20:44:01.747 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:44:01.740+0000 1694c700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:01.492162+0000 front 2019-11-29T20:43:01.708241+0000 (oldest deadline 2019-11-29T20:43:43.049045+0000) 2019-11-29T20:44:01.760 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:44:01.754+0000 1694c700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:42:59.453503+0000 front 2019-11-29T20:42:59.339587+0000 (oldest deadline 2019-11-29T20:43:43.553795+0000) 2019-11-29T20:44:01.779 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:44:01.772+0000 1694c700 -1 osd.0 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:01.638801+0000 front 2019-11-29T20:43:01.766271+0000 (oldest deadline 2019-11-29T20:43:46.194752+0000) 2019-11-29T20:44:02.290 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:44:02.286+0000 1694c700 -1 osd.1 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:00.297663+0000 front 2019-11-29T20:42:59.998179+0000 (oldest deadline 2019-11-29T20:43:44.676368+0000) 2019-11-29T20:44:02.571 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:44:02.566+0000 1694c700 -1 osd.2 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:00.850455+0000 front 2019-11-29T20:43:00.726057+0000 (oldest deadline 2019-11-29T20:43:46.441615+0000) 2019-11-29T20:44:02.743 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:44:02.737+0000 1694c700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:01.492162+0000 front 2019-11-29T20:43:01.708241+0000 (oldest deadline 2019-11-29T20:43:43.049045+0000) 2019-11-29T20:44:02.743 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:44:02.735+0000 1694c700 -1 osd.6 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:01.491601+0000 front 2019-11-29T20:43:01.622989+0000 (oldest deadline 2019-11-29T20:43:43.730020+0000) 2019-11-29T20:44:02.752 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:44:02.748+0000 1694c700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:42:59.453503+0000 front 2019-11-29T20:42:59.339587+0000 (oldest deadline 2019-11-29T20:43:43.553795+0000) 2019-11-29T20:44:02.777 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:44:02.772+0000 1694c700 -1 osd.0 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:01.638801+0000 front 2019-11-29T20:43:01.766271+0000 (oldest deadline 2019-11-29T20:43:46.194752+0000) 2019-11-29T20:44:03.325 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:44:03.320+0000 1694c700 -1 osd.1 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:00.297663+0000 front 2019-11-29T20:42:59.998179+0000 (oldest deadline 2019-11-29T20:43:44.676368+0000) 2019-11-29T20:44:03.529 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:44:03.524+0000 1694c700 -1 osd.2 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:00.850455+0000 front 2019-11-29T20:43:00.726057+0000 (oldest deadline 2019-11-29T20:43:46.441615+0000) 2019-11-29T20:44:03.706 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:44:03.701+0000 1694c700 -1 osd.6 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:01.491601+0000 front 2019-11-29T20:43:01.622989+0000 (oldest deadline 2019-11-29T20:43:43.730020+0000) 2019-11-29T20:44:03.734 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:44:03.727+0000 1694c700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:01.492162+0000 front 2019-11-29T20:43:01.708241+0000 (oldest deadline 2019-11-29T20:43:43.049045+0000) 2019-11-29T20:44:03.734 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:44:03.728+0000 1694c700 -1 osd.0 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:01.638801+0000 front 2019-11-29T20:43:01.766271+0000 (oldest deadline 2019-11-29T20:43:46.194752+0000) 2019-11-29T20:44:03.790 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:44:03.783+0000 1694c700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:42:59.453503+0000 front 2019-11-29T20:42:59.339587+0000 (oldest deadline 2019-11-29T20:43:43.553795+0000) 2019-11-29T20:44:04.318 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:44:04.313+0000 1694c700 -1 osd.1 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:00.297663+0000 front 2019-11-29T20:42:59.998179+0000 (oldest deadline 2019-11-29T20:43:44.676368+0000) 2019-11-29T20:44:04.511 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:44:04.506+0000 1694c700 -1 osd.2 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:00.850455+0000 front 2019-11-29T20:43:00.726057+0000 (oldest deadline 2019-11-29T20:43:46.441615+0000) 2019-11-29T20:44:04.692 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:44:04.687+0000 1694c700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:01.492162+0000 front 2019-11-29T20:43:01.708241+0000 (oldest deadline 2019-11-29T20:43:43.049045+0000) 2019-11-29T20:44:04.723 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:44:04.718+0000 1694c700 -1 osd.0 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:01.638801+0000 front 2019-11-29T20:43:01.766271+0000 (oldest deadline 2019-11-29T20:43:46.194752+0000) 2019-11-29T20:44:04.762 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:44:04.757+0000 1694c700 -1 osd.6 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:01.491601+0000 front 2019-11-29T20:43:01.622989+0000 (oldest deadline 2019-11-29T20:43:43.730020+0000) 2019-11-29T20:44:04.780 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:44:04.775+0000 1694c700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:42:59.453503+0000 front 2019-11-29T20:42:59.339587+0000 (oldest deadline 2019-11-29T20:43:43.553795+0000) 2019-11-29T20:44:05.274 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:44:05.270+0000 1694c700 -1 osd.1 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:00.297663+0000 front 2019-11-29T20:42:59.998179+0000 (oldest deadline 2019-11-29T20:43:44.676368+0000) 2019-11-29T20:44:05.562 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:44:05.557+0000 1694c700 -1 osd.2 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:00.850455+0000 front 2019-11-29T20:43:00.726057+0000 (oldest deadline 2019-11-29T20:43:46.441615+0000) 2019-11-29T20:44:05.687 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:44:05.682+0000 1694c700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:01.492162+0000 front 2019-11-29T20:43:01.708241+0000 (oldest deadline 2019-11-29T20:43:43.049045+0000) 2019-11-29T20:44:05.726 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:44:05.721+0000 1694c700 -1 osd.6 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:01.491601+0000 front 2019-11-29T20:43:01.622989+0000 (oldest deadline 2019-11-29T20:43:43.730020+0000) 2019-11-29T20:44:05.746 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:44:05.741+0000 1694c700 -1 osd.0 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:01.638801+0000 front 2019-11-29T20:43:01.766271+0000 (oldest deadline 2019-11-29T20:43:46.194752+0000) 2019-11-29T20:44:05.749 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:44:05.744+0000 1694c700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:42:59.453503+0000 front 2019-11-29T20:42:59.339587+0000 (oldest deadline 2019-11-29T20:43:43.553795+0000) 2019-11-29T20:44:06.228 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:44:06.223+0000 1694c700 -1 osd.1 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:00.297663+0000 front 2019-11-29T20:42:59.998179+0000 (oldest deadline 2019-11-29T20:43:44.676368+0000) 2019-11-29T20:44:06.536 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:44:06.531+0000 1694c700 -1 osd.2 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:00.850455+0000 front 2019-11-29T20:43:00.726057+0000 (oldest deadline 2019-11-29T20:43:46.441615+0000) 2019-11-29T20:44:06.654 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:44:06.644+0000 1694c700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:01.492162+0000 front 2019-11-29T20:43:01.708241+0000 (oldest deadline 2019-11-29T20:43:43.049045+0000) 2019-11-29T20:44:06.709 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:44:06.703+0000 1694c700 -1 osd.6 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:01.491601+0000 front 2019-11-29T20:43:01.622989+0000 (oldest deadline 2019-11-29T20:43:43.730020+0000) 2019-11-29T20:44:06.749 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:44:06.741+0000 1694c700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:42:59.453503+0000 front 2019-11-29T20:42:59.339587+0000 (oldest deadline 2019-11-29T20:43:43.553795+0000) 2019-11-29T20:44:06.759 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:44:06.754+0000 1694c700 -1 osd.0 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:01.638801+0000 front 2019-11-29T20:43:01.766271+0000 (oldest deadline 2019-11-29T20:43:46.194752+0000) 2019-11-29T20:44:07.240 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:44:07.234+0000 1694c700 -1 osd.1 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:00.297663+0000 front 2019-11-29T20:42:59.998179+0000 (oldest deadline 2019-11-29T20:43:44.676368+0000) 2019-11-29T20:44:07.581 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:44:07.575+0000 1694c700 -1 osd.2 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:00.850455+0000 front 2019-11-29T20:43:00.726057+0000 (oldest deadline 2019-11-29T20:43:46.441615+0000) 2019-11-29T20:44:07.679 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:44:07.673+0000 1694c700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:01.492162+0000 front 2019-11-29T20:43:01.708241+0000 (oldest deadline 2019-11-29T20:43:43.049045+0000) 2019-11-29T20:44:07.680 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:44:07.674+0000 1694c700 -1 osd.6 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:01.491601+0000 front 2019-11-29T20:43:01.622989+0000 (oldest deadline 2019-11-29T20:43:43.730020+0000) 2019-11-29T20:44:07.730 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:44:07.723+0000 1694c700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:42:59.453503+0000 front 2019-11-29T20:42:59.339587+0000 (oldest deadline 2019-11-29T20:43:43.553795+0000) 2019-11-29T20:44:07.814 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:44:07.808+0000 1694c700 -1 osd.0 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:01.638801+0000 front 2019-11-29T20:43:01.766271+0000 (oldest deadline 2019-11-29T20:43:46.194752+0000) 2019-11-29T20:44:08.276 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:44:08.271+0000 1694c700 -1 osd.1 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:00.297663+0000 front 2019-11-29T20:42:59.998179+0000 (oldest deadline 2019-11-29T20:43:44.676368+0000) 2019-11-29T20:44:08.574 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:44:08.569+0000 1694c700 -1 osd.2 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:00.850455+0000 front 2019-11-29T20:43:00.726057+0000 (oldest deadline 2019-11-29T20:43:46.441615+0000) 2019-11-29T20:44:08.720 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:44:08.713+0000 1694c700 -1 osd.6 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:01.491601+0000 front 2019-11-29T20:43:01.622989+0000 (oldest deadline 2019-11-29T20:43:43.730020+0000) 2019-11-29T20:44:08.726 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:44:08.720+0000 1694c700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:01.492162+0000 front 2019-11-29T20:43:01.708241+0000 (oldest deadline 2019-11-29T20:43:43.049045+0000) 2019-11-29T20:44:08.752 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:44:08.746+0000 1694c700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:42:59.453503+0000 front 2019-11-29T20:42:59.339587+0000 (oldest deadline 2019-11-29T20:43:43.553795+0000) 2019-11-29T20:44:08.806 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:44:08.800+0000 1694c700 -1 osd.0 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:01.638801+0000 front 2019-11-29T20:43:01.766271+0000 (oldest deadline 2019-11-29T20:43:46.194752+0000) 2019-11-29T20:44:09.248 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:44:09.242+0000 1694c700 -1 osd.1 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:00.297663+0000 front 2019-11-29T20:42:59.998179+0000 (oldest deadline 2019-11-29T20:43:44.676368+0000) 2019-11-29T20:44:09.612 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:44:09.607+0000 1694c700 -1 osd.2 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:00.850455+0000 front 2019-11-29T20:43:00.726057+0000 (oldest deadline 2019-11-29T20:43:46.441615+0000) 2019-11-29T20:44:09.719 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:44:09.709+0000 1694c700 -1 osd.6 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:01.491601+0000 front 2019-11-29T20:43:01.622989+0000 (oldest deadline 2019-11-29T20:43:43.730020+0000) 2019-11-29T20:44:09.754 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:44:09.743+0000 1694c700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:42:59.453503+0000 front 2019-11-29T20:42:59.339587+0000 (oldest deadline 2019-11-29T20:43:43.553795+0000) 2019-11-29T20:44:09.764 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:44:09.760+0000 1694c700 -1 osd.0 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:01.638801+0000 front 2019-11-29T20:43:01.766271+0000 (oldest deadline 2019-11-29T20:43:46.194752+0000) 2019-11-29T20:44:09.767 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:44:09.761+0000 1694c700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:01.492162+0000 front 2019-11-29T20:43:01.708241+0000 (oldest deadline 2019-11-29T20:43:43.049045+0000) 2019-11-29T20:44:10.219 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:44:10.213+0000 1694c700 -1 osd.1 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:00.297663+0000 front 2019-11-29T20:42:59.998179+0000 (oldest deadline 2019-11-29T20:43:44.676368+0000) 2019-11-29T20:44:10.638 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:44:10.633+0000 1694c700 -1 osd.2 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:00.850455+0000 front 2019-11-29T20:43:00.726057+0000 (oldest deadline 2019-11-29T20:43:46.441615+0000) 2019-11-29T20:44:10.714 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:44:10.708+0000 1694c700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:42:59.453503+0000 front 2019-11-29T20:42:59.339587+0000 (oldest deadline 2019-11-29T20:43:43.553795+0000) 2019-11-29T20:44:10.731 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:44:10.725+0000 1694c700 -1 osd.6 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:01.491601+0000 front 2019-11-29T20:43:01.622989+0000 (oldest deadline 2019-11-29T20:43:43.730020+0000) 2019-11-29T20:44:10.767 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:44:10.762+0000 1694c700 -1 osd.0 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:01.638801+0000 front 2019-11-29T20:43:01.766271+0000 (oldest deadline 2019-11-29T20:43:46.194752+0000) 2019-11-29T20:44:10.789 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:44:10.782+0000 1694c700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:01.492162+0000 front 2019-11-29T20:43:01.708241+0000 (oldest deadline 2019-11-29T20:43:43.049045+0000) 2019-11-29T20:44:11.183 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:44:11.178+0000 1694c700 -1 osd.1 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:00.297663+0000 front 2019-11-29T20:42:59.998179+0000 (oldest deadline 2019-11-29T20:43:44.676368+0000) 2019-11-29T20:44:11.625 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:44:11.620+0000 1694c700 -1 osd.2 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:00.850455+0000 front 2019-11-29T20:43:00.726057+0000 (oldest deadline 2019-11-29T20:43:46.441615+0000) 2019-11-29T20:44:11.701 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:44:11.694+0000 1694c700 -1 osd.6 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:01.491601+0000 front 2019-11-29T20:43:01.622989+0000 (oldest deadline 2019-11-29T20:43:43.730020+0000) 2019-11-29T20:44:11.730 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:44:11.724+0000 1694c700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:42:59.453503+0000 front 2019-11-29T20:42:59.339587+0000 (oldest deadline 2019-11-29T20:43:43.553795+0000) 2019-11-29T20:44:11.767 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:44:11.761+0000 1694c700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:01.492162+0000 front 2019-11-29T20:43:01.708241+0000 (oldest deadline 2019-11-29T20:43:43.049045+0000) 2019-11-29T20:44:12.155 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:44:12.150+0000 1694c700 -1 osd.1 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:00.297663+0000 front 2019-11-29T20:42:59.998179+0000 (oldest deadline 2019-11-29T20:43:44.676368+0000) 2019-11-29T20:44:12.623 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:44:12.616+0000 1694c700 -1 osd.2 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:00.850455+0000 front 2019-11-29T20:43:00.726057+0000 (oldest deadline 2019-11-29T20:43:46.441615+0000) 2019-11-29T20:44:12.674 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:44:12.669+0000 1694c700 -1 osd.6 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:01.491601+0000 front 2019-11-29T20:43:01.622989+0000 (oldest deadline 2019-11-29T20:43:43.730020+0000) 2019-11-29T20:44:12.724 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:44:12.719+0000 1694c700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:42:59.453503+0000 front 2019-11-29T20:42:59.339587+0000 (oldest deadline 2019-11-29T20:43:43.553795+0000) 2019-11-29T20:44:12.810 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:44:12.805+0000 1694c700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:01.492162+0000 front 2019-11-29T20:43:01.708241+0000 (oldest deadline 2019-11-29T20:43:43.049045+0000) 2019-11-29T20:44:13.206 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:44:13.200+0000 1694c700 -1 osd.1 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:00.297663+0000 front 2019-11-29T20:42:59.998179+0000 (oldest deadline 2019-11-29T20:43:44.676368+0000) 2019-11-29T20:44:13.631 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:44:13.626+0000 1694c700 -1 osd.2 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:00.850455+0000 front 2019-11-29T20:43:00.726057+0000 (oldest deadline 2019-11-29T20:43:46.441615+0000) 2019-11-29T20:44:13.721 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:44:13.716+0000 1694c700 -1 osd.6 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:01.491601+0000 front 2019-11-29T20:43:01.622989+0000 (oldest deadline 2019-11-29T20:43:43.730020+0000) 2019-11-29T20:44:13.732 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:44:13.726+0000 1694c700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:42:59.453503+0000 front 2019-11-29T20:42:59.339587+0000 (oldest deadline 2019-11-29T20:43:43.553795+0000) 2019-11-29T20:44:13.834 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:44:13.828+0000 1694c700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:01.492162+0000 front 2019-11-29T20:43:01.708241+0000 (oldest deadline 2019-11-29T20:43:43.049045+0000) 2019-11-29T20:44:14.231 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:44:14.226+0000 1694c700 -1 osd.1 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:00.297663+0000 front 2019-11-29T20:42:59.998179+0000 (oldest deadline 2019-11-29T20:43:44.676368+0000) 2019-11-29T20:44:14.605 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:44:14.595+0000 1694c700 -1 osd.2 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:00.850455+0000 front 2019-11-29T20:43:00.726057+0000 (oldest deadline 2019-11-29T20:43:46.441615+0000) 2019-11-29T20:44:14.686 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:44:14.680+0000 1694c700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:42:59.453503+0000 front 2019-11-29T20:42:59.339587+0000 (oldest deadline 2019-11-29T20:43:43.553795+0000) 2019-11-29T20:44:14.773 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:44:14.767+0000 1694c700 -1 osd.6 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:01.491601+0000 front 2019-11-29T20:43:01.622989+0000 (oldest deadline 2019-11-29T20:43:43.730020+0000) 2019-11-29T20:44:14.836 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:44:14.830+0000 1694c700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:01.492162+0000 front 2019-11-29T20:43:01.708241+0000 (oldest deadline 2019-11-29T20:43:43.049045+0000) 2019-11-29T20:44:15.229 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:44:15.223+0000 1694c700 -1 osd.1 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:00.297663+0000 front 2019-11-29T20:42:59.998179+0000 (oldest deadline 2019-11-29T20:43:44.676368+0000) 2019-11-29T20:44:15.610 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:44:15.604+0000 1694c700 -1 osd.2 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:00.850455+0000 front 2019-11-29T20:43:00.726057+0000 (oldest deadline 2019-11-29T20:43:46.441615+0000) 2019-11-29T20:44:15.698 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:44:15.690+0000 1694c700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:42:59.453503+0000 front 2019-11-29T20:42:59.339587+0000 (oldest deadline 2019-11-29T20:43:43.553795+0000) 2019-11-29T20:44:15.788 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:44:15.781+0000 1694c700 -1 osd.6 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:01.491601+0000 front 2019-11-29T20:43:01.622989+0000 (oldest deadline 2019-11-29T20:43:43.730020+0000) 2019-11-29T20:44:15.812 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:44:15.806+0000 1694c700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:01.492162+0000 front 2019-11-29T20:43:01.708241+0000 (oldest deadline 2019-11-29T20:43:43.049045+0000) 2019-11-29T20:44:16.234 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:44:16.229+0000 1694c700 -1 osd.1 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:00.297663+0000 front 2019-11-29T20:42:59.998179+0000 (oldest deadline 2019-11-29T20:43:44.676368+0000) 2019-11-29T20:44:16.590 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:44:16.585+0000 1694c700 -1 osd.2 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:00.850455+0000 front 2019-11-29T20:43:00.726057+0000 (oldest deadline 2019-11-29T20:43:46.441615+0000) 2019-11-29T20:44:16.738 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:44:16.732+0000 1694c700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:42:59.453503+0000 front 2019-11-29T20:42:59.339587+0000 (oldest deadline 2019-11-29T20:43:43.553795+0000) 2019-11-29T20:44:16.793 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:44:16.786+0000 1694c700 -1 osd.6 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:01.491601+0000 front 2019-11-29T20:43:01.622989+0000 (oldest deadline 2019-11-29T20:43:43.730020+0000) 2019-11-29T20:44:16.813 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:44:16.807+0000 1694c700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:01.492162+0000 front 2019-11-29T20:43:01.708241+0000 (oldest deadline 2019-11-29T20:43:43.049045+0000) 2019-11-29T20:44:17.271 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:44:17.265+0000 1694c700 -1 osd.1 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:00.297663+0000 front 2019-11-29T20:42:59.998179+0000 (oldest deadline 2019-11-29T20:43:44.676368+0000) 2019-11-29T20:44:17.546 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:44:17.541+0000 1694c700 -1 osd.2 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:00.850455+0000 front 2019-11-29T20:43:00.726057+0000 (oldest deadline 2019-11-29T20:43:46.441615+0000) 2019-11-29T20:44:17.698 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:44:17.692+0000 1694c700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:42:59.453503+0000 front 2019-11-29T20:42:59.339587+0000 (oldest deadline 2019-11-29T20:43:43.553795+0000) 2019-11-29T20:44:17.796 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:44:17.791+0000 1694c700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:01.492162+0000 front 2019-11-29T20:43:01.708241+0000 (oldest deadline 2019-11-29T20:43:43.049045+0000) 2019-11-29T20:44:17.831 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:44:17.825+0000 1694c700 -1 osd.6 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:01.491601+0000 front 2019-11-29T20:43:01.622989+0000 (oldest deadline 2019-11-29T20:43:43.730020+0000) 2019-11-29T20:44:18.268 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:44:18.263+0000 1694c700 -1 osd.1 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:00.297663+0000 front 2019-11-29T20:42:59.998179+0000 (oldest deadline 2019-11-29T20:43:44.676368+0000) 2019-11-29T20:44:18.538 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:44:18.533+0000 1694c700 -1 osd.2 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:00.850455+0000 front 2019-11-29T20:43:00.726057+0000 (oldest deadline 2019-11-29T20:43:46.441615+0000) 2019-11-29T20:44:18.730 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:44:18.724+0000 1694c700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:42:59.453503+0000 front 2019-11-29T20:42:59.339587+0000 (oldest deadline 2019-11-29T20:43:43.553795+0000) 2019-11-29T20:44:18.795 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:44:18.789+0000 1694c700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:01.492162+0000 front 2019-11-29T20:43:01.708241+0000 (oldest deadline 2019-11-29T20:43:43.049045+0000) 2019-11-29T20:44:18.799 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:44:18.794+0000 1694c700 -1 osd.6 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:01.491601+0000 front 2019-11-29T20:43:01.622989+0000 (oldest deadline 2019-11-29T20:43:43.730020+0000) 2019-11-29T20:44:19.288 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:44:19.283+0000 1694c700 -1 osd.1 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:00.297663+0000 front 2019-11-29T20:42:59.998179+0000 (oldest deadline 2019-11-29T20:43:44.676368+0000) 2019-11-29T20:44:19.564 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:44:19.559+0000 1694c700 -1 osd.2 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:00.850455+0000 front 2019-11-29T20:43:00.726057+0000 (oldest deadline 2019-11-29T20:43:46.441615+0000) 2019-11-29T20:44:19.742 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:44:19.736+0000 1694c700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:42:59.453503+0000 front 2019-11-29T20:42:59.339587+0000 (oldest deadline 2019-11-29T20:43:43.553795+0000) 2019-11-29T20:44:19.759 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:44:19.752+0000 1694c700 -1 osd.6 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:01.491601+0000 front 2019-11-29T20:43:01.622989+0000 (oldest deadline 2019-11-29T20:43:43.730020+0000) 2019-11-29T20:44:19.820 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:44:19.815+0000 1694c700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:01.492162+0000 front 2019-11-29T20:43:01.708241+0000 (oldest deadline 2019-11-29T20:43:43.049045+0000) 2019-11-29T20:44:20.309 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:44:20.303+0000 1694c700 -1 osd.1 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:00.297663+0000 front 2019-11-29T20:42:59.998179+0000 (oldest deadline 2019-11-29T20:43:44.676368+0000) 2019-11-29T20:44:20.613 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:44:20.608+0000 1694c700 -1 osd.2 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:00.850455+0000 front 2019-11-29T20:43:00.726057+0000 (oldest deadline 2019-11-29T20:43:46.441615+0000) 2019-11-29T20:44:20.750 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:44:20.745+0000 1694c700 -1 osd.6 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:01.491601+0000 front 2019-11-29T20:43:01.622989+0000 (oldest deadline 2019-11-29T20:43:43.730020+0000) 2019-11-29T20:44:20.766 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:44:20.762+0000 1694c700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:42:59.453503+0000 front 2019-11-29T20:42:59.339587+0000 (oldest deadline 2019-11-29T20:43:43.553795+0000) 2019-11-29T20:44:20.802 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:44:20.796+0000 1694c700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:01.492162+0000 front 2019-11-29T20:43:01.708241+0000 (oldest deadline 2019-11-29T20:43:43.049045+0000) 2019-11-29T20:44:20.923 INFO:tasks.ceph.mon.b.smithi022.stderr:2019-11-29T20:44:20.916+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.62:6823/10369,v1:172.21.15.62:6825/10369] for 45sec e184 v184) 2019-11-29T20:44:21.592 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:44:21.576+0000 1694c700 -1 osd.2 184 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:43:00.850455+0000 front 2019-11-29T20:43:00.726057+0000 (oldest deadline 2019-11-29T20:43:46.441615+0000) 2019-11-29T20:44:58.032 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:44:57.800+0000 114ab700 -1 osd.2 188 build_incremental_map_msg missing incremental map 188 2019-11-29T20:45:19.034 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:45:19.030+0000 1694c700 -1 osd.4 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.450723+0000 front 2019-11-29T20:44:36.457873+0000 (oldest deadline 2019-11-29T20:45:18.695322+0000) 2019-11-29T20:45:19.973 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:45:19.968+0000 1694c700 -1 osd.6 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:35.778052+0000 front 2019-11-29T20:44:35.817466+0000 (oldest deadline 2019-11-29T20:45:19.185242+0000) 2019-11-29T20:45:20.056 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:45:20.050+0000 1694c700 -1 osd.4 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.450723+0000 front 2019-11-29T20:44:36.457873+0000 (oldest deadline 2019-11-29T20:45:18.695322+0000) 2019-11-29T20:45:20.089 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:45:20.085+0000 1694c700 -1 osd.7 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:33.950141+0000 front 2019-11-29T20:44:34.467063+0000 (oldest deadline 2019-11-29T20:45:19.220255+0000) 2019-11-29T20:45:20.241 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:45:20.235+0000 1694c700 -1 osd.1 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.396901+0000 front 2019-11-29T20:44:36.396307+0000 (oldest deadline 2019-11-29T20:45:20.128156+0000) 2019-11-29T20:45:21.026 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:45:21.021+0000 1694c700 -1 osd.6 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:35.778052+0000 front 2019-11-29T20:44:35.817466+0000 (oldest deadline 2019-11-29T20:45:19.185242+0000) 2019-11-29T20:45:21.072 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:45:21.063+0000 1694c700 -1 osd.4 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.450723+0000 front 2019-11-29T20:44:36.457873+0000 (oldest deadline 2019-11-29T20:45:18.695322+0000) 2019-11-29T20:45:21.105 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:45:21.098+0000 1694c700 -1 osd.7 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:33.950141+0000 front 2019-11-29T20:44:34.467063+0000 (oldest deadline 2019-11-29T20:45:19.220255+0000) 2019-11-29T20:45:21.249 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:45:21.243+0000 1694c700 -1 osd.2 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.942148+0000 front 2019-11-29T20:44:36.484240+0000 (oldest deadline 2019-11-29T20:45:21.005883+0000) 2019-11-29T20:45:21.280 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:45:21.275+0000 1694c700 -1 osd.1 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.396901+0000 front 2019-11-29T20:44:36.396307+0000 (oldest deadline 2019-11-29T20:45:20.128156+0000) 2019-11-29T20:45:22.055 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:45:22.050+0000 1694c700 -1 osd.6 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:35.778052+0000 front 2019-11-29T20:44:35.817466+0000 (oldest deadline 2019-11-29T20:45:19.185242+0000) 2019-11-29T20:45:22.108 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:45:22.103+0000 1694c700 -1 osd.4 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.450723+0000 front 2019-11-29T20:44:36.457873+0000 (oldest deadline 2019-11-29T20:45:18.695322+0000) 2019-11-29T20:45:22.124 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:45:22.119+0000 1694c700 -1 osd.7 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:33.950141+0000 front 2019-11-29T20:44:34.467063+0000 (oldest deadline 2019-11-29T20:45:19.220255+0000) 2019-11-29T20:45:22.265 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:45:22.253+0000 1694c700 -1 osd.1 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.396901+0000 front 2019-11-29T20:44:36.396307+0000 (oldest deadline 2019-11-29T20:45:20.128156+0000) 2019-11-29T20:45:22.283 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:45:22.278+0000 1694c700 -1 osd.2 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.942148+0000 front 2019-11-29T20:44:36.484240+0000 (oldest deadline 2019-11-29T20:45:21.005883+0000) 2019-11-29T20:45:23.033 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:45:23.027+0000 1694c700 -1 osd.0 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.781910+0000 front 2019-11-29T20:44:37.190498+0000 (oldest deadline 2019-11-29T20:45:22.065697+0000) 2019-11-29T20:45:23.042 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:45:23.037+0000 1694c700 -1 osd.6 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:35.778052+0000 front 2019-11-29T20:44:35.817466+0000 (oldest deadline 2019-11-29T20:45:19.185242+0000) 2019-11-29T20:45:23.136 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:45:23.130+0000 1694c700 -1 osd.4 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.450723+0000 front 2019-11-29T20:44:36.457873+0000 (oldest deadline 2019-11-29T20:45:18.695322+0000) 2019-11-29T20:45:23.137 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:45:23.132+0000 1694c700 -1 osd.7 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:33.950141+0000 front 2019-11-29T20:44:34.467063+0000 (oldest deadline 2019-11-29T20:45:19.220255+0000) 2019-11-29T20:45:23.249 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:45:23.244+0000 1694c700 -1 osd.2 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.942148+0000 front 2019-11-29T20:44:36.484240+0000 (oldest deadline 2019-11-29T20:45:21.005883+0000) 2019-11-29T20:45:23.280 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:45:23.275+0000 1694c700 -1 osd.1 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.396901+0000 front 2019-11-29T20:44:36.396307+0000 (oldest deadline 2019-11-29T20:45:20.128156+0000) 2019-11-29T20:45:24.013 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:45:24.005+0000 1694c700 -1 osd.0 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.781910+0000 front 2019-11-29T20:44:37.190498+0000 (oldest deadline 2019-11-29T20:45:22.065697+0000) 2019-11-29T20:45:24.060 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:45:24.055+0000 1694c700 -1 osd.6 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:35.778052+0000 front 2019-11-29T20:44:35.817466+0000 (oldest deadline 2019-11-29T20:45:19.185242+0000) 2019-11-29T20:45:24.097 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:45:24.091+0000 1694c700 -1 osd.4 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.450723+0000 front 2019-11-29T20:44:36.457873+0000 (oldest deadline 2019-11-29T20:45:18.695322+0000) 2019-11-29T20:45:24.114 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:45:24.109+0000 1694c700 -1 osd.7 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:33.950141+0000 front 2019-11-29T20:44:34.467063+0000 (oldest deadline 2019-11-29T20:45:19.220255+0000) 2019-11-29T20:45:24.213 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:45:24.207+0000 1694c700 -1 osd.2 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.942148+0000 front 2019-11-29T20:44:36.484240+0000 (oldest deadline 2019-11-29T20:45:21.005883+0000) 2019-11-29T20:45:24.318 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:45:24.312+0000 1694c700 -1 osd.1 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.396901+0000 front 2019-11-29T20:44:36.396307+0000 (oldest deadline 2019-11-29T20:45:20.128156+0000) 2019-11-29T20:45:25.045 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:45:25.040+0000 1694c700 -1 osd.0 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.781910+0000 front 2019-11-29T20:44:37.190498+0000 (oldest deadline 2019-11-29T20:45:22.065697+0000) 2019-11-29T20:45:25.066 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:45:25.061+0000 1694c700 -1 osd.6 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:35.778052+0000 front 2019-11-29T20:44:35.817466+0000 (oldest deadline 2019-11-29T20:45:19.185242+0000) 2019-11-29T20:45:25.099 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:45:25.092+0000 1694c700 -1 osd.4 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.450723+0000 front 2019-11-29T20:44:36.457873+0000 (oldest deadline 2019-11-29T20:45:18.695322+0000) 2019-11-29T20:45:25.130 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:45:25.125+0000 1694c700 -1 osd.7 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:33.950141+0000 front 2019-11-29T20:44:34.467063+0000 (oldest deadline 2019-11-29T20:45:19.220255+0000) 2019-11-29T20:45:25.220 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:45:25.214+0000 1694c700 -1 osd.2 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.942148+0000 front 2019-11-29T20:44:36.484240+0000 (oldest deadline 2019-11-29T20:45:21.005883+0000) 2019-11-29T20:45:25.337 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:45:25.331+0000 1694c700 -1 osd.1 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.396901+0000 front 2019-11-29T20:44:36.396307+0000 (oldest deadline 2019-11-29T20:45:20.128156+0000) 2019-11-29T20:45:26.027 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:45:26.022+0000 1694c700 -1 osd.0 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.781910+0000 front 2019-11-29T20:44:37.190498+0000 (oldest deadline 2019-11-29T20:45:22.065697+0000) 2019-11-29T20:45:26.059 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:45:26.054+0000 1694c700 -1 osd.6 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:35.778052+0000 front 2019-11-29T20:44:35.817466+0000 (oldest deadline 2019-11-29T20:45:19.185242+0000) 2019-11-29T20:45:26.111 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:45:26.106+0000 1694c700 -1 osd.4 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.450723+0000 front 2019-11-29T20:44:36.457873+0000 (oldest deadline 2019-11-29T20:45:18.695322+0000) 2019-11-29T20:45:26.124 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:45:26.115+0000 1694c700 -1 osd.7 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:33.950141+0000 front 2019-11-29T20:44:34.467063+0000 (oldest deadline 2019-11-29T20:45:19.220255+0000) 2019-11-29T20:45:26.191 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:45:26.184+0000 1694c700 -1 osd.2 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.942148+0000 front 2019-11-29T20:44:36.484240+0000 (oldest deadline 2019-11-29T20:45:21.005883+0000) 2019-11-29T20:45:26.318 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:45:26.312+0000 1694c700 -1 osd.1 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.396901+0000 front 2019-11-29T20:44:36.396307+0000 (oldest deadline 2019-11-29T20:45:20.128156+0000) 2019-11-29T20:45:27.000 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:45:26.996+0000 1694c700 -1 osd.0 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.781910+0000 front 2019-11-29T20:44:37.190498+0000 (oldest deadline 2019-11-29T20:45:22.065697+0000) 2019-11-29T20:45:27.093 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:45:27.088+0000 1694c700 -1 osd.6 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:35.778052+0000 front 2019-11-29T20:44:35.817466+0000 (oldest deadline 2019-11-29T20:45:19.185242+0000) 2019-11-29T20:45:27.100 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:45:27.094+0000 1694c700 -1 osd.7 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:33.950141+0000 front 2019-11-29T20:44:34.467063+0000 (oldest deadline 2019-11-29T20:45:19.220255+0000) 2019-11-29T20:45:27.102 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:45:27.098+0000 1694c700 -1 osd.4 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.450723+0000 front 2019-11-29T20:44:36.457873+0000 (oldest deadline 2019-11-29T20:45:18.695322+0000) 2019-11-29T20:45:27.232 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:45:27.226+0000 1694c700 -1 osd.2 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.942148+0000 front 2019-11-29T20:44:36.484240+0000 (oldest deadline 2019-11-29T20:45:21.005883+0000) 2019-11-29T20:45:27.340 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:45:27.336+0000 1694c700 -1 osd.1 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.396901+0000 front 2019-11-29T20:44:36.396307+0000 (oldest deadline 2019-11-29T20:45:20.128156+0000) 2019-11-29T20:45:28.006 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:45:28.000+0000 1694c700 -1 osd.0 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.781910+0000 front 2019-11-29T20:44:37.190498+0000 (oldest deadline 2019-11-29T20:45:22.065697+0000) 2019-11-29T20:45:28.100 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:45:28.094+0000 1694c700 -1 osd.6 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:35.778052+0000 front 2019-11-29T20:44:35.817466+0000 (oldest deadline 2019-11-29T20:45:19.185242+0000) 2019-11-29T20:45:28.100 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:45:28.095+0000 1694c700 -1 osd.4 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.450723+0000 front 2019-11-29T20:44:36.457873+0000 (oldest deadline 2019-11-29T20:45:18.695322+0000) 2019-11-29T20:45:28.123 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:45:28.118+0000 1694c700 -1 osd.7 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:33.950141+0000 front 2019-11-29T20:44:34.467063+0000 (oldest deadline 2019-11-29T20:45:19.220255+0000) 2019-11-29T20:45:28.221 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:45:28.215+0000 1694c700 -1 osd.2 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.942148+0000 front 2019-11-29T20:44:36.484240+0000 (oldest deadline 2019-11-29T20:45:21.005883+0000) 2019-11-29T20:45:28.350 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:45:28.342+0000 1694c700 -1 osd.1 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.396901+0000 front 2019-11-29T20:44:36.396307+0000 (oldest deadline 2019-11-29T20:45:20.128156+0000) 2019-11-29T20:45:28.454 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:45:28.449+0000 1694c700 -1 osd.3 190 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:118930 7.5 7.2bcddf15 (undecoded) ondisk+retry+read+known_if_redirected e188) 2019-11-29T20:45:29.043 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:45:29.038+0000 1694c700 -1 osd.0 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.781910+0000 front 2019-11-29T20:44:37.190498+0000 (oldest deadline 2019-11-29T20:45:22.065697+0000) 2019-11-29T20:45:29.076 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:45:29.071+0000 1694c700 -1 osd.6 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:35.778052+0000 front 2019-11-29T20:44:35.817466+0000 (oldest deadline 2019-11-29T20:45:19.185242+0000) 2019-11-29T20:45:29.126 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:45:29.121+0000 1694c700 -1 osd.4 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.450723+0000 front 2019-11-29T20:44:36.457873+0000 (oldest deadline 2019-11-29T20:45:18.695322+0000) 2019-11-29T20:45:29.160 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:45:29.154+0000 1694c700 -1 osd.7 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:33.950141+0000 front 2019-11-29T20:44:34.467063+0000 (oldest deadline 2019-11-29T20:45:19.220255+0000) 2019-11-29T20:45:29.248 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:45:29.243+0000 1694c700 -1 osd.2 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.942148+0000 front 2019-11-29T20:44:36.484240+0000 (oldest deadline 2019-11-29T20:45:21.005883+0000) 2019-11-29T20:45:29.321 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:45:29.316+0000 1694c700 -1 osd.1 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.396901+0000 front 2019-11-29T20:44:36.396307+0000 (oldest deadline 2019-11-29T20:45:20.128156+0000) 2019-11-29T20:45:29.503 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:45:29.498+0000 1694c700 -1 osd.3 190 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4325.0:118930 7.5 7.2bcddf15 (undecoded) ondisk+retry+read+known_if_redirected e188) 2019-11-29T20:45:30.001 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:45:29.995+0000 1694c700 -1 osd.0 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.781910+0000 front 2019-11-29T20:44:37.190498+0000 (oldest deadline 2019-11-29T20:45:22.065697+0000) 2019-11-29T20:45:30.073 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:45:30.068+0000 1694c700 -1 osd.6 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:35.778052+0000 front 2019-11-29T20:44:35.817466+0000 (oldest deadline 2019-11-29T20:45:19.185242+0000) 2019-11-29T20:45:30.145 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:45:30.139+0000 1694c700 -1 osd.4 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.450723+0000 front 2019-11-29T20:44:36.457873+0000 (oldest deadline 2019-11-29T20:45:18.695322+0000) 2019-11-29T20:45:30.158 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:45:30.153+0000 1694c700 -1 osd.7 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:33.950141+0000 front 2019-11-29T20:44:34.467063+0000 (oldest deadline 2019-11-29T20:45:19.220255+0000) 2019-11-29T20:45:30.210 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:45:30.204+0000 1694c700 -1 osd.2 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.942148+0000 front 2019-11-29T20:44:36.484240+0000 (oldest deadline 2019-11-29T20:45:21.005883+0000) 2019-11-29T20:45:30.299 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:45:30.293+0000 1694c700 -1 osd.1 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.396901+0000 front 2019-11-29T20:44:36.396307+0000 (oldest deadline 2019-11-29T20:45:20.128156+0000) 2019-11-29T20:45:30.499 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:45:30.484+0000 1694c700 -1 osd.3 190 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4325.0:118930 7.5 7.2bcddf15 (undecoded) ondisk+retry+read+known_if_redirected e188) 2019-11-29T20:45:31.033 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:45:31.027+0000 1694c700 -1 osd.0 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.781910+0000 front 2019-11-29T20:44:37.190498+0000 (oldest deadline 2019-11-29T20:45:22.065697+0000) 2019-11-29T20:45:31.099 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:45:31.094+0000 1694c700 -1 osd.4 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.450723+0000 front 2019-11-29T20:44:36.457873+0000 (oldest deadline 2019-11-29T20:45:18.695322+0000) 2019-11-29T20:45:31.114 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:45:31.108+0000 1694c700 -1 osd.6 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:35.778052+0000 front 2019-11-29T20:44:35.817466+0000 (oldest deadline 2019-11-29T20:45:19.185242+0000) 2019-11-29T20:45:31.142 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:45:31.137+0000 1694c700 -1 osd.7 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:33.950141+0000 front 2019-11-29T20:44:34.467063+0000 (oldest deadline 2019-11-29T20:45:19.220255+0000) 2019-11-29T20:45:31.256 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:45:31.251+0000 1694c700 -1 osd.2 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.942148+0000 front 2019-11-29T20:44:36.484240+0000 (oldest deadline 2019-11-29T20:45:21.005883+0000) 2019-11-29T20:45:31.259 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:45:31.253+0000 1694c700 -1 osd.1 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.396901+0000 front 2019-11-29T20:44:36.396307+0000 (oldest deadline 2019-11-29T20:45:20.128156+0000) 2019-11-29T20:45:31.496 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:45:31.486+0000 1694c700 -1 osd.3 190 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4325.0:118930 7.5 7.2bcddf15 (undecoded) ondisk+retry+read+known_if_redirected e188) 2019-11-29T20:45:32.012 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:45:32.006+0000 1694c700 -1 osd.0 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.781910+0000 front 2019-11-29T20:44:37.190498+0000 (oldest deadline 2019-11-29T20:45:22.065697+0000) 2019-11-29T20:45:32.076 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:45:32.068+0000 1694c700 -1 osd.4 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.450723+0000 front 2019-11-29T20:44:36.457873+0000 (oldest deadline 2019-11-29T20:45:18.695322+0000) 2019-11-29T20:45:32.122 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:45:32.117+0000 1694c700 -1 osd.7 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:33.950141+0000 front 2019-11-29T20:44:34.467063+0000 (oldest deadline 2019-11-29T20:45:19.220255+0000) 2019-11-29T20:45:32.132 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:45:32.127+0000 1694c700 -1 osd.6 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:35.778052+0000 front 2019-11-29T20:44:35.817466+0000 (oldest deadline 2019-11-29T20:45:19.185242+0000) 2019-11-29T20:45:32.221 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:45:32.216+0000 1694c700 -1 osd.1 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.396901+0000 front 2019-11-29T20:44:36.396307+0000 (oldest deadline 2019-11-29T20:45:20.128156+0000) 2019-11-29T20:45:32.224 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:45:32.217+0000 1694c700 -1 osd.2 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.942148+0000 front 2019-11-29T20:44:36.484240+0000 (oldest deadline 2019-11-29T20:45:21.005883+0000) 2019-11-29T20:45:32.448 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:45:32.444+0000 1694c700 -1 osd.3 190 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4325.0:118930 7.5 7.2bcddf15 (undecoded) ondisk+retry+read+known_if_redirected e188) 2019-11-29T20:45:33.021 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:45:33.015+0000 1694c700 -1 osd.0 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.781910+0000 front 2019-11-29T20:44:37.190498+0000 (oldest deadline 2019-11-29T20:45:22.065697+0000) 2019-11-29T20:45:33.084 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:45:33.078+0000 1694c700 -1 osd.4 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.450723+0000 front 2019-11-29T20:44:36.457873+0000 (oldest deadline 2019-11-29T20:45:18.695322+0000) 2019-11-29T20:45:33.101 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:45:33.096+0000 1694c700 -1 osd.6 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:35.778052+0000 front 2019-11-29T20:44:35.817466+0000 (oldest deadline 2019-11-29T20:45:19.185242+0000) 2019-11-29T20:45:33.136 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:45:33.131+0000 1694c700 -1 osd.7 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:33.950141+0000 front 2019-11-29T20:44:34.467063+0000 (oldest deadline 2019-11-29T20:45:19.220255+0000) 2019-11-29T20:45:33.210 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:45:33.205+0000 1694c700 -1 osd.1 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.396901+0000 front 2019-11-29T20:44:36.396307+0000 (oldest deadline 2019-11-29T20:45:20.128156+0000) 2019-11-29T20:45:33.250 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:45:33.245+0000 1694c700 -1 osd.2 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.942148+0000 front 2019-11-29T20:44:36.484240+0000 (oldest deadline 2019-11-29T20:45:21.005883+0000) 2019-11-29T20:45:33.503 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:45:33.498+0000 1694c700 -1 osd.3 190 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4325.0:118930 7.5 7.2bcddf15 (undecoded) ondisk+retry+read+known_if_redirected e188) 2019-11-29T20:45:33.977 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:45:33.971+0000 1694c700 -1 osd.0 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.781910+0000 front 2019-11-29T20:44:37.190498+0000 (oldest deadline 2019-11-29T20:45:22.065697+0000) 2019-11-29T20:45:34.102 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:45:34.097+0000 1694c700 -1 osd.7 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:33.950141+0000 front 2019-11-29T20:44:34.467063+0000 (oldest deadline 2019-11-29T20:45:19.220255+0000) 2019-11-29T20:45:34.115 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:45:34.110+0000 1694c700 -1 osd.6 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:35.778052+0000 front 2019-11-29T20:44:35.817466+0000 (oldest deadline 2019-11-29T20:45:19.185242+0000) 2019-11-29T20:45:34.133 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:45:34.129+0000 1694c700 -1 osd.4 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.450723+0000 front 2019-11-29T20:44:36.457873+0000 (oldest deadline 2019-11-29T20:45:18.695322+0000) 2019-11-29T20:45:34.229 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:45:34.224+0000 1694c700 -1 osd.1 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.396901+0000 front 2019-11-29T20:44:36.396307+0000 (oldest deadline 2019-11-29T20:45:20.128156+0000) 2019-11-29T20:45:34.264 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:45:34.259+0000 1694c700 -1 osd.2 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.942148+0000 front 2019-11-29T20:44:36.484240+0000 (oldest deadline 2019-11-29T20:45:21.005883+0000) 2019-11-29T20:45:34.506 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:45:34.502+0000 1694c700 -1 osd.3 190 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4325.0:118930 7.5 7.2bcddf15 (undecoded) ondisk+retry+read+known_if_redirected e188) 2019-11-29T20:45:34.998 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:45:34.992+0000 1694c700 -1 osd.0 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.781910+0000 front 2019-11-29T20:44:37.190498+0000 (oldest deadline 2019-11-29T20:45:22.065697+0000) 2019-11-29T20:45:35.090 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:45:35.084+0000 1694c700 -1 osd.7 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:33.950141+0000 front 2019-11-29T20:44:34.467063+0000 (oldest deadline 2019-11-29T20:45:19.220255+0000) 2019-11-29T20:45:35.111 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:45:35.105+0000 1694c700 -1 osd.4 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.450723+0000 front 2019-11-29T20:44:36.457873+0000 (oldest deadline 2019-11-29T20:45:18.695322+0000) 2019-11-29T20:45:35.155 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:45:35.150+0000 1694c700 -1 osd.6 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:35.778052+0000 front 2019-11-29T20:44:35.817466+0000 (oldest deadline 2019-11-29T20:45:19.185242+0000) 2019-11-29T20:45:35.267 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:45:35.261+0000 1694c700 -1 osd.1 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.396901+0000 front 2019-11-29T20:44:36.396307+0000 (oldest deadline 2019-11-29T20:45:20.128156+0000) 2019-11-29T20:45:35.275 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:45:35.269+0000 1694c700 -1 osd.2 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.942148+0000 front 2019-11-29T20:44:36.484240+0000 (oldest deadline 2019-11-29T20:45:21.005883+0000) 2019-11-29T20:45:35.561 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:45:35.555+0000 1694c700 -1 osd.3 190 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4325.0:118930 7.5 7.2bcddf15 (undecoded) ondisk+retry+read+known_if_redirected e188) 2019-11-29T20:45:35.973 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:45:35.969+0000 1694c700 -1 osd.0 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.781910+0000 front 2019-11-29T20:44:37.190498+0000 (oldest deadline 2019-11-29T20:45:22.065697+0000) 2019-11-29T20:45:36.056 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:45:36.051+0000 1694c700 -1 osd.7 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:33.950141+0000 front 2019-11-29T20:44:34.467063+0000 (oldest deadline 2019-11-29T20:45:19.220255+0000) 2019-11-29T20:45:36.103 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:45:36.097+0000 1694c700 -1 osd.4 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.450723+0000 front 2019-11-29T20:44:36.457873+0000 (oldest deadline 2019-11-29T20:45:18.695322+0000) 2019-11-29T20:45:36.150 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:45:36.146+0000 1694c700 -1 osd.6 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:35.778052+0000 front 2019-11-29T20:44:35.817466+0000 (oldest deadline 2019-11-29T20:45:19.185242+0000) 2019-11-29T20:45:36.262 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:45:36.256+0000 1694c700 -1 osd.1 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.396901+0000 front 2019-11-29T20:44:36.396307+0000 (oldest deadline 2019-11-29T20:45:20.128156+0000) 2019-11-29T20:45:36.322 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:45:36.317+0000 1694c700 -1 osd.2 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.942148+0000 front 2019-11-29T20:44:36.484240+0000 (oldest deadline 2019-11-29T20:45:21.005883+0000) 2019-11-29T20:45:36.343 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:08:20:17.001 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T20:45:36.357 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:08:20:17.016 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T20:45:36.365 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:08:20:16.972 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T20:45:36.369 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:08:20:16.976 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T20:45:36.370 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:08:20:16.977 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T20:45:36.380 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:08:20:16.987 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T20:45:36.559 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:45:36.554+0000 1694c700 -1 osd.3 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:44:55.557837+0000 (oldest deadline 2019-11-29T20:45:35.557837+0000) 2019-11-29T20:45:36.559 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:45:36.555+0000 1694c700 -1 osd.3 190 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4325.0:118930 7.5 7.2bcddf15 (undecoded) ondisk+retry+read+known_if_redirected e188) 2019-11-29T20:45:36.672 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:08:20:17.279 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T20:45:36.677 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:08:20:17.336 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T20:45:36.691 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:08:20:17.298 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T20:45:36.951 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:45:36.946+0000 1694c700 -1 osd.0 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.781910+0000 front 2019-11-29T20:44:37.190498+0000 (oldest deadline 2019-11-29T20:45:22.065697+0000) 2019-11-29T20:45:37.098 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:45:37.094+0000 1694c700 -1 osd.7 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:33.950141+0000 front 2019-11-29T20:44:34.467063+0000 (oldest deadline 2019-11-29T20:45:19.220255+0000) 2019-11-29T20:45:37.138 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:45:37.134+0000 1694c700 -1 osd.6 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:35.778052+0000 front 2019-11-29T20:44:35.817466+0000 (oldest deadline 2019-11-29T20:45:19.185242+0000) 2019-11-29T20:45:37.154 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:45:37.150+0000 1694c700 -1 osd.4 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.450723+0000 front 2019-11-29T20:44:36.457873+0000 (oldest deadline 2019-11-29T20:45:18.695322+0000) 2019-11-29T20:45:37.283 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:45:37.278+0000 1694c700 -1 osd.2 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.942148+0000 front 2019-11-29T20:44:36.484240+0000 (oldest deadline 2019-11-29T20:45:21.005883+0000) 2019-11-29T20:45:37.294 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:45:37.290+0000 1694c700 -1 osd.1 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.396901+0000 front 2019-11-29T20:44:36.396307+0000 (oldest deadline 2019-11-29T20:45:20.128156+0000) 2019-11-29T20:45:37.522 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:45:37.518+0000 1694c700 -1 osd.3 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:44:55.557837+0000 (oldest deadline 2019-11-29T20:45:35.557837+0000) 2019-11-29T20:45:37.524 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:45:37.520+0000 1694c700 -1 osd.3 190 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4325.0:118930 7.5 7.2bcddf15 (undecoded) ondisk+retry+read+known_if_redirected e188) 2019-11-29T20:45:37.996 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:45:37.991+0000 1694c700 -1 osd.0 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.781910+0000 front 2019-11-29T20:44:37.190498+0000 (oldest deadline 2019-11-29T20:45:22.065697+0000) 2019-11-29T20:45:38.089 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:45:38.085+0000 1694c700 -1 osd.7 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:33.950141+0000 front 2019-11-29T20:44:34.467063+0000 (oldest deadline 2019-11-29T20:45:19.220255+0000) 2019-11-29T20:45:38.139 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:45:38.134+0000 1694c700 -1 osd.4 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.450723+0000 front 2019-11-29T20:44:36.457873+0000 (oldest deadline 2019-11-29T20:45:18.695322+0000) 2019-11-29T20:45:38.185 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:45:38.179+0000 1694c700 -1 osd.6 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:35.778052+0000 front 2019-11-29T20:44:35.817466+0000 (oldest deadline 2019-11-29T20:45:19.185242+0000) 2019-11-29T20:45:38.281 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:45:38.276+0000 1694c700 -1 osd.1 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.396901+0000 front 2019-11-29T20:44:36.396307+0000 (oldest deadline 2019-11-29T20:45:20.128156+0000) 2019-11-29T20:45:38.306 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:45:38.302+0000 1694c700 -1 osd.2 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.942148+0000 front 2019-11-29T20:44:36.484240+0000 (oldest deadline 2019-11-29T20:45:21.005883+0000) 2019-11-29T20:45:38.564 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:45:38.558+0000 1694c700 -1 osd.3 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:44:55.557837+0000 (oldest deadline 2019-11-29T20:45:35.557837+0000) 2019-11-29T20:45:38.568 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:45:38.564+0000 1694c700 -1 osd.3 190 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4325.0:118930 7.5 7.2bcddf15 (undecoded) ondisk+retry+read+known_if_redirected e188) 2019-11-29T20:45:38.977 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:45:38.971+0000 1694c700 -1 osd.0 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.781910+0000 front 2019-11-29T20:44:37.190498+0000 (oldest deadline 2019-11-29T20:45:22.065697+0000) 2019-11-29T20:45:39.103 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:45:39.097+0000 1694c700 -1 osd.7 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:33.950141+0000 front 2019-11-29T20:44:34.467063+0000 (oldest deadline 2019-11-29T20:45:19.220255+0000) 2019-11-29T20:45:39.122 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:45:39.118+0000 1694c700 -1 osd.4 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.450723+0000 front 2019-11-29T20:44:36.457873+0000 (oldest deadline 2019-11-29T20:45:18.695322+0000) 2019-11-29T20:45:39.193 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:45:39.186+0000 1694c700 -1 osd.6 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:35.778052+0000 front 2019-11-29T20:44:35.817466+0000 (oldest deadline 2019-11-29T20:45:19.185242+0000) 2019-11-29T20:45:39.253 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:45:39.249+0000 1694c700 -1 osd.1 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.396901+0000 front 2019-11-29T20:44:36.396307+0000 (oldest deadline 2019-11-29T20:45:20.128156+0000) 2019-11-29T20:45:39.296 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:45:39.292+0000 1694c700 -1 osd.2 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.942148+0000 front 2019-11-29T20:44:36.484240+0000 (oldest deadline 2019-11-29T20:45:21.005883+0000) 2019-11-29T20:45:39.549 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:45:39.544+0000 1694c700 -1 osd.3 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:44:55.557837+0000 (oldest deadline 2019-11-29T20:45:35.557837+0000) 2019-11-29T20:45:39.550 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:45:39.545+0000 1694c700 -1 osd.3 190 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4325.0:118930 7.5 7.2bcddf15 (undecoded) ondisk+retry+read+known_if_redirected e188) 2019-11-29T20:45:39.963 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:45:39.957+0000 1694c700 -1 osd.0 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.781910+0000 front 2019-11-29T20:44:37.190498+0000 (oldest deadline 2019-11-29T20:45:22.065697+0000) 2019-11-29T20:45:40.058 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:45:40.053+0000 1694c700 -1 osd.7 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:33.950141+0000 front 2019-11-29T20:44:34.467063+0000 (oldest deadline 2019-11-29T20:45:19.220255+0000) 2019-11-29T20:45:40.113 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:45:40.106+0000 1694c700 -1 osd.4 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.450723+0000 front 2019-11-29T20:44:36.457873+0000 (oldest deadline 2019-11-29T20:45:18.695322+0000) 2019-11-29T20:45:40.197 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:45:40.192+0000 1694c700 -1 osd.6 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:35.778052+0000 front 2019-11-29T20:44:35.817466+0000 (oldest deadline 2019-11-29T20:45:19.185242+0000) 2019-11-29T20:45:40.274 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:45:40.268+0000 1694c700 -1 osd.2 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.942148+0000 front 2019-11-29T20:44:36.484240+0000 (oldest deadline 2019-11-29T20:45:21.005883+0000) 2019-11-29T20:45:40.296 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:45:40.290+0000 1694c700 -1 osd.1 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.396901+0000 front 2019-11-29T20:44:36.396307+0000 (oldest deadline 2019-11-29T20:45:20.128156+0000) 2019-11-29T20:45:40.598 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:45:40.593+0000 1694c700 -1 osd.3 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:44:55.557837+0000 (oldest deadline 2019-11-29T20:45:35.557837+0000) 2019-11-29T20:45:40.598 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:45:40.594+0000 1694c700 -1 osd.3 190 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4325.0:118930 7.5 7.2bcddf15 (undecoded) ondisk+retry+read+known_if_redirected e188) 2019-11-29T20:45:40.952 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:45:40.946+0000 1694c700 -1 osd.0 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.781910+0000 front 2019-11-29T20:44:37.190498+0000 (oldest deadline 2019-11-29T20:45:22.065697+0000) 2019-11-29T20:45:41.069 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:45:41.064+0000 1694c700 -1 osd.7 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:33.950141+0000 front 2019-11-29T20:44:34.467063+0000 (oldest deadline 2019-11-29T20:45:19.220255+0000) 2019-11-29T20:45:41.142 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:45:41.137+0000 1694c700 -1 osd.4 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.450723+0000 front 2019-11-29T20:44:36.457873+0000 (oldest deadline 2019-11-29T20:45:18.695322+0000) 2019-11-29T20:45:41.215 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:45:41.209+0000 1694c700 -1 osd.6 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:35.778052+0000 front 2019-11-29T20:44:35.817466+0000 (oldest deadline 2019-11-29T20:45:19.185242+0000) 2019-11-29T20:45:41.310 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:45:41.305+0000 1694c700 -1 osd.1 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.396901+0000 front 2019-11-29T20:44:36.396307+0000 (oldest deadline 2019-11-29T20:45:20.128156+0000) 2019-11-29T20:45:41.314 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:45:41.309+0000 1694c700 -1 osd.2 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.942148+0000 front 2019-11-29T20:44:36.484240+0000 (oldest deadline 2019-11-29T20:45:21.005883+0000) 2019-11-29T20:45:41.629 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:45:41.623+0000 1694c700 -1 osd.3 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:44:55.557837+0000 (oldest deadline 2019-11-29T20:45:35.557837+0000) 2019-11-29T20:45:41.629 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:45:41.625+0000 1694c700 -1 osd.3 190 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4325.0:118930 7.5 7.2bcddf15 (undecoded) ondisk+retry+read+known_if_redirected e188) 2019-11-29T20:45:41.947 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:45:41.940+0000 1694c700 -1 osd.0 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.781910+0000 front 2019-11-29T20:44:37.190498+0000 (oldest deadline 2019-11-29T20:45:22.065697+0000) 2019-11-29T20:45:42.106 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:45:42.100+0000 1694c700 -1 osd.7 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:33.950141+0000 front 2019-11-29T20:44:34.467063+0000 (oldest deadline 2019-11-29T20:45:19.220255+0000) 2019-11-29T20:45:42.182 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:45:42.175+0000 1694c700 -1 osd.4 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.450723+0000 front 2019-11-29T20:44:36.457873+0000 (oldest deadline 2019-11-29T20:45:18.695322+0000) 2019-11-29T20:45:42.233 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:45:42.227+0000 1694c700 -1 osd.6 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:35.778052+0000 front 2019-11-29T20:44:35.817466+0000 (oldest deadline 2019-11-29T20:45:19.185242+0000) 2019-11-29T20:45:42.306 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:45:42.300+0000 1694c700 -1 osd.1 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.396901+0000 front 2019-11-29T20:44:36.396307+0000 (oldest deadline 2019-11-29T20:45:20.128156+0000) 2019-11-29T20:45:42.325 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:45:42.319+0000 1694c700 -1 osd.2 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.942148+0000 front 2019-11-29T20:44:36.484240+0000 (oldest deadline 2019-11-29T20:45:21.005883+0000) 2019-11-29T20:45:42.624 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:45:42.619+0000 1694c700 -1 osd.3 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:44:55.557837+0000 (oldest deadline 2019-11-29T20:45:35.557837+0000) 2019-11-29T20:45:42.624 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:45:42.620+0000 1694c700 -1 osd.3 190 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4325.0:118930 7.5 7.2bcddf15 (undecoded) ondisk+retry+read+known_if_redirected e188) 2019-11-29T20:45:42.941 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:45:42.936+0000 1694c700 -1 osd.0 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.781910+0000 front 2019-11-29T20:44:37.190498+0000 (oldest deadline 2019-11-29T20:45:22.065697+0000) 2019-11-29T20:45:43.097 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:45:43.092+0000 1694c700 -1 osd.7 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:33.950141+0000 front 2019-11-29T20:44:34.467063+0000 (oldest deadline 2019-11-29T20:45:19.220255+0000) 2019-11-29T20:45:43.180 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:45:43.172+0000 1694c700 -1 osd.4 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.450723+0000 front 2019-11-29T20:44:36.457873+0000 (oldest deadline 2019-11-29T20:45:18.695322+0000) 2019-11-29T20:45:43.286 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:45:43.281+0000 1694c700 -1 osd.6 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:35.778052+0000 front 2019-11-29T20:44:35.817466+0000 (oldest deadline 2019-11-29T20:45:19.185242+0000) 2019-11-29T20:45:43.294 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:45:43.287+0000 1694c700 -1 osd.1 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.396901+0000 front 2019-11-29T20:44:36.396307+0000 (oldest deadline 2019-11-29T20:45:20.128156+0000) 2019-11-29T20:45:43.303 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:45:43.297+0000 1694c700 -1 osd.2 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.942148+0000 front 2019-11-29T20:44:36.484240+0000 (oldest deadline 2019-11-29T20:45:21.005883+0000) 2019-11-29T20:45:43.648 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:45:43.642+0000 1694c700 -1 osd.3 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:44:55.557837+0000 (oldest deadline 2019-11-29T20:45:35.557837+0000) 2019-11-29T20:45:43.650 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:45:43.644+0000 1694c700 -1 osd.3 190 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4325.0:118930 7.5 7.2bcddf15 (undecoded) ondisk+retry+read+known_if_redirected e188) 2019-11-29T20:45:43.935 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:45:43.928+0000 1694c700 -1 osd.0 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.781910+0000 front 2019-11-29T20:44:37.190498+0000 (oldest deadline 2019-11-29T20:45:22.065697+0000) 2019-11-29T20:45:44.111 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:45:44.105+0000 1694c700 -1 osd.7 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:33.950141+0000 front 2019-11-29T20:44:34.467063+0000 (oldest deadline 2019-11-29T20:45:19.220255+0000) 2019-11-29T20:45:44.134 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:45:44.129+0000 1694c700 -1 osd.4 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.450723+0000 front 2019-11-29T20:44:36.457873+0000 (oldest deadline 2019-11-29T20:45:18.695322+0000) 2019-11-29T20:45:44.301 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:45:44.295+0000 1694c700 -1 osd.6 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:35.778052+0000 front 2019-11-29T20:44:35.817466+0000 (oldest deadline 2019-11-29T20:45:19.185242+0000) 2019-11-29T20:45:44.331 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:45:44.325+0000 1694c700 -1 osd.2 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.942148+0000 front 2019-11-29T20:44:36.484240+0000 (oldest deadline 2019-11-29T20:45:21.005883+0000) 2019-11-29T20:45:44.340 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:45:44.336+0000 1694c700 -1 osd.1 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.396901+0000 front 2019-11-29T20:44:36.396307+0000 (oldest deadline 2019-11-29T20:45:20.128156+0000) 2019-11-29T20:45:44.632 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:45:44.627+0000 1694c700 -1 osd.3 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:44:55.557837+0000 (oldest deadline 2019-11-29T20:45:35.557837+0000) 2019-11-29T20:45:44.633 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:45:44.628+0000 1694c700 -1 osd.3 190 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4325.0:118930 7.5 7.2bcddf15 (undecoded) ondisk+retry+read+known_if_redirected e188) 2019-11-29T20:45:44.916 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:45:44.911+0000 1694c700 -1 osd.0 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.781910+0000 front 2019-11-29T20:44:37.190498+0000 (oldest deadline 2019-11-29T20:45:22.065697+0000) 2019-11-29T20:45:45.119 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:45:45.114+0000 1694c700 -1 osd.7 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:33.950141+0000 front 2019-11-29T20:44:34.467063+0000 (oldest deadline 2019-11-29T20:45:19.220255+0000) 2019-11-29T20:45:45.131 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:45:45.124+0000 1694c700 -1 osd.4 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.450723+0000 front 2019-11-29T20:44:36.457873+0000 (oldest deadline 2019-11-29T20:45:18.695322+0000) 2019-11-29T20:45:45.289 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:45:45.284+0000 1694c700 -1 osd.6 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:35.778052+0000 front 2019-11-29T20:44:35.817466+0000 (oldest deadline 2019-11-29T20:45:19.185242+0000) 2019-11-29T20:45:45.323 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:45:45.318+0000 1694c700 -1 osd.1 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.396901+0000 front 2019-11-29T20:44:36.396307+0000 (oldest deadline 2019-11-29T20:45:20.128156+0000) 2019-11-29T20:45:45.371 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:45:45.366+0000 1694c700 -1 osd.2 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.942148+0000 front 2019-11-29T20:44:36.484240+0000 (oldest deadline 2019-11-29T20:45:21.005883+0000) 2019-11-29T20:45:45.593 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:45:45.587+0000 1694c700 -1 osd.3 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:44:55.557837+0000 (oldest deadline 2019-11-29T20:45:35.557837+0000) 2019-11-29T20:45:45.594 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:45:45.589+0000 1694c700 -1 osd.3 190 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4325.0:118930 7.5 7.2bcddf15 (undecoded) ondisk+retry+read+known_if_redirected e188) 2019-11-29T20:45:45.938 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:45:45.932+0000 1694c700 -1 osd.0 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.781910+0000 front 2019-11-29T20:44:37.190498+0000 (oldest deadline 2019-11-29T20:45:22.065697+0000) 2019-11-29T20:45:46.085 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:45:46.079+0000 1694c700 -1 osd.4 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.450723+0000 front 2019-11-29T20:44:36.457873+0000 (oldest deadline 2019-11-29T20:45:18.695322+0000) 2019-11-29T20:45:46.140 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:45:46.135+0000 1694c700 -1 osd.7 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:33.950141+0000 front 2019-11-29T20:44:34.467063+0000 (oldest deadline 2019-11-29T20:45:19.220255+0000) 2019-11-29T20:45:46.296 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:45:46.291+0000 1694c700 -1 osd.6 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:35.778052+0000 front 2019-11-29T20:44:35.817466+0000 (oldest deadline 2019-11-29T20:45:19.185242+0000) 2019-11-29T20:45:46.349 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:45:46.344+0000 1694c700 -1 osd.1 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.396901+0000 front 2019-11-29T20:44:36.396307+0000 (oldest deadline 2019-11-29T20:45:20.128156+0000) 2019-11-29T20:45:46.364 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:45:46.358+0000 1694c700 -1 osd.2 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.942148+0000 front 2019-11-29T20:44:36.484240+0000 (oldest deadline 2019-11-29T20:45:21.005883+0000) 2019-11-29T20:45:46.580 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:45:46.574+0000 1694c700 -1 osd.3 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:44:55.557837+0000 (oldest deadline 2019-11-29T20:45:35.557837+0000) 2019-11-29T20:45:46.580 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:45:46.575+0000 1694c700 -1 osd.3 190 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4325.0:118930 7.5 7.2bcddf15 (undecoded) ondisk+retry+read+known_if_redirected e188) 2019-11-29T20:45:46.909 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:45:46.903+0000 1694c700 -1 osd.0 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.781910+0000 front 2019-11-29T20:44:37.190498+0000 (oldest deadline 2019-11-29T20:45:22.065697+0000) 2019-11-29T20:45:47.049 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:45:47.043+0000 1694c700 -1 osd.4 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.450723+0000 front 2019-11-29T20:44:36.457873+0000 (oldest deadline 2019-11-29T20:45:18.695322+0000) 2019-11-29T20:45:47.105 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:45:47.099+0000 1694c700 -1 osd.7 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:33.950141+0000 front 2019-11-29T20:44:34.467063+0000 (oldest deadline 2019-11-29T20:45:19.220255+0000) 2019-11-29T20:45:47.255 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:45:47.250+0000 1694c700 -1 osd.6 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:35.778052+0000 front 2019-11-29T20:44:35.817466+0000 (oldest deadline 2019-11-29T20:45:19.185242+0000) 2019-11-29T20:45:47.330 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:45:47.325+0000 1694c700 -1 osd.2 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.942148+0000 front 2019-11-29T20:44:36.484240+0000 (oldest deadline 2019-11-29T20:45:21.005883+0000) 2019-11-29T20:45:47.370 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:45:47.366+0000 1694c700 -1 osd.1 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.396901+0000 front 2019-11-29T20:44:36.396307+0000 (oldest deadline 2019-11-29T20:45:20.128156+0000) 2019-11-29T20:45:47.617 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:45:47.611+0000 1694c700 -1 osd.3 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:44:55.557837+0000 (oldest deadline 2019-11-29T20:45:35.557837+0000) 2019-11-29T20:45:47.618 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:45:47.612+0000 1694c700 -1 osd.3 190 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4325.0:118930 7.5 7.2bcddf15 (undecoded) ondisk+retry+read+known_if_redirected e188) 2019-11-29T20:45:47.942 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:45:47.937+0000 1694c700 -1 osd.0 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.781910+0000 front 2019-11-29T20:44:37.190498+0000 (oldest deadline 2019-11-29T20:45:22.065697+0000) 2019-11-29T20:45:48.010 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:45:48.005+0000 1694c700 -1 osd.4 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.450723+0000 front 2019-11-29T20:44:36.457873+0000 (oldest deadline 2019-11-29T20:45:18.695322+0000) 2019-11-29T20:45:48.098 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:45:48.093+0000 1694c700 -1 osd.7 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:33.950141+0000 front 2019-11-29T20:44:34.467063+0000 (oldest deadline 2019-11-29T20:45:19.220255+0000) 2019-11-29T20:45:48.262 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:45:48.257+0000 1694c700 -1 osd.6 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:35.778052+0000 front 2019-11-29T20:44:35.817466+0000 (oldest deadline 2019-11-29T20:45:19.185242+0000) 2019-11-29T20:45:48.292 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:45:48.286+0000 1694c700 -1 osd.2 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.942148+0000 front 2019-11-29T20:44:36.484240+0000 (oldest deadline 2019-11-29T20:45:21.005883+0000) 2019-11-29T20:45:48.395 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:45:48.390+0000 1694c700 -1 osd.1 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.396901+0000 front 2019-11-29T20:44:36.396307+0000 (oldest deadline 2019-11-29T20:45:20.128156+0000) 2019-11-29T20:45:48.596 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:45:48.591+0000 1694c700 -1 osd.3 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:44:55.557837+0000 (oldest deadline 2019-11-29T20:45:35.557837+0000) 2019-11-29T20:45:48.597 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:45:48.592+0000 1694c700 -1 osd.3 190 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4325.0:118930 7.5 7.2bcddf15 (undecoded) ondisk+retry+read+known_if_redirected e188) 2019-11-29T20:45:48.956 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:45:48.951+0000 1694c700 -1 osd.0 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.781910+0000 front 2019-11-29T20:44:37.190498+0000 (oldest deadline 2019-11-29T20:45:22.065697+0000) 2019-11-29T20:45:49.035 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:45:49.029+0000 1694c700 -1 osd.4 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.450723+0000 front 2019-11-29T20:44:36.457873+0000 (oldest deadline 2019-11-29T20:45:18.695322+0000) 2019-11-29T20:45:49.106 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:45:49.100+0000 1694c700 -1 osd.7 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:33.950141+0000 front 2019-11-29T20:44:34.467063+0000 (oldest deadline 2019-11-29T20:45:19.220255+0000) 2019-11-29T20:45:49.221 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:45:49.215+0000 1694c700 -1 osd.6 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:35.778052+0000 front 2019-11-29T20:44:35.817466+0000 (oldest deadline 2019-11-29T20:45:19.185242+0000) 2019-11-29T20:45:49.333 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:45:49.328+0000 1694c700 -1 osd.2 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.942148+0000 front 2019-11-29T20:44:36.484240+0000 (oldest deadline 2019-11-29T20:45:21.005883+0000) 2019-11-29T20:45:49.362 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:45:49.356+0000 1694c700 -1 osd.1 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.396901+0000 front 2019-11-29T20:44:36.396307+0000 (oldest deadline 2019-11-29T20:45:20.128156+0000) 2019-11-29T20:45:49.617 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:45:49.611+0000 1694c700 -1 osd.3 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:44:55.557837+0000 (oldest deadline 2019-11-29T20:45:35.557837+0000) 2019-11-29T20:45:49.620 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:45:49.616+0000 1694c700 -1 osd.3 190 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4325.0:118930 7.5 7.2bcddf15 (undecoded) ondisk+retry+read+known_if_redirected e188) 2019-11-29T20:45:49.947 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:45:49.941+0000 1694c700 -1 osd.0 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.781910+0000 front 2019-11-29T20:44:37.190498+0000 (oldest deadline 2019-11-29T20:45:22.065697+0000) 2019-11-29T20:45:50.089 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:45:50.080+0000 1694c700 -1 osd.7 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:33.950141+0000 front 2019-11-29T20:44:34.467063+0000 (oldest deadline 2019-11-29T20:45:19.220255+0000) 2019-11-29T20:45:50.090 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:45:50.083+0000 1694c700 -1 osd.4 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.450723+0000 front 2019-11-29T20:44:36.457873+0000 (oldest deadline 2019-11-29T20:45:18.695322+0000) 2019-11-29T20:45:50.244 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:45:50.238+0000 1694c700 -1 osd.6 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:35.778052+0000 front 2019-11-29T20:44:35.817466+0000 (oldest deadline 2019-11-29T20:45:19.185242+0000) 2019-11-29T20:45:50.291 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:45:50.285+0000 1694c700 -1 osd.2 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.942148+0000 front 2019-11-29T20:44:36.484240+0000 (oldest deadline 2019-11-29T20:45:21.005883+0000) 2019-11-29T20:45:50.356 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:45:50.350+0000 1694c700 -1 osd.1 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.396901+0000 front 2019-11-29T20:44:36.396307+0000 (oldest deadline 2019-11-29T20:45:20.128156+0000) 2019-11-29T20:45:50.665 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:45:50.659+0000 1694c700 -1 osd.3 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:44:55.557837+0000 (oldest deadline 2019-11-29T20:45:35.557837+0000) 2019-11-29T20:45:50.666 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:45:50.663+0000 1694c700 -1 osd.3 190 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4325.0:118930 7.5 7.2bcddf15 (undecoded) ondisk+retry+read+known_if_redirected e188) 2019-11-29T20:45:51.004 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:45:50.996+0000 1694c700 -1 osd.0 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.781910+0000 front 2019-11-29T20:44:37.190498+0000 (oldest deadline 2019-11-29T20:45:22.065697+0000) 2019-11-29T20:45:51.052 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:45:51.047+0000 1694c700 -1 osd.7 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:33.950141+0000 front 2019-11-29T20:44:34.467063+0000 (oldest deadline 2019-11-29T20:45:19.220255+0000) 2019-11-29T20:45:51.065 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:45:51.059+0000 1694c700 -1 osd.4 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.450723+0000 front 2019-11-29T20:44:36.457873+0000 (oldest deadline 2019-11-29T20:45:18.695322+0000) 2019-11-29T20:45:51.208 INFO:tasks.ceph.mon.b.smithi022.stderr:2019-11-29T20:45:51.200+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.22:6818/9264,v1:172.21.15.22:6819/9264] for 42sec e190 v190) 2019-11-29T20:45:51.266 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:45:51.260+0000 1694c700 -1 osd.6 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:35.778052+0000 front 2019-11-29T20:44:35.817466+0000 (oldest deadline 2019-11-29T20:45:19.185242+0000) 2019-11-29T20:45:51.323 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:45:51.318+0000 1694c700 -1 osd.2 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.942148+0000 front 2019-11-29T20:44:36.484240+0000 (oldest deadline 2019-11-29T20:45:21.005883+0000) 2019-11-29T20:45:51.384 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:45:51.379+0000 1694c700 -1 osd.1 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.396901+0000 front 2019-11-29T20:44:36.396307+0000 (oldest deadline 2019-11-29T20:45:20.128156+0000) 2019-11-29T20:45:51.715 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:45:51.705+0000 1694c700 -1 osd.3 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:44:55.557837+0000 (oldest deadline 2019-11-29T20:45:35.557837+0000) 2019-11-29T20:45:51.717 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:45:51.713+0000 1694c700 -1 osd.3 190 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4325.0:118930 7.5 7.2bcddf15 (undecoded) ondisk+retry+read+known_if_redirected e188) 2019-11-29T20:45:51.961 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:45:51.957+0000 1694c700 -1 osd.0 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.781910+0000 front 2019-11-29T20:44:37.190498+0000 (oldest deadline 2019-11-29T20:45:22.065697+0000) 2019-11-29T20:45:52.025 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:45:52.018+0000 1694c700 -1 osd.7 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:33.950141+0000 front 2019-11-29T20:44:34.467063+0000 (oldest deadline 2019-11-29T20:45:19.220255+0000) 2019-11-29T20:45:52.114 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:45:52.108+0000 1694c700 -1 osd.4 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.450723+0000 front 2019-11-29T20:44:36.457873+0000 (oldest deadline 2019-11-29T20:45:18.695322+0000) 2019-11-29T20:45:52.313 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:45:52.309+0000 1694c700 -1 osd.2 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.942148+0000 front 2019-11-29T20:44:36.484240+0000 (oldest deadline 2019-11-29T20:45:21.005883+0000) 2019-11-29T20:45:52.315 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:45:52.309+0000 1694c700 -1 osd.6 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:35.778052+0000 front 2019-11-29T20:44:35.817466+0000 (oldest deadline 2019-11-29T20:45:19.185242+0000) 2019-11-29T20:45:52.418 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:45:52.411+0000 1694c700 -1 osd.1 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.396901+0000 front 2019-11-29T20:44:36.396307+0000 (oldest deadline 2019-11-29T20:45:20.128156+0000) 2019-11-29T20:45:52.672 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:45:52.668+0000 1694c700 -1 osd.3 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:44:55.557837+0000 (oldest deadline 2019-11-29T20:45:35.557837+0000) 2019-11-29T20:45:52.674 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:45:52.670+0000 1694c700 -1 osd.3 190 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4325.0:118930 7.5 7.2bcddf15 (undecoded) ondisk+retry+read+known_if_redirected e188) 2019-11-29T20:45:52.981 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:45:52.976+0000 1694c700 -1 osd.0 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.781910+0000 front 2019-11-29T20:44:37.190498+0000 (oldest deadline 2019-11-29T20:45:22.065697+0000) 2019-11-29T20:45:53.006 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:45:53.001+0000 1694c700 -1 osd.7 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:33.950141+0000 front 2019-11-29T20:44:34.467063+0000 (oldest deadline 2019-11-29T20:45:19.220255+0000) 2019-11-29T20:45:53.080 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:45:53.070+0000 1694c700 -1 osd.4 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.450723+0000 front 2019-11-29T20:44:36.457873+0000 (oldest deadline 2019-11-29T20:45:18.695322+0000) 2019-11-29T20:45:53.289 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:45:53.283+0000 1694c700 -1 osd.2 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.942148+0000 front 2019-11-29T20:44:36.484240+0000 (oldest deadline 2019-11-29T20:45:21.005883+0000) 2019-11-29T20:45:53.364 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:45:53.352+0000 1694c700 -1 osd.6 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:35.778052+0000 front 2019-11-29T20:44:35.817466+0000 (oldest deadline 2019-11-29T20:45:19.185242+0000) 2019-11-29T20:45:53.457 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:45:53.453+0000 1694c700 -1 osd.1 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.396901+0000 front 2019-11-29T20:44:36.396307+0000 (oldest deadline 2019-11-29T20:45:20.128156+0000) 2019-11-29T20:45:53.724 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:45:53.718+0000 1694c700 -1 osd.3 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:44:55.557837+0000 (oldest deadline 2019-11-29T20:45:35.557837+0000) 2019-11-29T20:45:53.727 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:45:53.722+0000 1694c700 -1 osd.3 190 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4325.0:118930 7.5 7.2bcddf15 (undecoded) ondisk+retry+read+known_if_redirected e188) 2019-11-29T20:45:53.986 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:45:53.980+0000 1694c700 -1 osd.0 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.781910+0000 front 2019-11-29T20:44:37.190498+0000 (oldest deadline 2019-11-29T20:45:22.065697+0000) 2019-11-29T20:45:54.007 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:45:54.001+0000 1694c700 -1 osd.7 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:33.950141+0000 front 2019-11-29T20:44:34.467063+0000 (oldest deadline 2019-11-29T20:45:19.220255+0000) 2019-11-29T20:45:54.065 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:45:54.059+0000 1694c700 -1 osd.4 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.450723+0000 front 2019-11-29T20:44:36.457873+0000 (oldest deadline 2019-11-29T20:45:18.695322+0000) 2019-11-29T20:45:54.294 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:45:54.288+0000 1694c700 -1 osd.2 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.942148+0000 front 2019-11-29T20:44:36.484240+0000 (oldest deadline 2019-11-29T20:45:21.005883+0000) 2019-11-29T20:45:54.323 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:45:54.317+0000 1694c700 -1 osd.6 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:35.778052+0000 front 2019-11-29T20:44:35.817466+0000 (oldest deadline 2019-11-29T20:45:19.185242+0000) 2019-11-29T20:45:54.423 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:45:54.418+0000 1694c700 -1 osd.1 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.396901+0000 front 2019-11-29T20:44:36.396307+0000 (oldest deadline 2019-11-29T20:45:20.128156+0000) 2019-11-29T20:45:54.737 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:45:54.732+0000 1694c700 -1 osd.3 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:44:55.557837+0000 (oldest deadline 2019-11-29T20:45:35.557837+0000) 2019-11-29T20:45:54.737 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:45:54.733+0000 1694c700 -1 osd.3 190 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4325.0:118930 7.5 7.2bcddf15 (undecoded) ondisk+retry+read+known_if_redirected e188) 2019-11-29T20:45:54.983 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:45:54.977+0000 1694c700 -1 osd.7 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:33.950141+0000 front 2019-11-29T20:44:34.467063+0000 (oldest deadline 2019-11-29T20:45:19.220255+0000) 2019-11-29T20:45:54.988 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:45:54.983+0000 1694c700 -1 osd.0 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.781910+0000 front 2019-11-29T20:44:37.190498+0000 (oldest deadline 2019-11-29T20:45:22.065697+0000) 2019-11-29T20:45:55.042 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:45:55.036+0000 1694c700 -1 osd.4 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.450723+0000 front 2019-11-29T20:44:36.457873+0000 (oldest deadline 2019-11-29T20:45:18.695322+0000) 2019-11-29T20:45:55.273 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:45:55.268+0000 1694c700 -1 osd.2 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.942148+0000 front 2019-11-29T20:44:36.484240+0000 (oldest deadline 2019-11-29T20:45:21.005883+0000) 2019-11-29T20:45:55.342 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:45:55.335+0000 1694c700 -1 osd.6 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:35.778052+0000 front 2019-11-29T20:44:35.817466+0000 (oldest deadline 2019-11-29T20:45:19.185242+0000) 2019-11-29T20:45:55.440 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:45:55.430+0000 1694c700 -1 osd.1 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.396901+0000 front 2019-11-29T20:44:36.396307+0000 (oldest deadline 2019-11-29T20:45:20.128156+0000) 2019-11-29T20:45:55.761 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:45:55.756+0000 1694c700 -1 osd.3 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:44:55.557837+0000 (oldest deadline 2019-11-29T20:45:35.557837+0000) 2019-11-29T20:45:55.764 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:45:55.759+0000 1694c700 -1 osd.3 190 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4325.0:118930 7.5 7.2bcddf15 (undecoded) ondisk+retry+read+known_if_redirected e188) 2019-11-29T20:45:55.966 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:45:55.960+0000 1694c700 -1 osd.0 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.781910+0000 front 2019-11-29T20:44:37.190498+0000 (oldest deadline 2019-11-29T20:45:22.065697+0000) 2019-11-29T20:45:56.013 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:45:56.007+0000 1694c700 -1 osd.7 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:33.950141+0000 front 2019-11-29T20:44:34.467063+0000 (oldest deadline 2019-11-29T20:45:19.220255+0000) 2019-11-29T20:45:56.094 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:45:56.088+0000 1694c700 -1 osd.4 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.450723+0000 front 2019-11-29T20:44:36.457873+0000 (oldest deadline 2019-11-29T20:45:18.695322+0000) 2019-11-29T20:45:56.231 INFO:tasks.ceph.mon.b.smithi022.stderr:2019-11-29T20:45:56.223+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.22:6818/9264,v1:172.21.15.22:6819/9264] for 42sec e190 v190) 2019-11-29T20:45:56.326 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:45:56.321+0000 1694c700 -1 osd.2 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.942148+0000 front 2019-11-29T20:44:36.484240+0000 (oldest deadline 2019-11-29T20:45:21.005883+0000) 2019-11-29T20:45:56.377 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:45:56.371+0000 1694c700 -1 osd.6 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:35.778052+0000 front 2019-11-29T20:44:35.817466+0000 (oldest deadline 2019-11-29T20:45:19.185242+0000) 2019-11-29T20:45:56.478 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:45:56.474+0000 1694c700 -1 osd.1 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.396901+0000 front 2019-11-29T20:44:36.396307+0000 (oldest deadline 2019-11-29T20:45:20.128156+0000) 2019-11-29T20:45:56.727 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:45:56.720+0000 1694c700 -1 osd.3 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:44:55.557837+0000 (oldest deadline 2019-11-29T20:45:35.557837+0000) 2019-11-29T20:45:56.728 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:45:56.724+0000 1694c700 -1 osd.3 190 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4325.0:118930 7.5 7.2bcddf15 (undecoded) ondisk+retry+read+known_if_redirected e188) 2019-11-29T20:45:56.982 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:45:56.977+0000 1694c700 -1 osd.0 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.781910+0000 front 2019-11-29T20:44:37.190498+0000 (oldest deadline 2019-11-29T20:45:22.065697+0000) 2019-11-29T20:45:57.032 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:45:57.026+0000 1694c700 -1 osd.7 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:33.950141+0000 front 2019-11-29T20:44:34.467063+0000 (oldest deadline 2019-11-29T20:45:19.220255+0000) 2019-11-29T20:45:57.146 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:45:57.139+0000 1694c700 -1 osd.4 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.450723+0000 front 2019-11-29T20:44:36.457873+0000 (oldest deadline 2019-11-29T20:45:18.695322+0000) 2019-11-29T20:45:57.306 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:45:57.300+0000 1694c700 -1 osd.2 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.942148+0000 front 2019-11-29T20:44:36.484240+0000 (oldest deadline 2019-11-29T20:45:21.005883+0000) 2019-11-29T20:45:57.349 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:45:57.335+0000 1694c700 -1 osd.6 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:35.778052+0000 front 2019-11-29T20:44:35.817466+0000 (oldest deadline 2019-11-29T20:45:19.185242+0000) 2019-11-29T20:45:57.478 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:45:57.473+0000 1694c700 -1 osd.1 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.396901+0000 front 2019-11-29T20:44:36.396307+0000 (oldest deadline 2019-11-29T20:45:20.128156+0000) 2019-11-29T20:45:57.752 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:45:57.746+0000 1694c700 -1 osd.3 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:44:55.557837+0000 (oldest deadline 2019-11-29T20:45:35.557837+0000) 2019-11-29T20:45:57.756 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:45:57.752+0000 1694c700 -1 osd.3 190 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4325.0:118930 7.5 7.2bcddf15 (undecoded) ondisk+retry+read+known_if_redirected e188) 2019-11-29T20:45:57.962 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:45:57.957+0000 1694c700 -1 osd.0 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.781910+0000 front 2019-11-29T20:44:37.190498+0000 (oldest deadline 2019-11-29T20:45:22.065697+0000) 2019-11-29T20:45:58.014 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:45:58.008+0000 1694c700 -1 osd.7 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:33.950141+0000 front 2019-11-29T20:44:34.467063+0000 (oldest deadline 2019-11-29T20:45:19.220255+0000) 2019-11-29T20:45:58.153 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:45:58.147+0000 1694c700 -1 osd.4 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.450723+0000 front 2019-11-29T20:44:36.457873+0000 (oldest deadline 2019-11-29T20:45:18.695322+0000) 2019-11-29T20:45:58.312 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:45:58.305+0000 1694c700 -1 osd.2 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.942148+0000 front 2019-11-29T20:44:36.484240+0000 (oldest deadline 2019-11-29T20:45:21.005883+0000) 2019-11-29T20:45:58.362 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:45:58.357+0000 1694c700 -1 osd.6 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:35.778052+0000 front 2019-11-29T20:44:35.817466+0000 (oldest deadline 2019-11-29T20:45:19.185242+0000) 2019-11-29T20:45:58.497 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:45:58.491+0000 1694c700 -1 osd.1 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.396901+0000 front 2019-11-29T20:44:36.396307+0000 (oldest deadline 2019-11-29T20:45:20.128156+0000) 2019-11-29T20:45:58.755 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:45:58.750+0000 1694c700 -1 osd.3 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:44:55.557837+0000 (oldest deadline 2019-11-29T20:45:35.557837+0000) 2019-11-29T20:45:58.758 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:45:58.754+0000 1694c700 -1 osd.3 190 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4325.0:118930 7.5 7.2bcddf15 (undecoded) ondisk+retry+read+known_if_redirected e188) 2019-11-29T20:45:58.974 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:45:58.969+0000 1694c700 -1 osd.0 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.781910+0000 front 2019-11-29T20:44:37.190498+0000 (oldest deadline 2019-11-29T20:45:22.065697+0000) 2019-11-29T20:45:58.997 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:45:58.991+0000 1694c700 -1 osd.7 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:33.950141+0000 front 2019-11-29T20:44:34.467063+0000 (oldest deadline 2019-11-29T20:45:19.220255+0000) 2019-11-29T20:45:59.152 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:45:59.145+0000 1694c700 -1 osd.4 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.450723+0000 front 2019-11-29T20:44:36.457873+0000 (oldest deadline 2019-11-29T20:45:18.695322+0000) 2019-11-29T20:45:59.284 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:45:59.279+0000 1694c700 -1 osd.2 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.942148+0000 front 2019-11-29T20:44:36.484240+0000 (oldest deadline 2019-11-29T20:45:21.005883+0000) 2019-11-29T20:45:59.339 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:45:59.332+0000 1694c700 -1 osd.6 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:35.778052+0000 front 2019-11-29T20:44:35.817466+0000 (oldest deadline 2019-11-29T20:45:19.185242+0000) 2019-11-29T20:45:59.530 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:45:59.525+0000 1694c700 -1 osd.1 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.396901+0000 front 2019-11-29T20:44:36.396307+0000 (oldest deadline 2019-11-29T20:45:20.128156+0000) 2019-11-29T20:45:59.761 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:45:59.756+0000 1694c700 -1 osd.3 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:44:55.557837+0000 (oldest deadline 2019-11-29T20:45:35.557837+0000) 2019-11-29T20:45:59.765 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:45:59.761+0000 1694c700 -1 osd.3 190 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4325.0:118930 7.5 7.2bcddf15 (undecoded) ondisk+retry+read+known_if_redirected e188) 2019-11-29T20:45:59.988 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:45:59.979+0000 1694c700 -1 osd.0 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.781910+0000 front 2019-11-29T20:44:37.190498+0000 (oldest deadline 2019-11-29T20:45:22.065697+0000) 2019-11-29T20:46:00.030 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:46:00.025+0000 1694c700 -1 osd.7 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:33.950141+0000 front 2019-11-29T20:44:34.467063+0000 (oldest deadline 2019-11-29T20:45:19.220255+0000) 2019-11-29T20:46:00.149 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:46:00.142+0000 1694c700 -1 osd.4 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.450723+0000 front 2019-11-29T20:44:36.457873+0000 (oldest deadline 2019-11-29T20:45:18.695322+0000) 2019-11-29T20:46:00.284 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:46:00.279+0000 1694c700 -1 osd.2 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.942148+0000 front 2019-11-29T20:44:36.484240+0000 (oldest deadline 2019-11-29T20:45:21.005883+0000) 2019-11-29T20:46:00.360 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:46:00.354+0000 1694c700 -1 osd.6 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:35.778052+0000 front 2019-11-29T20:44:35.817466+0000 (oldest deadline 2019-11-29T20:45:19.185242+0000) 2019-11-29T20:46:00.498 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:46:00.492+0000 1694c700 -1 osd.1 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.396901+0000 front 2019-11-29T20:44:36.396307+0000 (oldest deadline 2019-11-29T20:45:20.128156+0000) 2019-11-29T20:46:00.812 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:46:00.807+0000 1694c700 -1 osd.3 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:44:55.557837+0000 (oldest deadline 2019-11-29T20:45:35.557837+0000) 2019-11-29T20:46:00.813 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:46:00.809+0000 1694c700 -1 osd.3 190 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4325.0:118930 7.5 7.2bcddf15 (undecoded) ondisk+retry+read+known_if_redirected e188) 2019-11-29T20:46:00.941 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:46:00.936+0000 1694c700 -1 osd.0 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.781910+0000 front 2019-11-29T20:44:37.190498+0000 (oldest deadline 2019-11-29T20:45:22.065697+0000) 2019-11-29T20:46:01.015 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:46:01.009+0000 1694c700 -1 osd.7 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:33.950141+0000 front 2019-11-29T20:44:34.467063+0000 (oldest deadline 2019-11-29T20:45:19.220255+0000) 2019-11-29T20:46:01.195 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:46:01.188+0000 1694c700 -1 osd.4 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.450723+0000 front 2019-11-29T20:44:36.457873+0000 (oldest deadline 2019-11-29T20:45:18.695322+0000) 2019-11-29T20:46:01.242 INFO:tasks.ceph.mon.b.smithi022.stderr:2019-11-29T20:46:01.237+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.22:6818/9264,v1:172.21.15.22:6819/9264] for 42sec e190 v190) 2019-11-29T20:46:01.252 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:46:01.245+0000 1694c700 -1 osd.2 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.942148+0000 front 2019-11-29T20:44:36.484240+0000 (oldest deadline 2019-11-29T20:45:21.005883+0000) 2019-11-29T20:46:01.405 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:46:01.399+0000 1694c700 -1 osd.6 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:35.778052+0000 front 2019-11-29T20:44:35.817466+0000 (oldest deadline 2019-11-29T20:45:19.185242+0000) 2019-11-29T20:46:01.530 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:46:01.525+0000 1694c700 -1 osd.1 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.396901+0000 front 2019-11-29T20:44:36.396307+0000 (oldest deadline 2019-11-29T20:45:20.128156+0000) 2019-11-29T20:46:01.796 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:46:01.791+0000 1694c700 -1 osd.3 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:44:55.557837+0000 (oldest deadline 2019-11-29T20:45:35.557837+0000) 2019-11-29T20:46:01.798 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:46:01.794+0000 1694c700 -1 osd.3 190 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4325.0:118930 7.5 7.2bcddf15 (undecoded) ondisk+retry+read+known_if_redirected e188) 2019-11-29T20:46:01.903 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:46:01.898+0000 1694c700 -1 osd.0 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.781910+0000 front 2019-11-29T20:44:37.190498+0000 (oldest deadline 2019-11-29T20:45:22.065697+0000) 2019-11-29T20:46:02.037 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:46:02.031+0000 1694c700 -1 osd.7 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:33.950141+0000 front 2019-11-29T20:44:34.467063+0000 (oldest deadline 2019-11-29T20:45:19.220255+0000) 2019-11-29T20:46:02.228 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:46:02.222+0000 1694c700 -1 osd.4 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.450723+0000 front 2019-11-29T20:44:36.457873+0000 (oldest deadline 2019-11-29T20:45:18.695322+0000) 2019-11-29T20:46:02.282 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:46:02.276+0000 1694c700 -1 osd.2 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.942148+0000 front 2019-11-29T20:44:36.484240+0000 (oldest deadline 2019-11-29T20:45:21.005883+0000) 2019-11-29T20:46:02.411 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:46:02.405+0000 1694c700 -1 osd.6 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:35.778052+0000 front 2019-11-29T20:44:35.817466+0000 (oldest deadline 2019-11-29T20:45:19.185242+0000) 2019-11-29T20:46:02.505 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:46:02.497+0000 1694c700 -1 osd.1 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.396901+0000 front 2019-11-29T20:44:36.396307+0000 (oldest deadline 2019-11-29T20:45:20.128156+0000) 2019-11-29T20:46:02.802 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:46:02.797+0000 1694c700 -1 osd.3 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:44:55.557837+0000 (oldest deadline 2019-11-29T20:45:35.557837+0000) 2019-11-29T20:46:02.804 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:46:02.800+0000 1694c700 -1 osd.3 190 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4325.0:118930 7.5 7.2bcddf15 (undecoded) ondisk+retry+read+known_if_redirected e188) 2019-11-29T20:46:02.920 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:46:02.914+0000 1694c700 -1 osd.0 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.781910+0000 front 2019-11-29T20:44:37.190498+0000 (oldest deadline 2019-11-29T20:45:22.065697+0000) 2019-11-29T20:46:03.046 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:46:03.040+0000 1694c700 -1 osd.7 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:33.950141+0000 front 2019-11-29T20:44:34.467063+0000 (oldest deadline 2019-11-29T20:45:19.220255+0000) 2019-11-29T20:46:03.254 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:46:03.248+0000 1694c700 -1 osd.4 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.450723+0000 front 2019-11-29T20:44:36.457873+0000 (oldest deadline 2019-11-29T20:45:18.695322+0000) 2019-11-29T20:46:03.335 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:46:03.329+0000 1694c700 -1 osd.2 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.942148+0000 front 2019-11-29T20:44:36.484240+0000 (oldest deadline 2019-11-29T20:45:21.005883+0000) 2019-11-29T20:46:03.448 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:46:03.442+0000 1694c700 -1 osd.6 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:35.778052+0000 front 2019-11-29T20:44:35.817466+0000 (oldest deadline 2019-11-29T20:45:19.185242+0000) 2019-11-29T20:46:03.528 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:46:03.523+0000 1694c700 -1 osd.1 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.396901+0000 front 2019-11-29T20:44:36.396307+0000 (oldest deadline 2019-11-29T20:45:20.128156+0000) 2019-11-29T20:46:03.777 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:46:03.772+0000 1694c700 -1 osd.3 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:44:55.557837+0000 (oldest deadline 2019-11-29T20:45:35.557837+0000) 2019-11-29T20:46:03.781 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:46:03.776+0000 1694c700 -1 osd.3 190 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4325.0:118930 7.5 7.2bcddf15 (undecoded) ondisk+retry+read+known_if_redirected e188) 2019-11-29T20:46:03.957 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:46:03.951+0000 1694c700 -1 osd.0 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.781910+0000 front 2019-11-29T20:44:37.190498+0000 (oldest deadline 2019-11-29T20:45:22.065697+0000) 2019-11-29T20:46:04.015 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:46:04.008+0000 1694c700 -1 osd.7 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:33.950141+0000 front 2019-11-29T20:44:34.467063+0000 (oldest deadline 2019-11-29T20:45:19.220255+0000) 2019-11-29T20:46:04.261 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:46:04.253+0000 1694c700 -1 osd.4 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.450723+0000 front 2019-11-29T20:44:36.457873+0000 (oldest deadline 2019-11-29T20:45:18.695322+0000) 2019-11-29T20:46:04.311 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:46:04.304+0000 1694c700 -1 osd.2 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.942148+0000 front 2019-11-29T20:44:36.484240+0000 (oldest deadline 2019-11-29T20:45:21.005883+0000) 2019-11-29T20:46:04.443 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:46:04.438+0000 1694c700 -1 osd.6 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:35.778052+0000 front 2019-11-29T20:44:35.817466+0000 (oldest deadline 2019-11-29T20:45:19.185242+0000) 2019-11-29T20:46:04.535 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:46:04.530+0000 1694c700 -1 osd.1 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.396901+0000 front 2019-11-29T20:44:36.396307+0000 (oldest deadline 2019-11-29T20:45:20.128156+0000) 2019-11-29T20:46:04.814 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:46:04.808+0000 1694c700 -1 osd.3 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:44:55.557837+0000 (oldest deadline 2019-11-29T20:45:35.557837+0000) 2019-11-29T20:46:04.819 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:46:04.815+0000 1694c700 -1 osd.3 190 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4325.0:118930 7.5 7.2bcddf15 (undecoded) ondisk+retry+read+known_if_redirected e188) 2019-11-29T20:46:04.987 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:46:04.982+0000 1694c700 -1 osd.0 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.781910+0000 front 2019-11-29T20:44:37.190498+0000 (oldest deadline 2019-11-29T20:45:22.065697+0000) 2019-11-29T20:46:04.987 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:46:04.981+0000 1694c700 -1 osd.7 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:33.950141+0000 front 2019-11-29T20:44:34.467063+0000 (oldest deadline 2019-11-29T20:45:19.220255+0000) 2019-11-29T20:46:05.258 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:46:05.250+0000 1694c700 -1 osd.4 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.450723+0000 front 2019-11-29T20:44:36.457873+0000 (oldest deadline 2019-11-29T20:45:18.695322+0000) 2019-11-29T20:46:05.275 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:46:05.270+0000 1694c700 -1 osd.2 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.942148+0000 front 2019-11-29T20:44:36.484240+0000 (oldest deadline 2019-11-29T20:45:21.005883+0000) 2019-11-29T20:46:05.410 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:46:05.404+0000 1694c700 -1 osd.6 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:35.778052+0000 front 2019-11-29T20:44:35.817466+0000 (oldest deadline 2019-11-29T20:45:19.185242+0000) 2019-11-29T20:46:05.525 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:46:05.519+0000 1694c700 -1 osd.1 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.396901+0000 front 2019-11-29T20:44:36.396307+0000 (oldest deadline 2019-11-29T20:45:20.128156+0000) 2019-11-29T20:46:05.857 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:46:05.852+0000 1694c700 -1 osd.3 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:44:55.557837+0000 (oldest deadline 2019-11-29T20:45:35.557837+0000) 2019-11-29T20:46:05.861 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:46:05.856+0000 1694c700 -1 osd.3 190 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4325.0:118930 7.5 7.2bcddf15 (undecoded) ondisk+retry+read+known_if_redirected e188) 2019-11-29T20:46:05.949 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:46:05.943+0000 1694c700 -1 osd.7 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:33.950141+0000 front 2019-11-29T20:44:34.467063+0000 (oldest deadline 2019-11-29T20:45:19.220255+0000) 2019-11-29T20:46:05.953 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:46:05.948+0000 1694c700 -1 osd.0 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.781910+0000 front 2019-11-29T20:44:37.190498+0000 (oldest deadline 2019-11-29T20:45:22.065697+0000) 2019-11-29T20:46:06.223 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:46:06.216+0000 1694c700 -1 osd.4 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.450723+0000 front 2019-11-29T20:44:36.457873+0000 (oldest deadline 2019-11-29T20:45:18.695322+0000) 2019-11-29T20:46:06.262 INFO:tasks.ceph.mon.b.smithi022.stderr:2019-11-29T20:46:06.255+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.22:6818/9264,v1:172.21.15.22:6819/9264] for 42sec e190 v190) 2019-11-29T20:46:06.320 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:46:06.314+0000 1694c700 -1 osd.2 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.942148+0000 front 2019-11-29T20:44:36.484240+0000 (oldest deadline 2019-11-29T20:45:21.005883+0000) 2019-11-29T20:46:06.441 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:46:06.435+0000 1694c700 -1 osd.6 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:35.778052+0000 front 2019-11-29T20:44:35.817466+0000 (oldest deadline 2019-11-29T20:45:19.185242+0000) 2019-11-29T20:46:06.508 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:46:06.501+0000 1694c700 -1 osd.1 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.396901+0000 front 2019-11-29T20:44:36.396307+0000 (oldest deadline 2019-11-29T20:45:20.128156+0000) 2019-11-29T20:46:06.875 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:46:06.867+0000 1694c700 -1 osd.3 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:44:55.557837+0000 (oldest deadline 2019-11-29T20:45:35.557837+0000) 2019-11-29T20:46:06.876 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:46:06.870+0000 1694c700 -1 osd.3 190 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4325.0:118930 7.5 7.2bcddf15 (undecoded) ondisk+retry+read+known_if_redirected e188) 2019-11-29T20:46:06.912 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:46:06.907+0000 1694c700 -1 osd.7 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:33.950141+0000 front 2019-11-29T20:44:34.467063+0000 (oldest deadline 2019-11-29T20:45:19.220255+0000) 2019-11-29T20:46:06.968 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:46:06.962+0000 1694c700 -1 osd.0 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.781910+0000 front 2019-11-29T20:44:37.190498+0000 (oldest deadline 2019-11-29T20:45:22.065697+0000) 2019-11-29T20:46:07.179 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:46:07.173+0000 1694c700 -1 osd.4 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.450723+0000 front 2019-11-29T20:44:36.457873+0000 (oldest deadline 2019-11-29T20:45:18.695322+0000) 2019-11-29T20:46:07.329 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:46:07.324+0000 1694c700 -1 osd.2 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.942148+0000 front 2019-11-29T20:44:36.484240+0000 (oldest deadline 2019-11-29T20:45:21.005883+0000) 2019-11-29T20:46:07.416 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:46:07.410+0000 1694c700 -1 osd.6 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:35.778052+0000 front 2019-11-29T20:44:35.817466+0000 (oldest deadline 2019-11-29T20:45:19.185242+0000) 2019-11-29T20:46:07.467 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:46:07.460+0000 1694c700 -1 osd.1 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.396901+0000 front 2019-11-29T20:44:36.396307+0000 (oldest deadline 2019-11-29T20:45:20.128156+0000) 2019-11-29T20:46:07.869 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:46:07.862+0000 1694c700 -1 osd.7 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:33.950141+0000 front 2019-11-29T20:44:34.467063+0000 (oldest deadline 2019-11-29T20:45:19.220255+0000) 2019-11-29T20:46:07.898 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:46:07.892+0000 1694c700 -1 osd.3 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:44:55.557837+0000 (oldest deadline 2019-11-29T20:45:35.557837+0000) 2019-11-29T20:46:07.899 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:46:07.893+0000 1694c700 -1 osd.3 190 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4325.0:118930 7.5 7.2bcddf15 (undecoded) ondisk+retry+read+known_if_redirected e188) 2019-11-29T20:46:07.970 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:46:07.965+0000 1694c700 -1 osd.0 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.781910+0000 front 2019-11-29T20:44:37.190498+0000 (oldest deadline 2019-11-29T20:45:22.065697+0000) 2019-11-29T20:46:08.160 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:46:08.148+0000 1694c700 -1 osd.4 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.450723+0000 front 2019-11-29T20:44:36.457873+0000 (oldest deadline 2019-11-29T20:45:18.695322+0000) 2019-11-29T20:46:08.303 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:46:08.297+0000 1694c700 -1 osd.2 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.942148+0000 front 2019-11-29T20:44:36.484240+0000 (oldest deadline 2019-11-29T20:45:21.005883+0000) 2019-11-29T20:46:08.420 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:46:08.414+0000 1694c700 -1 osd.6 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:35.778052+0000 front 2019-11-29T20:44:35.817466+0000 (oldest deadline 2019-11-29T20:45:19.185242+0000) 2019-11-29T20:46:08.499 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:46:08.494+0000 1694c700 -1 osd.1 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.396901+0000 front 2019-11-29T20:44:36.396307+0000 (oldest deadline 2019-11-29T20:45:20.128156+0000) 2019-11-29T20:46:08.844 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:46:08.838+0000 1694c700 -1 osd.7 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:33.950141+0000 front 2019-11-29T20:44:34.467063+0000 (oldest deadline 2019-11-29T20:45:19.220255+0000) 2019-11-29T20:46:08.869 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:46:08.863+0000 1694c700 -1 osd.3 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:44:55.557837+0000 (oldest deadline 2019-11-29T20:45:35.557837+0000) 2019-11-29T20:46:08.870 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:46:08.865+0000 1694c700 -1 osd.3 190 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4325.0:118930 7.5 7.2bcddf15 (undecoded) ondisk+retry+read+known_if_redirected e188) 2019-11-29T20:46:08.983 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:46:08.977+0000 1694c700 -1 osd.0 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.781910+0000 front 2019-11-29T20:44:37.190498+0000 (oldest deadline 2019-11-29T20:45:22.065697+0000) 2019-11-29T20:46:09.191 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:46:09.184+0000 1694c700 -1 osd.4 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.450723+0000 front 2019-11-29T20:44:36.457873+0000 (oldest deadline 2019-11-29T20:45:18.695322+0000) 2019-11-29T20:46:09.342 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:46:09.337+0000 1694c700 -1 osd.2 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.942148+0000 front 2019-11-29T20:44:36.484240+0000 (oldest deadline 2019-11-29T20:45:21.005883+0000) 2019-11-29T20:46:09.405 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:46:09.399+0000 1694c700 -1 osd.6 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:35.778052+0000 front 2019-11-29T20:44:35.817466+0000 (oldest deadline 2019-11-29T20:45:19.185242+0000) 2019-11-29T20:46:09.536 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:46:09.530+0000 1694c700 -1 osd.1 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.396901+0000 front 2019-11-29T20:44:36.396307+0000 (oldest deadline 2019-11-29T20:45:20.128156+0000) 2019-11-29T20:46:09.829 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:46:09.823+0000 1694c700 -1 osd.7 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:33.950141+0000 front 2019-11-29T20:44:34.467063+0000 (oldest deadline 2019-11-29T20:45:19.220255+0000) 2019-11-29T20:46:09.914 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:46:09.909+0000 1694c700 -1 osd.3 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:44:55.557837+0000 (oldest deadline 2019-11-29T20:45:35.557837+0000) 2019-11-29T20:46:09.917 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:46:09.912+0000 1694c700 -1 osd.3 190 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4325.0:118930 7.5 7.2bcddf15 (undecoded) ondisk+retry+read+known_if_redirected e188) 2019-11-29T20:46:09.971 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:46:09.966+0000 1694c700 -1 osd.0 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.781910+0000 front 2019-11-29T20:44:37.190498+0000 (oldest deadline 2019-11-29T20:45:22.065697+0000) 2019-11-29T20:46:10.239 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:46:10.233+0000 1694c700 -1 osd.4 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.450723+0000 front 2019-11-29T20:44:36.457873+0000 (oldest deadline 2019-11-29T20:45:18.695322+0000) 2019-11-29T20:46:10.337 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:46:10.331+0000 1694c700 -1 osd.2 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.942148+0000 front 2019-11-29T20:44:36.484240+0000 (oldest deadline 2019-11-29T20:45:21.005883+0000) 2019-11-29T20:46:10.364 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:46:10.358+0000 1694c700 -1 osd.6 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:35.778052+0000 front 2019-11-29T20:44:35.817466+0000 (oldest deadline 2019-11-29T20:45:19.185242+0000) 2019-11-29T20:46:10.529 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:46:10.523+0000 1694c700 -1 osd.1 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.396901+0000 front 2019-11-29T20:44:36.396307+0000 (oldest deadline 2019-11-29T20:45:20.128156+0000) 2019-11-29T20:46:10.883 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:46:10.877+0000 1694c700 -1 osd.7 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:33.950141+0000 front 2019-11-29T20:44:34.467063+0000 (oldest deadline 2019-11-29T20:45:19.220255+0000) 2019-11-29T20:46:10.890 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:46:10.884+0000 1694c700 -1 osd.3 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:44:55.557837+0000 (oldest deadline 2019-11-29T20:45:35.557837+0000) 2019-11-29T20:46:10.891 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:46:10.886+0000 1694c700 -1 osd.3 190 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4325.0:118930 7.5 7.2bcddf15 (undecoded) ondisk+retry+read+known_if_redirected e188) 2019-11-29T20:46:10.976 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:46:10.971+0000 1694c700 -1 osd.0 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.781910+0000 front 2019-11-29T20:44:37.190498+0000 (oldest deadline 2019-11-29T20:45:22.065697+0000) 2019-11-29T20:46:11.267 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:46:11.260+0000 1694c700 -1 osd.4 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.450723+0000 front 2019-11-29T20:44:36.457873+0000 (oldest deadline 2019-11-29T20:45:18.695322+0000) 2019-11-29T20:46:11.323 INFO:tasks.ceph.mon.b.smithi022.stderr:2019-11-29T20:46:11.316+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.22:6818/9264,v1:172.21.15.22:6819/9264] for 42sec e190 v190) 2019-11-29T20:46:11.327 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:46:11.322+0000 1694c700 -1 osd.2 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:36.942148+0000 front 2019-11-29T20:44:36.484240+0000 (oldest deadline 2019-11-29T20:45:21.005883+0000) 2019-11-29T20:46:11.421 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:46:11.395+0000 1694c700 -1 osd.6 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:35.778052+0000 front 2019-11-29T20:44:35.817466+0000 (oldest deadline 2019-11-29T20:45:19.185242+0000) 2019-11-29T20:46:11.901 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:46:11.895+0000 1694c700 -1 osd.3 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:44:55.557837+0000 (oldest deadline 2019-11-29T20:45:35.557837+0000) 2019-11-29T20:46:11.905 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:46:11.898+0000 1694c700 -1 osd.3 190 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4325.0:118930 7.5 7.2bcddf15 (undecoded) ondisk+retry+read+known_if_redirected e188) 2019-11-29T20:46:11.910 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:46:11.904+0000 1694c700 -1 osd.7 190 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:44:33.950141+0000 front 2019-11-29T20:44:34.467063+0000 (oldest deadline 2019-11-29T20:45:19.220255+0000) 2019-11-29T20:46:40.776 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:46:40.770+0000 33787700 -1 osd.5 196 build_incremental_map_msg missing incremental map 196 2019-11-29T20:46:40.932 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:46:40.914+0000 3578b700 -1 osd.5 196 build_incremental_map_msg missing incremental map 196 2019-11-29T20:46:40.983 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:46:40.927+0000 32f86700 -1 osd.5 196 build_incremental_map_msg missing incremental map 196 2019-11-29T20:47:39.902 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:47:39.894+0000 1694c700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:54.077425+0000 front 2019-11-29T20:46:54.085466+0000 (oldest deadline 2019-11-29T20:47:39.299123+0000) 2019-11-29T20:47:40.330 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:47:40.323+0000 1694c700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:54.004922+0000 front 2019-11-29T20:46:53.973071+0000 (oldest deadline 2019-11-29T20:47:39.845015+0000) 2019-11-29T20:47:40.591 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:47:40.584+0000 1694c700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:55.179191+0000 front 2019-11-29T20:46:55.180469+0000 (oldest deadline 2019-11-29T20:47:39.833241+0000) 2019-11-29T20:47:40.657 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:47:40.646+0000 1694c700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:56.148035+0000 front 2019-11-29T20:46:56.566436+0000 (oldest deadline 2019-11-29T20:47:40.226304+0000) 2019-11-29T20:47:40.943 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:47:40.936+0000 1694c700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:54.077425+0000 front 2019-11-29T20:46:54.085466+0000 (oldest deadline 2019-11-29T20:47:39.299123+0000) 2019-11-29T20:47:41.308 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:47:41.302+0000 1694c700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:54.004922+0000 front 2019-11-29T20:46:53.973071+0000 (oldest deadline 2019-11-29T20:47:39.845015+0000) 2019-11-29T20:47:41.323 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:47:41.317+0000 1694c700 -1 osd.1 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:54.925993+0000 front 2019-11-29T20:46:54.680938+0000 (oldest deadline 2019-11-29T20:47:40.518220+0000) 2019-11-29T20:47:41.341 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:47:41.330+0000 1694c700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:57.792907+0000 front 2019-11-29T20:46:57.750527+0000 (oldest deadline 2019-11-29T20:47:41.230713+0000) 2019-11-29T20:47:41.603 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:47:41.597+0000 1694c700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:55.179191+0000 front 2019-11-29T20:46:55.180469+0000 (oldest deadline 2019-11-29T20:47:39.833241+0000) 2019-11-29T20:47:41.621 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:47:41.615+0000 1694c700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:56.148035+0000 front 2019-11-29T20:46:56.566436+0000 (oldest deadline 2019-11-29T20:47:40.226304+0000) 2019-11-29T20:47:41.900 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:47:41.894+0000 1694c700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:54.077425+0000 front 2019-11-29T20:46:54.085466+0000 (oldest deadline 2019-11-29T20:47:39.299123+0000) 2019-11-29T20:47:42.283 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:47:42.276+0000 1694c700 -1 osd.1 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:54.925993+0000 front 2019-11-29T20:46:54.680938+0000 (oldest deadline 2019-11-29T20:47:40.518220+0000) 2019-11-29T20:47:42.317 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:47:42.311+0000 1694c700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:54.004922+0000 front 2019-11-29T20:46:53.973071+0000 (oldest deadline 2019-11-29T20:47:39.845015+0000) 2019-11-29T20:47:42.341 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:47:42.335+0000 1694c700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:57.792907+0000 front 2019-11-29T20:46:57.750527+0000 (oldest deadline 2019-11-29T20:47:41.230713+0000) 2019-11-29T20:47:42.572 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:47:42.566+0000 1694c700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:55.179191+0000 front 2019-11-29T20:46:55.180469+0000 (oldest deadline 2019-11-29T20:47:39.833241+0000) 2019-11-29T20:47:42.618 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:47:42.612+0000 1694c700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:56.148035+0000 front 2019-11-29T20:46:56.566436+0000 (oldest deadline 2019-11-29T20:47:40.226304+0000) 2019-11-29T20:47:42.897 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:47:42.891+0000 1694c700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:54.077425+0000 front 2019-11-29T20:46:54.085466+0000 (oldest deadline 2019-11-29T20:47:39.299123+0000) 2019-11-29T20:47:43.149 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:47:43.143+0000 1694c700 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:57.906607+0000 front 2019-11-29T20:46:58.163331+0000 (oldest deadline 2019-11-29T20:47:42.500968+0000) 2019-11-29T20:47:43.251 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:47:43.245+0000 1694c700 -1 osd.1 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:54.925993+0000 front 2019-11-29T20:46:54.680938+0000 (oldest deadline 2019-11-29T20:47:40.518220+0000) 2019-11-29T20:47:43.334 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:47:43.328+0000 1694c700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:54.004922+0000 front 2019-11-29T20:46:53.973071+0000 (oldest deadline 2019-11-29T20:47:39.845015+0000) 2019-11-29T20:47:43.370 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:47:43.365+0000 1694c700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:57.792907+0000 front 2019-11-29T20:46:57.750527+0000 (oldest deadline 2019-11-29T20:47:41.230713+0000) 2019-11-29T20:47:43.608 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:47:43.602+0000 1694c700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:55.179191+0000 front 2019-11-29T20:46:55.180469+0000 (oldest deadline 2019-11-29T20:47:39.833241+0000) 2019-11-29T20:47:43.641 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:47:43.635+0000 1694c700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:56.148035+0000 front 2019-11-29T20:46:56.566436+0000 (oldest deadline 2019-11-29T20:47:40.226304+0000) 2019-11-29T20:47:43.914 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:47:43.908+0000 1694c700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:54.077425+0000 front 2019-11-29T20:46:54.085466+0000 (oldest deadline 2019-11-29T20:47:39.299123+0000) 2019-11-29T20:47:44.134 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:47:44.128+0000 1694c700 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:57.906607+0000 front 2019-11-29T20:46:58.163331+0000 (oldest deadline 2019-11-29T20:47:42.500968+0000) 2019-11-29T20:47:44.259 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:47:44.253+0000 1694c700 -1 osd.1 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:54.925993+0000 front 2019-11-29T20:46:54.680938+0000 (oldest deadline 2019-11-29T20:47:40.518220+0000) 2019-11-29T20:47:44.340 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:47:44.334+0000 1694c700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:57.792907+0000 front 2019-11-29T20:46:57.750527+0000 (oldest deadline 2019-11-29T20:47:41.230713+0000) 2019-11-29T20:47:44.362 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:47:44.356+0000 1694c700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:54.004922+0000 front 2019-11-29T20:46:53.973071+0000 (oldest deadline 2019-11-29T20:47:39.845015+0000) 2019-11-29T20:47:44.609 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:47:44.602+0000 1694c700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:55.179191+0000 front 2019-11-29T20:46:55.180469+0000 (oldest deadline 2019-11-29T20:47:39.833241+0000) 2019-11-29T20:47:44.671 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:47:44.664+0000 1694c700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:56.148035+0000 front 2019-11-29T20:46:56.566436+0000 (oldest deadline 2019-11-29T20:47:40.226304+0000) 2019-11-29T20:47:44.879 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:47:44.873+0000 1694c700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:54.077425+0000 front 2019-11-29T20:46:54.085466+0000 (oldest deadline 2019-11-29T20:47:39.299123+0000) 2019-11-29T20:47:45.161 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:47:45.155+0000 1694c700 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:57.906607+0000 front 2019-11-29T20:46:58.163331+0000 (oldest deadline 2019-11-29T20:47:42.500968+0000) 2019-11-29T20:47:45.227 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:47:45.222+0000 1694c700 -1 osd.1 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:54.925993+0000 front 2019-11-29T20:46:54.680938+0000 (oldest deadline 2019-11-29T20:47:40.518220+0000) 2019-11-29T20:47:45.313 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:47:45.307+0000 1694c700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:57.792907+0000 front 2019-11-29T20:46:57.750527+0000 (oldest deadline 2019-11-29T20:47:41.230713+0000) 2019-11-29T20:47:45.413 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:47:45.408+0000 1694c700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:54.004922+0000 front 2019-11-29T20:46:53.973071+0000 (oldest deadline 2019-11-29T20:47:39.845015+0000) 2019-11-29T20:47:45.584 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:47:45.578+0000 1694c700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:55.179191+0000 front 2019-11-29T20:46:55.180469+0000 (oldest deadline 2019-11-29T20:47:39.833241+0000) 2019-11-29T20:47:45.659 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:47:45.653+0000 1694c700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:56.148035+0000 front 2019-11-29T20:46:56.566436+0000 (oldest deadline 2019-11-29T20:47:40.226304+0000) 2019-11-29T20:47:45.863 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:47:45.857+0000 1694c700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:54.077425+0000 front 2019-11-29T20:46:54.085466+0000 (oldest deadline 2019-11-29T20:47:39.299123+0000) 2019-11-29T20:47:46.194 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:47:46.189+0000 1694c700 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:57.906607+0000 front 2019-11-29T20:46:58.163331+0000 (oldest deadline 2019-11-29T20:47:42.500968+0000) 2019-11-29T20:47:46.273 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:47:46.268+0000 1694c700 -1 osd.1 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:54.925993+0000 front 2019-11-29T20:46:54.680938+0000 (oldest deadline 2019-11-29T20:47:40.518220+0000) 2019-11-29T20:47:46.317 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:47:46.310+0000 1694c700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:57.792907+0000 front 2019-11-29T20:46:57.750527+0000 (oldest deadline 2019-11-29T20:47:41.230713+0000) 2019-11-29T20:47:46.389 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:47:46.382+0000 1694c700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:54.004922+0000 front 2019-11-29T20:46:53.973071+0000 (oldest deadline 2019-11-29T20:47:39.845015+0000) 2019-11-29T20:47:46.612 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:47:46.606+0000 1694c700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:55.179191+0000 front 2019-11-29T20:46:55.180469+0000 (oldest deadline 2019-11-29T20:47:39.833241+0000) 2019-11-29T20:47:46.645 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:47:46.637+0000 1694c700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:56.148035+0000 front 2019-11-29T20:46:56.566436+0000 (oldest deadline 2019-11-29T20:47:40.226304+0000) 2019-11-29T20:47:46.856 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:47:46.850+0000 1694c700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:54.077425+0000 front 2019-11-29T20:46:54.085466+0000 (oldest deadline 2019-11-29T20:47:39.299123+0000) 2019-11-29T20:47:47.160 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:47:47.155+0000 1694c700 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:57.906607+0000 front 2019-11-29T20:46:58.163331+0000 (oldest deadline 2019-11-29T20:47:42.500968+0000) 2019-11-29T20:47:47.310 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:47:47.304+0000 1694c700 -1 osd.1 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:54.925993+0000 front 2019-11-29T20:46:54.680938+0000 (oldest deadline 2019-11-29T20:47:40.518220+0000) 2019-11-29T20:47:47.329 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:47:47.323+0000 1694c700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:57.792907+0000 front 2019-11-29T20:46:57.750527+0000 (oldest deadline 2019-11-29T20:47:41.230713+0000) 2019-11-29T20:47:47.408 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:47:47.403+0000 1694c700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:54.004922+0000 front 2019-11-29T20:46:53.973071+0000 (oldest deadline 2019-11-29T20:47:39.845015+0000) 2019-11-29T20:47:47.577 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:47:47.571+0000 1694c700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:55.179191+0000 front 2019-11-29T20:46:55.180469+0000 (oldest deadline 2019-11-29T20:47:39.833241+0000) 2019-11-29T20:47:47.621 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:47:47.615+0000 1694c700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:56.148035+0000 front 2019-11-29T20:46:56.566436+0000 (oldest deadline 2019-11-29T20:47:40.226304+0000) 2019-11-29T20:47:47.831 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:47:47.824+0000 1694c700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:54.077425+0000 front 2019-11-29T20:46:54.085466+0000 (oldest deadline 2019-11-29T20:47:39.299123+0000) 2019-11-29T20:47:48.142 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:47:48.136+0000 1694c700 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:57.906607+0000 front 2019-11-29T20:46:58.163331+0000 (oldest deadline 2019-11-29T20:47:42.500968+0000) 2019-11-29T20:47:48.330 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:47:48.326+0000 1694c700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:57.792907+0000 front 2019-11-29T20:46:57.750527+0000 (oldest deadline 2019-11-29T20:47:41.230713+0000) 2019-11-29T20:47:48.334 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:47:48.329+0000 1694c700 -1 osd.1 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:54.925993+0000 front 2019-11-29T20:46:54.680938+0000 (oldest deadline 2019-11-29T20:47:40.518220+0000) 2019-11-29T20:47:48.409 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:47:48.404+0000 1694c700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:54.004922+0000 front 2019-11-29T20:46:53.973071+0000 (oldest deadline 2019-11-29T20:47:39.845015+0000) 2019-11-29T20:47:48.556 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:47:48.550+0000 1694c700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:55.179191+0000 front 2019-11-29T20:46:55.180469+0000 (oldest deadline 2019-11-29T20:47:39.833241+0000) 2019-11-29T20:47:48.626 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:47:48.621+0000 1694c700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:56.148035+0000 front 2019-11-29T20:46:56.566436+0000 (oldest deadline 2019-11-29T20:47:40.226304+0000) 2019-11-29T20:47:48.869 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:47:48.863+0000 1694c700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:54.077425+0000 front 2019-11-29T20:46:54.085466+0000 (oldest deadline 2019-11-29T20:47:39.299123+0000) 2019-11-29T20:47:49.118 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:47:49.112+0000 1694c700 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:57.906607+0000 front 2019-11-29T20:46:58.163331+0000 (oldest deadline 2019-11-29T20:47:42.500968+0000) 2019-11-29T20:47:49.367 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:47:49.362+0000 1694c700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:57.792907+0000 front 2019-11-29T20:46:57.750527+0000 (oldest deadline 2019-11-29T20:47:41.230713+0000) 2019-11-29T20:47:49.372 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:47:49.365+0000 1694c700 -1 osd.1 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:54.925993+0000 front 2019-11-29T20:46:54.680938+0000 (oldest deadline 2019-11-29T20:47:40.518220+0000) 2019-11-29T20:47:49.386 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:47:49.381+0000 1694c700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:54.004922+0000 front 2019-11-29T20:46:53.973071+0000 (oldest deadline 2019-11-29T20:47:39.845015+0000) 2019-11-29T20:47:49.600 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:47:49.593+0000 1694c700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:55.179191+0000 front 2019-11-29T20:46:55.180469+0000 (oldest deadline 2019-11-29T20:47:39.833241+0000) 2019-11-29T20:47:49.660 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:47:49.655+0000 1694c700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:56.148035+0000 front 2019-11-29T20:46:56.566436+0000 (oldest deadline 2019-11-29T20:47:40.226304+0000) 2019-11-29T20:47:49.891 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:47:49.886+0000 1694c700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:54.077425+0000 front 2019-11-29T20:46:54.085466+0000 (oldest deadline 2019-11-29T20:47:39.299123+0000) 2019-11-29T20:47:50.128 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:47:50.119+0000 1694c700 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:57.906607+0000 front 2019-11-29T20:46:58.163331+0000 (oldest deadline 2019-11-29T20:47:42.500968+0000) 2019-11-29T20:47:50.350 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:47:50.343+0000 1694c700 -1 osd.1 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:54.925993+0000 front 2019-11-29T20:46:54.680938+0000 (oldest deadline 2019-11-29T20:47:40.518220+0000) 2019-11-29T20:47:50.406 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:47:50.400+0000 1694c700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:57.792907+0000 front 2019-11-29T20:46:57.750527+0000 (oldest deadline 2019-11-29T20:47:41.230713+0000) 2019-11-29T20:47:50.433 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:47:50.427+0000 1694c700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:54.004922+0000 front 2019-11-29T20:46:53.973071+0000 (oldest deadline 2019-11-29T20:47:39.845015+0000) 2019-11-29T20:47:50.601 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:47:50.595+0000 1694c700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:55.179191+0000 front 2019-11-29T20:46:55.180469+0000 (oldest deadline 2019-11-29T20:47:39.833241+0000) 2019-11-29T20:47:50.697 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:47:50.691+0000 1694c700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:56.148035+0000 front 2019-11-29T20:46:56.566436+0000 (oldest deadline 2019-11-29T20:47:40.226304+0000) 2019-11-29T20:47:50.860 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:47:50.854+0000 1694c700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:54.077425+0000 front 2019-11-29T20:46:54.085466+0000 (oldest deadline 2019-11-29T20:47:39.299123+0000) 2019-11-29T20:47:51.143 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:47:51.138+0000 1694c700 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:57.906607+0000 front 2019-11-29T20:46:58.163331+0000 (oldest deadline 2019-11-29T20:47:42.500968+0000) 2019-11-29T20:47:51.334 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:47:51.329+0000 1694c700 -1 osd.1 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:54.925993+0000 front 2019-11-29T20:46:54.680938+0000 (oldest deadline 2019-11-29T20:47:40.518220+0000) 2019-11-29T20:47:51.450 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:47:51.445+0000 1694c700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:57.792907+0000 front 2019-11-29T20:46:57.750527+0000 (oldest deadline 2019-11-29T20:47:41.230713+0000) 2019-11-29T20:47:51.475 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:47:51.470+0000 1694c700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:54.004922+0000 front 2019-11-29T20:46:53.973071+0000 (oldest deadline 2019-11-29T20:47:39.845015+0000) 2019-11-29T20:47:51.651 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:47:51.645+0000 1694c700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:55.179191+0000 front 2019-11-29T20:46:55.180469+0000 (oldest deadline 2019-11-29T20:47:39.833241+0000) 2019-11-29T20:47:51.741 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:47:51.734+0000 1694c700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:56.148035+0000 front 2019-11-29T20:46:56.566436+0000 (oldest deadline 2019-11-29T20:47:40.226304+0000) 2019-11-29T20:47:51.911 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:47:51.906+0000 1694c700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:54.077425+0000 front 2019-11-29T20:46:54.085466+0000 (oldest deadline 2019-11-29T20:47:39.299123+0000) 2019-11-29T20:47:52.133 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:47:52.127+0000 1694c700 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:57.906607+0000 front 2019-11-29T20:46:58.163331+0000 (oldest deadline 2019-11-29T20:47:42.500968+0000) 2019-11-29T20:47:52.359 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:47:52.354+0000 1694c700 -1 osd.1 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:54.925993+0000 front 2019-11-29T20:46:54.680938+0000 (oldest deadline 2019-11-29T20:47:40.518220+0000) 2019-11-29T20:47:52.439 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:47:52.433+0000 1694c700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:54.004922+0000 front 2019-11-29T20:46:53.973071+0000 (oldest deadline 2019-11-29T20:47:39.845015+0000) 2019-11-29T20:47:52.469 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:47:52.463+0000 1694c700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:57.792907+0000 front 2019-11-29T20:46:57.750527+0000 (oldest deadline 2019-11-29T20:47:41.230713+0000) 2019-11-29T20:47:52.661 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:47:52.655+0000 1694c700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:55.179191+0000 front 2019-11-29T20:46:55.180469+0000 (oldest deadline 2019-11-29T20:47:39.833241+0000) 2019-11-29T20:47:52.777 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:47:52.769+0000 1694c700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:56.148035+0000 front 2019-11-29T20:46:56.566436+0000 (oldest deadline 2019-11-29T20:47:40.226304+0000) 2019-11-29T20:47:52.935 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:47:52.930+0000 1694c700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:54.077425+0000 front 2019-11-29T20:46:54.085466+0000 (oldest deadline 2019-11-29T20:47:39.299123+0000) 2019-11-29T20:47:53.182 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:47:53.176+0000 1694c700 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:57.906607+0000 front 2019-11-29T20:46:58.163331+0000 (oldest deadline 2019-11-29T20:47:42.500968+0000) 2019-11-29T20:47:53.371 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:47:53.366+0000 1694c700 -1 osd.1 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:54.925993+0000 front 2019-11-29T20:46:54.680938+0000 (oldest deadline 2019-11-29T20:47:40.518220+0000) 2019-11-29T20:47:53.442 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:47:53.436+0000 1694c700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:54.004922+0000 front 2019-11-29T20:46:53.973071+0000 (oldest deadline 2019-11-29T20:47:39.845015+0000) 2019-11-29T20:47:53.459 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:47:53.453+0000 1694c700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:57.792907+0000 front 2019-11-29T20:46:57.750527+0000 (oldest deadline 2019-11-29T20:47:41.230713+0000) 2019-11-29T20:47:53.678 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:47:53.672+0000 1694c700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:55.179191+0000 front 2019-11-29T20:46:55.180469+0000 (oldest deadline 2019-11-29T20:47:39.833241+0000) 2019-11-29T20:47:53.827 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:47:53.821+0000 1694c700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:56.148035+0000 front 2019-11-29T20:46:56.566436+0000 (oldest deadline 2019-11-29T20:47:40.226304+0000) 2019-11-29T20:47:53.913 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:47:53.906+0000 1694c700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:54.077425+0000 front 2019-11-29T20:46:54.085466+0000 (oldest deadline 2019-11-29T20:47:39.299123+0000) 2019-11-29T20:47:54.161 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:47:54.155+0000 1694c700 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:57.906607+0000 front 2019-11-29T20:46:58.163331+0000 (oldest deadline 2019-11-29T20:47:42.500968+0000) 2019-11-29T20:47:54.335 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:47:54.329+0000 1694c700 -1 osd.1 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:54.925993+0000 front 2019-11-29T20:46:54.680938+0000 (oldest deadline 2019-11-29T20:47:40.518220+0000) 2019-11-29T20:47:54.422 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:47:54.415+0000 1694c700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:54.004922+0000 front 2019-11-29T20:46:53.973071+0000 (oldest deadline 2019-11-29T20:47:39.845015+0000) 2019-11-29T20:47:54.484 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:47:54.478+0000 1694c700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:57.792907+0000 front 2019-11-29T20:46:57.750527+0000 (oldest deadline 2019-11-29T20:47:41.230713+0000) 2019-11-29T20:47:54.696 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:47:54.690+0000 1694c700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:55.179191+0000 front 2019-11-29T20:46:55.180469+0000 (oldest deadline 2019-11-29T20:47:39.833241+0000) 2019-11-29T20:47:54.797 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:47:54.792+0000 1694c700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:56.148035+0000 front 2019-11-29T20:46:56.566436+0000 (oldest deadline 2019-11-29T20:47:40.226304+0000) 2019-11-29T20:47:54.870 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:47:54.864+0000 1694c700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:54.077425+0000 front 2019-11-29T20:46:54.085466+0000 (oldest deadline 2019-11-29T20:47:39.299123+0000) 2019-11-29T20:47:55.195 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:47:55.189+0000 1694c700 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:57.906607+0000 front 2019-11-29T20:46:58.163331+0000 (oldest deadline 2019-11-29T20:47:42.500968+0000) 2019-11-29T20:47:55.351 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:47:55.346+0000 1694c700 -1 osd.1 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:54.925993+0000 front 2019-11-29T20:46:54.680938+0000 (oldest deadline 2019-11-29T20:47:40.518220+0000) 2019-11-29T20:47:55.432 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:47:55.426+0000 1694c700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:54.004922+0000 front 2019-11-29T20:46:53.973071+0000 (oldest deadline 2019-11-29T20:47:39.845015+0000) 2019-11-29T20:47:55.445 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:47:55.435+0000 1694c700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:57.792907+0000 front 2019-11-29T20:46:57.750527+0000 (oldest deadline 2019-11-29T20:47:41.230713+0000) 2019-11-29T20:47:55.682 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:47:55.676+0000 1694c700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:55.179191+0000 front 2019-11-29T20:46:55.180469+0000 (oldest deadline 2019-11-29T20:47:39.833241+0000) 2019-11-29T20:47:55.787 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:47:55.782+0000 1694c700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:56.148035+0000 front 2019-11-29T20:46:56.566436+0000 (oldest deadline 2019-11-29T20:47:40.226304+0000) 2019-11-29T20:47:55.874 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:47:55.868+0000 1694c700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:54.077425+0000 front 2019-11-29T20:46:54.085466+0000 (oldest deadline 2019-11-29T20:47:39.299123+0000) 2019-11-29T20:47:56.234 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:47:56.227+0000 1694c700 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:57.906607+0000 front 2019-11-29T20:46:58.163331+0000 (oldest deadline 2019-11-29T20:47:42.500968+0000) 2019-11-29T20:47:56.380 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:47:56.374+0000 1694c700 -1 osd.1 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:54.925993+0000 front 2019-11-29T20:46:54.680938+0000 (oldest deadline 2019-11-29T20:47:40.518220+0000) 2019-11-29T20:47:56.452 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:47:56.446+0000 1694c700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:54.004922+0000 front 2019-11-29T20:46:53.973071+0000 (oldest deadline 2019-11-29T20:47:39.845015+0000) 2019-11-29T20:47:56.479 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:47:56.473+0000 1694c700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:57.792907+0000 front 2019-11-29T20:46:57.750527+0000 (oldest deadline 2019-11-29T20:47:41.230713+0000) 2019-11-29T20:47:56.646 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:47:56.640+0000 1694c700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:55.179191+0000 front 2019-11-29T20:46:55.180469+0000 (oldest deadline 2019-11-29T20:47:39.833241+0000) 2019-11-29T20:47:56.745 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:47:56.740+0000 1694c700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:56.148035+0000 front 2019-11-29T20:46:56.566436+0000 (oldest deadline 2019-11-29T20:47:40.226304+0000) 2019-11-29T20:47:56.925 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:47:56.920+0000 1694c700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:54.077425+0000 front 2019-11-29T20:46:54.085466+0000 (oldest deadline 2019-11-29T20:47:39.299123+0000) 2019-11-29T20:47:57.268 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:47:57.262+0000 1694c700 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:57.906607+0000 front 2019-11-29T20:46:58.163331+0000 (oldest deadline 2019-11-29T20:47:42.500968+0000) 2019-11-29T20:47:57.415 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:47:57.405+0000 1694c700 -1 osd.1 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:54.925993+0000 front 2019-11-29T20:46:54.680938+0000 (oldest deadline 2019-11-29T20:47:40.518220+0000) 2019-11-29T20:47:57.460 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:47:57.455+0000 1694c700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:54.004922+0000 front 2019-11-29T20:46:53.973071+0000 (oldest deadline 2019-11-29T20:47:39.845015+0000) 2019-11-29T20:47:57.486 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:47:57.481+0000 1694c700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:57.792907+0000 front 2019-11-29T20:46:57.750527+0000 (oldest deadline 2019-11-29T20:47:41.230713+0000) 2019-11-29T20:47:57.667 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:47:57.661+0000 1694c700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:55.179191+0000 front 2019-11-29T20:46:55.180469+0000 (oldest deadline 2019-11-29T20:47:39.833241+0000) 2019-11-29T20:47:57.776 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:47:57.770+0000 1694c700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:56.148035+0000 front 2019-11-29T20:46:56.566436+0000 (oldest deadline 2019-11-29T20:47:40.226304+0000) 2019-11-29T20:47:57.915 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:47:57.909+0000 1694c700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:54.077425+0000 front 2019-11-29T20:46:54.085466+0000 (oldest deadline 2019-11-29T20:47:39.299123+0000) 2019-11-29T20:47:58.318 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:47:58.313+0000 1694c700 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:57.906607+0000 front 2019-11-29T20:46:58.163331+0000 (oldest deadline 2019-11-29T20:47:42.500968+0000) 2019-11-29T20:47:58.403 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:47:58.397+0000 1694c700 -1 osd.1 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:54.925993+0000 front 2019-11-29T20:46:54.680938+0000 (oldest deadline 2019-11-29T20:47:40.518220+0000) 2019-11-29T20:47:58.452 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:47:58.446+0000 1694c700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:57.792907+0000 front 2019-11-29T20:46:57.750527+0000 (oldest deadline 2019-11-29T20:47:41.230713+0000) 2019-11-29T20:47:58.476 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:47:58.468+0000 1694c700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:54.004922+0000 front 2019-11-29T20:46:53.973071+0000 (oldest deadline 2019-11-29T20:47:39.845015+0000) 2019-11-29T20:47:58.693 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:47:58.687+0000 1694c700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:55.179191+0000 front 2019-11-29T20:46:55.180469+0000 (oldest deadline 2019-11-29T20:47:39.833241+0000) 2019-11-29T20:47:58.760 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:47:58.755+0000 1694c700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:56.148035+0000 front 2019-11-29T20:46:56.566436+0000 (oldest deadline 2019-11-29T20:47:40.226304+0000) 2019-11-29T20:47:58.914 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:47:58.908+0000 1694c700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:54.077425+0000 front 2019-11-29T20:46:54.085466+0000 (oldest deadline 2019-11-29T20:47:39.299123+0000) 2019-11-29T20:47:59.307 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:47:59.301+0000 1694c700 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:57.906607+0000 front 2019-11-29T20:46:58.163331+0000 (oldest deadline 2019-11-29T20:47:42.500968+0000) 2019-11-29T20:47:59.456 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:47:59.451+0000 1694c700 -1 osd.1 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:54.925993+0000 front 2019-11-29T20:46:54.680938+0000 (oldest deadline 2019-11-29T20:47:40.518220+0000) 2019-11-29T20:47:59.465 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:47:59.459+0000 1694c700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:57.792907+0000 front 2019-11-29T20:46:57.750527+0000 (oldest deadline 2019-11-29T20:47:41.230713+0000) 2019-11-29T20:47:59.467 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:47:59.462+0000 1694c700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:54.004922+0000 front 2019-11-29T20:46:53.973071+0000 (oldest deadline 2019-11-29T20:47:39.845015+0000) 2019-11-29T20:47:59.674 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:47:59.667+0000 1694c700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:55.179191+0000 front 2019-11-29T20:46:55.180469+0000 (oldest deadline 2019-11-29T20:47:39.833241+0000) 2019-11-29T20:47:59.787 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:47:59.776+0000 1694c700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:56.148035+0000 front 2019-11-29T20:46:56.566436+0000 (oldest deadline 2019-11-29T20:47:40.226304+0000) 2019-11-29T20:47:59.923 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:47:59.916+0000 1694c700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:54.077425+0000 front 2019-11-29T20:46:54.085466+0000 (oldest deadline 2019-11-29T20:47:39.299123+0000) 2019-11-29T20:48:00.291 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:48:00.285+0000 1694c700 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:57.906607+0000 front 2019-11-29T20:46:58.163331+0000 (oldest deadline 2019-11-29T20:47:42.500968+0000) 2019-11-29T20:48:00.443 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:48:00.438+0000 1694c700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:57.792907+0000 front 2019-11-29T20:46:57.750527+0000 (oldest deadline 2019-11-29T20:47:41.230713+0000) 2019-11-29T20:48:00.465 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:48:00.460+0000 1694c700 -1 osd.1 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:54.925993+0000 front 2019-11-29T20:46:54.680938+0000 (oldest deadline 2019-11-29T20:47:40.518220+0000) 2019-11-29T20:48:00.466 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:48:00.460+0000 1694c700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:54.004922+0000 front 2019-11-29T20:46:53.973071+0000 (oldest deadline 2019-11-29T20:47:39.845015+0000) 2019-11-29T20:48:00.715 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:48:00.710+0000 1694c700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:55.179191+0000 front 2019-11-29T20:46:55.180469+0000 (oldest deadline 2019-11-29T20:47:39.833241+0000) 2019-11-29T20:48:00.829 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:48:00.824+0000 1694c700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:56.148035+0000 front 2019-11-29T20:46:56.566436+0000 (oldest deadline 2019-11-29T20:47:40.226304+0000) 2019-11-29T20:48:00.887 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:48:00.880+0000 1694c700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:54.077425+0000 front 2019-11-29T20:46:54.085466+0000 (oldest deadline 2019-11-29T20:47:39.299123+0000) 2019-11-29T20:48:01.255 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:48:01.249+0000 1694c700 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:57.906607+0000 front 2019-11-29T20:46:58.163331+0000 (oldest deadline 2019-11-29T20:47:42.500968+0000) 2019-11-29T20:48:01.430 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:48:01.421+0000 1694c700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:57.792907+0000 front 2019-11-29T20:46:57.750527+0000 (oldest deadline 2019-11-29T20:47:41.230713+0000) 2019-11-29T20:48:01.513 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:48:01.508+0000 1694c700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:54.004922+0000 front 2019-11-29T20:46:53.973071+0000 (oldest deadline 2019-11-29T20:47:39.845015+0000) 2019-11-29T20:48:01.514 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:48:01.509+0000 1694c700 -1 osd.1 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:54.925993+0000 front 2019-11-29T20:46:54.680938+0000 (oldest deadline 2019-11-29T20:47:40.518220+0000) 2019-11-29T20:48:01.761 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:48:01.756+0000 1694c700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:55.179191+0000 front 2019-11-29T20:46:55.180469+0000 (oldest deadline 2019-11-29T20:47:39.833241+0000) 2019-11-29T20:48:01.836 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:48:01.826+0000 1694c700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:56.148035+0000 front 2019-11-29T20:46:56.566436+0000 (oldest deadline 2019-11-29T20:47:40.226304+0000) 2019-11-29T20:48:01.919 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:48:01.914+0000 1694c700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:54.077425+0000 front 2019-11-29T20:46:54.085466+0000 (oldest deadline 2019-11-29T20:47:39.299123+0000) 2019-11-29T20:48:02.256 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:48:02.251+0000 1694c700 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:57.906607+0000 front 2019-11-29T20:46:58.163331+0000 (oldest deadline 2019-11-29T20:47:42.500968+0000) 2019-11-29T20:48:02.394 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:48:02.389+0000 1694c700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:57.792907+0000 front 2019-11-29T20:46:57.750527+0000 (oldest deadline 2019-11-29T20:47:41.230713+0000) 2019-11-29T20:48:02.509 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:48:02.504+0000 1694c700 -1 osd.1 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:54.925993+0000 front 2019-11-29T20:46:54.680938+0000 (oldest deadline 2019-11-29T20:47:40.518220+0000) 2019-11-29T20:48:02.563 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:48:02.559+0000 1694c700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:54.004922+0000 front 2019-11-29T20:46:53.973071+0000 (oldest deadline 2019-11-29T20:47:39.845015+0000) 2019-11-29T20:48:02.816 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:48:02.810+0000 1694c700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:55.179191+0000 front 2019-11-29T20:46:55.180469+0000 (oldest deadline 2019-11-29T20:47:39.833241+0000) 2019-11-29T20:48:02.884 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:48:02.878+0000 1694c700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:54.077425+0000 front 2019-11-29T20:46:54.085466+0000 (oldest deadline 2019-11-29T20:47:39.299123+0000) 2019-11-29T20:48:02.893 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:48:02.885+0000 1694c700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:56.148035+0000 front 2019-11-29T20:46:56.566436+0000 (oldest deadline 2019-11-29T20:47:40.226304+0000) 2019-11-29T20:48:03.239 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:48:03.233+0000 1694c700 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:57.906607+0000 front 2019-11-29T20:46:58.163331+0000 (oldest deadline 2019-11-29T20:47:42.500968+0000) 2019-11-29T20:48:03.368 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:48:03.363+0000 1694c700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:57.792907+0000 front 2019-11-29T20:46:57.750527+0000 (oldest deadline 2019-11-29T20:47:41.230713+0000) 2019-11-29T20:48:03.552 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:48:03.547+0000 1694c700 -1 osd.1 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:54.925993+0000 front 2019-11-29T20:46:54.680938+0000 (oldest deadline 2019-11-29T20:47:40.518220+0000) 2019-11-29T20:48:03.589 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:48:03.583+0000 1694c700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:54.004922+0000 front 2019-11-29T20:46:53.973071+0000 (oldest deadline 2019-11-29T20:47:39.845015+0000) 2019-11-29T20:48:03.842 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:48:03.836+0000 1694c700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:55.179191+0000 front 2019-11-29T20:46:55.180469+0000 (oldest deadline 2019-11-29T20:47:39.833241+0000) 2019-11-29T20:48:03.858 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:48:03.853+0000 1694c700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:56.148035+0000 front 2019-11-29T20:46:56.566436+0000 (oldest deadline 2019-11-29T20:47:40.226304+0000) 2019-11-29T20:48:03.889 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:48:03.876+0000 1694c700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:54.077425+0000 front 2019-11-29T20:46:54.085466+0000 (oldest deadline 2019-11-29T20:47:39.299123+0000) 2019-11-29T20:48:04.194 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:48:04.189+0000 1694c700 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:57.906607+0000 front 2019-11-29T20:46:58.163331+0000 (oldest deadline 2019-11-29T20:47:42.500968+0000) 2019-11-29T20:48:04.391 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:48:04.387+0000 1694c700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:57.792907+0000 front 2019-11-29T20:46:57.750527+0000 (oldest deadline 2019-11-29T20:47:41.230713+0000) 2019-11-29T20:48:04.545 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:48:04.540+0000 1694c700 -1 osd.1 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:54.925993+0000 front 2019-11-29T20:46:54.680938+0000 (oldest deadline 2019-11-29T20:47:40.518220+0000) 2019-11-29T20:48:04.610 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:48:04.603+0000 1694c700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:54.004922+0000 front 2019-11-29T20:46:53.973071+0000 (oldest deadline 2019-11-29T20:47:39.845015+0000) 2019-11-29T20:48:04.808 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:48:04.801+0000 1694c700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:55.179191+0000 front 2019-11-29T20:46:55.180469+0000 (oldest deadline 2019-11-29T20:47:39.833241+0000) 2019-11-29T20:48:04.842 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:48:04.837+0000 1694c700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:56.148035+0000 front 2019-11-29T20:46:56.566436+0000 (oldest deadline 2019-11-29T20:47:40.226304+0000) 2019-11-29T20:48:04.889 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:48:04.882+0000 1694c700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:54.077425+0000 front 2019-11-29T20:46:54.085466+0000 (oldest deadline 2019-11-29T20:47:39.299123+0000) 2019-11-29T20:48:05.237 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:48:05.232+0000 1694c700 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:57.906607+0000 front 2019-11-29T20:46:58.163331+0000 (oldest deadline 2019-11-29T20:47:42.500968+0000) 2019-11-29T20:48:05.380 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:48:05.375+0000 1694c700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:57.792907+0000 front 2019-11-29T20:46:57.750527+0000 (oldest deadline 2019-11-29T20:47:41.230713+0000) 2019-11-29T20:48:05.542 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:48:05.537+0000 1694c700 -1 osd.1 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:54.925993+0000 front 2019-11-29T20:46:54.680938+0000 (oldest deadline 2019-11-29T20:47:40.518220+0000) 2019-11-29T20:48:05.636 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:48:05.629+0000 1694c700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:54.004922+0000 front 2019-11-29T20:46:53.973071+0000 (oldest deadline 2019-11-29T20:47:39.845015+0000) 2019-11-29T20:48:05.852 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:48:05.845+0000 1694c700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:55.179191+0000 front 2019-11-29T20:46:55.180469+0000 (oldest deadline 2019-11-29T20:47:39.833241+0000) 2019-11-29T20:48:05.875 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:48:05.868+0000 1694c700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:56.148035+0000 front 2019-11-29T20:46:56.566436+0000 (oldest deadline 2019-11-29T20:47:40.226304+0000) 2019-11-29T20:48:05.884 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:48:05.878+0000 1694c700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:54.077425+0000 front 2019-11-29T20:46:54.085466+0000 (oldest deadline 2019-11-29T20:47:39.299123+0000) 2019-11-29T20:48:06.260 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:48:06.253+0000 1694c700 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:57.906607+0000 front 2019-11-29T20:46:58.163331+0000 (oldest deadline 2019-11-29T20:47:42.500968+0000) 2019-11-29T20:48:06.362 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:48:06.356+0000 1694c700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:57.792907+0000 front 2019-11-29T20:46:57.750527+0000 (oldest deadline 2019-11-29T20:47:41.230713+0000) 2019-11-29T20:48:06.504 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:48:06.499+0000 1694c700 -1 osd.1 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:54.925993+0000 front 2019-11-29T20:46:54.680938+0000 (oldest deadline 2019-11-29T20:47:40.518220+0000) 2019-11-29T20:48:06.645 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:48:06.639+0000 1694c700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:54.004922+0000 front 2019-11-29T20:46:53.973071+0000 (oldest deadline 2019-11-29T20:47:39.845015+0000) 2019-11-29T20:48:06.847 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:48:06.841+0000 1694c700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:55.179191+0000 front 2019-11-29T20:46:55.180469+0000 (oldest deadline 2019-11-29T20:47:39.833241+0000) 2019-11-29T20:48:06.848 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:48:06.844+0000 1694c700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:56.148035+0000 front 2019-11-29T20:46:56.566436+0000 (oldest deadline 2019-11-29T20:47:40.226304+0000) 2019-11-29T20:48:06.868 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:48:06.864+0000 1694c700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:54.077425+0000 front 2019-11-29T20:46:54.085466+0000 (oldest deadline 2019-11-29T20:47:39.299123+0000) 2019-11-29T20:48:07.256 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:48:07.250+0000 1694c700 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:57.906607+0000 front 2019-11-29T20:46:58.163331+0000 (oldest deadline 2019-11-29T20:47:42.500968+0000) 2019-11-29T20:48:07.317 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:48:07.311+0000 1694c700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:57.792907+0000 front 2019-11-29T20:46:57.750527+0000 (oldest deadline 2019-11-29T20:47:41.230713+0000) 2019-11-29T20:48:07.537 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:48:07.531+0000 1694c700 -1 osd.1 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:54.925993+0000 front 2019-11-29T20:46:54.680938+0000 (oldest deadline 2019-11-29T20:47:40.518220+0000) 2019-11-29T20:48:07.645 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:48:07.640+0000 1694c700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:54.004922+0000 front 2019-11-29T20:46:53.973071+0000 (oldest deadline 2019-11-29T20:47:39.845015+0000) 2019-11-29T20:48:07.847 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:48:07.841+0000 1694c700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:56.148035+0000 front 2019-11-29T20:46:56.566436+0000 (oldest deadline 2019-11-29T20:47:40.226304+0000) 2019-11-29T20:48:07.870 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:48:07.863+0000 1694c700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:55.179191+0000 front 2019-11-29T20:46:55.180469+0000 (oldest deadline 2019-11-29T20:47:39.833241+0000) 2019-11-29T20:48:07.915 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:48:07.908+0000 1694c700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:54.077425+0000 front 2019-11-29T20:46:54.085466+0000 (oldest deadline 2019-11-29T20:47:39.299123+0000) 2019-11-29T20:48:08.240 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:48:08.234+0000 1694c700 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:57.906607+0000 front 2019-11-29T20:46:58.163331+0000 (oldest deadline 2019-11-29T20:47:42.500968+0000) 2019-11-29T20:48:08.282 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:48:08.276+0000 1694c700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:57.792907+0000 front 2019-11-29T20:46:57.750527+0000 (oldest deadline 2019-11-29T20:47:41.230713+0000) 2019-11-29T20:48:08.515 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:48:08.507+0000 1694c700 -1 osd.1 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:54.925993+0000 front 2019-11-29T20:46:54.680938+0000 (oldest deadline 2019-11-29T20:47:40.518220+0000) 2019-11-29T20:48:08.686 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:48:08.681+0000 1694c700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:54.004922+0000 front 2019-11-29T20:46:53.973071+0000 (oldest deadline 2019-11-29T20:47:39.845015+0000) 2019-11-29T20:48:08.874 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:48:08.868+0000 1694c700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:56.148035+0000 front 2019-11-29T20:46:56.566436+0000 (oldest deadline 2019-11-29T20:47:40.226304+0000) 2019-11-29T20:48:08.887 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:48:08.882+0000 1694c700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:55.179191+0000 front 2019-11-29T20:46:55.180469+0000 (oldest deadline 2019-11-29T20:47:39.833241+0000) 2019-11-29T20:48:08.926 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:48:08.920+0000 1694c700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:54.077425+0000 front 2019-11-29T20:46:54.085466+0000 (oldest deadline 2019-11-29T20:47:39.299123+0000) 2019-11-29T20:48:09.212 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:48:09.207+0000 1694c700 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:57.906607+0000 front 2019-11-29T20:46:58.163331+0000 (oldest deadline 2019-11-29T20:47:42.500968+0000) 2019-11-29T20:48:09.249 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:48:09.243+0000 1694c700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:57.792907+0000 front 2019-11-29T20:46:57.750527+0000 (oldest deadline 2019-11-29T20:47:41.230713+0000) 2019-11-29T20:48:09.485 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:48:09.478+0000 1694c700 -1 osd.1 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:54.925993+0000 front 2019-11-29T20:46:54.680938+0000 (oldest deadline 2019-11-29T20:47:40.518220+0000) 2019-11-29T20:48:09.737 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:48:09.730+0000 1694c700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:54.004922+0000 front 2019-11-29T20:46:53.973071+0000 (oldest deadline 2019-11-29T20:47:39.845015+0000) 2019-11-29T20:48:09.834 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:48:09.827+0000 1694c700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:56.148035+0000 front 2019-11-29T20:46:56.566436+0000 (oldest deadline 2019-11-29T20:47:40.226304+0000) 2019-11-29T20:48:09.896 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:48:09.890+0000 1694c700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:55.179191+0000 front 2019-11-29T20:46:55.180469+0000 (oldest deadline 2019-11-29T20:47:39.833241+0000) 2019-11-29T20:48:09.973 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:48:09.968+0000 1694c700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:54.077425+0000 front 2019-11-29T20:46:54.085466+0000 (oldest deadline 2019-11-29T20:47:39.299123+0000) 2019-11-29T20:48:10.208 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:48:10.202+0000 1694c700 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:57.906607+0000 front 2019-11-29T20:46:58.163331+0000 (oldest deadline 2019-11-29T20:47:42.500968+0000) 2019-11-29T20:48:10.289 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:48:10.283+0000 1694c700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:57.792907+0000 front 2019-11-29T20:46:57.750527+0000 (oldest deadline 2019-11-29T20:47:41.230713+0000) 2019-11-29T20:48:10.512 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:48:10.506+0000 1694c700 -1 osd.1 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:54.925993+0000 front 2019-11-29T20:46:54.680938+0000 (oldest deadline 2019-11-29T20:47:40.518220+0000) 2019-11-29T20:48:10.750 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:48:10.744+0000 1694c700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:54.004922+0000 front 2019-11-29T20:46:53.973071+0000 (oldest deadline 2019-11-29T20:47:39.845015+0000) 2019-11-29T20:48:10.818 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:48:10.813+0000 1694c700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:56.148035+0000 front 2019-11-29T20:46:56.566436+0000 (oldest deadline 2019-11-29T20:47:40.226304+0000) 2019-11-29T20:48:10.912 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:48:10.906+0000 1694c700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:55.179191+0000 front 2019-11-29T20:46:55.180469+0000 (oldest deadline 2019-11-29T20:47:39.833241+0000) 2019-11-29T20:48:11.021 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:48:11.007+0000 1694c700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:54.077425+0000 front 2019-11-29T20:46:54.085466+0000 (oldest deadline 2019-11-29T20:47:39.299123+0000) 2019-11-29T20:48:11.186 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:48:11.181+0000 1694c700 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:57.906607+0000 front 2019-11-29T20:46:58.163331+0000 (oldest deadline 2019-11-29T20:47:42.500968+0000) 2019-11-29T20:48:11.278 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:48:11.274+0000 1694c700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:57.792907+0000 front 2019-11-29T20:46:57.750527+0000 (oldest deadline 2019-11-29T20:47:41.230713+0000) 2019-11-29T20:48:11.498 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:48:11.492+0000 1694c700 -1 osd.1 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:54.925993+0000 front 2019-11-29T20:46:54.680938+0000 (oldest deadline 2019-11-29T20:47:40.518220+0000) 2019-11-29T20:48:11.718 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:48:11.713+0000 1694c700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:54.004922+0000 front 2019-11-29T20:46:53.973071+0000 (oldest deadline 2019-11-29T20:47:39.845015+0000) 2019-11-29T20:48:11.845 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:48:11.839+0000 1694c700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:56.148035+0000 front 2019-11-29T20:46:56.566436+0000 (oldest deadline 2019-11-29T20:47:40.226304+0000) 2019-11-29T20:48:11.903 INFO:tasks.ceph.mon.b.smithi022.stderr:2019-11-29T20:48:11.899+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.62:6823/10369,v1:172.21.15.62:6825/10369] for 45sec e196 v196) 2019-11-29T20:48:11.904 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:48:11.898+0000 1694c700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:55.179191+0000 front 2019-11-29T20:46:55.180469+0000 (oldest deadline 2019-11-29T20:47:39.833241+0000) 2019-11-29T20:48:12.009 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:48:12.003+0000 1694c700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:54.077425+0000 front 2019-11-29T20:46:54.085466+0000 (oldest deadline 2019-11-29T20:47:39.299123+0000) 2019-11-29T20:48:12.191 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:48:12.186+0000 1694c700 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:57.906607+0000 front 2019-11-29T20:46:58.163331+0000 (oldest deadline 2019-11-29T20:47:42.500968+0000) 2019-11-29T20:48:12.329 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:48:12.324+0000 1694c700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:57.792907+0000 front 2019-11-29T20:46:57.750527+0000 (oldest deadline 2019-11-29T20:47:41.230713+0000) 2019-11-29T20:48:12.513 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:48:12.507+0000 1694c700 -1 osd.1 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:54.925993+0000 front 2019-11-29T20:46:54.680938+0000 (oldest deadline 2019-11-29T20:47:40.518220+0000) 2019-11-29T20:48:12.738 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:48:12.732+0000 1694c700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:54.004922+0000 front 2019-11-29T20:46:53.973071+0000 (oldest deadline 2019-11-29T20:47:39.845015+0000) 2019-11-29T20:48:12.826 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:48:12.819+0000 1694c700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:56.148035+0000 front 2019-11-29T20:46:56.566436+0000 (oldest deadline 2019-11-29T20:47:40.226304+0000) 2019-11-29T20:48:12.907 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:48:12.901+0000 1694c700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:55.179191+0000 front 2019-11-29T20:46:55.180469+0000 (oldest deadline 2019-11-29T20:47:39.833241+0000) 2019-11-29T20:48:12.968 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:48:12.963+0000 1694c700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:54.077425+0000 front 2019-11-29T20:46:54.085466+0000 (oldest deadline 2019-11-29T20:47:39.299123+0000) 2019-11-29T20:48:13.230 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:48:13.224+0000 1694c700 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:57.906607+0000 front 2019-11-29T20:46:58.163331+0000 (oldest deadline 2019-11-29T20:47:42.500968+0000) 2019-11-29T20:48:13.368 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:48:13.363+0000 1694c700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:57.792907+0000 front 2019-11-29T20:46:57.750527+0000 (oldest deadline 2019-11-29T20:47:41.230713+0000) 2019-11-29T20:48:13.553 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:48:13.547+0000 1694c700 -1 osd.1 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:54.925993+0000 front 2019-11-29T20:46:54.680938+0000 (oldest deadline 2019-11-29T20:47:40.518220+0000) 2019-11-29T20:48:13.759 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:48:13.753+0000 1694c700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:54.004922+0000 front 2019-11-29T20:46:53.973071+0000 (oldest deadline 2019-11-29T20:47:39.845015+0000) 2019-11-29T20:48:13.858 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:48:13.852+0000 1694c700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:56.148035+0000 front 2019-11-29T20:46:56.566436+0000 (oldest deadline 2019-11-29T20:47:40.226304+0000) 2019-11-29T20:48:13.878 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:48:13.872+0000 1694c700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:55.179191+0000 front 2019-11-29T20:46:55.180469+0000 (oldest deadline 2019-11-29T20:47:39.833241+0000) 2019-11-29T20:48:14.014 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:48:14.008+0000 1694c700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:54.077425+0000 front 2019-11-29T20:46:54.085466+0000 (oldest deadline 2019-11-29T20:47:39.299123+0000) 2019-11-29T20:48:14.197 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:48:14.191+0000 1694c700 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:57.906607+0000 front 2019-11-29T20:46:58.163331+0000 (oldest deadline 2019-11-29T20:47:42.500968+0000) 2019-11-29T20:48:14.372 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:48:14.366+0000 1694c700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:57.792907+0000 front 2019-11-29T20:46:57.750527+0000 (oldest deadline 2019-11-29T20:47:41.230713+0000) 2019-11-29T20:48:14.576 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:48:14.571+0000 1694c700 -1 osd.1 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:54.925993+0000 front 2019-11-29T20:46:54.680938+0000 (oldest deadline 2019-11-29T20:47:40.518220+0000) 2019-11-29T20:48:14.741 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:48:14.735+0000 1694c700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:54.004922+0000 front 2019-11-29T20:46:53.973071+0000 (oldest deadline 2019-11-29T20:47:39.845015+0000) 2019-11-29T20:48:14.862 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:48:14.856+0000 1694c700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:56.148035+0000 front 2019-11-29T20:46:56.566436+0000 (oldest deadline 2019-11-29T20:47:40.226304+0000) 2019-11-29T20:48:14.910 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:48:14.901+0000 1694c700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:55.179191+0000 front 2019-11-29T20:46:55.180469+0000 (oldest deadline 2019-11-29T20:47:39.833241+0000) 2019-11-29T20:48:15.054 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:48:15.048+0000 1694c700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:54.077425+0000 front 2019-11-29T20:46:54.085466+0000 (oldest deadline 2019-11-29T20:47:39.299123+0000) 2019-11-29T20:48:15.190 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:48:15.184+0000 1694c700 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:57.906607+0000 front 2019-11-29T20:46:58.163331+0000 (oldest deadline 2019-11-29T20:47:42.500968+0000) 2019-11-29T20:48:15.382 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:48:15.376+0000 1694c700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:57.792907+0000 front 2019-11-29T20:46:57.750527+0000 (oldest deadline 2019-11-29T20:47:41.230713+0000) 2019-11-29T20:48:15.620 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:48:15.615+0000 1694c700 -1 osd.1 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:54.925993+0000 front 2019-11-29T20:46:54.680938+0000 (oldest deadline 2019-11-29T20:47:40.518220+0000) 2019-11-29T20:48:15.789 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:48:15.784+0000 1694c700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:54.004922+0000 front 2019-11-29T20:46:53.973071+0000 (oldest deadline 2019-11-29T20:47:39.845015+0000) 2019-11-29T20:48:15.868 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:48:15.863+0000 1694c700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:56.148035+0000 front 2019-11-29T20:46:56.566436+0000 (oldest deadline 2019-11-29T20:47:40.226304+0000) 2019-11-29T20:48:15.919 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:48:15.914+0000 1694c700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:55.179191+0000 front 2019-11-29T20:46:55.180469+0000 (oldest deadline 2019-11-29T20:47:39.833241+0000) 2019-11-29T20:48:16.060 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:48:16.053+0000 1694c700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:54.077425+0000 front 2019-11-29T20:46:54.085466+0000 (oldest deadline 2019-11-29T20:47:39.299123+0000) 2019-11-29T20:48:16.153 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:48:16.148+0000 1694c700 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:57.906607+0000 front 2019-11-29T20:46:58.163331+0000 (oldest deadline 2019-11-29T20:47:42.500968+0000) 2019-11-29T20:48:16.353 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:48:16.342+0000 1694c700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:57.792907+0000 front 2019-11-29T20:46:57.750527+0000 (oldest deadline 2019-11-29T20:47:41.230713+0000) 2019-11-29T20:48:16.632 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:48:16.626+0000 1694c700 -1 osd.1 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:54.925993+0000 front 2019-11-29T20:46:54.680938+0000 (oldest deadline 2019-11-29T20:47:40.518220+0000) 2019-11-29T20:48:16.805 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:48:16.799+0000 1694c700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:54.004922+0000 front 2019-11-29T20:46:53.973071+0000 (oldest deadline 2019-11-29T20:47:39.845015+0000) 2019-11-29T20:48:16.821 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:48:16.817+0000 1694c700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:56.148035+0000 front 2019-11-29T20:46:56.566436+0000 (oldest deadline 2019-11-29T20:47:40.226304+0000) 2019-11-29T20:48:16.882 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:48:16.877+0000 1694c700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:55.179191+0000 front 2019-11-29T20:46:55.180469+0000 (oldest deadline 2019-11-29T20:47:39.833241+0000) 2019-11-29T20:48:16.955 INFO:tasks.ceph.mon.b.smithi022.stderr:2019-11-29T20:48:16.951+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.62:6823/10369,v1:172.21.15.62:6825/10369] for 45sec e196 v196) 2019-11-29T20:48:17.050 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:48:17.035+0000 1694c700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:46:54.077425+0000 front 2019-11-29T20:46:54.085466+0000 (oldest deadline 2019-11-29T20:47:39.299123+0000) 2019-11-29T20:48:37.188 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:08:23:17.846 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T20:48:37.197 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:08:23:17.803 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T20:48:37.197 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:08:23:17.855 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T20:48:37.201 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:08:23:17.809 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T20:48:37.266 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:08:23:17.872 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T20:48:37.271 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:08:23:17.878 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T20:48:37.362 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:08:23:18.020 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T20:48:37.386 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:08:23:17.993 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T20:48:37.431 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:08:23:18.037 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T20:48:54.636 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:48:54.624+0000 11cac700 -1 osd.2 201 build_incremental_map_msg missing incremental map 200 2019-11-29T20:48:54.707 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:48:54.592+0000 11cac700 -1 osd.1 201 build_incremental_map_msg missing incremental map 200 2019-11-29T20:49:14.232 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:49:14.227+0000 1694c700 -1 osd.6 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.136900+0000 front 2019-11-29T20:48:34.209527+0000 (oldest deadline 2019-11-29T20:49:14.178557+0000) 2019-11-29T20:49:15.223 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:49:15.217+0000 1694c700 -1 osd.6 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.136900+0000 front 2019-11-29T20:48:34.209527+0000 (oldest deadline 2019-11-29T20:49:14.178557+0000) 2019-11-29T20:49:15.965 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:49:15.960+0000 1694c700 -1 osd.0 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:32.642436+0000 front 2019-11-29T20:48:32.702162+0000 (oldest deadline 2019-11-29T20:49:15.246685+0000) 2019-11-29T20:49:16.220 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:49:16.215+0000 1694c700 -1 osd.6 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.136900+0000 front 2019-11-29T20:48:34.209527+0000 (oldest deadline 2019-11-29T20:49:14.178557+0000) 2019-11-29T20:49:16.243 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:49:16.235+0000 1694c700 -1 osd.1 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.125583+0000 front 2019-11-29T20:48:31.360296+0000 (oldest deadline 2019-11-29T20:49:15.717854+0000) 2019-11-29T20:49:16.273 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:49:16.267+0000 1694c700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:33.125676+0000 front 2019-11-29T20:48:30.633410+0000 (oldest deadline 2019-11-29T20:49:15.897952+0000) 2019-11-29T20:49:16.990 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:49:16.984+0000 1694c700 -1 osd.0 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:32.642436+0000 front 2019-11-29T20:48:32.702162+0000 (oldest deadline 2019-11-29T20:49:15.246685+0000) 2019-11-29T20:49:17.235 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:49:17.230+0000 1694c700 -1 osd.6 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.136900+0000 front 2019-11-29T20:48:34.209527+0000 (oldest deadline 2019-11-29T20:49:14.178557+0000) 2019-11-29T20:49:17.236 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:49:17.230+0000 1694c700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:33.125676+0000 front 2019-11-29T20:48:30.633410+0000 (oldest deadline 2019-11-29T20:49:15.897952+0000) 2019-11-29T20:49:17.249 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:49:17.242+0000 1694c700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:30.692127+0000 front 2019-11-29T20:48:30.438016+0000 (oldest deadline 2019-11-29T20:49:16.297727+0000) 2019-11-29T20:49:17.255 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:49:17.248+0000 1694c700 -1 osd.1 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.125583+0000 front 2019-11-29T20:48:31.360296+0000 (oldest deadline 2019-11-29T20:49:15.717854+0000) 2019-11-29T20:49:18.010 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:49:18.004+0000 1694c700 -1 osd.0 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:32.642436+0000 front 2019-11-29T20:48:32.702162+0000 (oldest deadline 2019-11-29T20:49:15.246685+0000) 2019-11-29T20:49:18.193 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:49:18.187+0000 1694c700 -1 osd.6 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.136900+0000 front 2019-11-29T20:48:34.209527+0000 (oldest deadline 2019-11-29T20:49:14.178557+0000) 2019-11-29T20:49:18.236 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:49:18.230+0000 1694c700 -1 osd.1 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.125583+0000 front 2019-11-29T20:48:31.360296+0000 (oldest deadline 2019-11-29T20:49:15.717854+0000) 2019-11-29T20:49:18.241 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:49:18.236+0000 1694c700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:33.125676+0000 front 2019-11-29T20:48:30.633410+0000 (oldest deadline 2019-11-29T20:49:15.897952+0000) 2019-11-29T20:49:18.257 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:49:18.253+0000 1694c700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:30.692127+0000 front 2019-11-29T20:48:30.438016+0000 (oldest deadline 2019-11-29T20:49:16.297727+0000) 2019-11-29T20:49:18.994 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:49:18.989+0000 1694c700 -1 osd.0 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:32.642436+0000 front 2019-11-29T20:48:32.702162+0000 (oldest deadline 2019-11-29T20:49:15.246685+0000) 2019-11-29T20:49:19.127 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:49:19.121+0000 1694c700 -1 osd.2 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.587271+0000 front 2019-11-29T20:48:33.607669+0000 (oldest deadline 2019-11-29T20:49:18.859125+0000) 2019-11-29T20:49:19.167 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:49:19.162+0000 1694c700 -1 osd.6 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.136900+0000 front 2019-11-29T20:48:34.209527+0000 (oldest deadline 2019-11-29T20:49:14.178557+0000) 2019-11-29T20:49:19.220 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:49:19.216+0000 1694c700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:33.125676+0000 front 2019-11-29T20:48:30.633410+0000 (oldest deadline 2019-11-29T20:49:15.897952+0000) 2019-11-29T20:49:19.243 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:49:19.238+0000 1694c700 -1 osd.1 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.125583+0000 front 2019-11-29T20:48:31.360296+0000 (oldest deadline 2019-11-29T20:49:15.717854+0000) 2019-11-29T20:49:19.295 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:49:19.289+0000 1694c700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:30.692127+0000 front 2019-11-29T20:48:30.438016+0000 (oldest deadline 2019-11-29T20:49:16.297727+0000) 2019-11-29T20:49:19.955 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:49:19.949+0000 1694c700 -1 osd.0 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:32.642436+0000 front 2019-11-29T20:48:32.702162+0000 (oldest deadline 2019-11-29T20:49:15.246685+0000) 2019-11-29T20:49:20.085 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:49:20.080+0000 1694c700 -1 osd.2 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.587271+0000 front 2019-11-29T20:48:33.607669+0000 (oldest deadline 2019-11-29T20:49:18.859125+0000) 2019-11-29T20:49:20.166 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:49:20.161+0000 1694c700 -1 osd.6 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.136900+0000 front 2019-11-29T20:48:34.209527+0000 (oldest deadline 2019-11-29T20:49:14.178557+0000) 2019-11-29T20:49:20.203 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:49:20.198+0000 1694c700 -1 osd.1 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.125583+0000 front 2019-11-29T20:48:31.360296+0000 (oldest deadline 2019-11-29T20:49:15.717854+0000) 2019-11-29T20:49:20.239 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:49:20.234+0000 1694c700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:33.125676+0000 front 2019-11-29T20:48:30.633410+0000 (oldest deadline 2019-11-29T20:49:15.897952+0000) 2019-11-29T20:49:20.270 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:49:20.265+0000 1694c700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:30.692127+0000 front 2019-11-29T20:48:30.438016+0000 (oldest deadline 2019-11-29T20:49:16.297727+0000) 2019-11-29T20:49:20.970 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:49:20.964+0000 1694c700 -1 osd.0 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:32.642436+0000 front 2019-11-29T20:48:32.702162+0000 (oldest deadline 2019-11-29T20:49:15.246685+0000) 2019-11-29T20:49:21.079 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:49:21.073+0000 1694c700 -1 osd.2 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.587271+0000 front 2019-11-29T20:48:33.607669+0000 (oldest deadline 2019-11-29T20:49:18.859125+0000) 2019-11-29T20:49:21.192 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:49:21.182+0000 1694c700 -1 osd.1 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.125583+0000 front 2019-11-29T20:48:31.360296+0000 (oldest deadline 2019-11-29T20:49:15.717854+0000) 2019-11-29T20:49:21.195 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:49:21.190+0000 1694c700 -1 osd.6 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.136900+0000 front 2019-11-29T20:48:34.209527+0000 (oldest deadline 2019-11-29T20:49:14.178557+0000) 2019-11-29T20:49:21.207 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:49:21.202+0000 1694c700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:33.125676+0000 front 2019-11-29T20:48:30.633410+0000 (oldest deadline 2019-11-29T20:49:15.897952+0000) 2019-11-29T20:49:21.317 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:49:21.311+0000 1694c700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:30.692127+0000 front 2019-11-29T20:48:30.438016+0000 (oldest deadline 2019-11-29T20:49:16.297727+0000) 2019-11-29T20:49:22.003 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:49:21.998+0000 1694c700 -1 osd.0 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:32.642436+0000 front 2019-11-29T20:48:32.702162+0000 (oldest deadline 2019-11-29T20:49:15.246685+0000) 2019-11-29T20:49:22.132 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:49:22.127+0000 1694c700 -1 osd.2 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.587271+0000 front 2019-11-29T20:48:33.607669+0000 (oldest deadline 2019-11-29T20:49:18.859125+0000) 2019-11-29T20:49:22.185 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:49:22.174+0000 1694c700 -1 osd.6 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.136900+0000 front 2019-11-29T20:48:34.209527+0000 (oldest deadline 2019-11-29T20:49:14.178557+0000) 2019-11-29T20:49:22.189 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:49:22.183+0000 1694c700 -1 osd.1 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.125583+0000 front 2019-11-29T20:48:31.360296+0000 (oldest deadline 2019-11-29T20:49:15.717854+0000) 2019-11-29T20:49:22.231 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:49:22.224+0000 1694c700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:33.125676+0000 front 2019-11-29T20:48:30.633410+0000 (oldest deadline 2019-11-29T20:49:15.897952+0000) 2019-11-29T20:49:22.273 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:49:22.267+0000 1694c700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:30.692127+0000 front 2019-11-29T20:48:30.438016+0000 (oldest deadline 2019-11-29T20:49:16.297727+0000) 2019-11-29T20:49:23.012 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:49:23.007+0000 1694c700 -1 osd.0 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:32.642436+0000 front 2019-11-29T20:48:32.702162+0000 (oldest deadline 2019-11-29T20:49:15.246685+0000) 2019-11-29T20:49:23.132 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:49:23.123+0000 1694c700 -1 osd.2 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.587271+0000 front 2019-11-29T20:48:33.607669+0000 (oldest deadline 2019-11-29T20:49:18.859125+0000) 2019-11-29T20:49:23.193 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:49:23.188+0000 1694c700 -1 osd.6 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.136900+0000 front 2019-11-29T20:48:34.209527+0000 (oldest deadline 2019-11-29T20:49:14.178557+0000) 2019-11-29T20:49:23.234 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:49:23.229+0000 1694c700 -1 osd.1 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.125583+0000 front 2019-11-29T20:48:31.360296+0000 (oldest deadline 2019-11-29T20:49:15.717854+0000) 2019-11-29T20:49:23.243 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:49:23.237+0000 1694c700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:33.125676+0000 front 2019-11-29T20:48:30.633410+0000 (oldest deadline 2019-11-29T20:49:15.897952+0000) 2019-11-29T20:49:23.288 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:49:23.279+0000 1694c700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:30.692127+0000 front 2019-11-29T20:48:30.438016+0000 (oldest deadline 2019-11-29T20:49:16.297727+0000) 2019-11-29T20:49:24.061 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:49:24.053+0000 1694c700 -1 osd.0 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:32.642436+0000 front 2019-11-29T20:48:32.702162+0000 (oldest deadline 2019-11-29T20:49:15.246685+0000) 2019-11-29T20:49:24.162 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:49:24.156+0000 1694c700 -1 osd.2 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.587271+0000 front 2019-11-29T20:48:33.607669+0000 (oldest deadline 2019-11-29T20:49:18.859125+0000) 2019-11-29T20:49:24.175 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:49:24.166+0000 1694c700 -1 osd.6 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.136900+0000 front 2019-11-29T20:48:34.209527+0000 (oldest deadline 2019-11-29T20:49:14.178557+0000) 2019-11-29T20:49:24.217 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:49:24.212+0000 1694c700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:33.125676+0000 front 2019-11-29T20:48:30.633410+0000 (oldest deadline 2019-11-29T20:49:15.897952+0000) 2019-11-29T20:49:24.280 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:49:24.275+0000 1694c700 -1 osd.1 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.125583+0000 front 2019-11-29T20:48:31.360296+0000 (oldest deadline 2019-11-29T20:49:15.717854+0000) 2019-11-29T20:49:24.322 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:49:24.316+0000 1694c700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:30.692127+0000 front 2019-11-29T20:48:30.438016+0000 (oldest deadline 2019-11-29T20:49:16.297727+0000) 2019-11-29T20:49:25.037 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:49:25.031+0000 1694c700 -1 osd.0 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:32.642436+0000 front 2019-11-29T20:48:32.702162+0000 (oldest deadline 2019-11-29T20:49:15.246685+0000) 2019-11-29T20:49:25.118 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:49:25.113+0000 1694c700 -1 osd.2 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.587271+0000 front 2019-11-29T20:48:33.607669+0000 (oldest deadline 2019-11-29T20:49:18.859125+0000) 2019-11-29T20:49:25.120 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:49:25.115+0000 1694c700 -1 osd.3 202 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:129962 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e200) 2019-11-29T20:49:25.159 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:49:25.153+0000 1694c700 -1 osd.6 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.136900+0000 front 2019-11-29T20:48:34.209527+0000 (oldest deadline 2019-11-29T20:49:14.178557+0000) 2019-11-29T20:49:25.247 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:49:25.243+0000 1694c700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:33.125676+0000 front 2019-11-29T20:48:30.633410+0000 (oldest deadline 2019-11-29T20:49:15.897952+0000) 2019-11-29T20:49:25.328 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:49:25.320+0000 1694c700 -1 osd.1 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.125583+0000 front 2019-11-29T20:48:31.360296+0000 (oldest deadline 2019-11-29T20:49:15.717854+0000) 2019-11-29T20:49:25.368 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:49:25.364+0000 1694c700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:30.692127+0000 front 2019-11-29T20:48:30.438016+0000 (oldest deadline 2019-11-29T20:49:16.297727+0000) 2019-11-29T20:49:26.044 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:49:26.038+0000 1694c700 -1 osd.0 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:32.642436+0000 front 2019-11-29T20:48:32.702162+0000 (oldest deadline 2019-11-29T20:49:15.246685+0000) 2019-11-29T20:49:26.079 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:49:26.073+0000 1694c700 -1 osd.3 202 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:129962 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e200) 2019-11-29T20:49:26.113 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:49:26.108+0000 1694c700 -1 osd.2 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.587271+0000 front 2019-11-29T20:48:33.607669+0000 (oldest deadline 2019-11-29T20:49:18.859125+0000) 2019-11-29T20:49:26.181 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:49:26.170+0000 1694c700 -1 osd.6 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.136900+0000 front 2019-11-29T20:48:34.209527+0000 (oldest deadline 2019-11-29T20:49:14.178557+0000) 2019-11-29T20:49:26.285 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:49:26.278+0000 1694c700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:33.125676+0000 front 2019-11-29T20:48:30.633410+0000 (oldest deadline 2019-11-29T20:49:15.897952+0000) 2019-11-29T20:49:26.373 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:49:26.367+0000 1694c700 -1 osd.1 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.125583+0000 front 2019-11-29T20:48:31.360296+0000 (oldest deadline 2019-11-29T20:49:15.717854+0000) 2019-11-29T20:49:26.421 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:49:26.415+0000 1694c700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:30.692127+0000 front 2019-11-29T20:48:30.438016+0000 (oldest deadline 2019-11-29T20:49:16.297727+0000) 2019-11-29T20:49:27.022 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:49:27.018+0000 1694c700 -1 osd.0 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:32.642436+0000 front 2019-11-29T20:48:32.702162+0000 (oldest deadline 2019-11-29T20:49:15.246685+0000) 2019-11-29T20:49:27.040 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:49:27.036+0000 1694c700 -1 osd.3 202 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:129962 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e200) 2019-11-29T20:49:27.087 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:49:27.083+0000 1694c700 -1 osd.2 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.587271+0000 front 2019-11-29T20:48:33.607669+0000 (oldest deadline 2019-11-29T20:49:18.859125+0000) 2019-11-29T20:49:27.197 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:49:27.193+0000 1694c700 -1 osd.6 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.136900+0000 front 2019-11-29T20:48:34.209527+0000 (oldest deadline 2019-11-29T20:49:14.178557+0000) 2019-11-29T20:49:27.280 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:49:27.274+0000 1694c700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:33.125676+0000 front 2019-11-29T20:48:30.633410+0000 (oldest deadline 2019-11-29T20:49:15.897952+0000) 2019-11-29T20:49:27.360 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:49:27.353+0000 1694c700 -1 osd.1 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.125583+0000 front 2019-11-29T20:48:31.360296+0000 (oldest deadline 2019-11-29T20:49:15.717854+0000) 2019-11-29T20:49:27.410 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:49:27.405+0000 1694c700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:30.692127+0000 front 2019-11-29T20:48:30.438016+0000 (oldest deadline 2019-11-29T20:49:16.297727+0000) 2019-11-29T20:49:28.061 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:49:28.056+0000 1694c700 -1 osd.0 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:32.642436+0000 front 2019-11-29T20:48:32.702162+0000 (oldest deadline 2019-11-29T20:49:15.246685+0000) 2019-11-29T20:49:28.078 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:49:28.073+0000 1694c700 -1 osd.3 202 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:129962 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e200) 2019-11-29T20:49:28.094 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:49:28.089+0000 1694c700 -1 osd.2 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.587271+0000 front 2019-11-29T20:48:33.607669+0000 (oldest deadline 2019-11-29T20:49:18.859125+0000) 2019-11-29T20:49:28.241 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:49:28.230+0000 1694c700 -1 osd.6 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.136900+0000 front 2019-11-29T20:48:34.209527+0000 (oldest deadline 2019-11-29T20:49:14.178557+0000) 2019-11-29T20:49:28.311 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:49:28.306+0000 1694c700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:33.125676+0000 front 2019-11-29T20:48:30.633410+0000 (oldest deadline 2019-11-29T20:49:15.897952+0000) 2019-11-29T20:49:28.327 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:49:28.321+0000 1694c700 -1 osd.1 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.125583+0000 front 2019-11-29T20:48:31.360296+0000 (oldest deadline 2019-11-29T20:49:15.717854+0000) 2019-11-29T20:49:28.399 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:49:28.395+0000 1694c700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:30.692127+0000 front 2019-11-29T20:48:30.438016+0000 (oldest deadline 2019-11-29T20:49:16.297727+0000) 2019-11-29T20:49:29.050 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:49:29.044+0000 1694c700 -1 osd.0 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:32.642436+0000 front 2019-11-29T20:48:32.702162+0000 (oldest deadline 2019-11-29T20:49:15.246685+0000) 2019-11-29T20:49:29.105 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:49:29.100+0000 1694c700 -1 osd.2 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.587271+0000 front 2019-11-29T20:48:33.607669+0000 (oldest deadline 2019-11-29T20:49:18.859125+0000) 2019-11-29T20:49:29.109 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:49:29.104+0000 1694c700 -1 osd.3 202 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:129962 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e200) 2019-11-29T20:49:29.269 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:49:29.264+0000 1694c700 -1 osd.6 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.136900+0000 front 2019-11-29T20:48:34.209527+0000 (oldest deadline 2019-11-29T20:49:14.178557+0000) 2019-11-29T20:49:29.344 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:49:29.339+0000 1694c700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:33.125676+0000 front 2019-11-29T20:48:30.633410+0000 (oldest deadline 2019-11-29T20:49:15.897952+0000) 2019-11-29T20:49:29.353 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:49:29.347+0000 1694c700 -1 osd.1 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.125583+0000 front 2019-11-29T20:48:31.360296+0000 (oldest deadline 2019-11-29T20:49:15.717854+0000) 2019-11-29T20:49:29.425 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:49:29.419+0000 1694c700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:30.692127+0000 front 2019-11-29T20:48:30.438016+0000 (oldest deadline 2019-11-29T20:49:16.297727+0000) 2019-11-29T20:49:30.071 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:49:30.067+0000 1694c700 -1 osd.3 202 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:129962 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e200) 2019-11-29T20:49:30.098 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:49:30.094+0000 1694c700 -1 osd.0 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:32.642436+0000 front 2019-11-29T20:48:32.702162+0000 (oldest deadline 2019-11-29T20:49:15.246685+0000) 2019-11-29T20:49:30.159 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:49:30.152+0000 1694c700 -1 osd.2 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.587271+0000 front 2019-11-29T20:48:33.607669+0000 (oldest deadline 2019-11-29T20:49:18.859125+0000) 2019-11-29T20:49:30.228 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:49:30.223+0000 1694c700 -1 osd.6 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.136900+0000 front 2019-11-29T20:48:34.209527+0000 (oldest deadline 2019-11-29T20:49:14.178557+0000) 2019-11-29T20:49:30.305 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:49:30.299+0000 1694c700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:33.125676+0000 front 2019-11-29T20:48:30.633410+0000 (oldest deadline 2019-11-29T20:49:15.897952+0000) 2019-11-29T20:49:30.322 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:49:30.316+0000 1694c700 -1 osd.1 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.125583+0000 front 2019-11-29T20:48:31.360296+0000 (oldest deadline 2019-11-29T20:49:15.717854+0000) 2019-11-29T20:49:30.391 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:49:30.385+0000 1694c700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:30.692127+0000 front 2019-11-29T20:48:30.438016+0000 (oldest deadline 2019-11-29T20:49:16.297727+0000) 2019-11-29T20:49:31.061 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:49:31.055+0000 1694c700 -1 osd.3 202 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:129962 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e200) 2019-11-29T20:49:31.140 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:49:31.134+0000 1694c700 -1 osd.0 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:32.642436+0000 front 2019-11-29T20:48:32.702162+0000 (oldest deadline 2019-11-29T20:49:15.246685+0000) 2019-11-29T20:49:31.200 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:49:31.193+0000 1694c700 -1 osd.2 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.587271+0000 front 2019-11-29T20:48:33.607669+0000 (oldest deadline 2019-11-29T20:49:18.859125+0000) 2019-11-29T20:49:31.222 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:49:31.218+0000 1694c700 -1 osd.6 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.136900+0000 front 2019-11-29T20:48:34.209527+0000 (oldest deadline 2019-11-29T20:49:14.178557+0000) 2019-11-29T20:49:31.333 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:49:31.328+0000 1694c700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:33.125676+0000 front 2019-11-29T20:48:30.633410+0000 (oldest deadline 2019-11-29T20:49:15.897952+0000) 2019-11-29T20:49:31.356 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:49:31.350+0000 1694c700 -1 osd.1 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.125583+0000 front 2019-11-29T20:48:31.360296+0000 (oldest deadline 2019-11-29T20:49:15.717854+0000) 2019-11-29T20:49:31.418 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:49:31.412+0000 1694c700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:30.692127+0000 front 2019-11-29T20:48:30.438016+0000 (oldest deadline 2019-11-29T20:49:16.297727+0000) 2019-11-29T20:49:32.061 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:49:32.054+0000 1694c700 -1 osd.3 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:48:51.894449+0000 (oldest deadline 2019-11-29T20:49:31.894449+0000) 2019-11-29T20:49:32.063 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:49:32.058+0000 1694c700 -1 osd.3 202 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:129962 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e200) 2019-11-29T20:49:32.175 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:49:32.170+0000 1694c700 -1 osd.2 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.587271+0000 front 2019-11-29T20:48:33.607669+0000 (oldest deadline 2019-11-29T20:49:18.859125+0000) 2019-11-29T20:49:32.181 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:49:32.176+0000 1694c700 -1 osd.0 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:32.642436+0000 front 2019-11-29T20:48:32.702162+0000 (oldest deadline 2019-11-29T20:49:15.246685+0000) 2019-11-29T20:49:32.275 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:49:32.271+0000 1694c700 -1 osd.6 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.136900+0000 front 2019-11-29T20:48:34.209527+0000 (oldest deadline 2019-11-29T20:49:14.178557+0000) 2019-11-29T20:49:32.385 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:49:32.379+0000 1694c700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:30.692127+0000 front 2019-11-29T20:48:30.438016+0000 (oldest deadline 2019-11-29T20:49:16.297727+0000) 2019-11-29T20:49:32.389 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:49:32.384+0000 1694c700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:33.125676+0000 front 2019-11-29T20:48:30.633410+0000 (oldest deadline 2019-11-29T20:49:15.897952+0000) 2019-11-29T20:49:32.390 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:49:32.385+0000 1694c700 -1 osd.1 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.125583+0000 front 2019-11-29T20:48:31.360296+0000 (oldest deadline 2019-11-29T20:49:15.717854+0000) 2019-11-29T20:49:33.111 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:49:33.106+0000 1694c700 -1 osd.3 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:48:51.894449+0000 (oldest deadline 2019-11-29T20:49:31.894449+0000) 2019-11-29T20:49:33.112 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:49:33.107+0000 1694c700 -1 osd.3 202 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:129962 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e200) 2019-11-29T20:49:33.192 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:49:33.186+0000 1694c700 -1 osd.0 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:32.642436+0000 front 2019-11-29T20:48:32.702162+0000 (oldest deadline 2019-11-29T20:49:15.246685+0000) 2019-11-29T20:49:33.212 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:49:33.206+0000 1694c700 -1 osd.2 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.587271+0000 front 2019-11-29T20:48:33.607669+0000 (oldest deadline 2019-11-29T20:49:18.859125+0000) 2019-11-29T20:49:33.309 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:49:33.304+0000 1694c700 -1 osd.6 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.136900+0000 front 2019-11-29T20:48:34.209527+0000 (oldest deadline 2019-11-29T20:49:14.178557+0000) 2019-11-29T20:49:33.417 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:49:33.413+0000 1694c700 -1 osd.1 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.125583+0000 front 2019-11-29T20:48:31.360296+0000 (oldest deadline 2019-11-29T20:49:15.717854+0000) 2019-11-29T20:49:33.424 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:49:33.419+0000 1694c700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:33.125676+0000 front 2019-11-29T20:48:30.633410+0000 (oldest deadline 2019-11-29T20:49:15.897952+0000) 2019-11-29T20:49:33.438 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:49:33.434+0000 1694c700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:30.692127+0000 front 2019-11-29T20:48:30.438016+0000 (oldest deadline 2019-11-29T20:49:16.297727+0000) 2019-11-29T20:49:34.127 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:49:34.121+0000 1694c700 -1 osd.3 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:48:51.894449+0000 (oldest deadline 2019-11-29T20:49:31.894449+0000) 2019-11-29T20:49:34.128 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:49:34.123+0000 1694c700 -1 osd.3 202 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:129962 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e200) 2019-11-29T20:49:34.206 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:49:34.200+0000 1694c700 -1 osd.0 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:32.642436+0000 front 2019-11-29T20:48:32.702162+0000 (oldest deadline 2019-11-29T20:49:15.246685+0000) 2019-11-29T20:49:34.217 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:49:34.209+0000 1694c700 -1 osd.2 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.587271+0000 front 2019-11-29T20:48:33.607669+0000 (oldest deadline 2019-11-29T20:49:18.859125+0000) 2019-11-29T20:49:34.315 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:49:34.309+0000 1694c700 -1 osd.6 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.136900+0000 front 2019-11-29T20:48:34.209527+0000 (oldest deadline 2019-11-29T20:49:14.178557+0000) 2019-11-29T20:49:34.400 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:49:34.395+0000 1694c700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:33.125676+0000 front 2019-11-29T20:48:30.633410+0000 (oldest deadline 2019-11-29T20:49:15.897952+0000) 2019-11-29T20:49:34.410 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:49:34.404+0000 1694c700 -1 osd.1 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.125583+0000 front 2019-11-29T20:48:31.360296+0000 (oldest deadline 2019-11-29T20:49:15.717854+0000) 2019-11-29T20:49:34.440 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:49:34.435+0000 1694c700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:30.692127+0000 front 2019-11-29T20:48:30.438016+0000 (oldest deadline 2019-11-29T20:49:16.297727+0000) 2019-11-29T20:49:34.872 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:08:24:15.531 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T20:49:34.877 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:08:24:15.536 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T20:49:34.905 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:08:24:15.511 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T20:49:34.905 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:08:24:15.512 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T20:49:34.914 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:08:24:15.520 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T20:49:34.917 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:08:24:15.523 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T20:49:34.965 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:08:24:15.623 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T20:49:35.009 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:08:24:15.616 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T20:49:35.027 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:08:24:15.634 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T20:49:35.162 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:49:35.157+0000 1694c700 -1 osd.3 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:48:51.894449+0000 (oldest deadline 2019-11-29T20:49:31.894449+0000) 2019-11-29T20:49:35.162 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:49:35.158+0000 1694c700 -1 osd.3 202 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:129962 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e200) 2019-11-29T20:49:35.174 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:49:35.169+0000 1694c700 -1 osd.2 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.587271+0000 front 2019-11-29T20:48:33.607669+0000 (oldest deadline 2019-11-29T20:49:18.859125+0000) 2019-11-29T20:49:35.198 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:49:35.193+0000 1694c700 -1 osd.0 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:32.642436+0000 front 2019-11-29T20:48:32.702162+0000 (oldest deadline 2019-11-29T20:49:15.246685+0000) 2019-11-29T20:49:35.312 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:49:35.307+0000 1694c700 -1 osd.6 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.136900+0000 front 2019-11-29T20:48:34.209527+0000 (oldest deadline 2019-11-29T20:49:14.178557+0000) 2019-11-29T20:49:35.366 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:49:35.361+0000 1694c700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:33.125676+0000 front 2019-11-29T20:48:30.633410+0000 (oldest deadline 2019-11-29T20:49:15.897952+0000) 2019-11-29T20:49:35.403 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:49:35.398+0000 1694c700 -1 osd.1 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.125583+0000 front 2019-11-29T20:48:31.360296+0000 (oldest deadline 2019-11-29T20:49:15.717854+0000) 2019-11-29T20:49:35.493 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:49:35.488+0000 1694c700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:30.692127+0000 front 2019-11-29T20:48:30.438016+0000 (oldest deadline 2019-11-29T20:49:16.297727+0000) 2019-11-29T20:49:36.121 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:49:36.115+0000 1694c700 -1 osd.3 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:48:51.894449+0000 (oldest deadline 2019-11-29T20:49:31.894449+0000) 2019-11-29T20:49:36.123 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:49:36.117+0000 1694c700 -1 osd.3 202 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:129962 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e200) 2019-11-29T20:49:36.176 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:49:36.171+0000 1694c700 -1 osd.0 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:32.642436+0000 front 2019-11-29T20:48:32.702162+0000 (oldest deadline 2019-11-29T20:49:15.246685+0000) 2019-11-29T20:49:36.205 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:49:36.200+0000 1694c700 -1 osd.2 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.587271+0000 front 2019-11-29T20:48:33.607669+0000 (oldest deadline 2019-11-29T20:49:18.859125+0000) 2019-11-29T20:49:36.288 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:49:36.283+0000 1694c700 -1 osd.6 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.136900+0000 front 2019-11-29T20:48:34.209527+0000 (oldest deadline 2019-11-29T20:49:14.178557+0000) 2019-11-29T20:49:36.332 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:49:36.327+0000 1694c700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:33.125676+0000 front 2019-11-29T20:48:30.633410+0000 (oldest deadline 2019-11-29T20:49:15.897952+0000) 2019-11-29T20:49:36.445 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:49:36.439+0000 1694c700 -1 osd.1 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.125583+0000 front 2019-11-29T20:48:31.360296+0000 (oldest deadline 2019-11-29T20:49:15.717854+0000) 2019-11-29T20:49:36.491 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:49:36.486+0000 1694c700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:30.692127+0000 front 2019-11-29T20:48:30.438016+0000 (oldest deadline 2019-11-29T20:49:16.297727+0000) 2019-11-29T20:49:37.145 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:49:37.139+0000 1694c700 -1 osd.3 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:48:51.894449+0000 (oldest deadline 2019-11-29T20:49:31.894449+0000) 2019-11-29T20:49:37.145 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:49:37.140+0000 1694c700 -1 osd.3 202 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:129962 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e200) 2019-11-29T20:49:37.154 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:49:37.149+0000 1694c700 -1 osd.0 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:32.642436+0000 front 2019-11-29T20:48:32.702162+0000 (oldest deadline 2019-11-29T20:49:15.246685+0000) 2019-11-29T20:49:37.163 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:49:37.159+0000 1694c700 -1 osd.2 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.587271+0000 front 2019-11-29T20:48:33.607669+0000 (oldest deadline 2019-11-29T20:49:18.859125+0000) 2019-11-29T20:49:37.267 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:49:37.262+0000 1694c700 -1 osd.6 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.136900+0000 front 2019-11-29T20:48:34.209527+0000 (oldest deadline 2019-11-29T20:49:14.178557+0000) 2019-11-29T20:49:37.326 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:49:37.321+0000 1694c700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:33.125676+0000 front 2019-11-29T20:48:30.633410+0000 (oldest deadline 2019-11-29T20:49:15.897952+0000) 2019-11-29T20:49:37.435 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:49:37.430+0000 1694c700 -1 osd.1 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.125583+0000 front 2019-11-29T20:48:31.360296+0000 (oldest deadline 2019-11-29T20:49:15.717854+0000) 2019-11-29T20:49:37.511 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:49:37.505+0000 1694c700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:30.692127+0000 front 2019-11-29T20:48:30.438016+0000 (oldest deadline 2019-11-29T20:49:16.297727+0000) 2019-11-29T20:49:38.140 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:49:38.135+0000 1694c700 -1 osd.2 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.587271+0000 front 2019-11-29T20:48:33.607669+0000 (oldest deadline 2019-11-29T20:49:18.859125+0000) 2019-11-29T20:49:38.158 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:49:38.152+0000 1694c700 -1 osd.3 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:48:51.894449+0000 (oldest deadline 2019-11-29T20:49:31.894449+0000) 2019-11-29T20:49:38.159 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:49:38.154+0000 1694c700 -1 osd.3 202 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:129962 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e200) 2019-11-29T20:49:38.186 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:49:38.181+0000 1694c700 -1 osd.0 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:32.642436+0000 front 2019-11-29T20:48:32.702162+0000 (oldest deadline 2019-11-29T20:49:15.246685+0000) 2019-11-29T20:49:38.288 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:49:38.281+0000 1694c700 -1 osd.6 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.136900+0000 front 2019-11-29T20:48:34.209527+0000 (oldest deadline 2019-11-29T20:49:14.178557+0000) 2019-11-29T20:49:38.357 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:49:38.351+0000 1694c700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:33.125676+0000 front 2019-11-29T20:48:30.633410+0000 (oldest deadline 2019-11-29T20:49:15.897952+0000) 2019-11-29T20:49:38.437 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:49:38.432+0000 1694c700 -1 osd.1 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.125583+0000 front 2019-11-29T20:48:31.360296+0000 (oldest deadline 2019-11-29T20:49:15.717854+0000) 2019-11-29T20:49:38.530 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:49:38.525+0000 1694c700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:30.692127+0000 front 2019-11-29T20:48:30.438016+0000 (oldest deadline 2019-11-29T20:49:16.297727+0000) 2019-11-29T20:49:39.163 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:49:39.157+0000 1694c700 -1 osd.2 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.587271+0000 front 2019-11-29T20:48:33.607669+0000 (oldest deadline 2019-11-29T20:49:18.859125+0000) 2019-11-29T20:49:39.164 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:49:39.159+0000 1694c700 -1 osd.3 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:48:51.894449+0000 (oldest deadline 2019-11-29T20:49:31.894449+0000) 2019-11-29T20:49:39.165 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:49:39.160+0000 1694c700 -1 osd.3 202 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:129962 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e200) 2019-11-29T20:49:39.214 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:49:39.209+0000 1694c700 -1 osd.0 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:32.642436+0000 front 2019-11-29T20:48:32.702162+0000 (oldest deadline 2019-11-29T20:49:15.246685+0000) 2019-11-29T20:49:39.266 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:49:39.261+0000 1694c700 -1 osd.6 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.136900+0000 front 2019-11-29T20:48:34.209527+0000 (oldest deadline 2019-11-29T20:49:14.178557+0000) 2019-11-29T20:49:39.398 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:49:39.392+0000 1694c700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:33.125676+0000 front 2019-11-29T20:48:30.633410+0000 (oldest deadline 2019-11-29T20:49:15.897952+0000) 2019-11-29T20:49:39.455 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:49:39.449+0000 1694c700 -1 osd.1 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.125583+0000 front 2019-11-29T20:48:31.360296+0000 (oldest deadline 2019-11-29T20:49:15.717854+0000) 2019-11-29T20:49:39.507 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:49:39.502+0000 1694c700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:30.692127+0000 front 2019-11-29T20:48:30.438016+0000 (oldest deadline 2019-11-29T20:49:16.297727+0000) 2019-11-29T20:49:40.133 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:49:40.128+0000 1694c700 -1 osd.2 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.587271+0000 front 2019-11-29T20:48:33.607669+0000 (oldest deadline 2019-11-29T20:49:18.859125+0000) 2019-11-29T20:49:40.169 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:49:40.163+0000 1694c700 -1 osd.3 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:48:51.894449+0000 (oldest deadline 2019-11-29T20:49:31.894449+0000) 2019-11-29T20:49:40.170 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:49:40.165+0000 1694c700 -1 osd.3 202 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:129962 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e200) 2019-11-29T20:49:40.183 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:49:40.178+0000 1694c700 -1 osd.0 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:32.642436+0000 front 2019-11-29T20:48:32.702162+0000 (oldest deadline 2019-11-29T20:49:15.246685+0000) 2019-11-29T20:49:40.317 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:49:40.311+0000 1694c700 -1 osd.6 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.136900+0000 front 2019-11-29T20:48:34.209527+0000 (oldest deadline 2019-11-29T20:49:14.178557+0000) 2019-11-29T20:49:40.414 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:49:40.409+0000 1694c700 -1 osd.1 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.125583+0000 front 2019-11-29T20:48:31.360296+0000 (oldest deadline 2019-11-29T20:49:15.717854+0000) 2019-11-29T20:49:40.432 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:49:40.427+0000 1694c700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:33.125676+0000 front 2019-11-29T20:48:30.633410+0000 (oldest deadline 2019-11-29T20:49:15.897952+0000) 2019-11-29T20:49:40.524 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:49:40.519+0000 1694c700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:30.692127+0000 front 2019-11-29T20:48:30.438016+0000 (oldest deadline 2019-11-29T20:49:16.297727+0000) 2019-11-29T20:49:41.091 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:49:41.085+0000 1694c700 -1 osd.2 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.587271+0000 front 2019-11-29T20:48:33.607669+0000 (oldest deadline 2019-11-29T20:49:18.859125+0000) 2019-11-29T20:49:41.209 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:49:41.204+0000 1694c700 -1 osd.3 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:48:51.894449+0000 (oldest deadline 2019-11-29T20:49:31.894449+0000) 2019-11-29T20:49:41.213 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:49:41.208+0000 1694c700 -1 osd.3 202 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:129962 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e200) 2019-11-29T20:49:41.229 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:49:41.224+0000 1694c700 -1 osd.0 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:32.642436+0000 front 2019-11-29T20:48:32.702162+0000 (oldest deadline 2019-11-29T20:49:15.246685+0000) 2019-11-29T20:49:41.270 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:49:41.265+0000 1694c700 -1 osd.6 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.136900+0000 front 2019-11-29T20:48:34.209527+0000 (oldest deadline 2019-11-29T20:49:14.178557+0000) 2019-11-29T20:49:41.388 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:49:41.383+0000 1694c700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:33.125676+0000 front 2019-11-29T20:48:30.633410+0000 (oldest deadline 2019-11-29T20:49:15.897952+0000) 2019-11-29T20:49:41.425 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:49:41.419+0000 1694c700 -1 osd.1 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.125583+0000 front 2019-11-29T20:48:31.360296+0000 (oldest deadline 2019-11-29T20:49:15.717854+0000) 2019-11-29T20:49:41.504 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:49:41.498+0000 1694c700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:30.692127+0000 front 2019-11-29T20:48:30.438016+0000 (oldest deadline 2019-11-29T20:49:16.297727+0000) 2019-11-29T20:49:42.053 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:49:42.046+0000 1694c700 -1 osd.2 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.587271+0000 front 2019-11-29T20:48:33.607669+0000 (oldest deadline 2019-11-29T20:49:18.859125+0000) 2019-11-29T20:49:42.215 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:49:42.209+0000 1694c700 -1 osd.3 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:48:51.894449+0000 (oldest deadline 2019-11-29T20:49:31.894449+0000) 2019-11-29T20:49:42.216 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:49:42.210+0000 1694c700 -1 osd.3 202 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:129962 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e200) 2019-11-29T20:49:42.276 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:49:42.272+0000 1694c700 -1 osd.0 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:32.642436+0000 front 2019-11-29T20:48:32.702162+0000 (oldest deadline 2019-11-29T20:49:15.246685+0000) 2019-11-29T20:49:42.313 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:49:42.308+0000 1694c700 -1 osd.6 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.136900+0000 front 2019-11-29T20:48:34.209527+0000 (oldest deadline 2019-11-29T20:49:14.178557+0000) 2019-11-29T20:49:42.397 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:49:42.391+0000 1694c700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:33.125676+0000 front 2019-11-29T20:48:30.633410+0000 (oldest deadline 2019-11-29T20:49:15.897952+0000) 2019-11-29T20:49:42.469 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:49:42.464+0000 1694c700 -1 osd.1 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.125583+0000 front 2019-11-29T20:48:31.360296+0000 (oldest deadline 2019-11-29T20:49:15.717854+0000) 2019-11-29T20:49:42.556 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:49:42.550+0000 1694c700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:30.692127+0000 front 2019-11-29T20:48:30.438016+0000 (oldest deadline 2019-11-29T20:49:16.297727+0000) 2019-11-29T20:49:43.057 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:49:43.051+0000 1694c700 -1 osd.2 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.587271+0000 front 2019-11-29T20:48:33.607669+0000 (oldest deadline 2019-11-29T20:49:18.859125+0000) 2019-11-29T20:49:43.206 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:49:43.199+0000 1694c700 -1 osd.3 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:48:51.894449+0000 (oldest deadline 2019-11-29T20:49:31.894449+0000) 2019-11-29T20:49:43.209 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:49:43.204+0000 1694c700 -1 osd.3 202 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:129962 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e200) 2019-11-29T20:49:43.275 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:49:43.269+0000 1694c700 -1 osd.0 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:32.642436+0000 front 2019-11-29T20:48:32.702162+0000 (oldest deadline 2019-11-29T20:49:15.246685+0000) 2019-11-29T20:49:43.330 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:49:43.325+0000 1694c700 -1 osd.6 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.136900+0000 front 2019-11-29T20:48:34.209527+0000 (oldest deadline 2019-11-29T20:49:14.178557+0000) 2019-11-29T20:49:43.443 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:49:43.436+0000 1694c700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:33.125676+0000 front 2019-11-29T20:48:30.633410+0000 (oldest deadline 2019-11-29T20:49:15.897952+0000) 2019-11-29T20:49:43.511 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:49:43.505+0000 1694c700 -1 osd.1 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.125583+0000 front 2019-11-29T20:48:31.360296+0000 (oldest deadline 2019-11-29T20:49:15.717854+0000) 2019-11-29T20:49:43.535 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:49:43.528+0000 1694c700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:30.692127+0000 front 2019-11-29T20:48:30.438016+0000 (oldest deadline 2019-11-29T20:49:16.297727+0000) 2019-11-29T20:49:44.021 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:49:44.012+0000 1694c700 -1 osd.2 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.587271+0000 front 2019-11-29T20:48:33.607669+0000 (oldest deadline 2019-11-29T20:49:18.859125+0000) 2019-11-29T20:49:44.247 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:49:44.241+0000 1694c700 -1 osd.3 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:48:51.894449+0000 (oldest deadline 2019-11-29T20:49:31.894449+0000) 2019-11-29T20:49:44.248 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:49:44.243+0000 1694c700 -1 osd.3 202 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:129962 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e200) 2019-11-29T20:49:44.326 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:49:44.321+0000 1694c700 -1 osd.0 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:32.642436+0000 front 2019-11-29T20:48:32.702162+0000 (oldest deadline 2019-11-29T20:49:15.246685+0000) 2019-11-29T20:49:44.336 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:49:44.330+0000 1694c700 -1 osd.6 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.136900+0000 front 2019-11-29T20:48:34.209527+0000 (oldest deadline 2019-11-29T20:49:14.178557+0000) 2019-11-29T20:49:44.476 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:49:44.470+0000 1694c700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:33.125676+0000 front 2019-11-29T20:48:30.633410+0000 (oldest deadline 2019-11-29T20:49:15.897952+0000) 2019-11-29T20:49:44.498 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:49:44.492+0000 1694c700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:30.692127+0000 front 2019-11-29T20:48:30.438016+0000 (oldest deadline 2019-11-29T20:49:16.297727+0000) 2019-11-29T20:49:44.506 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:49:44.501+0000 1694c700 -1 osd.1 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.125583+0000 front 2019-11-29T20:48:31.360296+0000 (oldest deadline 2019-11-29T20:49:15.717854+0000) 2019-11-29T20:49:45.068 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:49:45.061+0000 1694c700 -1 osd.2 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.587271+0000 front 2019-11-29T20:48:33.607669+0000 (oldest deadline 2019-11-29T20:49:18.859125+0000) 2019-11-29T20:49:45.274 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:49:45.267+0000 1694c700 -1 osd.3 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:48:51.894449+0000 (oldest deadline 2019-11-29T20:49:31.894449+0000) 2019-11-29T20:49:45.276 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:49:45.269+0000 1694c700 -1 osd.3 202 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:129962 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e200) 2019-11-29T20:49:45.284 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:49:45.279+0000 1694c700 -1 osd.0 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:32.642436+0000 front 2019-11-29T20:48:32.702162+0000 (oldest deadline 2019-11-29T20:49:15.246685+0000) 2019-11-29T20:49:45.389 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:49:45.382+0000 1694c700 -1 osd.6 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.136900+0000 front 2019-11-29T20:48:34.209527+0000 (oldest deadline 2019-11-29T20:49:14.178557+0000) 2019-11-29T20:49:45.497 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:49:45.492+0000 1694c700 -1 osd.1 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.125583+0000 front 2019-11-29T20:48:31.360296+0000 (oldest deadline 2019-11-29T20:49:15.717854+0000) 2019-11-29T20:49:45.511 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:49:45.500+0000 1694c700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:33.125676+0000 front 2019-11-29T20:48:30.633410+0000 (oldest deadline 2019-11-29T20:49:15.897952+0000) 2019-11-29T20:49:45.526 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:49:45.519+0000 1694c700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:30.692127+0000 front 2019-11-29T20:48:30.438016+0000 (oldest deadline 2019-11-29T20:49:16.297727+0000) 2019-11-29T20:49:46.052 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:49:46.046+0000 1694c700 -1 osd.2 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.587271+0000 front 2019-11-29T20:48:33.607669+0000 (oldest deadline 2019-11-29T20:49:18.859125+0000) 2019-11-29T20:49:46.235 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:49:46.228+0000 1694c700 -1 osd.3 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:48:51.894449+0000 (oldest deadline 2019-11-29T20:49:31.894449+0000) 2019-11-29T20:49:46.235 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:49:46.230+0000 1694c700 -1 osd.3 202 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:129962 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e200) 2019-11-29T20:49:46.252 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:49:46.244+0000 1694c700 -1 osd.0 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:32.642436+0000 front 2019-11-29T20:48:32.702162+0000 (oldest deadline 2019-11-29T20:49:15.246685+0000) 2019-11-29T20:49:46.357 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:49:46.351+0000 1694c700 -1 osd.6 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.136900+0000 front 2019-11-29T20:48:34.209527+0000 (oldest deadline 2019-11-29T20:49:14.178557+0000) 2019-11-29T20:49:46.511 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:49:46.505+0000 1694c700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:30.692127+0000 front 2019-11-29T20:48:30.438016+0000 (oldest deadline 2019-11-29T20:49:16.297727+0000) 2019-11-29T20:49:46.515 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:49:46.509+0000 1694c700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:33.125676+0000 front 2019-11-29T20:48:30.633410+0000 (oldest deadline 2019-11-29T20:49:15.897952+0000) 2019-11-29T20:49:46.542 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:49:46.537+0000 1694c700 -1 osd.1 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.125583+0000 front 2019-11-29T20:48:31.360296+0000 (oldest deadline 2019-11-29T20:49:15.717854+0000) 2019-11-29T20:49:47.087 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:49:47.082+0000 1694c700 -1 osd.2 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.587271+0000 front 2019-11-29T20:48:33.607669+0000 (oldest deadline 2019-11-29T20:49:18.859125+0000) 2019-11-29T20:49:47.217 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:49:47.212+0000 1694c700 -1 osd.0 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:32.642436+0000 front 2019-11-29T20:48:32.702162+0000 (oldest deadline 2019-11-29T20:49:15.246685+0000) 2019-11-29T20:49:47.273 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:49:47.268+0000 1694c700 -1 osd.3 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:48:51.894449+0000 (oldest deadline 2019-11-29T20:49:31.894449+0000) 2019-11-29T20:49:47.273 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:49:47.269+0000 1694c700 -1 osd.3 202 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:129962 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e200) 2019-11-29T20:49:47.317 INFO:tasks.ceph.mon.b.smithi022.stderr:2019-11-29T20:49:47.308+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 3 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.22:6818/9264,v1:172.21.15.22:6819/9264] for 44sec e202 v202) 2019-11-29T20:49:47.331 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:49:47.325+0000 1694c700 -1 osd.6 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.136900+0000 front 2019-11-29T20:48:34.209527+0000 (oldest deadline 2019-11-29T20:49:14.178557+0000) 2019-11-29T20:49:47.475 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:49:47.470+0000 1694c700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:33.125676+0000 front 2019-11-29T20:48:30.633410+0000 (oldest deadline 2019-11-29T20:49:15.897952+0000) 2019-11-29T20:49:47.533 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:49:47.528+0000 1694c700 -1 osd.1 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.125583+0000 front 2019-11-29T20:48:31.360296+0000 (oldest deadline 2019-11-29T20:49:15.717854+0000) 2019-11-29T20:49:47.541 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:49:47.536+0000 1694c700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:30.692127+0000 front 2019-11-29T20:48:30.438016+0000 (oldest deadline 2019-11-29T20:49:16.297727+0000) 2019-11-29T20:49:48.045 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:49:48.037+0000 1694c700 -1 osd.2 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.587271+0000 front 2019-11-29T20:48:33.607669+0000 (oldest deadline 2019-11-29T20:49:18.859125+0000) 2019-11-29T20:49:48.211 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:49:48.205+0000 1694c700 -1 osd.0 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:32.642436+0000 front 2019-11-29T20:48:32.702162+0000 (oldest deadline 2019-11-29T20:49:15.246685+0000) 2019-11-29T20:49:48.267 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:49:48.260+0000 1694c700 -1 osd.3 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:48:51.894449+0000 (oldest deadline 2019-11-29T20:49:31.894449+0000) 2019-11-29T20:49:48.267 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:49:48.263+0000 1694c700 -1 osd.3 202 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:129962 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e200) 2019-11-29T20:49:48.306 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:49:48.300+0000 1694c700 -1 osd.6 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.136900+0000 front 2019-11-29T20:48:34.209527+0000 (oldest deadline 2019-11-29T20:49:14.178557+0000) 2019-11-29T20:49:48.500 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:49:48.493+0000 1694c700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:30.692127+0000 front 2019-11-29T20:48:30.438016+0000 (oldest deadline 2019-11-29T20:49:16.297727+0000) 2019-11-29T20:49:48.516 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:49:48.511+0000 1694c700 -1 osd.1 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.125583+0000 front 2019-11-29T20:48:31.360296+0000 (oldest deadline 2019-11-29T20:49:15.717854+0000) 2019-11-29T20:49:48.520 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:49:48.514+0000 1694c700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:33.125676+0000 front 2019-11-29T20:48:30.633410+0000 (oldest deadline 2019-11-29T20:49:15.897952+0000) 2019-11-29T20:49:49.004 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:49:48.998+0000 1694c700 -1 osd.2 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.587271+0000 front 2019-11-29T20:48:33.607669+0000 (oldest deadline 2019-11-29T20:49:18.859125+0000) 2019-11-29T20:49:49.222 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:49:49.217+0000 1694c700 -1 osd.0 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:32.642436+0000 front 2019-11-29T20:48:32.702162+0000 (oldest deadline 2019-11-29T20:49:15.246685+0000) 2019-11-29T20:49:49.223 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:49:49.218+0000 1694c700 -1 osd.3 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:48:51.894449+0000 (oldest deadline 2019-11-29T20:49:31.894449+0000) 2019-11-29T20:49:49.227 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:49:49.222+0000 1694c700 -1 osd.3 202 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:129962 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e200) 2019-11-29T20:49:49.303 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:49:49.296+0000 1694c700 -1 osd.6 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.136900+0000 front 2019-11-29T20:48:34.209527+0000 (oldest deadline 2019-11-29T20:49:14.178557+0000) 2019-11-29T20:49:49.494 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:49:49.488+0000 1694c700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:30.692127+0000 front 2019-11-29T20:48:30.438016+0000 (oldest deadline 2019-11-29T20:49:16.297727+0000) 2019-11-29T20:49:49.506 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:49:49.500+0000 1694c700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:33.125676+0000 front 2019-11-29T20:48:30.633410+0000 (oldest deadline 2019-11-29T20:49:15.897952+0000) 2019-11-29T20:49:49.562 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:49:49.556+0000 1694c700 -1 osd.1 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.125583+0000 front 2019-11-29T20:48:31.360296+0000 (oldest deadline 2019-11-29T20:49:15.717854+0000) 2019-11-29T20:49:50.051 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:49:50.045+0000 1694c700 -1 osd.2 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.587271+0000 front 2019-11-29T20:48:33.607669+0000 (oldest deadline 2019-11-29T20:49:18.859125+0000) 2019-11-29T20:49:50.205 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:49:50.198+0000 1694c700 -1 osd.3 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:48:51.894449+0000 (oldest deadline 2019-11-29T20:49:31.894449+0000) 2019-11-29T20:49:50.206 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:49:50.200+0000 1694c700 -1 osd.3 202 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:129962 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e200) 2019-11-29T20:49:50.263 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:49:50.258+0000 1694c700 -1 osd.0 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:32.642436+0000 front 2019-11-29T20:48:32.702162+0000 (oldest deadline 2019-11-29T20:49:15.246685+0000) 2019-11-29T20:49:50.341 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:49:50.335+0000 1694c700 -1 osd.6 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.136900+0000 front 2019-11-29T20:48:34.209527+0000 (oldest deadline 2019-11-29T20:49:14.178557+0000) 2019-11-29T20:49:50.456 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:49:50.450+0000 1694c700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:30.692127+0000 front 2019-11-29T20:48:30.438016+0000 (oldest deadline 2019-11-29T20:49:16.297727+0000) 2019-11-29T20:49:50.464 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:49:50.458+0000 1694c700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:33.125676+0000 front 2019-11-29T20:48:30.633410+0000 (oldest deadline 2019-11-29T20:49:15.897952+0000) 2019-11-29T20:49:50.585 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:49:50.579+0000 1694c700 -1 osd.1 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.125583+0000 front 2019-11-29T20:48:31.360296+0000 (oldest deadline 2019-11-29T20:49:15.717854+0000) 2019-11-29T20:49:51.048 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:49:51.043+0000 1694c700 -1 osd.2 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.587271+0000 front 2019-11-29T20:48:33.607669+0000 (oldest deadline 2019-11-29T20:49:18.859125+0000) 2019-11-29T20:49:51.187 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:49:51.182+0000 1694c700 -1 osd.3 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:48:51.894449+0000 (oldest deadline 2019-11-29T20:49:31.894449+0000) 2019-11-29T20:49:51.189 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:49:51.185+0000 1694c700 -1 osd.3 202 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:129962 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e200) 2019-11-29T20:49:51.287 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:49:51.281+0000 1694c700 -1 osd.0 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:32.642436+0000 front 2019-11-29T20:48:32.702162+0000 (oldest deadline 2019-11-29T20:49:15.246685+0000) 2019-11-29T20:49:51.374 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:49:51.366+0000 1694c700 -1 osd.6 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.136900+0000 front 2019-11-29T20:48:34.209527+0000 (oldest deadline 2019-11-29T20:49:14.178557+0000) 2019-11-29T20:49:51.445 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:49:51.438+0000 1694c700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:33.125676+0000 front 2019-11-29T20:48:30.633410+0000 (oldest deadline 2019-11-29T20:49:15.897952+0000) 2019-11-29T20:49:51.481 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:49:51.475+0000 1694c700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:30.692127+0000 front 2019-11-29T20:48:30.438016+0000 (oldest deadline 2019-11-29T20:49:16.297727+0000) 2019-11-29T20:49:51.616 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:49:51.610+0000 1694c700 -1 osd.1 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.125583+0000 front 2019-11-29T20:48:31.360296+0000 (oldest deadline 2019-11-29T20:49:15.717854+0000) 2019-11-29T20:49:52.006 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:49:52.000+0000 1694c700 -1 osd.2 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.587271+0000 front 2019-11-29T20:48:33.607669+0000 (oldest deadline 2019-11-29T20:49:18.859125+0000) 2019-11-29T20:49:52.214 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:49:52.208+0000 1694c700 -1 osd.3 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:48:51.894449+0000 (oldest deadline 2019-11-29T20:49:31.894449+0000) 2019-11-29T20:49:52.215 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:49:52.210+0000 1694c700 -1 osd.3 202 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:129962 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e200) 2019-11-29T20:49:52.318 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:49:52.314+0000 1694c700 -1 osd.0 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:32.642436+0000 front 2019-11-29T20:48:32.702162+0000 (oldest deadline 2019-11-29T20:49:15.246685+0000) 2019-11-29T20:49:52.336 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:49:52.329+0000 1694c700 -1 osd.6 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.136900+0000 front 2019-11-29T20:48:34.209527+0000 (oldest deadline 2019-11-29T20:49:14.178557+0000) 2019-11-29T20:49:52.337 INFO:tasks.ceph.mon.b.smithi022.stderr:2019-11-29T20:49:52.328+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.22:6818/9264,v1:172.21.15.22:6819/9264] for 44sec e202 v202) 2019-11-29T20:49:52.416 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:49:52.410+0000 1694c700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:33.125676+0000 front 2019-11-29T20:48:30.633410+0000 (oldest deadline 2019-11-29T20:49:15.897952+0000) 2019-11-29T20:49:52.515 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:49:52.508+0000 1694c700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:30.692127+0000 front 2019-11-29T20:48:30.438016+0000 (oldest deadline 2019-11-29T20:49:16.297727+0000) 2019-11-29T20:49:52.580 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:49:52.575+0000 1694c700 -1 osd.1 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.125583+0000 front 2019-11-29T20:48:31.360296+0000 (oldest deadline 2019-11-29T20:49:15.717854+0000) 2019-11-29T20:49:52.981 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:49:52.975+0000 1694c700 -1 osd.2 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.587271+0000 front 2019-11-29T20:48:33.607669+0000 (oldest deadline 2019-11-29T20:49:18.859125+0000) 2019-11-29T20:49:53.208 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:49:53.200+0000 1694c700 -1 osd.3 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:48:51.894449+0000 (oldest deadline 2019-11-29T20:49:31.894449+0000) 2019-11-29T20:49:53.208 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:49:53.203+0000 1694c700 -1 osd.3 202 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:129962 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e200) 2019-11-29T20:49:53.279 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:49:53.274+0000 1694c700 -1 osd.0 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:32.642436+0000 front 2019-11-29T20:48:32.702162+0000 (oldest deadline 2019-11-29T20:49:15.246685+0000) 2019-11-29T20:49:53.352 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:49:53.336+0000 1694c700 -1 osd.6 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.136900+0000 front 2019-11-29T20:48:34.209527+0000 (oldest deadline 2019-11-29T20:49:14.178557+0000) 2019-11-29T20:49:53.461 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:49:53.455+0000 1694c700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:33.125676+0000 front 2019-11-29T20:48:30.633410+0000 (oldest deadline 2019-11-29T20:49:15.897952+0000) 2019-11-29T20:49:53.559 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:49:53.552+0000 1694c700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:30.692127+0000 front 2019-11-29T20:48:30.438016+0000 (oldest deadline 2019-11-29T20:49:16.297727+0000) 2019-11-29T20:49:53.630 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:49:53.618+0000 1694c700 -1 osd.1 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.125583+0000 front 2019-11-29T20:48:31.360296+0000 (oldest deadline 2019-11-29T20:49:15.717854+0000) 2019-11-29T20:49:53.986 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:49:53.980+0000 1694c700 -1 osd.2 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.587271+0000 front 2019-11-29T20:48:33.607669+0000 (oldest deadline 2019-11-29T20:49:18.859125+0000) 2019-11-29T20:49:54.253 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:49:54.246+0000 1694c700 -1 osd.3 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:48:51.894449+0000 (oldest deadline 2019-11-29T20:49:31.894449+0000) 2019-11-29T20:49:54.255 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:49:54.250+0000 1694c700 -1 osd.3 202 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:129962 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e200) 2019-11-29T20:49:54.258 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:49:54.250+0000 1694c700 -1 osd.0 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:32.642436+0000 front 2019-11-29T20:48:32.702162+0000 (oldest deadline 2019-11-29T20:49:15.246685+0000) 2019-11-29T20:49:54.378 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:49:54.372+0000 1694c700 -1 osd.6 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.136900+0000 front 2019-11-29T20:48:34.209527+0000 (oldest deadline 2019-11-29T20:49:14.178557+0000) 2019-11-29T20:49:54.470 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:49:54.463+0000 1694c700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:33.125676+0000 front 2019-11-29T20:48:30.633410+0000 (oldest deadline 2019-11-29T20:49:15.897952+0000) 2019-11-29T20:49:54.596 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:49:54.590+0000 1694c700 -1 osd.1 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.125583+0000 front 2019-11-29T20:48:31.360296+0000 (oldest deadline 2019-11-29T20:49:15.717854+0000) 2019-11-29T20:49:54.608 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:49:54.601+0000 1694c700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:30.692127+0000 front 2019-11-29T20:48:30.438016+0000 (oldest deadline 2019-11-29T20:49:16.297727+0000) 2019-11-29T20:49:55.009 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:49:55.004+0000 1694c700 -1 osd.2 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.587271+0000 front 2019-11-29T20:48:33.607669+0000 (oldest deadline 2019-11-29T20:49:18.859125+0000) 2019-11-29T20:49:55.265 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:49:55.257+0000 1694c700 -1 osd.3 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:48:51.894449+0000 (oldest deadline 2019-11-29T20:49:31.894449+0000) 2019-11-29T20:49:55.265 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:49:55.259+0000 1694c700 -1 osd.3 202 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:129962 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e200) 2019-11-29T20:49:55.270 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:49:55.263+0000 1694c700 -1 osd.0 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:32.642436+0000 front 2019-11-29T20:48:32.702162+0000 (oldest deadline 2019-11-29T20:49:15.246685+0000) 2019-11-29T20:49:55.430 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:49:55.424+0000 1694c700 -1 osd.6 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.136900+0000 front 2019-11-29T20:48:34.209527+0000 (oldest deadline 2019-11-29T20:49:14.178557+0000) 2019-11-29T20:49:55.500 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:49:55.494+0000 1694c700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:33.125676+0000 front 2019-11-29T20:48:30.633410+0000 (oldest deadline 2019-11-29T20:49:15.897952+0000) 2019-11-29T20:49:55.569 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:49:55.562+0000 1694c700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:30.692127+0000 front 2019-11-29T20:48:30.438016+0000 (oldest deadline 2019-11-29T20:49:16.297727+0000) 2019-11-29T20:49:55.572 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:49:55.566+0000 1694c700 -1 osd.1 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.125583+0000 front 2019-11-29T20:48:31.360296+0000 (oldest deadline 2019-11-29T20:49:15.717854+0000) 2019-11-29T20:49:56.033 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:49:56.023+0000 1694c700 -1 osd.2 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.587271+0000 front 2019-11-29T20:48:33.607669+0000 (oldest deadline 2019-11-29T20:49:18.859125+0000) 2019-11-29T20:49:56.284 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:49:56.278+0000 1694c700 -1 osd.0 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:32.642436+0000 front 2019-11-29T20:48:32.702162+0000 (oldest deadline 2019-11-29T20:49:15.246685+0000) 2019-11-29T20:49:56.293 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:49:56.287+0000 1694c700 -1 osd.3 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:48:51.894449+0000 (oldest deadline 2019-11-29T20:49:31.894449+0000) 2019-11-29T20:49:56.294 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:49:56.288+0000 1694c700 -1 osd.3 202 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:129962 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e200) 2019-11-29T20:49:56.397 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:49:56.390+0000 1694c700 -1 osd.6 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.136900+0000 front 2019-11-29T20:48:34.209527+0000 (oldest deadline 2019-11-29T20:49:14.178557+0000) 2019-11-29T20:49:56.519 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:49:56.511+0000 1694c700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:33.125676+0000 front 2019-11-29T20:48:30.633410+0000 (oldest deadline 2019-11-29T20:49:15.897952+0000) 2019-11-29T20:49:56.592 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:49:56.586+0000 1694c700 -1 osd.1 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.125583+0000 front 2019-11-29T20:48:31.360296+0000 (oldest deadline 2019-11-29T20:49:15.717854+0000) 2019-11-29T20:49:56.621 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:49:56.615+0000 1694c700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:30.692127+0000 front 2019-11-29T20:48:30.438016+0000 (oldest deadline 2019-11-29T20:49:16.297727+0000) 2019-11-29T20:49:57.032 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:49:57.027+0000 1694c700 -1 osd.2 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.587271+0000 front 2019-11-29T20:48:33.607669+0000 (oldest deadline 2019-11-29T20:49:18.859125+0000) 2019-11-29T20:49:57.237 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:49:57.233+0000 1694c700 -1 osd.0 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:32.642436+0000 front 2019-11-29T20:48:32.702162+0000 (oldest deadline 2019-11-29T20:49:15.246685+0000) 2019-11-29T20:49:57.262 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:49:57.257+0000 1694c700 -1 osd.3 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:48:51.894449+0000 (oldest deadline 2019-11-29T20:49:31.894449+0000) 2019-11-29T20:49:57.264 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:49:57.259+0000 1694c700 -1 osd.3 202 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:129962 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e200) 2019-11-29T20:49:57.346 INFO:tasks.ceph.mon.b.smithi022.stderr:2019-11-29T20:49:57.341+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.22:6818/9264,v1:172.21.15.22:6819/9264] for 44sec e202 v202) 2019-11-29T20:49:57.358 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:49:57.353+0000 1694c700 -1 osd.6 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.136900+0000 front 2019-11-29T20:48:34.209527+0000 (oldest deadline 2019-11-29T20:49:14.178557+0000) 2019-11-29T20:49:57.492 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:49:57.486+0000 1694c700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:33.125676+0000 front 2019-11-29T20:48:30.633410+0000 (oldest deadline 2019-11-29T20:49:15.897952+0000) 2019-11-29T20:49:57.566 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:49:57.560+0000 1694c700 -1 osd.1 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.125583+0000 front 2019-11-29T20:48:31.360296+0000 (oldest deadline 2019-11-29T20:49:15.717854+0000) 2019-11-29T20:49:57.612 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:49:57.605+0000 1694c700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:30.692127+0000 front 2019-11-29T20:48:30.438016+0000 (oldest deadline 2019-11-29T20:49:16.297727+0000) 2019-11-29T20:49:58.000 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:49:57.995+0000 1694c700 -1 osd.2 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.587271+0000 front 2019-11-29T20:48:33.607669+0000 (oldest deadline 2019-11-29T20:49:18.859125+0000) 2019-11-29T20:49:58.228 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:49:58.222+0000 1694c700 -1 osd.0 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:32.642436+0000 front 2019-11-29T20:48:32.702162+0000 (oldest deadline 2019-11-29T20:49:15.246685+0000) 2019-11-29T20:49:58.287 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:49:58.281+0000 1694c700 -1 osd.3 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:48:51.894449+0000 (oldest deadline 2019-11-29T20:49:31.894449+0000) 2019-11-29T20:49:58.288 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:49:58.282+0000 1694c700 -1 osd.3 202 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:129962 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e200) 2019-11-29T20:49:58.325 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:49:58.318+0000 1694c700 -1 osd.6 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.136900+0000 front 2019-11-29T20:48:34.209527+0000 (oldest deadline 2019-11-29T20:49:14.178557+0000) 2019-11-29T20:49:58.511 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:49:58.505+0000 1694c700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:33.125676+0000 front 2019-11-29T20:48:30.633410+0000 (oldest deadline 2019-11-29T20:49:15.897952+0000) 2019-11-29T20:49:58.606 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:49:58.600+0000 1694c700 -1 osd.1 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.125583+0000 front 2019-11-29T20:48:31.360296+0000 (oldest deadline 2019-11-29T20:49:15.717854+0000) 2019-11-29T20:49:58.625 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:49:58.616+0000 1694c700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:30.692127+0000 front 2019-11-29T20:48:30.438016+0000 (oldest deadline 2019-11-29T20:49:16.297727+0000) 2019-11-29T20:49:58.961 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:49:58.956+0000 1694c700 -1 osd.2 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.587271+0000 front 2019-11-29T20:48:33.607669+0000 (oldest deadline 2019-11-29T20:49:18.859125+0000) 2019-11-29T20:49:59.210 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:49:59.205+0000 1694c700 -1 osd.0 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:32.642436+0000 front 2019-11-29T20:48:32.702162+0000 (oldest deadline 2019-11-29T20:49:15.246685+0000) 2019-11-29T20:49:59.267 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:49:59.263+0000 1694c700 -1 osd.3 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:48:51.894449+0000 (oldest deadline 2019-11-29T20:49:31.894449+0000) 2019-11-29T20:49:59.268 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:49:59.264+0000 1694c700 -1 osd.3 202 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:129962 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e200) 2019-11-29T20:49:59.279 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:49:59.273+0000 1694c700 -1 osd.6 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.136900+0000 front 2019-11-29T20:48:34.209527+0000 (oldest deadline 2019-11-29T20:49:14.178557+0000) 2019-11-29T20:49:59.476 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:49:59.470+0000 1694c700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:33.125676+0000 front 2019-11-29T20:48:30.633410+0000 (oldest deadline 2019-11-29T20:49:15.897952+0000) 2019-11-29T20:49:59.624 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:49:59.618+0000 1694c700 -1 osd.1 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.125583+0000 front 2019-11-29T20:48:31.360296+0000 (oldest deadline 2019-11-29T20:49:15.717854+0000) 2019-11-29T20:49:59.676 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:49:59.668+0000 1694c700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:30.692127+0000 front 2019-11-29T20:48:30.438016+0000 (oldest deadline 2019-11-29T20:49:16.297727+0000) 2019-11-29T20:49:59.985 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:49:59.980+0000 1694c700 -1 osd.2 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.587271+0000 front 2019-11-29T20:48:33.607669+0000 (oldest deadline 2019-11-29T20:49:18.859125+0000) 2019-11-29T20:50:00.210 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:50:00.205+0000 1694c700 -1 osd.0 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:32.642436+0000 front 2019-11-29T20:48:32.702162+0000 (oldest deadline 2019-11-29T20:49:15.246685+0000) 2019-11-29T20:50:00.237 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:50:00.231+0000 1694c700 -1 osd.6 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.136900+0000 front 2019-11-29T20:48:34.209527+0000 (oldest deadline 2019-11-29T20:49:14.178557+0000) 2019-11-29T20:50:00.249 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:50:00.243+0000 1694c700 -1 osd.3 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:48:51.894449+0000 (oldest deadline 2019-11-29T20:49:31.894449+0000) 2019-11-29T20:50:00.251 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:50:00.245+0000 1694c700 -1 osd.3 202 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:129962 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e200) 2019-11-29T20:50:00.497 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:50:00.490+0000 1694c700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:33.125676+0000 front 2019-11-29T20:48:30.633410+0000 (oldest deadline 2019-11-29T20:49:15.897952+0000) 2019-11-29T20:50:00.656 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:50:00.650+0000 1694c700 -1 osd.1 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.125583+0000 front 2019-11-29T20:48:31.360296+0000 (oldest deadline 2019-11-29T20:49:15.717854+0000) 2019-11-29T20:50:00.664 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:50:00.658+0000 1694c700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:30.692127+0000 front 2019-11-29T20:48:30.438016+0000 (oldest deadline 2019-11-29T20:49:16.297727+0000) 2019-11-29T20:50:01.025 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:50:01.018+0000 1694c700 -1 osd.2 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.587271+0000 front 2019-11-29T20:48:33.607669+0000 (oldest deadline 2019-11-29T20:49:18.859125+0000) 2019-11-29T20:50:01.169 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:50:01.162+0000 1694c700 -1 osd.0 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:32.642436+0000 front 2019-11-29T20:48:32.702162+0000 (oldest deadline 2019-11-29T20:49:15.246685+0000) 2019-11-29T20:50:01.220 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:50:01.213+0000 1694c700 -1 osd.3 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:48:51.894449+0000 (oldest deadline 2019-11-29T20:49:31.894449+0000) 2019-11-29T20:50:01.220 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:50:01.215+0000 1694c700 -1 osd.3 202 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:129962 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e200) 2019-11-29T20:50:01.243 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:50:01.236+0000 1694c700 -1 osd.6 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.136900+0000 front 2019-11-29T20:48:34.209527+0000 (oldest deadline 2019-11-29T20:49:14.178557+0000) 2019-11-29T20:50:01.544 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:50:01.538+0000 1694c700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:33.125676+0000 front 2019-11-29T20:48:30.633410+0000 (oldest deadline 2019-11-29T20:49:15.897952+0000) 2019-11-29T20:50:01.699 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:50:01.693+0000 1694c700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:30.692127+0000 front 2019-11-29T20:48:30.438016+0000 (oldest deadline 2019-11-29T20:49:16.297727+0000) 2019-11-29T20:50:01.705 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:50:01.699+0000 1694c700 -1 osd.1 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.125583+0000 front 2019-11-29T20:48:31.360296+0000 (oldest deadline 2019-11-29T20:49:15.717854+0000) 2019-11-29T20:50:02.058 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:50:02.053+0000 1694c700 -1 osd.2 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.587271+0000 front 2019-11-29T20:48:33.607669+0000 (oldest deadline 2019-11-29T20:49:18.859125+0000) 2019-11-29T20:50:02.205 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:50:02.200+0000 1694c700 -1 osd.0 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:32.642436+0000 front 2019-11-29T20:48:32.702162+0000 (oldest deadline 2019-11-29T20:49:15.246685+0000) 2019-11-29T20:50:02.213 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:50:02.206+0000 1694c700 -1 osd.6 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.136900+0000 front 2019-11-29T20:48:34.209527+0000 (oldest deadline 2019-11-29T20:49:14.178557+0000) 2019-11-29T20:50:02.216 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:50:02.209+0000 1694c700 -1 osd.3 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:48:51.894449+0000 (oldest deadline 2019-11-29T20:49:31.894449+0000) 2019-11-29T20:50:02.220 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:50:02.213+0000 1694c700 -1 osd.3 202 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:129962 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e200) 2019-11-29T20:50:02.367 INFO:tasks.ceph.mon.b.smithi022.stderr:2019-11-29T20:50:02.359+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.22:6818/9264,v1:172.21.15.22:6819/9264] for 44sec e202 v202) 2019-11-29T20:50:02.532 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:50:02.526+0000 1694c700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:33.125676+0000 front 2019-11-29T20:48:30.633410+0000 (oldest deadline 2019-11-29T20:49:15.897952+0000) 2019-11-29T20:50:02.687 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:50:02.682+0000 1694c700 -1 osd.1 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.125583+0000 front 2019-11-29T20:48:31.360296+0000 (oldest deadline 2019-11-29T20:49:15.717854+0000) 2019-11-29T20:50:02.742 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:50:02.737+0000 1694c700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:30.692127+0000 front 2019-11-29T20:48:30.438016+0000 (oldest deadline 2019-11-29T20:49:16.297727+0000) 2019-11-29T20:50:03.102 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:50:03.096+0000 1694c700 -1 osd.2 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.587271+0000 front 2019-11-29T20:48:33.607669+0000 (oldest deadline 2019-11-29T20:49:18.859125+0000) 2019-11-29T20:50:03.187 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:50:03.182+0000 1694c700 -1 osd.0 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:32.642436+0000 front 2019-11-29T20:48:32.702162+0000 (oldest deadline 2019-11-29T20:49:15.246685+0000) 2019-11-29T20:50:03.211 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:50:03.205+0000 1694c700 -1 osd.6 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.136900+0000 front 2019-11-29T20:48:34.209527+0000 (oldest deadline 2019-11-29T20:49:14.178557+0000) 2019-11-29T20:50:03.249 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:50:03.243+0000 1694c700 -1 osd.3 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:48:51.894449+0000 (oldest deadline 2019-11-29T20:49:31.894449+0000) 2019-11-29T20:50:03.250 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:50:03.245+0000 1694c700 -1 osd.3 202 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:129962 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e200) 2019-11-29T20:50:03.499 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:50:03.493+0000 1694c700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:33.125676+0000 front 2019-11-29T20:48:30.633410+0000 (oldest deadline 2019-11-29T20:49:15.897952+0000) 2019-11-29T20:50:03.716 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:50:03.712+0000 1694c700 -1 osd.1 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.125583+0000 front 2019-11-29T20:48:31.360296+0000 (oldest deadline 2019-11-29T20:49:15.717854+0000) 2019-11-29T20:50:03.735 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:50:03.728+0000 1694c700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:30.692127+0000 front 2019-11-29T20:48:30.438016+0000 (oldest deadline 2019-11-29T20:49:16.297727+0000) 2019-11-29T20:50:04.109 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:50:04.105+0000 1694c700 -1 osd.2 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.587271+0000 front 2019-11-29T20:48:33.607669+0000 (oldest deadline 2019-11-29T20:49:18.859125+0000) 2019-11-29T20:50:04.199 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:50:04.192+0000 1694c700 -1 osd.0 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:32.642436+0000 front 2019-11-29T20:48:32.702162+0000 (oldest deadline 2019-11-29T20:49:15.246685+0000) 2019-11-29T20:50:04.237 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:50:04.231+0000 1694c700 -1 osd.6 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.136900+0000 front 2019-11-29T20:48:34.209527+0000 (oldest deadline 2019-11-29T20:49:14.178557+0000) 2019-11-29T20:50:04.268 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:50:04.262+0000 1694c700 -1 osd.3 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:48:51.894449+0000 (oldest deadline 2019-11-29T20:49:31.894449+0000) 2019-11-29T20:50:04.269 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:50:04.264+0000 1694c700 -1 osd.3 202 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:129962 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e200) 2019-11-29T20:50:04.474 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:50:04.467+0000 1694c700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:33.125676+0000 front 2019-11-29T20:48:30.633410+0000 (oldest deadline 2019-11-29T20:49:15.897952+0000) 2019-11-29T20:50:04.731 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:50:04.725+0000 1694c700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:30.692127+0000 front 2019-11-29T20:48:30.438016+0000 (oldest deadline 2019-11-29T20:49:16.297727+0000) 2019-11-29T20:50:04.759 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:50:04.754+0000 1694c700 -1 osd.1 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.125583+0000 front 2019-11-29T20:48:31.360296+0000 (oldest deadline 2019-11-29T20:49:15.717854+0000) 2019-11-29T20:50:05.104 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:50:05.097+0000 1694c700 -1 osd.2 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.587271+0000 front 2019-11-29T20:48:33.607669+0000 (oldest deadline 2019-11-29T20:49:18.859125+0000) 2019-11-29T20:50:05.204 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:50:05.198+0000 1694c700 -1 osd.0 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:32.642436+0000 front 2019-11-29T20:48:32.702162+0000 (oldest deadline 2019-11-29T20:49:15.246685+0000) 2019-11-29T20:50:05.277 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:50:05.272+0000 1694c700 -1 osd.6 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.136900+0000 front 2019-11-29T20:48:34.209527+0000 (oldest deadline 2019-11-29T20:49:14.178557+0000) 2019-11-29T20:50:05.292 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:50:05.286+0000 1694c700 -1 osd.3 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:48:51.894449+0000 (oldest deadline 2019-11-29T20:49:31.894449+0000) 2019-11-29T20:50:05.293 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:50:05.288+0000 1694c700 -1 osd.3 202 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:129962 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e200) 2019-11-29T20:50:05.430 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:50:05.424+0000 1694c700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:33.125676+0000 front 2019-11-29T20:48:30.633410+0000 (oldest deadline 2019-11-29T20:49:15.897952+0000) 2019-11-29T20:50:05.721 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:50:05.715+0000 1694c700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:30.692127+0000 front 2019-11-29T20:48:30.438016+0000 (oldest deadline 2019-11-29T20:49:16.297727+0000) 2019-11-29T20:50:05.810 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:50:05.805+0000 1694c700 -1 osd.1 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.125583+0000 front 2019-11-29T20:48:31.360296+0000 (oldest deadline 2019-11-29T20:49:15.717854+0000) 2019-11-29T20:50:06.148 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:50:06.142+0000 1694c700 -1 osd.2 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.587271+0000 front 2019-11-29T20:48:33.607669+0000 (oldest deadline 2019-11-29T20:49:18.859125+0000) 2019-11-29T20:50:06.251 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:50:06.246+0000 1694c700 -1 osd.0 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:32.642436+0000 front 2019-11-29T20:48:32.702162+0000 (oldest deadline 2019-11-29T20:49:15.246685+0000) 2019-11-29T20:50:06.322 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:50:06.318+0000 1694c700 -1 osd.3 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:48:51.894449+0000 (oldest deadline 2019-11-29T20:49:31.894449+0000) 2019-11-29T20:50:06.325 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:50:06.320+0000 1694c700 -1 osd.3 202 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:129962 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e200) 2019-11-29T20:50:06.329 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:50:06.322+0000 1694c700 -1 osd.6 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.136900+0000 front 2019-11-29T20:48:34.209527+0000 (oldest deadline 2019-11-29T20:49:14.178557+0000) 2019-11-29T20:50:06.407 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:50:06.401+0000 1694c700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:33.125676+0000 front 2019-11-29T20:48:30.633410+0000 (oldest deadline 2019-11-29T20:49:15.897952+0000) 2019-11-29T20:50:06.728 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:50:06.723+0000 1694c700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:30.692127+0000 front 2019-11-29T20:48:30.438016+0000 (oldest deadline 2019-11-29T20:49:16.297727+0000) 2019-11-29T20:50:06.806 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:50:06.801+0000 1694c700 -1 osd.1 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.125583+0000 front 2019-11-29T20:48:31.360296+0000 (oldest deadline 2019-11-29T20:49:15.717854+0000) 2019-11-29T20:50:07.143 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:50:07.137+0000 1694c700 -1 osd.2 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.587271+0000 front 2019-11-29T20:48:33.607669+0000 (oldest deadline 2019-11-29T20:49:18.859125+0000) 2019-11-29T20:50:07.254 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:50:07.248+0000 1694c700 -1 osd.0 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:32.642436+0000 front 2019-11-29T20:48:32.702162+0000 (oldest deadline 2019-11-29T20:49:15.246685+0000) 2019-11-29T20:50:07.290 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:50:07.284+0000 1694c700 -1 osd.6 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:34.136900+0000 front 2019-11-29T20:48:34.209527+0000 (oldest deadline 2019-11-29T20:49:14.178557+0000) 2019-11-29T20:50:07.293 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:50:07.287+0000 1694c700 -1 osd.3 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:48:51.894449+0000 (oldest deadline 2019-11-29T20:49:31.894449+0000) 2019-11-29T20:50:07.295 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:50:07.289+0000 1694c700 -1 osd.3 202 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:129962 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e200) 2019-11-29T20:50:07.407 INFO:tasks.ceph.mon.b.smithi022.stderr:2019-11-29T20:50:07.399+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.22:6818/9264,v1:172.21.15.22:6819/9264] for 44sec e202 v202) 2019-11-29T20:50:07.452 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:50:07.447+0000 1694c700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:48:33.125676+0000 front 2019-11-29T20:48:30.633410+0000 (oldest deadline 2019-11-29T20:49:15.897952+0000) 2019-11-29T20:50:33.071 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:50:33.027+0000 33f88700 -1 osd.5 202 build_incremental_map_msg missing incremental map 200 2019-11-29T20:51:35.240 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:51:35.233+0000 1694c700 -1 osd.5 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:52.573227+0000 front 2019-11-29T20:50:51.485186+0000 (oldest deadline 2019-11-29T20:51:34.946732+0000) 2019-11-29T20:51:35.992 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:51:35.987+0000 1694c700 -1 osd.7 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:54.482210+0000 front 2019-11-29T20:50:53.556673+0000 (oldest deadline 2019-11-29T20:51:35.143062+0000) 2019-11-29T20:51:36.257 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:51:36.252+0000 1694c700 -1 osd.5 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:52.573227+0000 front 2019-11-29T20:50:51.485186+0000 (oldest deadline 2019-11-29T20:51:34.946732+0000) 2019-11-29T20:51:36.778 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:51:36.771+0000 1694c700 -1 osd.6 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:54.485771+0000 front 2019-11-29T20:50:54.485266+0000 (oldest deadline 2019-11-29T20:51:36.048928+0000) 2019-11-29T20:51:36.911 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:51:36.905+0000 1694c700 -1 osd.0 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:55.217128+0000 front 2019-11-29T20:50:54.474620+0000 (oldest deadline 2019-11-29T20:51:36.323322+0000) 2019-11-29T20:51:37.013 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:51:37.008+0000 1694c700 -1 osd.7 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:54.482210+0000 front 2019-11-29T20:50:53.556673+0000 (oldest deadline 2019-11-29T20:51:35.143062+0000) 2019-11-29T20:51:37.308 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:51:37.302+0000 1694c700 -1 osd.5 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:52.573227+0000 front 2019-11-29T20:50:51.485186+0000 (oldest deadline 2019-11-29T20:51:34.946732+0000) 2019-11-29T20:51:37.754 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:51:37.748+0000 1694c700 -1 osd.6 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:54.485771+0000 front 2019-11-29T20:50:54.485266+0000 (oldest deadline 2019-11-29T20:51:36.048928+0000) 2019-11-29T20:51:37.957 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:51:37.952+0000 1694c700 -1 osd.0 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:55.217128+0000 front 2019-11-29T20:50:54.474620+0000 (oldest deadline 2019-11-29T20:51:36.323322+0000) 2019-11-29T20:51:37.958 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:51:37.952+0000 1694c700 -1 osd.4 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:52.212151+0000 front 2019-11-29T20:50:52.208344+0000 (oldest deadline 2019-11-29T20:51:37.483759+0000) 2019-11-29T20:51:38.022 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:51:38.016+0000 1694c700 -1 osd.7 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:54.482210+0000 front 2019-11-29T20:50:53.556673+0000 (oldest deadline 2019-11-29T20:51:35.143062+0000) 2019-11-29T20:51:38.340 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:51:38.334+0000 1694c700 -1 osd.5 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:52.573227+0000 front 2019-11-29T20:50:51.485186+0000 (oldest deadline 2019-11-29T20:51:34.946732+0000) 2019-11-29T20:51:38.520 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:51:38.516+0000 1694c700 -1 osd.1 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:52.594060+0000 front 2019-11-29T20:50:53.872602+0000 (oldest deadline 2019-11-29T20:51:38.431209+0000) 2019-11-29T20:51:38.815 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:51:38.803+0000 1694c700 -1 osd.6 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:54.485771+0000 front 2019-11-29T20:50:54.485266+0000 (oldest deadline 2019-11-29T20:51:36.048928+0000) 2019-11-29T20:51:38.923 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:51:38.916+0000 1694c700 -1 osd.2 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:54.477537+0000 front 2019-11-29T20:50:55.261592+0000 (oldest deadline 2019-11-29T20:51:38.475588+0000) 2019-11-29T20:51:38.933 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:51:38.928+0000 1694c700 -1 osd.0 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:55.217128+0000 front 2019-11-29T20:50:54.474620+0000 (oldest deadline 2019-11-29T20:51:36.323322+0000) 2019-11-29T20:51:39.005 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:51:38.999+0000 1694c700 -1 osd.4 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:52.212151+0000 front 2019-11-29T20:50:52.208344+0000 (oldest deadline 2019-11-29T20:51:37.483759+0000) 2019-11-29T20:51:39.057 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:51:39.051+0000 1694c700 -1 osd.7 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:54.482210+0000 front 2019-11-29T20:50:53.556673+0000 (oldest deadline 2019-11-29T20:51:35.143062+0000) 2019-11-29T20:51:39.295 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:51:39.290+0000 1694c700 -1 osd.5 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:52.573227+0000 front 2019-11-29T20:50:51.485186+0000 (oldest deadline 2019-11-29T20:51:34.946732+0000) 2019-11-29T20:51:39.543 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:51:39.536+0000 1694c700 -1 osd.1 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:52.594060+0000 front 2019-11-29T20:50:53.872602+0000 (oldest deadline 2019-11-29T20:51:38.431209+0000) 2019-11-29T20:51:39.808 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:51:39.802+0000 1694c700 -1 osd.6 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:54.485771+0000 front 2019-11-29T20:50:54.485266+0000 (oldest deadline 2019-11-29T20:51:36.048928+0000) 2019-11-29T20:51:39.959 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:51:39.954+0000 1694c700 -1 osd.0 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:55.217128+0000 front 2019-11-29T20:50:54.474620+0000 (oldest deadline 2019-11-29T20:51:36.323322+0000) 2019-11-29T20:51:39.969 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:51:39.965+0000 1694c700 -1 osd.2 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:54.477537+0000 front 2019-11-29T20:50:55.261592+0000 (oldest deadline 2019-11-29T20:51:38.475588+0000) 2019-11-29T20:51:40.017 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:51:40.011+0000 1694c700 -1 osd.4 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:52.212151+0000 front 2019-11-29T20:50:52.208344+0000 (oldest deadline 2019-11-29T20:51:37.483759+0000) 2019-11-29T20:51:40.068 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:51:40.062+0000 1694c700 -1 osd.7 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:54.482210+0000 front 2019-11-29T20:50:53.556673+0000 (oldest deadline 2019-11-29T20:51:35.143062+0000) 2019-11-29T20:51:40.321 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:51:40.316+0000 1694c700 -1 osd.5 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:52.573227+0000 front 2019-11-29T20:50:51.485186+0000 (oldest deadline 2019-11-29T20:51:34.946732+0000) 2019-11-29T20:51:40.546 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:51:40.541+0000 1694c700 -1 osd.1 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:52.594060+0000 front 2019-11-29T20:50:53.872602+0000 (oldest deadline 2019-11-29T20:51:38.431209+0000) 2019-11-29T20:51:40.771 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:51:40.766+0000 1694c700 -1 osd.6 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:54.485771+0000 front 2019-11-29T20:50:54.485266+0000 (oldest deadline 2019-11-29T20:51:36.048928+0000) 2019-11-29T20:51:40.956 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:51:40.952+0000 1694c700 -1 osd.2 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:54.477537+0000 front 2019-11-29T20:50:55.261592+0000 (oldest deadline 2019-11-29T20:51:38.475588+0000) 2019-11-29T20:51:40.963 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:51:40.958+0000 1694c700 -1 osd.0 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:55.217128+0000 front 2019-11-29T20:50:54.474620+0000 (oldest deadline 2019-11-29T20:51:36.323322+0000) 2019-11-29T20:51:40.976 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:51:40.969+0000 1694c700 -1 osd.4 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:52.212151+0000 front 2019-11-29T20:50:52.208344+0000 (oldest deadline 2019-11-29T20:51:37.483759+0000) 2019-11-29T20:51:41.087 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:51:41.081+0000 1694c700 -1 osd.7 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:54.482210+0000 front 2019-11-29T20:50:53.556673+0000 (oldest deadline 2019-11-29T20:51:35.143062+0000) 2019-11-29T20:51:41.315 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:51:41.310+0000 1694c700 -1 osd.5 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:52.573227+0000 front 2019-11-29T20:50:51.485186+0000 (oldest deadline 2019-11-29T20:51:34.946732+0000) 2019-11-29T20:51:41.535 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:51:41.530+0000 1694c700 -1 osd.1 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:52.594060+0000 front 2019-11-29T20:50:53.872602+0000 (oldest deadline 2019-11-29T20:51:38.431209+0000) 2019-11-29T20:51:41.760 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:51:41.755+0000 1694c700 -1 osd.6 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:54.485771+0000 front 2019-11-29T20:50:54.485266+0000 (oldest deadline 2019-11-29T20:51:36.048928+0000) 2019-11-29T20:51:41.909 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:51:41.904+0000 1694c700 -1 osd.2 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:54.477537+0000 front 2019-11-29T20:50:55.261592+0000 (oldest deadline 2019-11-29T20:51:38.475588+0000) 2019-11-29T20:51:41.964 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:51:41.959+0000 1694c700 -1 osd.0 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:55.217128+0000 front 2019-11-29T20:50:54.474620+0000 (oldest deadline 2019-11-29T20:51:36.323322+0000) 2019-11-29T20:51:41.985 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:51:41.978+0000 1694c700 -1 osd.4 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:52.212151+0000 front 2019-11-29T20:50:52.208344+0000 (oldest deadline 2019-11-29T20:51:37.483759+0000) 2019-11-29T20:51:42.129 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:51:42.123+0000 1694c700 -1 osd.7 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:54.482210+0000 front 2019-11-29T20:50:53.556673+0000 (oldest deadline 2019-11-29T20:51:35.143062+0000) 2019-11-29T20:51:42.356 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:51:42.351+0000 1694c700 -1 osd.5 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:52.573227+0000 front 2019-11-29T20:50:51.485186+0000 (oldest deadline 2019-11-29T20:51:34.946732+0000) 2019-11-29T20:51:42.528 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:51:42.522+0000 1694c700 -1 osd.1 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:52.594060+0000 front 2019-11-29T20:50:53.872602+0000 (oldest deadline 2019-11-29T20:51:38.431209+0000) 2019-11-29T20:51:42.719 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:51:42.712+0000 1694c700 -1 osd.6 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:54.485771+0000 front 2019-11-29T20:50:54.485266+0000 (oldest deadline 2019-11-29T20:51:36.048928+0000) 2019-11-29T20:51:42.898 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:51:42.893+0000 1694c700 -1 osd.2 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:54.477537+0000 front 2019-11-29T20:50:55.261592+0000 (oldest deadline 2019-11-29T20:51:38.475588+0000) 2019-11-29T20:51:42.965 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:51:42.960+0000 1694c700 -1 osd.4 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:52.212151+0000 front 2019-11-29T20:50:52.208344+0000 (oldest deadline 2019-11-29T20:51:37.483759+0000) 2019-11-29T20:51:43.004 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:51:42.999+0000 1694c700 -1 osd.0 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:55.217128+0000 front 2019-11-29T20:50:54.474620+0000 (oldest deadline 2019-11-29T20:51:36.323322+0000) 2019-11-29T20:51:43.093 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:51:43.088+0000 1694c700 -1 osd.7 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:54.482210+0000 front 2019-11-29T20:50:53.556673+0000 (oldest deadline 2019-11-29T20:51:35.143062+0000) 2019-11-29T20:51:43.395 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:51:43.390+0000 1694c700 -1 osd.5 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:52.573227+0000 front 2019-11-29T20:50:51.485186+0000 (oldest deadline 2019-11-29T20:51:34.946732+0000) 2019-11-29T20:51:43.568 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:51:43.560+0000 1694c700 -1 osd.1 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:52.594060+0000 front 2019-11-29T20:50:53.872602+0000 (oldest deadline 2019-11-29T20:51:38.431209+0000) 2019-11-29T20:51:43.746 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:51:43.741+0000 1694c700 -1 osd.6 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:54.485771+0000 front 2019-11-29T20:50:54.485266+0000 (oldest deadline 2019-11-29T20:51:36.048928+0000) 2019-11-29T20:51:43.924 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:51:43.918+0000 1694c700 -1 osd.4 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:52.212151+0000 front 2019-11-29T20:50:52.208344+0000 (oldest deadline 2019-11-29T20:51:37.483759+0000) 2019-11-29T20:51:43.931 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:51:43.926+0000 1694c700 -1 osd.2 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:54.477537+0000 front 2019-11-29T20:50:55.261592+0000 (oldest deadline 2019-11-29T20:51:38.475588+0000) 2019-11-29T20:51:44.022 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:51:44.015+0000 1694c700 -1 osd.0 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:55.217128+0000 front 2019-11-29T20:50:54.474620+0000 (oldest deadline 2019-11-29T20:51:36.323322+0000) 2019-11-29T20:51:44.067 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:51:44.060+0000 1694c700 -1 osd.7 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:54.482210+0000 front 2019-11-29T20:50:53.556673+0000 (oldest deadline 2019-11-29T20:51:35.143062+0000) 2019-11-29T20:51:44.364 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:51:44.358+0000 1694c700 -1 osd.5 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:52.573227+0000 front 2019-11-29T20:50:51.485186+0000 (oldest deadline 2019-11-29T20:51:34.946732+0000) 2019-11-29T20:51:44.588 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:51:44.582+0000 1694c700 -1 osd.1 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:52.594060+0000 front 2019-11-29T20:50:53.872602+0000 (oldest deadline 2019-11-29T20:51:38.431209+0000) 2019-11-29T20:51:44.734 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:51:44.728+0000 1694c700 -1 osd.6 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:54.485771+0000 front 2019-11-29T20:50:54.485266+0000 (oldest deadline 2019-11-29T20:51:36.048928+0000) 2019-11-29T20:51:44.974 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:51:44.970+0000 1694c700 -1 osd.4 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:52.212151+0000 front 2019-11-29T20:50:52.208344+0000 (oldest deadline 2019-11-29T20:51:37.483759+0000) 2019-11-29T20:51:44.978 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:51:44.972+0000 1694c700 -1 osd.2 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:54.477537+0000 front 2019-11-29T20:50:55.261592+0000 (oldest deadline 2019-11-29T20:51:38.475588+0000) 2019-11-29T20:51:45.046 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:51:45.039+0000 1694c700 -1 osd.7 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:54.482210+0000 front 2019-11-29T20:50:53.556673+0000 (oldest deadline 2019-11-29T20:51:35.143062+0000) 2019-11-29T20:51:45.072 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:51:45.066+0000 1694c700 -1 osd.0 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:55.217128+0000 front 2019-11-29T20:50:54.474620+0000 (oldest deadline 2019-11-29T20:51:36.323322+0000) 2019-11-29T20:51:45.396 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:51:45.391+0000 1694c700 -1 osd.5 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:52.573227+0000 front 2019-11-29T20:50:51.485186+0000 (oldest deadline 2019-11-29T20:51:34.946732+0000) 2019-11-29T20:51:45.543 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:51:45.538+0000 1694c700 -1 osd.1 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:52.594060+0000 front 2019-11-29T20:50:53.872602+0000 (oldest deadline 2019-11-29T20:51:38.431209+0000) 2019-11-29T20:51:45.752 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:51:45.746+0000 1694c700 -1 osd.6 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:54.485771+0000 front 2019-11-29T20:50:54.485266+0000 (oldest deadline 2019-11-29T20:51:36.048928+0000) 2019-11-29T20:51:45.958 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:51:45.953+0000 1694c700 -1 osd.2 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:54.477537+0000 front 2019-11-29T20:50:55.261592+0000 (oldest deadline 2019-11-29T20:51:38.475588+0000) 2019-11-29T20:51:45.963 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:51:45.956+0000 1694c700 -1 osd.4 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:52.212151+0000 front 2019-11-29T20:50:52.208344+0000 (oldest deadline 2019-11-29T20:51:37.483759+0000) 2019-11-29T20:51:46.081 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:51:46.074+0000 1694c700 -1 osd.0 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:55.217128+0000 front 2019-11-29T20:50:54.474620+0000 (oldest deadline 2019-11-29T20:51:36.323322+0000) 2019-11-29T20:51:46.101 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:51:46.091+0000 1694c700 -1 osd.7 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:54.482210+0000 front 2019-11-29T20:50:53.556673+0000 (oldest deadline 2019-11-29T20:51:35.143062+0000) 2019-11-29T20:51:46.381 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:51:46.373+0000 1694c700 -1 osd.5 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:52.573227+0000 front 2019-11-29T20:50:51.485186+0000 (oldest deadline 2019-11-29T20:51:34.946732+0000) 2019-11-29T20:51:46.587 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:51:46.581+0000 1694c700 -1 osd.1 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:52.594060+0000 front 2019-11-29T20:50:53.872602+0000 (oldest deadline 2019-11-29T20:51:38.431209+0000) 2019-11-29T20:51:46.771 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:51:46.765+0000 1694c700 -1 osd.6 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:54.485771+0000 front 2019-11-29T20:50:54.485266+0000 (oldest deadline 2019-11-29T20:51:36.048928+0000) 2019-11-29T20:51:47.006 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:51:47.000+0000 1694c700 -1 osd.2 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:54.477537+0000 front 2019-11-29T20:50:55.261592+0000 (oldest deadline 2019-11-29T20:51:38.475588+0000) 2019-11-29T20:51:47.007 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:51:47.001+0000 1694c700 -1 osd.4 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:52.212151+0000 front 2019-11-29T20:50:52.208344+0000 (oldest deadline 2019-11-29T20:51:37.483759+0000) 2019-11-29T20:51:47.123 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:51:47.117+0000 1694c700 -1 osd.7 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:54.482210+0000 front 2019-11-29T20:50:53.556673+0000 (oldest deadline 2019-11-29T20:51:35.143062+0000) 2019-11-29T20:51:47.131 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:51:47.125+0000 1694c700 -1 osd.0 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:55.217128+0000 front 2019-11-29T20:50:54.474620+0000 (oldest deadline 2019-11-29T20:51:36.323322+0000) 2019-11-29T20:51:47.368 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:51:47.362+0000 1694c700 -1 osd.5 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:52.573227+0000 front 2019-11-29T20:50:51.485186+0000 (oldest deadline 2019-11-29T20:51:34.946732+0000) 2019-11-29T20:51:47.562 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:51:47.556+0000 1694c700 -1 osd.1 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:52.594060+0000 front 2019-11-29T20:50:53.872602+0000 (oldest deadline 2019-11-29T20:51:38.431209+0000) 2019-11-29T20:51:47.781 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:51:47.775+0000 1694c700 -1 osd.6 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:54.485771+0000 front 2019-11-29T20:50:54.485266+0000 (oldest deadline 2019-11-29T20:51:36.048928+0000) 2019-11-29T20:51:47.964 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:51:47.959+0000 1694c700 -1 osd.2 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:54.477537+0000 front 2019-11-29T20:50:55.261592+0000 (oldest deadline 2019-11-29T20:51:38.475588+0000) 2019-11-29T20:51:47.989 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:51:47.983+0000 1694c700 -1 osd.4 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:52.212151+0000 front 2019-11-29T20:50:52.208344+0000 (oldest deadline 2019-11-29T20:51:37.483759+0000) 2019-11-29T20:51:48.109 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:51:48.103+0000 1694c700 -1 osd.0 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:55.217128+0000 front 2019-11-29T20:50:54.474620+0000 (oldest deadline 2019-11-29T20:51:36.323322+0000) 2019-11-29T20:51:48.136 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:51:48.131+0000 1694c700 -1 osd.7 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:54.482210+0000 front 2019-11-29T20:50:53.556673+0000 (oldest deadline 2019-11-29T20:51:35.143062+0000) 2019-11-29T20:51:48.408 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:51:48.401+0000 1694c700 -1 osd.5 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:52.573227+0000 front 2019-11-29T20:50:51.485186+0000 (oldest deadline 2019-11-29T20:51:34.946732+0000) 2019-11-29T20:51:48.602 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:51:48.596+0000 1694c700 -1 osd.1 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:52.594060+0000 front 2019-11-29T20:50:53.872602+0000 (oldest deadline 2019-11-29T20:51:38.431209+0000) 2019-11-29T20:51:48.762 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:51:48.756+0000 1694c700 -1 osd.6 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:54.485771+0000 front 2019-11-29T20:50:54.485266+0000 (oldest deadline 2019-11-29T20:51:36.048928+0000) 2019-11-29T20:51:48.982 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:51:48.976+0000 1694c700 -1 osd.2 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:54.477537+0000 front 2019-11-29T20:50:55.261592+0000 (oldest deadline 2019-11-29T20:51:38.475588+0000) 2019-11-29T20:51:49.037 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:51:49.030+0000 1694c700 -1 osd.4 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:52.212151+0000 front 2019-11-29T20:50:52.208344+0000 (oldest deadline 2019-11-29T20:51:37.483759+0000) 2019-11-29T20:51:49.140 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:51:49.134+0000 1694c700 -1 osd.0 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:55.217128+0000 front 2019-11-29T20:50:54.474620+0000 (oldest deadline 2019-11-29T20:51:36.323322+0000) 2019-11-29T20:51:49.165 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:51:49.159+0000 1694c700 -1 osd.7 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:54.482210+0000 front 2019-11-29T20:50:53.556673+0000 (oldest deadline 2019-11-29T20:51:35.143062+0000) 2019-11-29T20:51:49.382 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:51:49.376+0000 1694c700 -1 osd.5 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:52.573227+0000 front 2019-11-29T20:50:51.485186+0000 (oldest deadline 2019-11-29T20:51:34.946732+0000) 2019-11-29T20:51:49.597 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:51:49.591+0000 1694c700 -1 osd.1 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:52.594060+0000 front 2019-11-29T20:50:53.872602+0000 (oldest deadline 2019-11-29T20:51:38.431209+0000) 2019-11-29T20:51:49.767 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:51:49.761+0000 1694c700 -1 osd.6 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:54.485771+0000 front 2019-11-29T20:50:54.485266+0000 (oldest deadline 2019-11-29T20:51:36.048928+0000) 2019-11-29T20:51:49.937 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:51:49.931+0000 1694c700 -1 osd.2 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:54.477537+0000 front 2019-11-29T20:50:55.261592+0000 (oldest deadline 2019-11-29T20:51:38.475588+0000) 2019-11-29T20:51:50.003 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:51:49.996+0000 1694c700 -1 osd.4 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:52.212151+0000 front 2019-11-29T20:50:52.208344+0000 (oldest deadline 2019-11-29T20:51:37.483759+0000) 2019-11-29T20:51:50.146 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:51:50.140+0000 1694c700 -1 osd.7 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:54.482210+0000 front 2019-11-29T20:50:53.556673+0000 (oldest deadline 2019-11-29T20:51:35.143062+0000) 2019-11-29T20:51:50.190 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:51:50.185+0000 1694c700 -1 osd.0 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:55.217128+0000 front 2019-11-29T20:50:54.474620+0000 (oldest deadline 2019-11-29T20:51:36.323322+0000) 2019-11-29T20:51:50.402 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:51:50.396+0000 1694c700 -1 osd.5 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:52.573227+0000 front 2019-11-29T20:50:51.485186+0000 (oldest deadline 2019-11-29T20:51:34.946732+0000) 2019-11-29T20:51:50.575 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:51:50.569+0000 1694c700 -1 osd.1 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:52.594060+0000 front 2019-11-29T20:50:53.872602+0000 (oldest deadline 2019-11-29T20:51:38.431209+0000) 2019-11-29T20:51:50.724 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:51:50.719+0000 1694c700 -1 osd.6 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:54.485771+0000 front 2019-11-29T20:50:54.485266+0000 (oldest deadline 2019-11-29T20:51:36.048928+0000) 2019-11-29T20:51:50.917 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:51:50.910+0000 1694c700 -1 osd.2 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:54.477537+0000 front 2019-11-29T20:50:55.261592+0000 (oldest deadline 2019-11-29T20:51:38.475588+0000) 2019-11-29T20:51:51.030 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:51:51.026+0000 1694c700 -1 osd.4 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:52.212151+0000 front 2019-11-29T20:50:52.208344+0000 (oldest deadline 2019-11-29T20:51:37.483759+0000) 2019-11-29T20:51:51.121 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:51:51.116+0000 1694c700 -1 osd.7 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:54.482210+0000 front 2019-11-29T20:50:53.556673+0000 (oldest deadline 2019-11-29T20:51:35.143062+0000) 2019-11-29T20:51:51.202 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:51:51.197+0000 1694c700 -1 osd.0 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:55.217128+0000 front 2019-11-29T20:50:54.474620+0000 (oldest deadline 2019-11-29T20:51:36.323322+0000) 2019-11-29T20:51:51.364 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:51:51.358+0000 1694c700 -1 osd.5 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:52.573227+0000 front 2019-11-29T20:50:51.485186+0000 (oldest deadline 2019-11-29T20:51:34.946732+0000) 2019-11-29T20:51:51.548 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:51:51.543+0000 1694c700 -1 osd.1 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:52.594060+0000 front 2019-11-29T20:50:53.872602+0000 (oldest deadline 2019-11-29T20:51:38.431209+0000) 2019-11-29T20:51:51.791 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:51:51.783+0000 1694c700 -1 osd.6 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:54.485771+0000 front 2019-11-29T20:50:54.485266+0000 (oldest deadline 2019-11-29T20:51:36.048928+0000) 2019-11-29T20:51:51.881 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:51:51.875+0000 1694c700 -1 osd.2 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:54.477537+0000 front 2019-11-29T20:50:55.261592+0000 (oldest deadline 2019-11-29T20:51:38.475588+0000) 2019-11-29T20:51:52.008 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:51:52.001+0000 1694c700 -1 osd.4 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:52.212151+0000 front 2019-11-29T20:50:52.208344+0000 (oldest deadline 2019-11-29T20:51:37.483759+0000) 2019-11-29T20:51:52.134 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:51:52.129+0000 1694c700 -1 osd.7 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:54.482210+0000 front 2019-11-29T20:50:53.556673+0000 (oldest deadline 2019-11-29T20:51:35.143062+0000) 2019-11-29T20:51:52.161 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:51:52.155+0000 1694c700 -1 osd.0 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:55.217128+0000 front 2019-11-29T20:50:54.474620+0000 (oldest deadline 2019-11-29T20:51:36.323322+0000) 2019-11-29T20:51:52.321 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:51:52.315+0000 1694c700 -1 osd.5 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:52.573227+0000 front 2019-11-29T20:50:51.485186+0000 (oldest deadline 2019-11-29T20:51:34.946732+0000) 2019-11-29T20:51:52.558 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:51:52.552+0000 1694c700 -1 osd.1 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:52.594060+0000 front 2019-11-29T20:50:53.872602+0000 (oldest deadline 2019-11-29T20:51:38.431209+0000) 2019-11-29T20:51:52.828 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:51:52.822+0000 1694c700 -1 osd.6 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:54.485771+0000 front 2019-11-29T20:50:54.485266+0000 (oldest deadline 2019-11-29T20:51:36.048928+0000) 2019-11-29T20:51:52.855 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:51:52.851+0000 1694c700 -1 osd.2 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:54.477537+0000 front 2019-11-29T20:50:55.261592+0000 (oldest deadline 2019-11-29T20:51:38.475588+0000) 2019-11-29T20:51:53.053 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:51:53.046+0000 1694c700 -1 osd.4 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:52.212151+0000 front 2019-11-29T20:50:52.208344+0000 (oldest deadline 2019-11-29T20:51:37.483759+0000) 2019-11-29T20:51:53.131 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:51:53.125+0000 1694c700 -1 osd.7 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:54.482210+0000 front 2019-11-29T20:50:53.556673+0000 (oldest deadline 2019-11-29T20:51:35.143062+0000) 2019-11-29T20:51:53.191 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:51:53.181+0000 1694c700 -1 osd.0 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:55.217128+0000 front 2019-11-29T20:50:54.474620+0000 (oldest deadline 2019-11-29T20:51:36.323322+0000) 2019-11-29T20:51:53.343 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:51:53.337+0000 1694c700 -1 osd.5 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:52.573227+0000 front 2019-11-29T20:50:51.485186+0000 (oldest deadline 2019-11-29T20:51:34.946732+0000) 2019-11-29T20:51:53.566 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:51:53.560+0000 1694c700 -1 osd.1 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:52.594060+0000 front 2019-11-29T20:50:53.872602+0000 (oldest deadline 2019-11-29T20:51:38.431209+0000) 2019-11-29T20:51:53.832 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:51:53.826+0000 1694c700 -1 osd.6 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:54.485771+0000 front 2019-11-29T20:50:54.485266+0000 (oldest deadline 2019-11-29T20:51:36.048928+0000) 2019-11-29T20:51:53.840 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:51:53.835+0000 1694c700 -1 osd.2 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:54.477537+0000 front 2019-11-29T20:50:55.261592+0000 (oldest deadline 2019-11-29T20:51:38.475588+0000) 2019-11-29T20:51:54.077 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:51:54.070+0000 1694c700 -1 osd.4 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:52.212151+0000 front 2019-11-29T20:50:52.208344+0000 (oldest deadline 2019-11-29T20:51:37.483759+0000) 2019-11-29T20:51:54.158 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:51:54.151+0000 1694c700 -1 osd.7 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:54.482210+0000 front 2019-11-29T20:50:53.556673+0000 (oldest deadline 2019-11-29T20:51:35.143062+0000) 2019-11-29T20:51:54.161 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:51:54.156+0000 1694c700 -1 osd.0 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:55.217128+0000 front 2019-11-29T20:50:54.474620+0000 (oldest deadline 2019-11-29T20:51:36.323322+0000) 2019-11-29T20:51:54.329 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:51:54.324+0000 1694c700 -1 osd.5 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:52.573227+0000 front 2019-11-29T20:50:51.485186+0000 (oldest deadline 2019-11-29T20:51:34.946732+0000) 2019-11-29T20:51:54.595 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:51:54.588+0000 1694c700 -1 osd.1 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:52.594060+0000 front 2019-11-29T20:50:53.872602+0000 (oldest deadline 2019-11-29T20:51:38.431209+0000) 2019-11-29T20:51:54.826 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:51:54.821+0000 1694c700 -1 osd.2 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:54.477537+0000 front 2019-11-29T20:50:55.261592+0000 (oldest deadline 2019-11-29T20:51:38.475588+0000) 2019-11-29T20:51:54.836 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:51:54.830+0000 1694c700 -1 osd.6 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:54.485771+0000 front 2019-11-29T20:50:54.485266+0000 (oldest deadline 2019-11-29T20:51:36.048928+0000) 2019-11-29T20:51:55.055 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:51:55.048+0000 1694c700 -1 osd.4 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:52.212151+0000 front 2019-11-29T20:50:52.208344+0000 (oldest deadline 2019-11-29T20:51:37.483759+0000) 2019-11-29T20:51:55.128 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:51:55.123+0000 1694c700 -1 osd.0 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:55.217128+0000 front 2019-11-29T20:50:54.474620+0000 (oldest deadline 2019-11-29T20:51:36.323322+0000) 2019-11-29T20:51:55.207 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:51:55.201+0000 1694c700 -1 osd.7 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:54.482210+0000 front 2019-11-29T20:50:53.556673+0000 (oldest deadline 2019-11-29T20:51:35.143062+0000) 2019-11-29T20:51:55.341 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:51:55.335+0000 1694c700 -1 osd.5 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:52.573227+0000 front 2019-11-29T20:50:51.485186+0000 (oldest deadline 2019-11-29T20:51:34.946732+0000) 2019-11-29T20:51:55.556 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:51:55.550+0000 1694c700 -1 osd.1 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:52.594060+0000 front 2019-11-29T20:50:53.872602+0000 (oldest deadline 2019-11-29T20:51:38.431209+0000) 2019-11-29T20:51:55.837 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:51:55.832+0000 1694c700 -1 osd.2 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:54.477537+0000 front 2019-11-29T20:50:55.261592+0000 (oldest deadline 2019-11-29T20:51:38.475588+0000) 2019-11-29T20:51:55.888 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:51:55.882+0000 1694c700 -1 osd.6 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:54.485771+0000 front 2019-11-29T20:50:54.485266+0000 (oldest deadline 2019-11-29T20:51:36.048928+0000) 2019-11-29T20:51:56.083 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:51:56.077+0000 1694c700 -1 osd.4 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:52.212151+0000 front 2019-11-29T20:50:52.208344+0000 (oldest deadline 2019-11-29T20:51:37.483759+0000) 2019-11-29T20:51:56.089 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:51:56.083+0000 1694c700 -1 osd.0 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:55.217128+0000 front 2019-11-29T20:50:54.474620+0000 (oldest deadline 2019-11-29T20:51:36.323322+0000) 2019-11-29T20:51:56.235 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:51:56.229+0000 1694c700 -1 osd.7 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:54.482210+0000 front 2019-11-29T20:50:53.556673+0000 (oldest deadline 2019-11-29T20:51:35.143062+0000) 2019-11-29T20:51:56.361 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:51:56.355+0000 1694c700 -1 osd.5 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:52.573227+0000 front 2019-11-29T20:50:51.485186+0000 (oldest deadline 2019-11-29T20:51:34.946732+0000) 2019-11-29T20:51:56.585 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:51:56.580+0000 1694c700 -1 osd.1 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:52.594060+0000 front 2019-11-29T20:50:53.872602+0000 (oldest deadline 2019-11-29T20:51:38.431209+0000) 2019-11-29T20:51:56.826 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:51:56.820+0000 1694c700 -1 osd.2 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:54.477537+0000 front 2019-11-29T20:50:55.261592+0000 (oldest deadline 2019-11-29T20:51:38.475588+0000) 2019-11-29T20:51:56.935 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:51:56.930+0000 1694c700 -1 osd.6 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:54.485771+0000 front 2019-11-29T20:50:54.485266+0000 (oldest deadline 2019-11-29T20:51:36.048928+0000) 2019-11-29T20:51:57.049 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:51:57.044+0000 1694c700 -1 osd.0 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:55.217128+0000 front 2019-11-29T20:50:54.474620+0000 (oldest deadline 2019-11-29T20:51:36.323322+0000) 2019-11-29T20:51:57.108 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:51:57.102+0000 1694c700 -1 osd.4 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:52.212151+0000 front 2019-11-29T20:50:52.208344+0000 (oldest deadline 2019-11-29T20:51:37.483759+0000) 2019-11-29T20:51:57.260 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:51:57.254+0000 1694c700 -1 osd.7 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:54.482210+0000 front 2019-11-29T20:50:53.556673+0000 (oldest deadline 2019-11-29T20:51:35.143062+0000) 2019-11-29T20:51:57.359 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:51:57.354+0000 1694c700 -1 osd.5 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:52.573227+0000 front 2019-11-29T20:50:51.485186+0000 (oldest deadline 2019-11-29T20:51:34.946732+0000) 2019-11-29T20:51:57.546 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:51:57.540+0000 1694c700 -1 osd.1 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:52.594060+0000 front 2019-11-29T20:50:53.872602+0000 (oldest deadline 2019-11-29T20:51:38.431209+0000) 2019-11-29T20:51:57.853 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:51:57.848+0000 1694c700 -1 osd.2 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:54.477537+0000 front 2019-11-29T20:50:55.261592+0000 (oldest deadline 2019-11-29T20:51:38.475588+0000) 2019-11-29T20:51:57.903 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:51:57.898+0000 1694c700 -1 osd.6 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:54.485771+0000 front 2019-11-29T20:50:54.485266+0000 (oldest deadline 2019-11-29T20:51:36.048928+0000) 2019-11-29T20:51:58.065 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:51:58.060+0000 1694c700 -1 osd.0 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:55.217128+0000 front 2019-11-29T20:50:54.474620+0000 (oldest deadline 2019-11-29T20:51:36.323322+0000) 2019-11-29T20:51:58.095 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:51:58.089+0000 1694c700 -1 osd.4 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:52.212151+0000 front 2019-11-29T20:50:52.208344+0000 (oldest deadline 2019-11-29T20:51:37.483759+0000) 2019-11-29T20:51:58.241 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:51:58.234+0000 1694c700 -1 osd.7 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:54.482210+0000 front 2019-11-29T20:50:53.556673+0000 (oldest deadline 2019-11-29T20:51:35.143062+0000) 2019-11-29T20:51:58.319 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:51:58.313+0000 1694c700 -1 osd.5 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:52.573227+0000 front 2019-11-29T20:50:51.485186+0000 (oldest deadline 2019-11-29T20:51:34.946732+0000) 2019-11-29T20:51:58.561 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:51:58.556+0000 1694c700 -1 osd.1 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:52.594060+0000 front 2019-11-29T20:50:53.872602+0000 (oldest deadline 2019-11-29T20:51:38.431209+0000) 2019-11-29T20:51:58.842 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:51:58.833+0000 1694c700 -1 osd.2 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:54.477537+0000 front 2019-11-29T20:50:55.261592+0000 (oldest deadline 2019-11-29T20:51:38.475588+0000) 2019-11-29T20:51:58.936 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:51:58.930+0000 1694c700 -1 osd.6 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:54.485771+0000 front 2019-11-29T20:50:54.485266+0000 (oldest deadline 2019-11-29T20:51:36.048928+0000) 2019-11-29T20:51:59.064 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:51:59.053+0000 1694c700 -1 osd.4 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:52.212151+0000 front 2019-11-29T20:50:52.208344+0000 (oldest deadline 2019-11-29T20:51:37.483759+0000) 2019-11-29T20:51:59.085 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:51:59.080+0000 1694c700 -1 osd.0 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:55.217128+0000 front 2019-11-29T20:50:54.474620+0000 (oldest deadline 2019-11-29T20:51:36.323322+0000) 2019-11-29T20:51:59.198 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:51:59.190+0000 1694c700 -1 osd.7 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:54.482210+0000 front 2019-11-29T20:50:53.556673+0000 (oldest deadline 2019-11-29T20:51:35.143062+0000) 2019-11-29T20:51:59.337 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:51:59.331+0000 1694c700 -1 osd.5 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:52.573227+0000 front 2019-11-29T20:50:51.485186+0000 (oldest deadline 2019-11-29T20:51:34.946732+0000) 2019-11-29T20:51:59.613 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:51:59.606+0000 1694c700 -1 osd.1 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:52.594060+0000 front 2019-11-29T20:50:53.872602+0000 (oldest deadline 2019-11-29T20:51:38.431209+0000) 2019-11-29T20:51:59.890 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:51:59.885+0000 1694c700 -1 osd.2 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:54.477537+0000 front 2019-11-29T20:50:55.261592+0000 (oldest deadline 2019-11-29T20:51:38.475588+0000) 2019-11-29T20:51:59.909 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:51:59.902+0000 1694c700 -1 osd.6 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:54.485771+0000 front 2019-11-29T20:50:54.485266+0000 (oldest deadline 2019-11-29T20:51:36.048928+0000) 2019-11-29T20:52:00.074 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:52:00.069+0000 1694c700 -1 osd.0 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:55.217128+0000 front 2019-11-29T20:50:54.474620+0000 (oldest deadline 2019-11-29T20:51:36.323322+0000) 2019-11-29T20:52:00.077 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:52:00.065+0000 1694c700 -1 osd.4 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:52.212151+0000 front 2019-11-29T20:50:52.208344+0000 (oldest deadline 2019-11-29T20:51:37.483759+0000) 2019-11-29T20:52:00.151 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:52:00.145+0000 1694c700 -1 osd.7 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:54.482210+0000 front 2019-11-29T20:50:53.556673+0000 (oldest deadline 2019-11-29T20:51:35.143062+0000) 2019-11-29T20:52:00.376 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:52:00.370+0000 1694c700 -1 osd.5 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:52.573227+0000 front 2019-11-29T20:50:51.485186+0000 (oldest deadline 2019-11-29T20:51:34.946732+0000) 2019-11-29T20:52:00.626 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:52:00.620+0000 1694c700 -1 osd.1 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:52.594060+0000 front 2019-11-29T20:50:53.872602+0000 (oldest deadline 2019-11-29T20:51:38.431209+0000) 2019-11-29T20:52:00.929 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:52:00.922+0000 1694c700 -1 osd.2 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:54.477537+0000 front 2019-11-29T20:50:55.261592+0000 (oldest deadline 2019-11-29T20:51:38.475588+0000) 2019-11-29T20:52:00.954 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:52:00.949+0000 1694c700 -1 osd.6 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:54.485771+0000 front 2019-11-29T20:50:54.485266+0000 (oldest deadline 2019-11-29T20:51:36.048928+0000) 2019-11-29T20:52:01.040 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:52:01.034+0000 1694c700 -1 osd.0 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:55.217128+0000 front 2019-11-29T20:50:54.474620+0000 (oldest deadline 2019-11-29T20:51:36.323322+0000) 2019-11-29T20:52:01.111 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:52:01.104+0000 1694c700 -1 osd.4 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:52.212151+0000 front 2019-11-29T20:50:52.208344+0000 (oldest deadline 2019-11-29T20:51:37.483759+0000) 2019-11-29T20:52:01.120 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:52:01.114+0000 1694c700 -1 osd.7 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:54.482210+0000 front 2019-11-29T20:50:53.556673+0000 (oldest deadline 2019-11-29T20:51:35.143062+0000) 2019-11-29T20:52:01.401 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:52:01.396+0000 1694c700 -1 osd.5 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:52.573227+0000 front 2019-11-29T20:50:51.485186+0000 (oldest deadline 2019-11-29T20:51:34.946732+0000) 2019-11-29T20:52:01.612 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:52:01.606+0000 1694c700 -1 osd.1 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:52.594060+0000 front 2019-11-29T20:50:53.872602+0000 (oldest deadline 2019-11-29T20:51:38.431209+0000) 2019-11-29T20:52:01.902 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:52:01.896+0000 1694c700 -1 osd.2 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:54.477537+0000 front 2019-11-29T20:50:55.261592+0000 (oldest deadline 2019-11-29T20:51:38.475588+0000) 2019-11-29T20:52:01.996 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:52:01.991+0000 1694c700 -1 osd.6 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:54.485771+0000 front 2019-11-29T20:50:54.485266+0000 (oldest deadline 2019-11-29T20:51:36.048928+0000) 2019-11-29T20:52:02.055 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:52:02.050+0000 1694c700 -1 osd.0 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:55.217128+0000 front 2019-11-29T20:50:54.474620+0000 (oldest deadline 2019-11-29T20:51:36.323322+0000) 2019-11-29T20:52:02.100 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:52:02.094+0000 1694c700 -1 osd.7 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:54.482210+0000 front 2019-11-29T20:50:53.556673+0000 (oldest deadline 2019-11-29T20:51:35.143062+0000) 2019-11-29T20:52:02.141 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:52:02.128+0000 1694c700 -1 osd.4 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:52.212151+0000 front 2019-11-29T20:50:52.208344+0000 (oldest deadline 2019-11-29T20:51:37.483759+0000) 2019-11-29T20:52:02.436 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:52:02.431+0000 1694c700 -1 osd.5 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:52.573227+0000 front 2019-11-29T20:50:51.485186+0000 (oldest deadline 2019-11-29T20:51:34.946732+0000) 2019-11-29T20:52:02.615 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:52:02.611+0000 1694c700 -1 osd.1 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:52.594060+0000 front 2019-11-29T20:50:53.872602+0000 (oldest deadline 2019-11-29T20:51:38.431209+0000) 2019-11-29T20:52:02.857 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:52:02.851+0000 1694c700 -1 osd.2 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:54.477537+0000 front 2019-11-29T20:50:55.261592+0000 (oldest deadline 2019-11-29T20:51:38.475588+0000) 2019-11-29T20:52:02.982 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:52:02.976+0000 1694c700 -1 osd.6 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:54.485771+0000 front 2019-11-29T20:50:54.485266+0000 (oldest deadline 2019-11-29T20:51:36.048928+0000) 2019-11-29T20:52:03.029 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:52:03.023+0000 1694c700 -1 osd.0 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:55.217128+0000 front 2019-11-29T20:50:54.474620+0000 (oldest deadline 2019-11-29T20:51:36.323322+0000) 2019-11-29T20:52:03.061 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:52:03.056+0000 1694c700 -1 osd.7 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:54.482210+0000 front 2019-11-29T20:50:53.556673+0000 (oldest deadline 2019-11-29T20:51:35.143062+0000) 2019-11-29T20:52:03.157 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:52:03.152+0000 1694c700 -1 osd.4 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:52.212151+0000 front 2019-11-29T20:50:52.208344+0000 (oldest deadline 2019-11-29T20:51:37.483759+0000) 2019-11-29T20:52:03.467 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:52:03.461+0000 1694c700 -1 osd.5 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:52.573227+0000 front 2019-11-29T20:50:51.485186+0000 (oldest deadline 2019-11-29T20:51:34.946732+0000) 2019-11-29T20:52:03.595 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:52:03.589+0000 1694c700 -1 osd.1 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:52.594060+0000 front 2019-11-29T20:50:53.872602+0000 (oldest deadline 2019-11-29T20:51:38.431209+0000) 2019-11-29T20:52:03.858 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:52:03.853+0000 1694c700 -1 osd.2 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:54.477537+0000 front 2019-11-29T20:50:55.261592+0000 (oldest deadline 2019-11-29T20:51:38.475588+0000) 2019-11-29T20:52:03.997 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:52:03.991+0000 1694c700 -1 osd.6 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:54.485771+0000 front 2019-11-29T20:50:54.485266+0000 (oldest deadline 2019-11-29T20:51:36.048928+0000) 2019-11-29T20:52:04.053 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:52:04.047+0000 1694c700 -1 osd.7 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:54.482210+0000 front 2019-11-29T20:50:53.556673+0000 (oldest deadline 2019-11-29T20:51:35.143062+0000) 2019-11-29T20:52:04.079 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:52:04.074+0000 1694c700 -1 osd.0 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:55.217128+0000 front 2019-11-29T20:50:54.474620+0000 (oldest deadline 2019-11-29T20:51:36.323322+0000) 2019-11-29T20:52:04.145 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:52:04.139+0000 1694c700 -1 osd.4 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:52.212151+0000 front 2019-11-29T20:50:52.208344+0000 (oldest deadline 2019-11-29T20:51:37.483759+0000) 2019-11-29T20:52:04.455 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:52:04.447+0000 1694c700 -1 osd.5 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:52.573227+0000 front 2019-11-29T20:50:51.485186+0000 (oldest deadline 2019-11-29T20:51:34.946732+0000) 2019-11-29T20:52:04.600 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:52:04.593+0000 1694c700 -1 osd.1 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:52.594060+0000 front 2019-11-29T20:50:53.872602+0000 (oldest deadline 2019-11-29T20:51:38.431209+0000) 2019-11-29T20:52:04.814 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:52:04.809+0000 1694c700 -1 osd.2 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:54.477537+0000 front 2019-11-29T20:50:55.261592+0000 (oldest deadline 2019-11-29T20:51:38.475588+0000) 2019-11-29T20:52:04.971 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:52:04.967+0000 1694c700 -1 osd.6 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:54.485771+0000 front 2019-11-29T20:50:54.485266+0000 (oldest deadline 2019-11-29T20:51:36.048928+0000) 2019-11-29T20:52:05.063 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:52:05.057+0000 1694c700 -1 osd.7 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:54.482210+0000 front 2019-11-29T20:50:53.556673+0000 (oldest deadline 2019-11-29T20:51:35.143062+0000) 2019-11-29T20:52:05.069 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:52:05.064+0000 1694c700 -1 osd.0 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:55.217128+0000 front 2019-11-29T20:50:54.474620+0000 (oldest deadline 2019-11-29T20:51:36.323322+0000) 2019-11-29T20:52:05.130 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:52:05.123+0000 1694c700 -1 osd.4 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:52.212151+0000 front 2019-11-29T20:50:52.208344+0000 (oldest deadline 2019-11-29T20:51:37.483759+0000) 2019-11-29T20:52:05.446 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:52:05.440+0000 1694c700 -1 osd.5 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:52.573227+0000 front 2019-11-29T20:50:51.485186+0000 (oldest deadline 2019-11-29T20:51:34.946732+0000) 2019-11-29T20:52:05.645 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:52:05.640+0000 1694c700 -1 osd.1 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:52.594060+0000 front 2019-11-29T20:50:53.872602+0000 (oldest deadline 2019-11-29T20:51:38.431209+0000) 2019-11-29T20:52:05.814 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:52:05.809+0000 1694c700 -1 osd.2 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:54.477537+0000 front 2019-11-29T20:50:55.261592+0000 (oldest deadline 2019-11-29T20:51:38.475588+0000) 2019-11-29T20:52:05.998 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:52:05.993+0000 1694c700 -1 osd.6 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:54.485771+0000 front 2019-11-29T20:50:54.485266+0000 (oldest deadline 2019-11-29T20:51:36.048928+0000) 2019-11-29T20:52:06.029 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:52:06.022+0000 1694c700 -1 osd.7 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:54.482210+0000 front 2019-11-29T20:50:53.556673+0000 (oldest deadline 2019-11-29T20:51:35.143062+0000) 2019-11-29T20:52:06.082 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:52:06.075+0000 1694c700 -1 osd.0 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:55.217128+0000 front 2019-11-29T20:50:54.474620+0000 (oldest deadline 2019-11-29T20:51:36.323322+0000) 2019-11-29T20:52:06.121 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:52:06.115+0000 1694c700 -1 osd.4 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:52.212151+0000 front 2019-11-29T20:50:52.208344+0000 (oldest deadline 2019-11-29T20:51:37.483759+0000) 2019-11-29T20:52:06.408 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:52:06.402+0000 1694c700 -1 osd.5 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:52.573227+0000 front 2019-11-29T20:50:51.485186+0000 (oldest deadline 2019-11-29T20:51:34.946732+0000) 2019-11-29T20:52:06.634 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:52:06.617+0000 1694c700 -1 osd.1 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:52.594060+0000 front 2019-11-29T20:50:53.872602+0000 (oldest deadline 2019-11-29T20:51:38.431209+0000) 2019-11-29T20:52:06.788 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:52:06.782+0000 1694c700 -1 osd.2 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:54.477537+0000 front 2019-11-29T20:50:55.261592+0000 (oldest deadline 2019-11-29T20:51:38.475588+0000) 2019-11-29T20:52:07.013 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:52:07.008+0000 1694c700 -1 osd.7 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:54.482210+0000 front 2019-11-29T20:50:53.556673+0000 (oldest deadline 2019-11-29T20:51:35.143062+0000) 2019-11-29T20:52:07.031 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:52:07.026+0000 1694c700 -1 osd.6 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:54.485771+0000 front 2019-11-29T20:50:54.485266+0000 (oldest deadline 2019-11-29T20:51:36.048928+0000) 2019-11-29T20:52:07.058 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:52:07.053+0000 1694c700 -1 osd.0 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:55.217128+0000 front 2019-11-29T20:50:54.474620+0000 (oldest deadline 2019-11-29T20:51:36.323322+0000) 2019-11-29T20:52:07.129 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:52:07.123+0000 1694c700 -1 osd.4 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:52.212151+0000 front 2019-11-29T20:50:52.208344+0000 (oldest deadline 2019-11-29T20:51:37.483759+0000) 2019-11-29T20:52:07.437 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:52:07.431+0000 1694c700 -1 osd.5 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:52.573227+0000 front 2019-11-29T20:50:51.485186+0000 (oldest deadline 2019-11-29T20:51:34.946732+0000) 2019-11-29T20:52:07.640 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:52:07.635+0000 1694c700 -1 osd.1 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:52.594060+0000 front 2019-11-29T20:50:53.872602+0000 (oldest deadline 2019-11-29T20:51:38.431209+0000) 2019-11-29T20:52:07.808 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:52:07.802+0000 1694c700 -1 osd.2 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:54.477537+0000 front 2019-11-29T20:50:55.261592+0000 (oldest deadline 2019-11-29T20:51:38.475588+0000) 2019-11-29T20:52:07.848 INFO:tasks.ceph.mon.b.smithi022.stderr:2019-11-29T20:52:07.843+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 3 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.62:6823/10369,v1:172.21.15.62:6825/10369] for 43sec e207 v207) 2019-11-29T20:52:07.969 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:52:07.963+0000 1694c700 -1 osd.7 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:54.482210+0000 front 2019-11-29T20:50:53.556673+0000 (oldest deadline 2019-11-29T20:51:35.143062+0000) 2019-11-29T20:52:08.019 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:52:08.013+0000 1694c700 -1 osd.0 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:55.217128+0000 front 2019-11-29T20:50:54.474620+0000 (oldest deadline 2019-11-29T20:51:36.323322+0000) 2019-11-29T20:52:08.030 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:52:08.025+0000 1694c700 -1 osd.6 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:54.485771+0000 front 2019-11-29T20:50:54.485266+0000 (oldest deadline 2019-11-29T20:51:36.048928+0000) 2019-11-29T20:52:08.173 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:52:08.167+0000 1694c700 -1 osd.4 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:52.212151+0000 front 2019-11-29T20:50:52.208344+0000 (oldest deadline 2019-11-29T20:51:37.483759+0000) 2019-11-29T20:52:08.480 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:52:08.473+0000 1694c700 -1 osd.5 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:52.573227+0000 front 2019-11-29T20:50:51.485186+0000 (oldest deadline 2019-11-29T20:51:34.946732+0000) 2019-11-29T20:52:08.600 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:52:08.592+0000 1694c700 -1 osd.1 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:52.594060+0000 front 2019-11-29T20:50:53.872602+0000 (oldest deadline 2019-11-29T20:51:38.431209+0000) 2019-11-29T20:52:08.820 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:52:08.815+0000 1694c700 -1 osd.2 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:54.477537+0000 front 2019-11-29T20:50:55.261592+0000 (oldest deadline 2019-11-29T20:51:38.475588+0000) 2019-11-29T20:52:08.924 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:52:08.918+0000 1694c700 -1 osd.7 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:54.482210+0000 front 2019-11-29T20:50:53.556673+0000 (oldest deadline 2019-11-29T20:51:35.143062+0000) 2019-11-29T20:52:08.973 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:52:08.968+0000 1694c700 -1 osd.0 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:55.217128+0000 front 2019-11-29T20:50:54.474620+0000 (oldest deadline 2019-11-29T20:51:36.323322+0000) 2019-11-29T20:52:09.082 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:52:09.077+0000 1694c700 -1 osd.6 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:54.485771+0000 front 2019-11-29T20:50:54.485266+0000 (oldest deadline 2019-11-29T20:51:36.048928+0000) 2019-11-29T20:52:09.189 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:52:09.178+0000 1694c700 -1 osd.4 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:52.212151+0000 front 2019-11-29T20:50:52.208344+0000 (oldest deadline 2019-11-29T20:51:37.483759+0000) 2019-11-29T20:52:09.435 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:52:09.430+0000 1694c700 -1 osd.5 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:52.573227+0000 front 2019-11-29T20:50:51.485186+0000 (oldest deadline 2019-11-29T20:51:34.946732+0000) 2019-11-29T20:52:09.633 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:52:09.628+0000 1694c700 -1 osd.1 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:52.594060+0000 front 2019-11-29T20:50:53.872602+0000 (oldest deadline 2019-11-29T20:51:38.431209+0000) 2019-11-29T20:52:09.857 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:52:09.851+0000 1694c700 -1 osd.2 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:54.477537+0000 front 2019-11-29T20:50:55.261592+0000 (oldest deadline 2019-11-29T20:51:38.475588+0000) 2019-11-29T20:52:09.931 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:52:09.924+0000 1694c700 -1 osd.7 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:54.482210+0000 front 2019-11-29T20:50:53.556673+0000 (oldest deadline 2019-11-29T20:51:35.143062+0000) 2019-11-29T20:52:09.942 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:52:09.937+0000 1694c700 -1 osd.0 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:55.217128+0000 front 2019-11-29T20:50:54.474620+0000 (oldest deadline 2019-11-29T20:51:36.323322+0000) 2019-11-29T20:52:10.117 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:52:10.111+0000 1694c700 -1 osd.6 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:54.485771+0000 front 2019-11-29T20:50:54.485266+0000 (oldest deadline 2019-11-29T20:51:36.048928+0000) 2019-11-29T20:52:10.205 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:52:10.196+0000 1694c700 -1 osd.4 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:52.212151+0000 front 2019-11-29T20:50:52.208344+0000 (oldest deadline 2019-11-29T20:51:37.483759+0000) 2019-11-29T20:52:10.468 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:52:10.462+0000 1694c700 -1 osd.5 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:52.573227+0000 front 2019-11-29T20:50:51.485186+0000 (oldest deadline 2019-11-29T20:51:34.946732+0000) 2019-11-29T20:52:10.675 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:52:10.670+0000 1694c700 -1 osd.1 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:52.594060+0000 front 2019-11-29T20:50:53.872602+0000 (oldest deadline 2019-11-29T20:51:38.431209+0000) 2019-11-29T20:52:10.889 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:52:10.883+0000 1694c700 -1 osd.7 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:54.482210+0000 front 2019-11-29T20:50:53.556673+0000 (oldest deadline 2019-11-29T20:51:35.143062+0000) 2019-11-29T20:52:10.905 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:52:10.899+0000 1694c700 -1 osd.2 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:54.477537+0000 front 2019-11-29T20:50:55.261592+0000 (oldest deadline 2019-11-29T20:51:38.475588+0000) 2019-11-29T20:52:10.934 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:52:10.927+0000 1694c700 -1 osd.0 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:55.217128+0000 front 2019-11-29T20:50:54.474620+0000 (oldest deadline 2019-11-29T20:51:36.323322+0000) 2019-11-29T20:52:11.165 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:52:11.159+0000 1694c700 -1 osd.6 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:54.485771+0000 front 2019-11-29T20:50:54.485266+0000 (oldest deadline 2019-11-29T20:51:36.048928+0000) 2019-11-29T20:52:11.202 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:52:11.197+0000 1694c700 -1 osd.4 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:52.212151+0000 front 2019-11-29T20:50:52.208344+0000 (oldest deadline 2019-11-29T20:51:37.483759+0000) 2019-11-29T20:52:11.476 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:52:11.470+0000 1694c700 -1 osd.5 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:52.573227+0000 front 2019-11-29T20:50:51.485186+0000 (oldest deadline 2019-11-29T20:51:34.946732+0000) 2019-11-29T20:52:11.650 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:52:11.646+0000 1694c700 -1 osd.1 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:52.594060+0000 front 2019-11-29T20:50:53.872602+0000 (oldest deadline 2019-11-29T20:51:38.431209+0000) 2019-11-29T20:52:11.904 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:52:11.898+0000 1694c700 -1 osd.7 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:54.482210+0000 front 2019-11-29T20:50:53.556673+0000 (oldest deadline 2019-11-29T20:51:35.143062+0000) 2019-11-29T20:52:11.906 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:52:11.901+0000 1694c700 -1 osd.2 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:54.477537+0000 front 2019-11-29T20:50:55.261592+0000 (oldest deadline 2019-11-29T20:51:38.475588+0000) 2019-11-29T20:52:11.970 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:52:11.965+0000 1694c700 -1 osd.0 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:55.217128+0000 front 2019-11-29T20:50:54.474620+0000 (oldest deadline 2019-11-29T20:51:36.323322+0000) 2019-11-29T20:52:12.200 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:52:12.194+0000 1694c700 -1 osd.6 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:54.485771+0000 front 2019-11-29T20:50:54.485266+0000 (oldest deadline 2019-11-29T20:51:36.048928+0000) 2019-11-29T20:52:12.250 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:52:12.244+0000 1694c700 -1 osd.4 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:52.212151+0000 front 2019-11-29T20:50:52.208344+0000 (oldest deadline 2019-11-29T20:51:37.483759+0000) 2019-11-29T20:52:12.433 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:52:12.427+0000 1694c700 -1 osd.5 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:52.573227+0000 front 2019-11-29T20:50:51.485186+0000 (oldest deadline 2019-11-29T20:51:34.946732+0000) 2019-11-29T20:52:12.634 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:52:12.629+0000 1694c700 -1 osd.1 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:52.594060+0000 front 2019-11-29T20:50:53.872602+0000 (oldest deadline 2019-11-29T20:51:38.431209+0000) 2019-11-29T20:52:12.864 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:52:12.858+0000 1694c700 -1 osd.7 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:54.482210+0000 front 2019-11-29T20:50:53.556673+0000 (oldest deadline 2019-11-29T20:51:35.143062+0000) 2019-11-29T20:52:12.926 INFO:tasks.ceph.mon.b.smithi022.stderr:2019-11-29T20:52:12.921+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.62:6823/10369,v1:172.21.15.62:6825/10369] for 43sec e207 v207) 2019-11-29T20:52:12.946 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:52:12.940+0000 1694c700 -1 osd.2 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:54.477537+0000 front 2019-11-29T20:50:55.261592+0000 (oldest deadline 2019-11-29T20:51:38.475588+0000) 2019-11-29T20:52:13.024 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:52:13.019+0000 1694c700 -1 osd.0 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:55.217128+0000 front 2019-11-29T20:50:54.474620+0000 (oldest deadline 2019-11-29T20:51:36.323322+0000) 2019-11-29T20:52:13.206 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:52:13.200+0000 1694c700 -1 osd.6 207 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:50:54.485771+0000 front 2019-11-29T20:50:54.485266+0000 (oldest deadline 2019-11-29T20:51:36.048928+0000) 2019-11-29T20:52:43.807 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:52:43.605+0000 1694c700 -1 osd.4 210 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:119831 5.e 5:7759931f:::notify.3:head [watch reconnect cookie 821270592 gen 61] snapc 0=[] ondisk+write+known_if_redirected e208) 2019-11-29T20:52:52.139 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:52:52.129+0000 11cac700 -1 osd.0 211 build_incremental_map_msg missing incremental map 211 2019-11-29T20:52:52.632 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:52:52.619+0000 11cac700 -1 osd.7 211 build_incremental_map_msg missing incremental map 211 2019-11-29T20:52:54.255 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:52:54.233+0000 32785700 -1 osd.3 213 build_incremental_map_msg missing incremental map 213 2019-11-29T20:52:54.606 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:52:54.401+0000 31783700 -1 osd.3 213 build_incremental_map_msg missing incremental map 213 2019-11-29T20:52:54.636 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:52:54.456+0000 33f88700 -1 osd.3 213 build_incremental_map_msg missing incremental map 213 2019-11-29T20:52:54.674 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:52:54.524+0000 38f92700 -1 osd.3 213 build_incremental_map_msg missing incremental map 213 2019-11-29T20:52:54.711 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:52:54.585+0000 38f92700 -1 osd.3 213 build_incremental_map_msg missing incremental map 213 2019-11-29T20:52:55.659 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:52:55.593+0000 35f8c700 -1 osd.3 213 build_incremental_map_msg missing incremental map 213 2019-11-29T20:52:56.064 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:52:55.871+0000 31783700 -1 osd.5 213 build_incremental_map_msg missing incremental map 213 2019-11-29T20:52:56.149 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:52:55.970+0000 32785700 -1 osd.5 213 build_incremental_map_msg missing incremental map 213 2019-11-29T20:52:58.863 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:52:58.858+0000 34789700 -1 osd.3 213 build_incremental_map_msg missing incremental map 213 2019-11-29T20:53:03.426 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:08:27:44.085 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T20:53:03.430 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:08:27:44.088 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T20:53:03.485 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:08:27:44.092 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T20:53:03.487 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:08:27:44.094 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T20:53:03.487 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:08:27:44.094 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T20:53:03.489 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:08:27:44.096 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T20:53:03.660 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:08:27:44.318 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T20:53:03.783 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:08:27:44.390 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T20:53:03.816 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:08:27:44.423 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T20:53:10.919 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:53:10.914+0000 1694c700 -1 osd.7 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:29.226228+0000 front 2019-11-29T20:52:29.205951+0000 (oldest deadline 2019-11-29T20:53:10.723109+0000) 2019-11-29T20:53:11.971 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:53:11.966+0000 1694c700 -1 osd.7 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:29.226228+0000 front 2019-11-29T20:52:29.205951+0000 (oldest deadline 2019-11-29T20:53:10.723109+0000) 2019-11-29T20:53:12.160 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:53:12.153+0000 1694c700 -1 osd.2 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:26.129626+0000 front 2019-11-29T20:52:26.319075+0000 (oldest deadline 2019-11-29T20:53:11.396081+0000) 2019-11-29T20:53:12.970 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:53:12.966+0000 1694c700 -1 osd.7 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:29.226228+0000 front 2019-11-29T20:52:29.205951+0000 (oldest deadline 2019-11-29T20:53:10.723109+0000) 2019-11-29T20:53:13.016 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:53:13.010+0000 1694c700 -1 osd.1 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.077799+0000 front 2019-11-29T20:52:28.067090+0000 (oldest deadline 2019-11-29T20:53:12.140209+0000) 2019-11-29T20:53:13.112 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:53:13.104+0000 1694c700 -1 osd.4 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.047773+0000 front 2019-11-29T20:52:28.219811+0000 (oldest deadline 2019-11-29T20:53:12.734925+0000) 2019-11-29T20:53:13.149 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:53:13.143+0000 1694c700 -1 osd.2 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:26.129626+0000 front 2019-11-29T20:52:26.319075+0000 (oldest deadline 2019-11-29T20:53:11.396081+0000) 2019-11-29T20:53:13.477 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:53:13.472+0000 1694c700 -1 osd.0 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.922827+0000 front 2019-11-29T20:52:28.921082+0000 (oldest deadline 2019-11-29T20:53:12.976992+0000) 2019-11-29T20:53:14.007 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:53:14.003+0000 1694c700 -1 osd.7 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:29.226228+0000 front 2019-11-29T20:52:29.205951+0000 (oldest deadline 2019-11-29T20:53:10.723109+0000) 2019-11-29T20:53:14.034 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:53:14.029+0000 1694c700 -1 osd.1 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.077799+0000 front 2019-11-29T20:52:28.067090+0000 (oldest deadline 2019-11-29T20:53:12.140209+0000) 2019-11-29T20:53:14.087 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:53:14.080+0000 1694c700 -1 osd.4 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.047773+0000 front 2019-11-29T20:52:28.219811+0000 (oldest deadline 2019-11-29T20:53:12.734925+0000) 2019-11-29T20:53:14.203 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:53:14.197+0000 1694c700 -1 osd.2 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:26.129626+0000 front 2019-11-29T20:52:26.319075+0000 (oldest deadline 2019-11-29T20:53:11.396081+0000) 2019-11-29T20:53:14.440 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:53:14.434+0000 1694c700 -1 osd.0 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.922827+0000 front 2019-11-29T20:52:28.921082+0000 (oldest deadline 2019-11-29T20:53:12.976992+0000) 2019-11-29T20:53:15.020 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:53:15.015+0000 1694c700 -1 osd.1 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.077799+0000 front 2019-11-29T20:52:28.067090+0000 (oldest deadline 2019-11-29T20:53:12.140209+0000) 2019-11-29T20:53:15.044 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:53:15.039+0000 1694c700 -1 osd.7 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:29.226228+0000 front 2019-11-29T20:52:29.205951+0000 (oldest deadline 2019-11-29T20:53:10.723109+0000) 2019-11-29T20:53:15.127 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:53:15.122+0000 1694c700 -1 osd.4 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.047773+0000 front 2019-11-29T20:52:28.219811+0000 (oldest deadline 2019-11-29T20:53:12.734925+0000) 2019-11-29T20:53:15.256 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:53:15.250+0000 1694c700 -1 osd.2 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:26.129626+0000 front 2019-11-29T20:52:26.319075+0000 (oldest deadline 2019-11-29T20:53:11.396081+0000) 2019-11-29T20:53:15.482 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:53:15.478+0000 1694c700 -1 osd.0 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.922827+0000 front 2019-11-29T20:52:28.921082+0000 (oldest deadline 2019-11-29T20:53:12.976992+0000) 2019-11-29T20:53:15.980 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:53:15.972+0000 1694c700 -1 osd.1 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.077799+0000 front 2019-11-29T20:52:28.067090+0000 (oldest deadline 2019-11-29T20:53:12.140209+0000) 2019-11-29T20:53:16.011 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:53:16.006+0000 1694c700 -1 osd.7 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:29.226228+0000 front 2019-11-29T20:52:29.205951+0000 (oldest deadline 2019-11-29T20:53:10.723109+0000) 2019-11-29T20:53:16.124 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:53:16.119+0000 1694c700 -1 osd.4 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.047773+0000 front 2019-11-29T20:52:28.219811+0000 (oldest deadline 2019-11-29T20:53:12.734925+0000) 2019-11-29T20:53:16.305 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:53:16.300+0000 1694c700 -1 osd.2 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:26.129626+0000 front 2019-11-29T20:52:26.319075+0000 (oldest deadline 2019-11-29T20:53:11.396081+0000) 2019-11-29T20:53:16.504 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:53:16.497+0000 1694c700 -1 osd.0 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.922827+0000 front 2019-11-29T20:52:28.921082+0000 (oldest deadline 2019-11-29T20:53:12.976992+0000) 2019-11-29T20:53:16.978 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:53:16.972+0000 1694c700 -1 osd.1 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.077799+0000 front 2019-11-29T20:52:28.067090+0000 (oldest deadline 2019-11-29T20:53:12.140209+0000) 2019-11-29T20:53:17.058 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:53:17.053+0000 1694c700 -1 osd.7 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:29.226228+0000 front 2019-11-29T20:52:29.205951+0000 (oldest deadline 2019-11-29T20:53:10.723109+0000) 2019-11-29T20:53:17.088 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:53:17.083+0000 1694c700 -1 osd.4 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.047773+0000 front 2019-11-29T20:52:28.219811+0000 (oldest deadline 2019-11-29T20:53:12.734925+0000) 2019-11-29T20:53:17.332 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:53:17.327+0000 1694c700 -1 osd.2 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:26.129626+0000 front 2019-11-29T20:52:26.319075+0000 (oldest deadline 2019-11-29T20:53:11.396081+0000) 2019-11-29T20:53:17.467 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:53:17.461+0000 1694c700 -1 osd.0 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.922827+0000 front 2019-11-29T20:52:28.921082+0000 (oldest deadline 2019-11-29T20:53:12.976992+0000) 2019-11-29T20:53:17.994 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:53:17.988+0000 1694c700 -1 osd.1 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.077799+0000 front 2019-11-29T20:52:28.067090+0000 (oldest deadline 2019-11-29T20:53:12.140209+0000) 2019-11-29T20:53:18.033 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:53:18.027+0000 1694c700 -1 osd.7 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:29.226228+0000 front 2019-11-29T20:52:29.205951+0000 (oldest deadline 2019-11-29T20:53:10.723109+0000) 2019-11-29T20:53:18.096 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:53:18.090+0000 1694c700 -1 osd.4 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.047773+0000 front 2019-11-29T20:52:28.219811+0000 (oldest deadline 2019-11-29T20:53:12.734925+0000) 2019-11-29T20:53:18.379 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:53:18.374+0000 1694c700 -1 osd.2 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:26.129626+0000 front 2019-11-29T20:52:26.319075+0000 (oldest deadline 2019-11-29T20:53:11.396081+0000) 2019-11-29T20:53:18.485 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:53:18.480+0000 1694c700 -1 osd.0 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.922827+0000 front 2019-11-29T20:52:28.921082+0000 (oldest deadline 2019-11-29T20:53:12.976992+0000) 2019-11-29T20:53:19.004 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:53:18.999+0000 1694c700 -1 osd.7 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:29.226228+0000 front 2019-11-29T20:52:29.205951+0000 (oldest deadline 2019-11-29T20:53:10.723109+0000) 2019-11-29T20:53:19.028 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:53:19.022+0000 1694c700 -1 osd.1 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.077799+0000 front 2019-11-29T20:52:28.067090+0000 (oldest deadline 2019-11-29T20:53:12.140209+0000) 2019-11-29T20:53:19.096 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:53:19.088+0000 1694c700 -1 osd.4 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.047773+0000 front 2019-11-29T20:52:28.219811+0000 (oldest deadline 2019-11-29T20:53:12.734925+0000) 2019-11-29T20:53:19.366 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:53:19.360+0000 1694c700 -1 osd.2 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:26.129626+0000 front 2019-11-29T20:52:26.319075+0000 (oldest deadline 2019-11-29T20:53:11.396081+0000) 2019-11-29T20:53:19.503 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:53:19.497+0000 1694c700 -1 osd.0 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.922827+0000 front 2019-11-29T20:52:28.921082+0000 (oldest deadline 2019-11-29T20:53:12.976992+0000) 2019-11-29T20:53:20.000 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:53:19.990+0000 1694c700 -1 osd.7 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:29.226228+0000 front 2019-11-29T20:52:29.205951+0000 (oldest deadline 2019-11-29T20:53:10.723109+0000) 2019-11-29T20:53:20.076 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:53:20.071+0000 1694c700 -1 osd.4 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.047773+0000 front 2019-11-29T20:52:28.219811+0000 (oldest deadline 2019-11-29T20:53:12.734925+0000) 2019-11-29T20:53:20.078 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:53:20.072+0000 1694c700 -1 osd.1 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.077799+0000 front 2019-11-29T20:52:28.067090+0000 (oldest deadline 2019-11-29T20:53:12.140209+0000) 2019-11-29T20:53:20.357 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:53:20.351+0000 1694c700 -1 osd.2 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:26.129626+0000 front 2019-11-29T20:52:26.319075+0000 (oldest deadline 2019-11-29T20:53:11.396081+0000) 2019-11-29T20:53:20.507 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:53:20.501+0000 1694c700 -1 osd.0 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.922827+0000 front 2019-11-29T20:52:28.921082+0000 (oldest deadline 2019-11-29T20:53:12.976992+0000) 2019-11-29T20:53:20.986 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:53:20.981+0000 1694c700 -1 osd.7 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:29.226228+0000 front 2019-11-29T20:52:29.205951+0000 (oldest deadline 2019-11-29T20:53:10.723109+0000) 2019-11-29T20:53:21.092 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:53:21.087+0000 1694c700 -1 osd.4 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.047773+0000 front 2019-11-29T20:52:28.219811+0000 (oldest deadline 2019-11-29T20:53:12.734925+0000) 2019-11-29T20:53:21.106 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:53:21.101+0000 1694c700 -1 osd.1 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.077799+0000 front 2019-11-29T20:52:28.067090+0000 (oldest deadline 2019-11-29T20:53:12.140209+0000) 2019-11-29T20:53:21.342 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:53:21.337+0000 1694c700 -1 osd.2 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:26.129626+0000 front 2019-11-29T20:52:26.319075+0000 (oldest deadline 2019-11-29T20:53:11.396081+0000) 2019-11-29T20:53:21.536 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:53:21.531+0000 1694c700 -1 osd.0 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.922827+0000 front 2019-11-29T20:52:28.921082+0000 (oldest deadline 2019-11-29T20:53:12.976992+0000) 2019-11-29T20:53:21.894 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:53:21.889+0000 1694c700 -1 osd.3 213 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:119886 7.5 7.2bcddf15 (undecoded) ondisk+retry+read+known_if_redirected e211) 2019-11-29T20:53:21.947 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:53:21.942+0000 1694c700 -1 osd.7 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:29.226228+0000 front 2019-11-29T20:52:29.205951+0000 (oldest deadline 2019-11-29T20:53:10.723109+0000) 2019-11-29T20:53:22.078 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:53:22.073+0000 1694c700 -1 osd.4 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.047773+0000 front 2019-11-29T20:52:28.219811+0000 (oldest deadline 2019-11-29T20:53:12.734925+0000) 2019-11-29T20:53:22.099 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:53:22.094+0000 1694c700 -1 osd.1 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.077799+0000 front 2019-11-29T20:52:28.067090+0000 (oldest deadline 2019-11-29T20:53:12.140209+0000) 2019-11-29T20:53:22.347 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:53:22.341+0000 1694c700 -1 osd.2 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:26.129626+0000 front 2019-11-29T20:52:26.319075+0000 (oldest deadline 2019-11-29T20:53:11.396081+0000) 2019-11-29T20:53:22.587 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:53:22.581+0000 1694c700 -1 osd.0 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.922827+0000 front 2019-11-29T20:52:28.921082+0000 (oldest deadline 2019-11-29T20:53:12.976992+0000) 2019-11-29T20:53:22.909 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:53:22.904+0000 1694c700 -1 osd.3 213 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4325.0:119886 7.5 7.2bcddf15 (undecoded) ondisk+retry+read+known_if_redirected e211) 2019-11-29T20:53:22.985 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:53:22.980+0000 1694c700 -1 osd.7 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:29.226228+0000 front 2019-11-29T20:52:29.205951+0000 (oldest deadline 2019-11-29T20:53:10.723109+0000) 2019-11-29T20:53:23.071 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:53:23.064+0000 1694c700 -1 osd.1 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.077799+0000 front 2019-11-29T20:52:28.067090+0000 (oldest deadline 2019-11-29T20:53:12.140209+0000) 2019-11-29T20:53:23.134 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:53:23.128+0000 1694c700 -1 osd.4 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.047773+0000 front 2019-11-29T20:52:28.219811+0000 (oldest deadline 2019-11-29T20:53:12.734925+0000) 2019-11-29T20:53:23.369 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:53:23.364+0000 1694c700 -1 osd.2 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:26.129626+0000 front 2019-11-29T20:52:26.319075+0000 (oldest deadline 2019-11-29T20:53:11.396081+0000) 2019-11-29T20:53:23.569 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:53:23.562+0000 1694c700 -1 osd.0 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.922827+0000 front 2019-11-29T20:52:28.921082+0000 (oldest deadline 2019-11-29T20:53:12.976992+0000) 2019-11-29T20:53:23.914 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:53:23.909+0000 1694c700 -1 osd.3 213 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4325.0:119886 7.5 7.2bcddf15 (undecoded) ondisk+retry+read+known_if_redirected e211) 2019-11-29T20:53:23.973 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:53:23.968+0000 1694c700 -1 osd.7 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:29.226228+0000 front 2019-11-29T20:52:29.205951+0000 (oldest deadline 2019-11-29T20:53:10.723109+0000) 2019-11-29T20:53:24.100 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:53:24.095+0000 1694c700 -1 osd.1 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.077799+0000 front 2019-11-29T20:52:28.067090+0000 (oldest deadline 2019-11-29T20:53:12.140209+0000) 2019-11-29T20:53:24.101 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:53:24.097+0000 1694c700 -1 osd.4 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.047773+0000 front 2019-11-29T20:52:28.219811+0000 (oldest deadline 2019-11-29T20:53:12.734925+0000) 2019-11-29T20:53:24.400 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:53:24.394+0000 1694c700 -1 osd.2 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:26.129626+0000 front 2019-11-29T20:52:26.319075+0000 (oldest deadline 2019-11-29T20:53:11.396081+0000) 2019-11-29T20:53:24.552 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:53:24.546+0000 1694c700 -1 osd.0 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.922827+0000 front 2019-11-29T20:52:28.921082+0000 (oldest deadline 2019-11-29T20:53:12.976992+0000) 2019-11-29T20:53:24.934 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:53:24.930+0000 1694c700 -1 osd.7 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:29.226228+0000 front 2019-11-29T20:52:29.205951+0000 (oldest deadline 2019-11-29T20:53:10.723109+0000) 2019-11-29T20:53:24.945 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:53:24.941+0000 1694c700 -1 osd.3 213 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4325.0:119886 7.5 7.2bcddf15 (undecoded) ondisk+retry+read+known_if_redirected e211) 2019-11-29T20:53:25.083 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:53:25.078+0000 1694c700 -1 osd.1 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.077799+0000 front 2019-11-29T20:52:28.067090+0000 (oldest deadline 2019-11-29T20:53:12.140209+0000) 2019-11-29T20:53:25.093 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:53:25.087+0000 1694c700 -1 osd.4 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.047773+0000 front 2019-11-29T20:52:28.219811+0000 (oldest deadline 2019-11-29T20:53:12.734925+0000) 2019-11-29T20:53:25.400 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:53:25.394+0000 1694c700 -1 osd.2 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:26.129626+0000 front 2019-11-29T20:52:26.319075+0000 (oldest deadline 2019-11-29T20:53:11.396081+0000) 2019-11-29T20:53:25.511 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:53:25.506+0000 1694c700 -1 osd.0 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.922827+0000 front 2019-11-29T20:52:28.921082+0000 (oldest deadline 2019-11-29T20:53:12.976992+0000) 2019-11-29T20:53:25.902 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:53:25.897+0000 1694c700 -1 osd.7 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:29.226228+0000 front 2019-11-29T20:52:29.205951+0000 (oldest deadline 2019-11-29T20:53:10.723109+0000) 2019-11-29T20:53:25.907 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:53:25.901+0000 1694c700 -1 osd.3 213 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4325.0:119886 7.5 7.2bcddf15 (undecoded) ondisk+retry+read+known_if_redirected e211) 2019-11-29T20:53:26.111 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:53:26.107+0000 1694c700 -1 osd.4 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.047773+0000 front 2019-11-29T20:52:28.219811+0000 (oldest deadline 2019-11-29T20:53:12.734925+0000) 2019-11-29T20:53:26.130 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:53:26.127+0000 1694c700 -1 osd.1 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.077799+0000 front 2019-11-29T20:52:28.067090+0000 (oldest deadline 2019-11-29T20:53:12.140209+0000) 2019-11-29T20:53:26.366 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:53:26.362+0000 1694c700 -1 osd.2 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:26.129626+0000 front 2019-11-29T20:52:26.319075+0000 (oldest deadline 2019-11-29T20:53:11.396081+0000) 2019-11-29T20:53:26.470 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:53:26.464+0000 1694c700 -1 osd.0 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.922827+0000 front 2019-11-29T20:52:28.921082+0000 (oldest deadline 2019-11-29T20:53:12.976992+0000) 2019-11-29T20:53:26.876 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:53:26.871+0000 1694c700 -1 osd.7 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:29.226228+0000 front 2019-11-29T20:52:29.205951+0000 (oldest deadline 2019-11-29T20:53:10.723109+0000) 2019-11-29T20:53:26.880 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:53:26.876+0000 1694c700 -1 osd.3 213 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4325.0:119886 7.5 7.2bcddf15 (undecoded) ondisk+retry+read+known_if_redirected e211) 2019-11-29T20:53:27.117 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:53:27.111+0000 1694c700 -1 osd.4 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.047773+0000 front 2019-11-29T20:52:28.219811+0000 (oldest deadline 2019-11-29T20:53:12.734925+0000) 2019-11-29T20:53:27.181 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:53:27.176+0000 1694c700 -1 osd.1 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.077799+0000 front 2019-11-29T20:52:28.067090+0000 (oldest deadline 2019-11-29T20:53:12.140209+0000) 2019-11-29T20:53:27.410 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:53:27.405+0000 1694c700 -1 osd.2 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:26.129626+0000 front 2019-11-29T20:52:26.319075+0000 (oldest deadline 2019-11-29T20:53:11.396081+0000) 2019-11-29T20:53:27.457 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:53:27.452+0000 1694c700 -1 osd.0 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.922827+0000 front 2019-11-29T20:52:28.921082+0000 (oldest deadline 2019-11-29T20:53:12.976992+0000) 2019-11-29T20:53:27.864 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:53:27.852+0000 1694c700 -1 osd.6 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:26.083170+0000 front 2019-11-29T20:52:27.816859+0000 (oldest deadline 2019-11-29T20:53:26.953949+0000) 2019-11-29T20:53:27.880 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:53:27.875+0000 1694c700 -1 osd.3 213 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4325.0:119886 7.5 7.2bcddf15 (undecoded) ondisk+retry+read+known_if_redirected e211) 2019-11-29T20:53:27.919 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:53:27.915+0000 1694c700 -1 osd.7 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:29.226228+0000 front 2019-11-29T20:52:29.205951+0000 (oldest deadline 2019-11-29T20:53:10.723109+0000) 2019-11-29T20:53:28.084 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:53:28.073+0000 1694c700 -1 osd.4 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.047773+0000 front 2019-11-29T20:52:28.219811+0000 (oldest deadline 2019-11-29T20:53:12.734925+0000) 2019-11-29T20:53:28.153 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:53:28.145+0000 1694c700 -1 osd.1 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.077799+0000 front 2019-11-29T20:52:28.067090+0000 (oldest deadline 2019-11-29T20:53:12.140209+0000) 2019-11-29T20:53:28.369 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:53:28.364+0000 1694c700 -1 osd.2 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:26.129626+0000 front 2019-11-29T20:52:26.319075+0000 (oldest deadline 2019-11-29T20:53:11.396081+0000) 2019-11-29T20:53:28.507 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:53:28.502+0000 1694c700 -1 osd.0 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.922827+0000 front 2019-11-29T20:52:28.921082+0000 (oldest deadline 2019-11-29T20:53:12.976992+0000) 2019-11-29T20:53:28.898 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:53:28.893+0000 1694c700 -1 osd.6 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:26.083170+0000 front 2019-11-29T20:52:27.816859+0000 (oldest deadline 2019-11-29T20:53:26.953949+0000) 2019-11-29T20:53:28.899 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:53:28.895+0000 1694c700 -1 osd.3 213 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4325.0:119886 7.5 7.2bcddf15 (undecoded) ondisk+retry+read+known_if_redirected e211) 2019-11-29T20:53:28.962 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:53:28.958+0000 1694c700 -1 osd.7 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:29.226228+0000 front 2019-11-29T20:52:29.205951+0000 (oldest deadline 2019-11-29T20:53:10.723109+0000) 2019-11-29T20:53:29.066 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:53:29.061+0000 1694c700 -1 osd.4 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.047773+0000 front 2019-11-29T20:52:28.219811+0000 (oldest deadline 2019-11-29T20:53:12.734925+0000) 2019-11-29T20:53:29.197 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:53:29.190+0000 1694c700 -1 osd.1 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.077799+0000 front 2019-11-29T20:52:28.067090+0000 (oldest deadline 2019-11-29T20:53:12.140209+0000) 2019-11-29T20:53:29.382 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:53:29.376+0000 1694c700 -1 osd.2 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:26.129626+0000 front 2019-11-29T20:52:26.319075+0000 (oldest deadline 2019-11-29T20:53:11.396081+0000) 2019-11-29T20:53:29.472 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:53:29.467+0000 1694c700 -1 osd.0 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.922827+0000 front 2019-11-29T20:52:28.921082+0000 (oldest deadline 2019-11-29T20:53:12.976992+0000) 2019-11-29T20:53:29.597 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:08:28:10.255 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T20:53:29.614 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:08:28:10.272 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T20:53:29.618 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:08:28:10.225 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T20:53:29.619 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:08:28:10.226 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T20:53:29.622 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:08:28:10.229 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T20:53:29.624 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:08:28:10.231 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T20:53:29.694 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:08:28:10.300 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T20:53:29.696 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:08:28:10.303 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T20:53:29.705 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:08:28:10.363 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T20:53:29.911 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:53:29.906+0000 1694c700 -1 osd.6 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:26.083170+0000 front 2019-11-29T20:52:27.816859+0000 (oldest deadline 2019-11-29T20:53:26.953949+0000) 2019-11-29T20:53:29.949 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:53:29.943+0000 1694c700 -1 osd.3 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:52:49.240380+0000 (oldest deadline 2019-11-29T20:53:29.240380+0000) 2019-11-29T20:53:29.950 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:53:29.945+0000 1694c700 -1 osd.3 213 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4325.0:119886 7.5 7.2bcddf15 (undecoded) ondisk+retry+read+known_if_redirected e211) 2019-11-29T20:53:29.955 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:53:29.949+0000 1694c700 -1 osd.7 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:29.226228+0000 front 2019-11-29T20:52:29.205951+0000 (oldest deadline 2019-11-29T20:53:10.723109+0000) 2019-11-29T20:53:30.027 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:53:30.023+0000 1694c700 -1 osd.4 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.047773+0000 front 2019-11-29T20:52:28.219811+0000 (oldest deadline 2019-11-29T20:53:12.734925+0000) 2019-11-29T20:53:30.228 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:53:30.223+0000 1694c700 -1 osd.1 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.077799+0000 front 2019-11-29T20:52:28.067090+0000 (oldest deadline 2019-11-29T20:53:12.140209+0000) 2019-11-29T20:53:30.423 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:53:30.418+0000 1694c700 -1 osd.2 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:26.129626+0000 front 2019-11-29T20:52:26.319075+0000 (oldest deadline 2019-11-29T20:53:11.396081+0000) 2019-11-29T20:53:30.450 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:53:30.445+0000 1694c700 -1 osd.0 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.922827+0000 front 2019-11-29T20:52:28.921082+0000 (oldest deadline 2019-11-29T20:53:12.976992+0000) 2019-11-29T20:53:30.923 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:53:30.918+0000 1694c700 -1 osd.7 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:29.226228+0000 front 2019-11-29T20:52:29.205951+0000 (oldest deadline 2019-11-29T20:53:10.723109+0000) 2019-11-29T20:53:30.957 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:53:30.952+0000 1694c700 -1 osd.6 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:26.083170+0000 front 2019-11-29T20:52:27.816859+0000 (oldest deadline 2019-11-29T20:53:26.953949+0000) 2019-11-29T20:53:30.973 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:53:30.966+0000 1694c700 -1 osd.3 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:52:49.240380+0000 (oldest deadline 2019-11-29T20:53:29.240380+0000) 2019-11-29T20:53:30.974 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:53:30.968+0000 1694c700 -1 osd.3 213 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4325.0:119886 7.5 7.2bcddf15 (undecoded) ondisk+retry+read+known_if_redirected e211) 2019-11-29T20:53:31.069 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:53:31.064+0000 1694c700 -1 osd.4 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.047773+0000 front 2019-11-29T20:52:28.219811+0000 (oldest deadline 2019-11-29T20:53:12.734925+0000) 2019-11-29T20:53:31.220 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:53:31.212+0000 1694c700 -1 osd.1 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.077799+0000 front 2019-11-29T20:52:28.067090+0000 (oldest deadline 2019-11-29T20:53:12.140209+0000) 2019-11-29T20:53:31.419 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:53:31.410+0000 1694c700 -1 osd.0 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.922827+0000 front 2019-11-29T20:52:28.921082+0000 (oldest deadline 2019-11-29T20:53:12.976992+0000) 2019-11-29T20:53:31.433 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:53:31.428+0000 1694c700 -1 osd.2 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:26.129626+0000 front 2019-11-29T20:52:26.319075+0000 (oldest deadline 2019-11-29T20:53:11.396081+0000) 2019-11-29T20:53:31.908 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:53:31.902+0000 1694c700 -1 osd.7 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:29.226228+0000 front 2019-11-29T20:52:29.205951+0000 (oldest deadline 2019-11-29T20:53:10.723109+0000) 2019-11-29T20:53:31.959 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:53:31.954+0000 1694c700 -1 osd.6 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:26.083170+0000 front 2019-11-29T20:52:27.816859+0000 (oldest deadline 2019-11-29T20:53:26.953949+0000) 2019-11-29T20:53:31.981 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:53:31.976+0000 1694c700 -1 osd.3 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:52:49.240380+0000 (oldest deadline 2019-11-29T20:53:29.240380+0000) 2019-11-29T20:53:31.984 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:53:31.980+0000 1694c700 -1 osd.3 213 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4325.0:119886 7.5 7.2bcddf15 (undecoded) ondisk+retry+read+known_if_redirected e211) 2019-11-29T20:53:32.121 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:53:32.116+0000 1694c700 -1 osd.4 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.047773+0000 front 2019-11-29T20:52:28.219811+0000 (oldest deadline 2019-11-29T20:53:12.734925+0000) 2019-11-29T20:53:32.207 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:53:32.201+0000 1694c700 -1 osd.1 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.077799+0000 front 2019-11-29T20:52:28.067090+0000 (oldest deadline 2019-11-29T20:53:12.140209+0000) 2019-11-29T20:53:32.385 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:53:32.379+0000 1694c700 -1 osd.0 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.922827+0000 front 2019-11-29T20:52:28.921082+0000 (oldest deadline 2019-11-29T20:53:12.976992+0000) 2019-11-29T20:53:32.447 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:53:32.442+0000 1694c700 -1 osd.2 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:26.129626+0000 front 2019-11-29T20:52:26.319075+0000 (oldest deadline 2019-11-29T20:53:11.396081+0000) 2019-11-29T20:53:32.932 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:53:32.926+0000 1694c700 -1 osd.6 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:26.083170+0000 front 2019-11-29T20:52:27.816859+0000 (oldest deadline 2019-11-29T20:53:26.953949+0000) 2019-11-29T20:53:32.956 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:53:32.951+0000 1694c700 -1 osd.7 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:29.226228+0000 front 2019-11-29T20:52:29.205951+0000 (oldest deadline 2019-11-29T20:53:10.723109+0000) 2019-11-29T20:53:32.969 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:53:32.963+0000 1694c700 -1 osd.3 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:52:49.240380+0000 (oldest deadline 2019-11-29T20:53:29.240380+0000) 2019-11-29T20:53:32.970 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:53:32.965+0000 1694c700 -1 osd.3 213 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4325.0:119886 7.5 7.2bcddf15 (undecoded) ondisk+retry+read+known_if_redirected e211) 2019-11-29T20:53:33.083 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:53:33.078+0000 1694c700 -1 osd.4 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.047773+0000 front 2019-11-29T20:52:28.219811+0000 (oldest deadline 2019-11-29T20:53:12.734925+0000) 2019-11-29T20:53:33.186 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:53:33.181+0000 1694c700 -1 osd.1 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.077799+0000 front 2019-11-29T20:52:28.067090+0000 (oldest deadline 2019-11-29T20:53:12.140209+0000) 2019-11-29T20:53:33.398 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:53:33.393+0000 1694c700 -1 osd.0 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.922827+0000 front 2019-11-29T20:52:28.921082+0000 (oldest deadline 2019-11-29T20:53:12.976992+0000) 2019-11-29T20:53:33.431 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:53:33.425+0000 1694c700 -1 osd.2 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:26.129626+0000 front 2019-11-29T20:52:26.319075+0000 (oldest deadline 2019-11-29T20:53:11.396081+0000) 2019-11-29T20:53:33.960 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:53:33.953+0000 1694c700 -1 osd.7 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:29.226228+0000 front 2019-11-29T20:52:29.205951+0000 (oldest deadline 2019-11-29T20:53:10.723109+0000) 2019-11-29T20:53:33.975 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:53:33.970+0000 1694c700 -1 osd.6 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:26.083170+0000 front 2019-11-29T20:52:27.816859+0000 (oldest deadline 2019-11-29T20:53:26.953949+0000) 2019-11-29T20:53:33.994 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:53:33.989+0000 1694c700 -1 osd.3 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:52:49.240380+0000 (oldest deadline 2019-11-29T20:53:29.240380+0000) 2019-11-29T20:53:33.997 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:53:33.993+0000 1694c700 -1 osd.3 213 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4325.0:119886 7.5 7.2bcddf15 (undecoded) ondisk+retry+read+known_if_redirected e211) 2019-11-29T20:53:34.108 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:53:34.103+0000 1694c700 -1 osd.4 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.047773+0000 front 2019-11-29T20:52:28.219811+0000 (oldest deadline 2019-11-29T20:53:12.734925+0000) 2019-11-29T20:53:34.235 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:53:34.230+0000 1694c700 -1 osd.1 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.077799+0000 front 2019-11-29T20:52:28.067090+0000 (oldest deadline 2019-11-29T20:53:12.140209+0000) 2019-11-29T20:53:34.392 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:53:34.386+0000 1694c700 -1 osd.0 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.922827+0000 front 2019-11-29T20:52:28.921082+0000 (oldest deadline 2019-11-29T20:53:12.976992+0000) 2019-11-29T20:53:34.458 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:53:34.453+0000 1694c700 -1 osd.2 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:26.129626+0000 front 2019-11-29T20:52:26.319075+0000 (oldest deadline 2019-11-29T20:53:11.396081+0000) 2019-11-29T20:53:34.969 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:53:34.963+0000 1694c700 -1 osd.6 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:26.083170+0000 front 2019-11-29T20:52:27.816859+0000 (oldest deadline 2019-11-29T20:53:26.953949+0000) 2019-11-29T20:53:34.973 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:53:34.964+0000 1694c700 -1 osd.7 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:29.226228+0000 front 2019-11-29T20:52:29.205951+0000 (oldest deadline 2019-11-29T20:53:10.723109+0000) 2019-11-29T20:53:35.016 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:53:35.010+0000 1694c700 -1 osd.3 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:52:49.240380+0000 (oldest deadline 2019-11-29T20:53:29.240380+0000) 2019-11-29T20:53:35.025 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:53:35.015+0000 1694c700 -1 osd.3 213 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4325.0:119886 7.5 7.2bcddf15 (undecoded) ondisk+retry+read+known_if_redirected e211) 2019-11-29T20:53:35.143 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:53:35.137+0000 1694c700 -1 osd.4 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.047773+0000 front 2019-11-29T20:52:28.219811+0000 (oldest deadline 2019-11-29T20:53:12.734925+0000) 2019-11-29T20:53:35.236 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:53:35.231+0000 1694c700 -1 osd.1 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.077799+0000 front 2019-11-29T20:52:28.067090+0000 (oldest deadline 2019-11-29T20:53:12.140209+0000) 2019-11-29T20:53:35.404 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:53:35.398+0000 1694c700 -1 osd.0 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.922827+0000 front 2019-11-29T20:52:28.921082+0000 (oldest deadline 2019-11-29T20:53:12.976992+0000) 2019-11-29T20:53:35.502 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:53:35.496+0000 1694c700 -1 osd.2 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:26.129626+0000 front 2019-11-29T20:52:26.319075+0000 (oldest deadline 2019-11-29T20:53:11.396081+0000) 2019-11-29T20:53:35.965 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:53:35.959+0000 1694c700 -1 osd.6 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:26.083170+0000 front 2019-11-29T20:52:27.816859+0000 (oldest deadline 2019-11-29T20:53:26.953949+0000) 2019-11-29T20:53:35.981 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:53:35.976+0000 1694c700 -1 osd.7 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:29.226228+0000 front 2019-11-29T20:52:29.205951+0000 (oldest deadline 2019-11-29T20:53:10.723109+0000) 2019-11-29T20:53:35.993 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:53:35.987+0000 1694c700 -1 osd.3 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:52:49.240380+0000 (oldest deadline 2019-11-29T20:53:29.240380+0000) 2019-11-29T20:53:35.993 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:53:35.989+0000 1694c700 -1 osd.3 213 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4325.0:119886 7.5 7.2bcddf15 (undecoded) ondisk+retry+read+known_if_redirected e211) 2019-11-29T20:53:36.118 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:53:36.113+0000 1694c700 -1 osd.4 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.047773+0000 front 2019-11-29T20:52:28.219811+0000 (oldest deadline 2019-11-29T20:53:12.734925+0000) 2019-11-29T20:53:36.219 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:53:36.213+0000 1694c700 -1 osd.1 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.077799+0000 front 2019-11-29T20:52:28.067090+0000 (oldest deadline 2019-11-29T20:53:12.140209+0000) 2019-11-29T20:53:36.436 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:53:36.432+0000 1694c700 -1 osd.0 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.922827+0000 front 2019-11-29T20:52:28.921082+0000 (oldest deadline 2019-11-29T20:53:12.976992+0000) 2019-11-29T20:53:36.490 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:53:36.486+0000 1694c700 -1 osd.2 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:26.129626+0000 front 2019-11-29T20:52:26.319075+0000 (oldest deadline 2019-11-29T20:53:11.396081+0000) 2019-11-29T20:53:36.941 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:53:36.936+0000 1694c700 -1 osd.6 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:26.083170+0000 front 2019-11-29T20:52:27.816859+0000 (oldest deadline 2019-11-29T20:53:26.953949+0000) 2019-11-29T20:53:36.957 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:53:36.952+0000 1694c700 -1 osd.7 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:29.226228+0000 front 2019-11-29T20:52:29.205951+0000 (oldest deadline 2019-11-29T20:53:10.723109+0000) 2019-11-29T20:53:37.036 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:53:37.031+0000 1694c700 -1 osd.3 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:52:49.240380+0000 (oldest deadline 2019-11-29T20:53:29.240380+0000) 2019-11-29T20:53:37.038 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:53:37.034+0000 1694c700 -1 osd.3 213 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4325.0:119886 7.5 7.2bcddf15 (undecoded) ondisk+retry+read+known_if_redirected e211) 2019-11-29T20:53:37.148 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:53:37.142+0000 1694c700 -1 osd.4 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.047773+0000 front 2019-11-29T20:52:28.219811+0000 (oldest deadline 2019-11-29T20:53:12.734925+0000) 2019-11-29T20:53:37.181 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:53:37.175+0000 1694c700 -1 osd.1 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.077799+0000 front 2019-11-29T20:52:28.067090+0000 (oldest deadline 2019-11-29T20:53:12.140209+0000) 2019-11-29T20:53:37.450 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:53:37.445+0000 1694c700 -1 osd.0 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.922827+0000 front 2019-11-29T20:52:28.921082+0000 (oldest deadline 2019-11-29T20:53:12.976992+0000) 2019-11-29T20:53:37.526 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:53:37.521+0000 1694c700 -1 osd.2 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:26.129626+0000 front 2019-11-29T20:52:26.319075+0000 (oldest deadline 2019-11-29T20:53:11.396081+0000) 2019-11-29T20:53:37.913 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:53:37.906+0000 1694c700 -1 osd.7 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:29.226228+0000 front 2019-11-29T20:52:29.205951+0000 (oldest deadline 2019-11-29T20:53:10.723109+0000) 2019-11-29T20:53:37.921 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:53:37.914+0000 1694c700 -1 osd.6 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:26.083170+0000 front 2019-11-29T20:52:27.816859+0000 (oldest deadline 2019-11-29T20:53:26.953949+0000) 2019-11-29T20:53:38.022 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:53:38.017+0000 1694c700 -1 osd.3 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:52:49.240380+0000 (oldest deadline 2019-11-29T20:53:29.240380+0000) 2019-11-29T20:53:38.024 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:53:38.020+0000 1694c700 -1 osd.3 213 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4325.0:119886 7.5 7.2bcddf15 (undecoded) ondisk+retry+read+known_if_redirected e211) 2019-11-29T20:53:38.110 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:53:38.104+0000 1694c700 -1 osd.4 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.047773+0000 front 2019-11-29T20:52:28.219811+0000 (oldest deadline 2019-11-29T20:53:12.734925+0000) 2019-11-29T20:53:38.216 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:53:38.209+0000 1694c700 -1 osd.1 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.077799+0000 front 2019-11-29T20:52:28.067090+0000 (oldest deadline 2019-11-29T20:53:12.140209+0000) 2019-11-29T20:53:38.428 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:53:38.422+0000 1694c700 -1 osd.0 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.922827+0000 front 2019-11-29T20:52:28.921082+0000 (oldest deadline 2019-11-29T20:53:12.976992+0000) 2019-11-29T20:53:38.528 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:53:38.523+0000 1694c700 -1 osd.2 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:26.129626+0000 front 2019-11-29T20:52:26.319075+0000 (oldest deadline 2019-11-29T20:53:11.396081+0000) 2019-11-29T20:53:38.926 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:53:38.921+0000 1694c700 -1 osd.6 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:26.083170+0000 front 2019-11-29T20:52:27.816859+0000 (oldest deadline 2019-11-29T20:53:26.953949+0000) 2019-11-29T20:53:38.959 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:53:38.953+0000 1694c700 -1 osd.7 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:29.226228+0000 front 2019-11-29T20:52:29.205951+0000 (oldest deadline 2019-11-29T20:53:10.723109+0000) 2019-11-29T20:53:39.041 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:53:39.036+0000 1694c700 -1 osd.3 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:52:49.240380+0000 (oldest deadline 2019-11-29T20:53:29.240380+0000) 2019-11-29T20:53:39.042 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:53:39.037+0000 1694c700 -1 osd.3 213 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4325.0:119886 7.5 7.2bcddf15 (undecoded) ondisk+retry+read+known_if_redirected e211) 2019-11-29T20:53:39.079 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:53:39.072+0000 1694c700 -1 osd.4 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.047773+0000 front 2019-11-29T20:52:28.219811+0000 (oldest deadline 2019-11-29T20:53:12.734925+0000) 2019-11-29T20:53:39.249 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:53:39.244+0000 1694c700 -1 osd.1 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.077799+0000 front 2019-11-29T20:52:28.067090+0000 (oldest deadline 2019-11-29T20:53:12.140209+0000) 2019-11-29T20:53:39.432 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:53:39.427+0000 1694c700 -1 osd.0 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.922827+0000 front 2019-11-29T20:52:28.921082+0000 (oldest deadline 2019-11-29T20:53:12.976992+0000) 2019-11-29T20:53:39.533 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:53:39.525+0000 1694c700 -1 osd.2 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:26.129626+0000 front 2019-11-29T20:52:26.319075+0000 (oldest deadline 2019-11-29T20:53:11.396081+0000) 2019-11-29T20:53:39.900 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:53:39.894+0000 1694c700 -1 osd.6 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:26.083170+0000 front 2019-11-29T20:52:27.816859+0000 (oldest deadline 2019-11-29T20:53:26.953949+0000) 2019-11-29T20:53:40.003 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:53:39.996+0000 1694c700 -1 osd.7 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:29.226228+0000 front 2019-11-29T20:52:29.205951+0000 (oldest deadline 2019-11-29T20:53:10.723109+0000) 2019-11-29T20:53:40.048 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:53:40.042+0000 1694c700 -1 osd.3 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:52:49.240380+0000 (oldest deadline 2019-11-29T20:53:29.240380+0000) 2019-11-29T20:53:40.049 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:53:40.043+0000 1694c700 -1 osd.3 213 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4325.0:119886 7.5 7.2bcddf15 (undecoded) ondisk+retry+read+known_if_redirected e211) 2019-11-29T20:53:40.068 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:53:40.061+0000 1694c700 -1 osd.4 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.047773+0000 front 2019-11-29T20:52:28.219811+0000 (oldest deadline 2019-11-29T20:53:12.734925+0000) 2019-11-29T20:53:40.253 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:53:40.248+0000 1694c700 -1 osd.1 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.077799+0000 front 2019-11-29T20:52:28.067090+0000 (oldest deadline 2019-11-29T20:53:12.140209+0000) 2019-11-29T20:53:40.475 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:53:40.469+0000 1694c700 -1 osd.0 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.922827+0000 front 2019-11-29T20:52:28.921082+0000 (oldest deadline 2019-11-29T20:53:12.976992+0000) 2019-11-29T20:53:40.535 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:53:40.530+0000 1694c700 -1 osd.2 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:26.129626+0000 front 2019-11-29T20:52:26.319075+0000 (oldest deadline 2019-11-29T20:53:11.396081+0000) 2019-11-29T20:53:40.863 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:53:40.856+0000 1694c700 -1 osd.6 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:26.083170+0000 front 2019-11-29T20:52:27.816859+0000 (oldest deadline 2019-11-29T20:53:26.953949+0000) 2019-11-29T20:53:40.975 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:53:40.969+0000 1694c700 -1 osd.7 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:29.226228+0000 front 2019-11-29T20:52:29.205951+0000 (oldest deadline 2019-11-29T20:53:10.723109+0000) 2019-11-29T20:53:41.017 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:53:41.012+0000 1694c700 -1 osd.3 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:52:49.240380+0000 (oldest deadline 2019-11-29T20:53:29.240380+0000) 2019-11-29T20:53:41.018 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:53:41.013+0000 1694c700 -1 osd.3 213 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4325.0:119886 7.5 7.2bcddf15 (undecoded) ondisk+retry+read+known_if_redirected e211) 2019-11-29T20:53:41.055 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:53:41.048+0000 1694c700 -1 osd.4 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.047773+0000 front 2019-11-29T20:52:28.219811+0000 (oldest deadline 2019-11-29T20:53:12.734925+0000) 2019-11-29T20:53:41.289 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:53:41.283+0000 1694c700 -1 osd.1 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.077799+0000 front 2019-11-29T20:52:28.067090+0000 (oldest deadline 2019-11-29T20:53:12.140209+0000) 2019-11-29T20:53:41.467 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:53:41.461+0000 1694c700 -1 osd.0 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.922827+0000 front 2019-11-29T20:52:28.921082+0000 (oldest deadline 2019-11-29T20:53:12.976992+0000) 2019-11-29T20:53:41.536 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:53:41.530+0000 1694c700 -1 osd.2 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:26.129626+0000 front 2019-11-29T20:52:26.319075+0000 (oldest deadline 2019-11-29T20:53:11.396081+0000) 2019-11-29T20:53:41.894 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:53:41.887+0000 1694c700 -1 osd.6 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:26.083170+0000 front 2019-11-29T20:52:27.816859+0000 (oldest deadline 2019-11-29T20:53:26.953949+0000) 2019-11-29T20:53:42.019 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:53:42.014+0000 1694c700 -1 osd.7 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:29.226228+0000 front 2019-11-29T20:52:29.205951+0000 (oldest deadline 2019-11-29T20:53:10.723109+0000) 2019-11-29T20:53:42.022 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:53:42.016+0000 1694c700 -1 osd.4 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.047773+0000 front 2019-11-29T20:52:28.219811+0000 (oldest deadline 2019-11-29T20:53:12.734925+0000) 2019-11-29T20:53:42.052 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:53:42.046+0000 1694c700 -1 osd.3 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:52:49.240380+0000 (oldest deadline 2019-11-29T20:53:29.240380+0000) 2019-11-29T20:53:42.052 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:53:42.048+0000 1694c700 -1 osd.3 213 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4325.0:119886 7.5 7.2bcddf15 (undecoded) ondisk+retry+read+known_if_redirected e211) 2019-11-29T20:53:42.308 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:53:42.302+0000 1694c700 -1 osd.1 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.077799+0000 front 2019-11-29T20:52:28.067090+0000 (oldest deadline 2019-11-29T20:53:12.140209+0000) 2019-11-29T20:53:42.449 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:53:42.443+0000 1694c700 -1 osd.0 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.922827+0000 front 2019-11-29T20:52:28.921082+0000 (oldest deadline 2019-11-29T20:53:12.976992+0000) 2019-11-29T20:53:42.501 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:53:42.495+0000 1694c700 -1 osd.2 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:26.129626+0000 front 2019-11-29T20:52:26.319075+0000 (oldest deadline 2019-11-29T20:53:11.396081+0000) 2019-11-29T20:53:42.900 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:53:42.893+0000 1694c700 -1 osd.6 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:26.083170+0000 front 2019-11-29T20:52:27.816859+0000 (oldest deadline 2019-11-29T20:53:26.953949+0000) 2019-11-29T20:53:42.982 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:53:42.976+0000 1694c700 -1 osd.4 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.047773+0000 front 2019-11-29T20:52:28.219811+0000 (oldest deadline 2019-11-29T20:53:12.734925+0000) 2019-11-29T20:53:43.046 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:53:43.041+0000 1694c700 -1 osd.3 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:52:49.240380+0000 (oldest deadline 2019-11-29T20:53:29.240380+0000) 2019-11-29T20:53:43.047 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:53:43.042+0000 1694c700 -1 osd.3 213 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4325.0:119886 7.5 7.2bcddf15 (undecoded) ondisk+retry+read+known_if_redirected e211) 2019-11-29T20:53:43.065 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:53:43.060+0000 1694c700 -1 osd.7 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:29.226228+0000 front 2019-11-29T20:52:29.205951+0000 (oldest deadline 2019-11-29T20:53:10.723109+0000) 2019-11-29T20:53:43.290 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:53:43.284+0000 1694c700 -1 osd.1 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.077799+0000 front 2019-11-29T20:52:28.067090+0000 (oldest deadline 2019-11-29T20:53:12.140209+0000) 2019-11-29T20:53:43.413 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:53:43.406+0000 1694c700 -1 osd.0 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.922827+0000 front 2019-11-29T20:52:28.921082+0000 (oldest deadline 2019-11-29T20:53:12.976992+0000) 2019-11-29T20:53:43.454 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:53:43.450+0000 1694c700 -1 osd.2 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:26.129626+0000 front 2019-11-29T20:52:26.319075+0000 (oldest deadline 2019-11-29T20:53:11.396081+0000) 2019-11-29T20:53:43.485 INFO:tasks.ceph.mon.b.smithi022.stderr:2019-11-29T20:53:43.476+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.22:6818/9264,v1:172.21.15.22:6819/9264] for 44sec e213 v213) 2019-11-29T20:53:43.900 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:53:43.894+0000 1694c700 -1 osd.6 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:26.083170+0000 front 2019-11-29T20:52:27.816859+0000 (oldest deadline 2019-11-29T20:53:26.953949+0000) 2019-11-29T20:53:43.973 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:53:43.967+0000 1694c700 -1 osd.4 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.047773+0000 front 2019-11-29T20:52:28.219811+0000 (oldest deadline 2019-11-29T20:53:12.734925+0000) 2019-11-29T20:53:44.085 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:53:44.079+0000 1694c700 -1 osd.3 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:52:49.240380+0000 (oldest deadline 2019-11-29T20:53:29.240380+0000) 2019-11-29T20:53:44.087 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:53:44.080+0000 1694c700 -1 osd.3 213 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4325.0:119886 7.5 7.2bcddf15 (undecoded) ondisk+retry+read+known_if_redirected e211) 2019-11-29T20:53:44.091 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:53:44.086+0000 1694c700 -1 osd.7 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:29.226228+0000 front 2019-11-29T20:52:29.205951+0000 (oldest deadline 2019-11-29T20:53:10.723109+0000) 2019-11-29T20:53:44.249 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:53:44.244+0000 1694c700 -1 osd.1 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.077799+0000 front 2019-11-29T20:52:28.067090+0000 (oldest deadline 2019-11-29T20:53:12.140209+0000) 2019-11-29T20:53:44.414 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:53:44.409+0000 1694c700 -1 osd.2 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:26.129626+0000 front 2019-11-29T20:52:26.319075+0000 (oldest deadline 2019-11-29T20:53:11.396081+0000) 2019-11-29T20:53:44.416 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:53:44.411+0000 1694c700 -1 osd.0 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.922827+0000 front 2019-11-29T20:52:28.921082+0000 (oldest deadline 2019-11-29T20:53:12.976992+0000) 2019-11-29T20:53:44.854 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:53:44.848+0000 1694c700 -1 osd.6 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:26.083170+0000 front 2019-11-29T20:52:27.816859+0000 (oldest deadline 2019-11-29T20:53:26.953949+0000) 2019-11-29T20:53:44.941 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:53:44.934+0000 1694c700 -1 osd.4 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.047773+0000 front 2019-11-29T20:52:28.219811+0000 (oldest deadline 2019-11-29T20:53:12.734925+0000) 2019-11-29T20:53:45.089 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:53:45.085+0000 1694c700 -1 osd.3 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:52:49.240380+0000 (oldest deadline 2019-11-29T20:53:29.240380+0000) 2019-11-29T20:53:45.090 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:53:45.086+0000 1694c700 -1 osd.3 213 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4325.0:119886 7.5 7.2bcddf15 (undecoded) ondisk+retry+read+known_if_redirected e211) 2019-11-29T20:53:45.120 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:53:45.115+0000 1694c700 -1 osd.7 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:29.226228+0000 front 2019-11-29T20:52:29.205951+0000 (oldest deadline 2019-11-29T20:53:10.723109+0000) 2019-11-29T20:53:45.274 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:53:45.269+0000 1694c700 -1 osd.1 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.077799+0000 front 2019-11-29T20:52:28.067090+0000 (oldest deadline 2019-11-29T20:53:12.140209+0000) 2019-11-29T20:53:45.409 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:53:45.404+0000 1694c700 -1 osd.0 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.922827+0000 front 2019-11-29T20:52:28.921082+0000 (oldest deadline 2019-11-29T20:53:12.976992+0000) 2019-11-29T20:53:45.459 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:53:45.453+0000 1694c700 -1 osd.2 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:26.129626+0000 front 2019-11-29T20:52:26.319075+0000 (oldest deadline 2019-11-29T20:53:11.396081+0000) 2019-11-29T20:53:45.815 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:53:45.809+0000 1694c700 -1 osd.6 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:26.083170+0000 front 2019-11-29T20:52:27.816859+0000 (oldest deadline 2019-11-29T20:53:26.953949+0000) 2019-11-29T20:53:45.988 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:53:45.982+0000 1694c700 -1 osd.4 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.047773+0000 front 2019-11-29T20:52:28.219811+0000 (oldest deadline 2019-11-29T20:53:12.734925+0000) 2019-11-29T20:53:46.085 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:53:46.079+0000 1694c700 -1 osd.7 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:29.226228+0000 front 2019-11-29T20:52:29.205951+0000 (oldest deadline 2019-11-29T20:53:10.723109+0000) 2019-11-29T20:53:46.130 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:53:46.124+0000 1694c700 -1 osd.3 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:52:49.240380+0000 (oldest deadline 2019-11-29T20:53:29.240380+0000) 2019-11-29T20:53:46.133 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:53:46.128+0000 1694c700 -1 osd.3 213 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4325.0:119886 7.5 7.2bcddf15 (undecoded) ondisk+retry+read+known_if_redirected e211) 2019-11-29T20:53:46.233 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:53:46.227+0000 1694c700 -1 osd.1 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.077799+0000 front 2019-11-29T20:52:28.067090+0000 (oldest deadline 2019-11-29T20:53:12.140209+0000) 2019-11-29T20:53:46.421 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:53:46.415+0000 1694c700 -1 osd.0 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.922827+0000 front 2019-11-29T20:52:28.921082+0000 (oldest deadline 2019-11-29T20:53:12.976992+0000) 2019-11-29T20:53:46.489 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:53:46.484+0000 1694c700 -1 osd.2 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:26.129626+0000 front 2019-11-29T20:52:26.319075+0000 (oldest deadline 2019-11-29T20:53:11.396081+0000) 2019-11-29T20:53:46.825 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:53:46.819+0000 1694c700 -1 osd.6 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:26.083170+0000 front 2019-11-29T20:52:27.816859+0000 (oldest deadline 2019-11-29T20:53:26.953949+0000) 2019-11-29T20:53:46.991 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:53:46.984+0000 1694c700 -1 osd.4 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.047773+0000 front 2019-11-29T20:52:28.219811+0000 (oldest deadline 2019-11-29T20:53:12.734925+0000) 2019-11-29T20:53:47.099 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:53:47.094+0000 1694c700 -1 osd.7 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:29.226228+0000 front 2019-11-29T20:52:29.205951+0000 (oldest deadline 2019-11-29T20:53:10.723109+0000) 2019-11-29T20:53:47.153 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:53:47.148+0000 1694c700 -1 osd.3 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:52:49.240380+0000 (oldest deadline 2019-11-29T20:53:29.240380+0000) 2019-11-29T20:53:47.161 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:53:47.152+0000 1694c700 -1 osd.3 213 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4325.0:119886 7.5 7.2bcddf15 (undecoded) ondisk+retry+read+known_if_redirected e211) 2019-11-29T20:53:47.209 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:53:47.203+0000 1694c700 -1 osd.1 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.077799+0000 front 2019-11-29T20:52:28.067090+0000 (oldest deadline 2019-11-29T20:53:12.140209+0000) 2019-11-29T20:53:47.430 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:53:47.424+0000 1694c700 -1 osd.0 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.922827+0000 front 2019-11-29T20:52:28.921082+0000 (oldest deadline 2019-11-29T20:53:12.976992+0000) 2019-11-29T20:53:47.543 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:53:47.537+0000 1694c700 -1 osd.2 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:26.129626+0000 front 2019-11-29T20:52:26.319075+0000 (oldest deadline 2019-11-29T20:53:11.396081+0000) 2019-11-29T20:53:47.816 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:53:47.811+0000 1694c700 -1 osd.6 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:26.083170+0000 front 2019-11-29T20:52:27.816859+0000 (oldest deadline 2019-11-29T20:53:26.953949+0000) 2019-11-29T20:53:47.948 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:53:47.941+0000 1694c700 -1 osd.4 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.047773+0000 front 2019-11-29T20:52:28.219811+0000 (oldest deadline 2019-11-29T20:53:12.734925+0000) 2019-11-29T20:53:48.153 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:53:48.146+0000 1694c700 -1 osd.7 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:29.226228+0000 front 2019-11-29T20:52:29.205951+0000 (oldest deadline 2019-11-29T20:53:10.723109+0000) 2019-11-29T20:53:48.197 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:53:48.190+0000 1694c700 -1 osd.3 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:52:49.240380+0000 (oldest deadline 2019-11-29T20:53:29.240380+0000) 2019-11-29T20:53:48.197 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:53:48.192+0000 1694c700 -1 osd.3 213 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4325.0:119886 7.5 7.2bcddf15 (undecoded) ondisk+retry+read+known_if_redirected e211) 2019-11-29T20:53:48.254 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:53:48.248+0000 1694c700 -1 osd.1 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.077799+0000 front 2019-11-29T20:52:28.067090+0000 (oldest deadline 2019-11-29T20:53:12.140209+0000) 2019-11-29T20:53:48.462 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:53:48.455+0000 1694c700 -1 osd.0 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.922827+0000 front 2019-11-29T20:52:28.921082+0000 (oldest deadline 2019-11-29T20:53:12.976992+0000) 2019-11-29T20:53:48.497 INFO:tasks.ceph.mon.b.smithi022.stderr:2019-11-29T20:53:48.490+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.22:6818/9264,v1:172.21.15.22:6819/9264] for 44sec e213 v213) 2019-11-29T20:53:48.571 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:53:48.565+0000 1694c700 -1 osd.2 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:26.129626+0000 front 2019-11-29T20:52:26.319075+0000 (oldest deadline 2019-11-29T20:53:11.396081+0000) 2019-11-29T20:53:48.849 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:53:48.843+0000 1694c700 -1 osd.6 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:26.083170+0000 front 2019-11-29T20:52:27.816859+0000 (oldest deadline 2019-11-29T20:53:26.953949+0000) 2019-11-29T20:53:48.957 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:53:48.951+0000 1694c700 -1 osd.4 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.047773+0000 front 2019-11-29T20:52:28.219811+0000 (oldest deadline 2019-11-29T20:53:12.734925+0000) 2019-11-29T20:53:49.176 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:53:49.170+0000 1694c700 -1 osd.7 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:29.226228+0000 front 2019-11-29T20:52:29.205951+0000 (oldest deadline 2019-11-29T20:53:10.723109+0000) 2019-11-29T20:53:49.186 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:53:49.181+0000 1694c700 -1 osd.3 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:52:49.240380+0000 (oldest deadline 2019-11-29T20:53:29.240380+0000) 2019-11-29T20:53:49.189 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:53:49.184+0000 1694c700 -1 osd.3 213 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4325.0:119886 7.5 7.2bcddf15 (undecoded) ondisk+retry+read+known_if_redirected e211) 2019-11-29T20:53:49.290 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:53:49.284+0000 1694c700 -1 osd.1 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.077799+0000 front 2019-11-29T20:52:28.067090+0000 (oldest deadline 2019-11-29T20:53:12.140209+0000) 2019-11-29T20:53:49.480 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:53:49.475+0000 1694c700 -1 osd.0 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.922827+0000 front 2019-11-29T20:52:28.921082+0000 (oldest deadline 2019-11-29T20:53:12.976992+0000) 2019-11-29T20:53:49.608 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:53:49.602+0000 1694c700 -1 osd.2 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:26.129626+0000 front 2019-11-29T20:52:26.319075+0000 (oldest deadline 2019-11-29T20:53:11.396081+0000) 2019-11-29T20:53:49.834 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:53:49.829+0000 1694c700 -1 osd.6 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:26.083170+0000 front 2019-11-29T20:52:27.816859+0000 (oldest deadline 2019-11-29T20:53:26.953949+0000) 2019-11-29T20:53:49.975 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:53:49.969+0000 1694c700 -1 osd.4 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.047773+0000 front 2019-11-29T20:52:28.219811+0000 (oldest deadline 2019-11-29T20:53:12.734925+0000) 2019-11-29T20:53:50.215 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:53:50.209+0000 1694c700 -1 osd.7 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:29.226228+0000 front 2019-11-29T20:52:29.205951+0000 (oldest deadline 2019-11-29T20:53:10.723109+0000) 2019-11-29T20:53:50.215 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:53:50.208+0000 1694c700 -1 osd.3 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:52:49.240380+0000 (oldest deadline 2019-11-29T20:53:29.240380+0000) 2019-11-29T20:53:50.216 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:53:50.211+0000 1694c700 -1 osd.3 213 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4325.0:119886 7.5 7.2bcddf15 (undecoded) ondisk+retry+read+known_if_redirected e211) 2019-11-29T20:53:50.322 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:53:50.317+0000 1694c700 -1 osd.1 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.077799+0000 front 2019-11-29T20:52:28.067090+0000 (oldest deadline 2019-11-29T20:53:12.140209+0000) 2019-11-29T20:53:50.491 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:53:50.485+0000 1694c700 -1 osd.0 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.922827+0000 front 2019-11-29T20:52:28.921082+0000 (oldest deadline 2019-11-29T20:53:12.976992+0000) 2019-11-29T20:53:50.626 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:53:50.620+0000 1694c700 -1 osd.2 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:26.129626+0000 front 2019-11-29T20:52:26.319075+0000 (oldest deadline 2019-11-29T20:53:11.396081+0000) 2019-11-29T20:53:50.803 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:53:50.796+0000 1694c700 -1 osd.6 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:26.083170+0000 front 2019-11-29T20:52:27.816859+0000 (oldest deadline 2019-11-29T20:53:26.953949+0000) 2019-11-29T20:53:50.983 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:53:50.978+0000 1694c700 -1 osd.4 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.047773+0000 front 2019-11-29T20:52:28.219811+0000 (oldest deadline 2019-11-29T20:53:12.734925+0000) 2019-11-29T20:53:51.183 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:53:51.177+0000 1694c700 -1 osd.7 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:29.226228+0000 front 2019-11-29T20:52:29.205951+0000 (oldest deadline 2019-11-29T20:53:10.723109+0000) 2019-11-29T20:53:51.247 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:53:51.241+0000 1694c700 -1 osd.3 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:52:49.240380+0000 (oldest deadline 2019-11-29T20:53:29.240380+0000) 2019-11-29T20:53:51.251 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:53:51.246+0000 1694c700 -1 osd.3 213 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4325.0:119886 7.5 7.2bcddf15 (undecoded) ondisk+retry+read+known_if_redirected e211) 2019-11-29T20:53:51.365 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:53:51.357+0000 1694c700 -1 osd.1 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.077799+0000 front 2019-11-29T20:52:28.067090+0000 (oldest deadline 2019-11-29T20:53:12.140209+0000) 2019-11-29T20:53:51.531 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:53:51.525+0000 1694c700 -1 osd.0 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.922827+0000 front 2019-11-29T20:52:28.921082+0000 (oldest deadline 2019-11-29T20:53:12.976992+0000) 2019-11-29T20:53:51.586 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:53:51.581+0000 1694c700 -1 osd.2 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:26.129626+0000 front 2019-11-29T20:52:26.319075+0000 (oldest deadline 2019-11-29T20:53:11.396081+0000) 2019-11-29T20:53:51.760 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:53:51.753+0000 1694c700 -1 osd.6 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:26.083170+0000 front 2019-11-29T20:52:27.816859+0000 (oldest deadline 2019-11-29T20:53:26.953949+0000) 2019-11-29T20:53:51.988 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:53:51.981+0000 1694c700 -1 osd.4 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.047773+0000 front 2019-11-29T20:52:28.219811+0000 (oldest deadline 2019-11-29T20:53:12.734925+0000) 2019-11-29T20:53:52.166 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:53:52.160+0000 1694c700 -1 osd.7 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:29.226228+0000 front 2019-11-29T20:52:29.205951+0000 (oldest deadline 2019-11-29T20:53:10.723109+0000) 2019-11-29T20:53:52.277 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:53:52.271+0000 1694c700 -1 osd.3 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:52:49.240380+0000 (oldest deadline 2019-11-29T20:53:29.240380+0000) 2019-11-29T20:53:52.277 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:53:52.273+0000 1694c700 -1 osd.3 213 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4325.0:119886 7.5 7.2bcddf15 (undecoded) ondisk+retry+read+known_if_redirected e211) 2019-11-29T20:53:52.355 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:53:52.349+0000 1694c700 -1 osd.1 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.077799+0000 front 2019-11-29T20:52:28.067090+0000 (oldest deadline 2019-11-29T20:53:12.140209+0000) 2019-11-29T20:53:52.514 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:53:52.507+0000 1694c700 -1 osd.0 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.922827+0000 front 2019-11-29T20:52:28.921082+0000 (oldest deadline 2019-11-29T20:53:12.976992+0000) 2019-11-29T20:53:52.592 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:53:52.586+0000 1694c700 -1 osd.2 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:26.129626+0000 front 2019-11-29T20:52:26.319075+0000 (oldest deadline 2019-11-29T20:53:11.396081+0000) 2019-11-29T20:53:52.756 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:53:52.750+0000 1694c700 -1 osd.6 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:26.083170+0000 front 2019-11-29T20:52:27.816859+0000 (oldest deadline 2019-11-29T20:53:26.953949+0000) 2019-11-29T20:53:53.041 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:53:53.035+0000 1694c700 -1 osd.4 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.047773+0000 front 2019-11-29T20:52:28.219811+0000 (oldest deadline 2019-11-29T20:53:12.734925+0000) 2019-11-29T20:53:53.187 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:53:53.181+0000 1694c700 -1 osd.7 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:29.226228+0000 front 2019-11-29T20:52:29.205951+0000 (oldest deadline 2019-11-29T20:53:10.723109+0000) 2019-11-29T20:53:53.318 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:53:53.311+0000 1694c700 -1 osd.3 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:52:49.240380+0000 (oldest deadline 2019-11-29T20:53:29.240380+0000) 2019-11-29T20:53:53.319 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:53:53.314+0000 1694c700 -1 osd.3 213 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4325.0:119886 7.5 7.2bcddf15 (undecoded) ondisk+retry+read+known_if_redirected e211) 2019-11-29T20:53:53.374 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:53:53.369+0000 1694c700 -1 osd.1 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.077799+0000 front 2019-11-29T20:52:28.067090+0000 (oldest deadline 2019-11-29T20:53:12.140209+0000) 2019-11-29T20:53:53.479 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:53:53.473+0000 1694c700 -1 osd.0 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.922827+0000 front 2019-11-29T20:52:28.921082+0000 (oldest deadline 2019-11-29T20:53:12.976992+0000) 2019-11-29T20:53:53.518 INFO:tasks.ceph.mon.b.smithi022.stderr:2019-11-29T20:53:53.510+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.22:6818/9264,v1:172.21.15.22:6819/9264] for 44sec e213 v213) 2019-11-29T20:53:53.601 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:53:53.596+0000 1694c700 -1 osd.2 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:26.129626+0000 front 2019-11-29T20:52:26.319075+0000 (oldest deadline 2019-11-29T20:53:11.396081+0000) 2019-11-29T20:53:53.796 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:53:53.790+0000 1694c700 -1 osd.6 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:26.083170+0000 front 2019-11-29T20:52:27.816859+0000 (oldest deadline 2019-11-29T20:53:26.953949+0000) 2019-11-29T20:53:54.004 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:53:53.999+0000 1694c700 -1 osd.4 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.047773+0000 front 2019-11-29T20:52:28.219811+0000 (oldest deadline 2019-11-29T20:53:12.734925+0000) 2019-11-29T20:53:54.237 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:53:54.231+0000 1694c700 -1 osd.7 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:29.226228+0000 front 2019-11-29T20:52:29.205951+0000 (oldest deadline 2019-11-29T20:53:10.723109+0000) 2019-11-29T20:53:54.296 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:53:54.291+0000 1694c700 -1 osd.3 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:52:49.240380+0000 (oldest deadline 2019-11-29T20:53:29.240380+0000) 2019-11-29T20:53:54.298 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:53:54.294+0000 1694c700 -1 osd.3 213 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4325.0:119886 7.5 7.2bcddf15 (undecoded) ondisk+retry+read+known_if_redirected e211) 2019-11-29T20:53:54.376 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:53:54.370+0000 1694c700 -1 osd.1 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.077799+0000 front 2019-11-29T20:52:28.067090+0000 (oldest deadline 2019-11-29T20:53:12.140209+0000) 2019-11-29T20:53:54.465 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:53:54.459+0000 1694c700 -1 osd.0 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.922827+0000 front 2019-11-29T20:52:28.921082+0000 (oldest deadline 2019-11-29T20:53:12.976992+0000) 2019-11-29T20:53:54.616 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:53:54.610+0000 1694c700 -1 osd.2 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:26.129626+0000 front 2019-11-29T20:52:26.319075+0000 (oldest deadline 2019-11-29T20:53:11.396081+0000) 2019-11-29T20:53:54.841 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:53:54.834+0000 1694c700 -1 osd.6 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:26.083170+0000 front 2019-11-29T20:52:27.816859+0000 (oldest deadline 2019-11-29T20:53:26.953949+0000) 2019-11-29T20:53:55.055 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:53:55.050+0000 1694c700 -1 osd.4 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.047773+0000 front 2019-11-29T20:52:28.219811+0000 (oldest deadline 2019-11-29T20:53:12.734925+0000) 2019-11-29T20:53:55.226 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:53:55.220+0000 1694c700 -1 osd.7 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:29.226228+0000 front 2019-11-29T20:52:29.205951+0000 (oldest deadline 2019-11-29T20:53:10.723109+0000) 2019-11-29T20:53:55.294 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:53:55.281+0000 1694c700 -1 osd.3 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:52:49.240380+0000 (oldest deadline 2019-11-29T20:53:29.240380+0000) 2019-11-29T20:53:55.294 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:53:55.285+0000 1694c700 -1 osd.3 213 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4325.0:119886 7.5 7.2bcddf15 (undecoded) ondisk+retry+read+known_if_redirected e211) 2019-11-29T20:53:55.413 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:53:55.407+0000 1694c700 -1 osd.1 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.077799+0000 front 2019-11-29T20:52:28.067090+0000 (oldest deadline 2019-11-29T20:53:12.140209+0000) 2019-11-29T20:53:55.433 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:53:55.427+0000 1694c700 -1 osd.0 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.922827+0000 front 2019-11-29T20:52:28.921082+0000 (oldest deadline 2019-11-29T20:53:12.976992+0000) 2019-11-29T20:53:55.628 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:53:55.623+0000 1694c700 -1 osd.2 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:26.129626+0000 front 2019-11-29T20:52:26.319075+0000 (oldest deadline 2019-11-29T20:53:11.396081+0000) 2019-11-29T20:53:55.831 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:53:55.825+0000 1694c700 -1 osd.6 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:26.083170+0000 front 2019-11-29T20:52:27.816859+0000 (oldest deadline 2019-11-29T20:53:26.953949+0000) 2019-11-29T20:53:56.021 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:53:56.015+0000 1694c700 -1 osd.4 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.047773+0000 front 2019-11-29T20:52:28.219811+0000 (oldest deadline 2019-11-29T20:53:12.734925+0000) 2019-11-29T20:53:56.250 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:53:56.242+0000 1694c700 -1 osd.7 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:29.226228+0000 front 2019-11-29T20:52:29.205951+0000 (oldest deadline 2019-11-29T20:53:10.723109+0000) 2019-11-29T20:53:56.322 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:53:56.317+0000 1694c700 -1 osd.3 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:52:49.240380+0000 (oldest deadline 2019-11-29T20:53:29.240380+0000) 2019-11-29T20:53:56.325 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:53:56.321+0000 1694c700 -1 osd.3 213 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4325.0:119886 7.5 7.2bcddf15 (undecoded) ondisk+retry+read+known_if_redirected e211) 2019-11-29T20:53:56.448 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:53:56.443+0000 1694c700 -1 osd.1 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.077799+0000 front 2019-11-29T20:52:28.067090+0000 (oldest deadline 2019-11-29T20:53:12.140209+0000) 2019-11-29T20:53:56.479 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:53:56.472+0000 1694c700 -1 osd.0 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.922827+0000 front 2019-11-29T20:52:28.921082+0000 (oldest deadline 2019-11-29T20:53:12.976992+0000) 2019-11-29T20:53:56.622 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:53:56.617+0000 1694c700 -1 osd.2 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:26.129626+0000 front 2019-11-29T20:52:26.319075+0000 (oldest deadline 2019-11-29T20:53:11.396081+0000) 2019-11-29T20:53:56.856 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:53:56.850+0000 1694c700 -1 osd.6 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:26.083170+0000 front 2019-11-29T20:52:27.816859+0000 (oldest deadline 2019-11-29T20:53:26.953949+0000) 2019-11-29T20:53:57.061 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:53:57.054+0000 1694c700 -1 osd.4 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.047773+0000 front 2019-11-29T20:52:28.219811+0000 (oldest deadline 2019-11-29T20:53:12.734925+0000) 2019-11-29T20:53:57.224 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:53:57.218+0000 1694c700 -1 osd.7 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:29.226228+0000 front 2019-11-29T20:52:29.205951+0000 (oldest deadline 2019-11-29T20:53:10.723109+0000) 2019-11-29T20:53:57.364 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:53:57.360+0000 1694c700 -1 osd.3 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:52:49.240380+0000 (oldest deadline 2019-11-29T20:53:29.240380+0000) 2019-11-29T20:53:57.366 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:53:57.362+0000 1694c700 -1 osd.3 213 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4325.0:119886 7.5 7.2bcddf15 (undecoded) ondisk+retry+read+known_if_redirected e211) 2019-11-29T20:53:57.436 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:53:57.431+0000 1694c700 -1 osd.1 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.077799+0000 front 2019-11-29T20:52:28.067090+0000 (oldest deadline 2019-11-29T20:53:12.140209+0000) 2019-11-29T20:53:57.473 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:53:57.467+0000 1694c700 -1 osd.0 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.922827+0000 front 2019-11-29T20:52:28.921082+0000 (oldest deadline 2019-11-29T20:53:12.976992+0000) 2019-11-29T20:53:57.670 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:53:57.665+0000 1694c700 -1 osd.2 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:26.129626+0000 front 2019-11-29T20:52:26.319075+0000 (oldest deadline 2019-11-29T20:53:11.396081+0000) 2019-11-29T20:53:57.826 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:53:57.816+0000 1694c700 -1 osd.6 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:26.083170+0000 front 2019-11-29T20:52:27.816859+0000 (oldest deadline 2019-11-29T20:53:26.953949+0000) 2019-11-29T20:53:58.035 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:53:58.029+0000 1694c700 -1 osd.4 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.047773+0000 front 2019-11-29T20:52:28.219811+0000 (oldest deadline 2019-11-29T20:53:12.734925+0000) 2019-11-29T20:53:58.219 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:53:58.210+0000 1694c700 -1 osd.7 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:29.226228+0000 front 2019-11-29T20:52:29.205951+0000 (oldest deadline 2019-11-29T20:53:10.723109+0000) 2019-11-29T20:53:58.394 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:53:58.388+0000 1694c700 -1 osd.3 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:52:49.240380+0000 (oldest deadline 2019-11-29T20:53:29.240380+0000) 2019-11-29T20:53:58.396 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:53:58.390+0000 1694c700 -1 osd.3 213 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4325.0:119886 7.5 7.2bcddf15 (undecoded) ondisk+retry+read+known_if_redirected e211) 2019-11-29T20:53:58.466 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:53:58.460+0000 1694c700 -1 osd.1 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.077799+0000 front 2019-11-29T20:52:28.067090+0000 (oldest deadline 2019-11-29T20:53:12.140209+0000) 2019-11-29T20:53:58.526 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:53:58.521+0000 1694c700 -1 osd.0 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.922827+0000 front 2019-11-29T20:52:28.921082+0000 (oldest deadline 2019-11-29T20:53:12.976992+0000) 2019-11-29T20:53:58.536 INFO:tasks.ceph.mon.b.smithi022.stderr:2019-11-29T20:53:58.526+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.22:6818/9264,v1:172.21.15.22:6819/9264] for 44sec e213 v213) 2019-11-29T20:53:58.643 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:53:58.637+0000 1694c700 -1 osd.2 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:26.129626+0000 front 2019-11-29T20:52:26.319075+0000 (oldest deadline 2019-11-29T20:53:11.396081+0000) 2019-11-29T20:53:58.813 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:53:58.806+0000 1694c700 -1 osd.6 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:26.083170+0000 front 2019-11-29T20:52:27.816859+0000 (oldest deadline 2019-11-29T20:53:26.953949+0000) 2019-11-29T20:53:59.011 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:53:59.005+0000 1694c700 -1 osd.4 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.047773+0000 front 2019-11-29T20:52:28.219811+0000 (oldest deadline 2019-11-29T20:53:12.734925+0000) 2019-11-29T20:53:59.190 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:53:59.184+0000 1694c700 -1 osd.7 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:29.226228+0000 front 2019-11-29T20:52:29.205951+0000 (oldest deadline 2019-11-29T20:53:10.723109+0000) 2019-11-29T20:53:59.430 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:53:59.424+0000 1694c700 -1 osd.3 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:52:49.240380+0000 (oldest deadline 2019-11-29T20:53:29.240380+0000) 2019-11-29T20:53:59.430 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:53:59.426+0000 1694c700 -1 osd.3 213 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4325.0:119886 7.5 7.2bcddf15 (undecoded) ondisk+retry+read+known_if_redirected e211) 2019-11-29T20:53:59.495 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:53:59.489+0000 1694c700 -1 osd.1 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.077799+0000 front 2019-11-29T20:52:28.067090+0000 (oldest deadline 2019-11-29T20:53:12.140209+0000) 2019-11-29T20:53:59.525 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:53:59.519+0000 1694c700 -1 osd.0 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.922827+0000 front 2019-11-29T20:52:28.921082+0000 (oldest deadline 2019-11-29T20:53:12.976992+0000) 2019-11-29T20:53:59.678 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:53:59.674+0000 1694c700 -1 osd.2 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:26.129626+0000 front 2019-11-29T20:52:26.319075+0000 (oldest deadline 2019-11-29T20:53:11.396081+0000) 2019-11-29T20:53:59.842 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:53:59.836+0000 1694c700 -1 osd.6 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:26.083170+0000 front 2019-11-29T20:52:27.816859+0000 (oldest deadline 2019-11-29T20:53:26.953949+0000) 2019-11-29T20:53:59.968 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:53:59.960+0000 1694c700 -1 osd.4 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.047773+0000 front 2019-11-29T20:52:28.219811+0000 (oldest deadline 2019-11-29T20:53:12.734925+0000) 2019-11-29T20:54:00.157 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:54:00.151+0000 1694c700 -1 osd.7 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:29.226228+0000 front 2019-11-29T20:52:29.205951+0000 (oldest deadline 2019-11-29T20:53:10.723109+0000) 2019-11-29T20:54:00.417 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:54:00.411+0000 1694c700 -1 osd.3 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:52:49.240380+0000 (oldest deadline 2019-11-29T20:53:29.240380+0000) 2019-11-29T20:54:00.418 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:54:00.413+0000 1694c700 -1 osd.3 213 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4325.0:119886 7.5 7.2bcddf15 (undecoded) ondisk+retry+read+known_if_redirected e211) 2019-11-29T20:54:00.478 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:54:00.473+0000 1694c700 -1 osd.1 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.077799+0000 front 2019-11-29T20:52:28.067090+0000 (oldest deadline 2019-11-29T20:53:12.140209+0000) 2019-11-29T20:54:00.519 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:54:00.513+0000 1694c700 -1 osd.0 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.922827+0000 front 2019-11-29T20:52:28.921082+0000 (oldest deadline 2019-11-29T20:53:12.976992+0000) 2019-11-29T20:54:00.727 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:54:00.721+0000 1694c700 -1 osd.2 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:26.129626+0000 front 2019-11-29T20:52:26.319075+0000 (oldest deadline 2019-11-29T20:53:11.396081+0000) 2019-11-29T20:54:00.880 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:54:00.874+0000 1694c700 -1 osd.6 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:26.083170+0000 front 2019-11-29T20:52:27.816859+0000 (oldest deadline 2019-11-29T20:53:26.953949+0000) 2019-11-29T20:54:00.962 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:54:00.956+0000 1694c700 -1 osd.4 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.047773+0000 front 2019-11-29T20:52:28.219811+0000 (oldest deadline 2019-11-29T20:53:12.734925+0000) 2019-11-29T20:54:01.156 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:54:01.150+0000 1694c700 -1 osd.7 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:29.226228+0000 front 2019-11-29T20:52:29.205951+0000 (oldest deadline 2019-11-29T20:53:10.723109+0000) 2019-11-29T20:54:01.451 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:54:01.445+0000 1694c700 -1 osd.3 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:52:49.240380+0000 (oldest deadline 2019-11-29T20:53:29.240380+0000) 2019-11-29T20:54:01.452 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:54:01.447+0000 1694c700 -1 osd.3 213 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4325.0:119886 7.5 7.2bcddf15 (undecoded) ondisk+retry+read+known_if_redirected e211) 2019-11-29T20:54:01.508 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:54:01.502+0000 1694c700 -1 osd.1 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.077799+0000 front 2019-11-29T20:52:28.067090+0000 (oldest deadline 2019-11-29T20:53:12.140209+0000) 2019-11-29T20:54:01.516 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:54:01.510+0000 1694c700 -1 osd.0 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.922827+0000 front 2019-11-29T20:52:28.921082+0000 (oldest deadline 2019-11-29T20:53:12.976992+0000) 2019-11-29T20:54:01.688 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:54:01.683+0000 1694c700 -1 osd.2 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:26.129626+0000 front 2019-11-29T20:52:26.319075+0000 (oldest deadline 2019-11-29T20:53:11.396081+0000) 2019-11-29T20:54:01.897 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:54:01.890+0000 1694c700 -1 osd.6 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:26.083170+0000 front 2019-11-29T20:52:27.816859+0000 (oldest deadline 2019-11-29T20:53:26.953949+0000) 2019-11-29T20:54:01.953 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:54:01.946+0000 1694c700 -1 osd.4 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.047773+0000 front 2019-11-29T20:52:28.219811+0000 (oldest deadline 2019-11-29T20:53:12.734925+0000) 2019-11-29T20:54:02.173 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:54:02.166+0000 1694c700 -1 osd.7 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:29.226228+0000 front 2019-11-29T20:52:29.205951+0000 (oldest deadline 2019-11-29T20:53:10.723109+0000) 2019-11-29T20:54:02.489 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:54:02.483+0000 1694c700 -1 osd.3 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:52:49.240380+0000 (oldest deadline 2019-11-29T20:53:29.240380+0000) 2019-11-29T20:54:02.490 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:54:02.485+0000 1694c700 -1 osd.3 213 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4325.0:119886 7.5 7.2bcddf15 (undecoded) ondisk+retry+read+known_if_redirected e211) 2019-11-29T20:54:02.506 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:54:02.501+0000 1694c700 -1 osd.0 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.922827+0000 front 2019-11-29T20:52:28.921082+0000 (oldest deadline 2019-11-29T20:53:12.976992+0000) 2019-11-29T20:54:02.525 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:54:02.520+0000 1694c700 -1 osd.1 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.077799+0000 front 2019-11-29T20:52:28.067090+0000 (oldest deadline 2019-11-29T20:53:12.140209+0000) 2019-11-29T20:54:02.644 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:54:02.637+0000 1694c700 -1 osd.2 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:26.129626+0000 front 2019-11-29T20:52:26.319075+0000 (oldest deadline 2019-11-29T20:53:11.396081+0000) 2019-11-29T20:54:02.870 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:54:02.864+0000 1694c700 -1 osd.6 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:26.083170+0000 front 2019-11-29T20:52:27.816859+0000 (oldest deadline 2019-11-29T20:53:26.953949+0000) 2019-11-29T20:54:02.981 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:54:02.973+0000 1694c700 -1 osd.4 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.047773+0000 front 2019-11-29T20:52:28.219811+0000 (oldest deadline 2019-11-29T20:53:12.734925+0000) 2019-11-29T20:54:03.161 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:54:03.154+0000 1694c700 -1 osd.7 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:29.226228+0000 front 2019-11-29T20:52:29.205951+0000 (oldest deadline 2019-11-29T20:53:10.723109+0000) 2019-11-29T20:54:03.490 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:54:03.484+0000 1694c700 -1 osd.3 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:52:49.240380+0000 (oldest deadline 2019-11-29T20:53:29.240380+0000) 2019-11-29T20:54:03.490 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:54:03.485+0000 1694c700 -1 osd.3 213 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4325.0:119886 7.5 7.2bcddf15 (undecoded) ondisk+retry+read+known_if_redirected e211) 2019-11-29T20:54:03.498 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:54:03.493+0000 1694c700 -1 osd.1 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.077799+0000 front 2019-11-29T20:52:28.067090+0000 (oldest deadline 2019-11-29T20:53:12.140209+0000) 2019-11-29T20:54:03.546 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:54:03.540+0000 1694c700 -1 osd.0 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:28.922827+0000 front 2019-11-29T20:52:28.921082+0000 (oldest deadline 2019-11-29T20:53:12.976992+0000) 2019-11-29T20:54:03.591 INFO:tasks.ceph.mon.b.smithi022.stderr:2019-11-29T20:54:03.582+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.22:6818/9264,v1:172.21.15.22:6819/9264] for 44sec e213 v213) 2019-11-29T20:54:03.698 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:54:03.693+0000 1694c700 -1 osd.2 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:26.129626+0000 front 2019-11-29T20:52:26.319075+0000 (oldest deadline 2019-11-29T20:53:11.396081+0000) 2019-11-29T20:54:04.113 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:54:04.108+0000 1694c700 -1 osd.7 213 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:52:29.226228+0000 front 2019-11-29T20:52:29.205951+0000 (oldest deadline 2019-11-29T20:53:10.723109+0000) 2019-11-29T20:54:04.639 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:54:04.504+0000 1694c700 -1 osd.3 214 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4325.0:119886 7.5 7.2bcddf15 (undecoded) ondisk+retry+read+known_if_redirected e211) 2019-11-29T20:54:04.735 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:54:04.595+0000 33f88700 -1 osd.3 214 build_incremental_map_msg missing incremental map 213 2019-11-29T20:54:28.571 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:54:28.565+0000 37f90700 -1 osd.5 213 build_incremental_map_msg missing incremental map 213 2019-11-29T20:54:34.205 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:54:34.119+0000 31783700 -1 osd.5 218 build_incremental_map_msg missing incremental map 218 2019-11-29T20:54:34.286 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:54:34.157+0000 31783700 -1 osd.5 218 build_incremental_map_msg missing incremental map 218 2019-11-29T20:54:34.346 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:54:34.231+0000 31783700 -1 osd.5 218 build_incremental_map_msg missing incremental map 218 2019-11-29T20:54:34.402 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:54:34.300+0000 31f84700 -1 osd.5 218 build_incremental_map_msg missing incremental map 218 2019-11-29T20:54:34.753 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:54:34.725+0000 33787700 -1 osd.5 218 build_incremental_map_msg missing incremental map 218 2019-11-29T20:55:34.695 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:55:34.689+0000 1694c700 -1 osd.7 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:53.842806+0000 front 2019-11-29T20:54:53.334172+0000 (oldest deadline 2019-11-29T20:55:33.764802+0000) 2019-11-29T20:55:35.655 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:55:35.648+0000 1694c700 -1 osd.7 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:53.842806+0000 front 2019-11-29T20:54:53.334172+0000 (oldest deadline 2019-11-29T20:55:33.764802+0000) 2019-11-29T20:55:35.674 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:55:35.668+0000 1694c700 -1 osd.5 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:54.035872+0000 front 2019-11-29T20:54:53.546829+0000 (oldest deadline 2019-11-29T20:55:35.191256+0000) 2019-11-29T20:55:35.998 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:55:35.991+0000 1694c700 -1 osd.4 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:50.992444+0000 front 2019-11-29T20:54:51.048024+0000 (oldest deadline 2019-11-29T20:55:35.026315+0000) 2019-11-29T20:55:36.685 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:55:36.680+0000 1694c700 -1 osd.7 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:53.842806+0000 front 2019-11-29T20:54:53.334172+0000 (oldest deadline 2019-11-29T20:55:33.764802+0000) 2019-11-29T20:55:36.709 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:55:36.703+0000 1694c700 -1 osd.5 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:54.035872+0000 front 2019-11-29T20:54:53.546829+0000 (oldest deadline 2019-11-29T20:55:35.191256+0000) 2019-11-29T20:55:36.965 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:55:36.959+0000 1694c700 -1 osd.4 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:50.992444+0000 front 2019-11-29T20:54:51.048024+0000 (oldest deadline 2019-11-29T20:55:35.026315+0000) 2019-11-29T20:55:37.565 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:55:37.559+0000 1694c700 -1 osd.6 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:51.891915+0000 front 2019-11-29T20:54:51.839064+0000 (oldest deadline 2019-11-29T20:55:36.987042+0000) 2019-11-29T20:55:37.717 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:55:37.707+0000 1694c700 -1 osd.5 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:54.035872+0000 front 2019-11-29T20:54:53.546829+0000 (oldest deadline 2019-11-29T20:55:35.191256+0000) 2019-11-29T20:55:37.717 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:55:37.707+0000 1694c700 -1 osd.7 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:53.842806+0000 front 2019-11-29T20:54:53.334172+0000 (oldest deadline 2019-11-29T20:55:33.764802+0000) 2019-11-29T20:55:37.931 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:55:37.926+0000 1694c700 -1 osd.4 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:50.992444+0000 front 2019-11-29T20:54:51.048024+0000 (oldest deadline 2019-11-29T20:55:35.026315+0000) 2019-11-29T20:55:38.583 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:55:38.576+0000 1694c700 -1 osd.6 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:51.891915+0000 front 2019-11-29T20:54:51.839064+0000 (oldest deadline 2019-11-29T20:55:36.987042+0000) 2019-11-29T20:55:38.671 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:55:38.663+0000 1694c700 -1 osd.5 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:54.035872+0000 front 2019-11-29T20:54:53.546829+0000 (oldest deadline 2019-11-29T20:55:35.191256+0000) 2019-11-29T20:55:38.697 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:55:38.692+0000 1694c700 -1 osd.7 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:53.842806+0000 front 2019-11-29T20:54:53.334172+0000 (oldest deadline 2019-11-29T20:55:33.764802+0000) 2019-11-29T20:55:38.813 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:55:38.807+0000 1694c700 -1 osd.2 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:54.024703+0000 front 2019-11-29T20:54:53.491222+0000 (oldest deadline 2019-11-29T20:55:38.758293+0000) 2019-11-29T20:55:38.926 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:55:38.920+0000 1694c700 -1 osd.4 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:50.992444+0000 front 2019-11-29T20:54:51.048024+0000 (oldest deadline 2019-11-29T20:55:35.026315+0000) 2019-11-29T20:55:39.092 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:55:39.088+0000 1694c700 -1 osd.0 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:53.562248+0000 front 2019-11-29T20:54:53.222953+0000 (oldest deadline 2019-11-29T20:55:38.505715+0000) 2019-11-29T20:55:39.540 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:55:39.533+0000 1694c700 -1 osd.6 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:51.891915+0000 front 2019-11-29T20:54:51.839064+0000 (oldest deadline 2019-11-29T20:55:36.987042+0000) 2019-11-29T20:55:39.638 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:55:39.632+0000 1694c700 -1 osd.5 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:54.035872+0000 front 2019-11-29T20:54:53.546829+0000 (oldest deadline 2019-11-29T20:55:35.191256+0000) 2019-11-29T20:55:39.716 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:55:39.710+0000 1694c700 -1 osd.7 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:53.842806+0000 front 2019-11-29T20:54:53.334172+0000 (oldest deadline 2019-11-29T20:55:33.764802+0000) 2019-11-29T20:55:39.804 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:55:39.798+0000 1694c700 -1 osd.2 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:54.024703+0000 front 2019-11-29T20:54:53.491222+0000 (oldest deadline 2019-11-29T20:55:38.758293+0000) 2019-11-29T20:55:39.945 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:55:39.939+0000 1694c700 -1 osd.4 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:50.992444+0000 front 2019-11-29T20:54:51.048024+0000 (oldest deadline 2019-11-29T20:55:35.026315+0000) 2019-11-29T20:55:40.082 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:55:40.077+0000 1694c700 -1 osd.0 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:53.562248+0000 front 2019-11-29T20:54:53.222953+0000 (oldest deadline 2019-11-29T20:55:38.505715+0000) 2019-11-29T20:55:40.577 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:55:40.571+0000 1694c700 -1 osd.6 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:51.891915+0000 front 2019-11-29T20:54:51.839064+0000 (oldest deadline 2019-11-29T20:55:36.987042+0000) 2019-11-29T20:55:40.643 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:55:40.636+0000 1694c700 -1 osd.5 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:54.035872+0000 front 2019-11-29T20:54:53.546829+0000 (oldest deadline 2019-11-29T20:55:35.191256+0000) 2019-11-29T20:55:40.734 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:55:40.728+0000 1694c700 -1 osd.7 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:53.842806+0000 front 2019-11-29T20:54:53.334172+0000 (oldest deadline 2019-11-29T20:55:33.764802+0000) 2019-11-29T20:55:40.803 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:55:40.798+0000 1694c700 -1 osd.2 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:54.024703+0000 front 2019-11-29T20:54:53.491222+0000 (oldest deadline 2019-11-29T20:55:38.758293+0000) 2019-11-29T20:55:40.927 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:55:40.921+0000 1694c700 -1 osd.4 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:50.992444+0000 front 2019-11-29T20:54:51.048024+0000 (oldest deadline 2019-11-29T20:55:35.026315+0000) 2019-11-29T20:55:41.077 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:55:41.073+0000 1694c700 -1 osd.0 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:53.562248+0000 front 2019-11-29T20:54:53.222953+0000 (oldest deadline 2019-11-29T20:55:38.505715+0000) 2019-11-29T20:55:41.616 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:55:41.610+0000 1694c700 -1 osd.6 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:51.891915+0000 front 2019-11-29T20:54:51.839064+0000 (oldest deadline 2019-11-29T20:55:36.987042+0000) 2019-11-29T20:55:41.696 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:55:41.690+0000 1694c700 -1 osd.5 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:54.035872+0000 front 2019-11-29T20:54:53.546829+0000 (oldest deadline 2019-11-29T20:55:35.191256+0000) 2019-11-29T20:55:41.712 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:55:41.706+0000 1694c700 -1 osd.7 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:53.842806+0000 front 2019-11-29T20:54:53.334172+0000 (oldest deadline 2019-11-29T20:55:33.764802+0000) 2019-11-29T20:55:41.823 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:55:41.818+0000 1694c700 -1 osd.2 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:54.024703+0000 front 2019-11-29T20:54:53.491222+0000 (oldest deadline 2019-11-29T20:55:38.758293+0000) 2019-11-29T20:55:41.901 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:55:41.895+0000 1694c700 -1 osd.4 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:50.992444+0000 front 2019-11-29T20:54:51.048024+0000 (oldest deadline 2019-11-29T20:55:35.026315+0000) 2019-11-29T20:55:42.059 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:55:42.054+0000 1694c700 -1 osd.0 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:53.562248+0000 front 2019-11-29T20:54:53.222953+0000 (oldest deadline 2019-11-29T20:55:38.505715+0000) 2019-11-29T20:55:42.596 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:55:42.590+0000 1694c700 -1 osd.6 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:51.891915+0000 front 2019-11-29T20:54:51.839064+0000 (oldest deadline 2019-11-29T20:55:36.987042+0000) 2019-11-29T20:55:42.671 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:55:42.665+0000 1694c700 -1 osd.5 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:54.035872+0000 front 2019-11-29T20:54:53.546829+0000 (oldest deadline 2019-11-29T20:55:35.191256+0000) 2019-11-29T20:55:42.762 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:55:42.756+0000 1694c700 -1 osd.7 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:53.842806+0000 front 2019-11-29T20:54:53.334172+0000 (oldest deadline 2019-11-29T20:55:33.764802+0000) 2019-11-29T20:55:42.826 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:55:42.819+0000 1694c700 -1 osd.2 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:54.024703+0000 front 2019-11-29T20:54:53.491222+0000 (oldest deadline 2019-11-29T20:55:38.758293+0000) 2019-11-29T20:55:42.894 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:55:42.888+0000 1694c700 -1 osd.4 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:50.992444+0000 front 2019-11-29T20:54:51.048024+0000 (oldest deadline 2019-11-29T20:55:35.026315+0000) 2019-11-29T20:55:43.076 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:55:43.069+0000 1694c700 -1 osd.0 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:53.562248+0000 front 2019-11-29T20:54:53.222953+0000 (oldest deadline 2019-11-29T20:55:38.505715+0000) 2019-11-29T20:55:43.611 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:55:43.604+0000 1694c700 -1 osd.6 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:51.891915+0000 front 2019-11-29T20:54:51.839064+0000 (oldest deadline 2019-11-29T20:55:36.987042+0000) 2019-11-29T20:55:43.641 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:55:43.635+0000 1694c700 -1 osd.5 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:54.035872+0000 front 2019-11-29T20:54:53.546829+0000 (oldest deadline 2019-11-29T20:55:35.191256+0000) 2019-11-29T20:55:43.781 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:55:43.776+0000 1694c700 -1 osd.7 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:53.842806+0000 front 2019-11-29T20:54:53.334172+0000 (oldest deadline 2019-11-29T20:55:33.764802+0000) 2019-11-29T20:55:43.852 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:55:43.846+0000 1694c700 -1 osd.2 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:54.024703+0000 front 2019-11-29T20:54:53.491222+0000 (oldest deadline 2019-11-29T20:55:38.758293+0000) 2019-11-29T20:55:43.917 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:55:43.906+0000 1694c700 -1 osd.4 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:50.992444+0000 front 2019-11-29T20:54:51.048024+0000 (oldest deadline 2019-11-29T20:55:35.026315+0000) 2019-11-29T20:55:44.089 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:55:44.083+0000 1694c700 -1 osd.0 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:53.562248+0000 front 2019-11-29T20:54:53.222953+0000 (oldest deadline 2019-11-29T20:55:38.505715+0000) 2019-11-29T20:55:44.569 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:55:44.563+0000 1694c700 -1 osd.6 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:51.891915+0000 front 2019-11-29T20:54:51.839064+0000 (oldest deadline 2019-11-29T20:55:36.987042+0000) 2019-11-29T20:55:44.641 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:55:44.635+0000 1694c700 -1 osd.5 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:54.035872+0000 front 2019-11-29T20:54:53.546829+0000 (oldest deadline 2019-11-29T20:55:35.191256+0000) 2019-11-29T20:55:44.787 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:55:44.778+0000 1694c700 -1 osd.7 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:53.842806+0000 front 2019-11-29T20:54:53.334172+0000 (oldest deadline 2019-11-29T20:55:33.764802+0000) 2019-11-29T20:55:44.873 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:55:44.863+0000 1694c700 -1 osd.2 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:54.024703+0000 front 2019-11-29T20:54:53.491222+0000 (oldest deadline 2019-11-29T20:55:38.758293+0000) 2019-11-29T20:55:44.883 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:55:44.877+0000 1694c700 -1 osd.4 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:50.992444+0000 front 2019-11-29T20:54:51.048024+0000 (oldest deadline 2019-11-29T20:55:35.026315+0000) 2019-11-29T20:55:45.099 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:55:45.093+0000 1694c700 -1 osd.0 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:53.562248+0000 front 2019-11-29T20:54:53.222953+0000 (oldest deadline 2019-11-29T20:55:38.505715+0000) 2019-11-29T20:55:45.546 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:55:45.541+0000 1694c700 -1 osd.6 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:51.891915+0000 front 2019-11-29T20:54:51.839064+0000 (oldest deadline 2019-11-29T20:55:36.987042+0000) 2019-11-29T20:55:45.671 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:55:45.665+0000 1694c700 -1 osd.5 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:54.035872+0000 front 2019-11-29T20:54:53.546829+0000 (oldest deadline 2019-11-29T20:55:35.191256+0000) 2019-11-29T20:55:45.743 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:55:45.737+0000 1694c700 -1 osd.7 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:53.842806+0000 front 2019-11-29T20:54:53.334172+0000 (oldest deadline 2019-11-29T20:55:33.764802+0000) 2019-11-29T20:55:45.922 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:55:45.916+0000 1694c700 -1 osd.2 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:54.024703+0000 front 2019-11-29T20:54:53.491222+0000 (oldest deadline 2019-11-29T20:55:38.758293+0000) 2019-11-29T20:55:45.936 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:55:45.930+0000 1694c700 -1 osd.4 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:50.992444+0000 front 2019-11-29T20:54:51.048024+0000 (oldest deadline 2019-11-29T20:55:35.026315+0000) 2019-11-29T20:55:46.104 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:55:46.098+0000 1694c700 -1 osd.0 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:53.562248+0000 front 2019-11-29T20:54:53.222953+0000 (oldest deadline 2019-11-29T20:55:38.505715+0000) 2019-11-29T20:55:46.576 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:55:46.570+0000 1694c700 -1 osd.6 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:51.891915+0000 front 2019-11-29T20:54:51.839064+0000 (oldest deadline 2019-11-29T20:55:36.987042+0000) 2019-11-29T20:55:46.646 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:55:46.640+0000 1694c700 -1 osd.5 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:54.035872+0000 front 2019-11-29T20:54:53.546829+0000 (oldest deadline 2019-11-29T20:55:35.191256+0000) 2019-11-29T20:55:46.739 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:55:46.733+0000 1694c700 -1 osd.7 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:53.842806+0000 front 2019-11-29T20:54:53.334172+0000 (oldest deadline 2019-11-29T20:55:33.764802+0000) 2019-11-29T20:55:46.943 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:55:46.936+0000 1694c700 -1 osd.4 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:50.992444+0000 front 2019-11-29T20:54:51.048024+0000 (oldest deadline 2019-11-29T20:55:35.026315+0000) 2019-11-29T20:55:46.949 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:55:46.944+0000 1694c700 -1 osd.2 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:54.024703+0000 front 2019-11-29T20:54:53.491222+0000 (oldest deadline 2019-11-29T20:55:38.758293+0000) 2019-11-29T20:55:47.153 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:55:47.148+0000 1694c700 -1 osd.0 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:53.562248+0000 front 2019-11-29T20:54:53.222953+0000 (oldest deadline 2019-11-29T20:55:38.505715+0000) 2019-11-29T20:55:47.568 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:55:47.562+0000 1694c700 -1 osd.6 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:51.891915+0000 front 2019-11-29T20:54:51.839064+0000 (oldest deadline 2019-11-29T20:55:36.987042+0000) 2019-11-29T20:55:47.691 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:55:47.685+0000 1694c700 -1 osd.5 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:54.035872+0000 front 2019-11-29T20:54:53.546829+0000 (oldest deadline 2019-11-29T20:55:35.191256+0000) 2019-11-29T20:55:47.752 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:55:47.746+0000 1694c700 -1 osd.7 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:53.842806+0000 front 2019-11-29T20:54:53.334172+0000 (oldest deadline 2019-11-29T20:55:33.764802+0000) 2019-11-29T20:55:47.966 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:55:47.960+0000 1694c700 -1 osd.2 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:54.024703+0000 front 2019-11-29T20:54:53.491222+0000 (oldest deadline 2019-11-29T20:55:38.758293+0000) 2019-11-29T20:55:47.984 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:55:47.978+0000 1694c700 -1 osd.4 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:50.992444+0000 front 2019-11-29T20:54:51.048024+0000 (oldest deadline 2019-11-29T20:55:35.026315+0000) 2019-11-29T20:55:48.173 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:55:48.166+0000 1694c700 -1 osd.0 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:53.562248+0000 front 2019-11-29T20:54:53.222953+0000 (oldest deadline 2019-11-29T20:55:38.505715+0000) 2019-11-29T20:55:48.603 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:55:48.588+0000 1694c700 -1 osd.6 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:51.891915+0000 front 2019-11-29T20:54:51.839064+0000 (oldest deadline 2019-11-29T20:55:36.987042+0000) 2019-11-29T20:55:48.680 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:55:48.672+0000 1694c700 -1 osd.5 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:54.035872+0000 front 2019-11-29T20:54:53.546829+0000 (oldest deadline 2019-11-29T20:55:35.191256+0000) 2019-11-29T20:55:48.750 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:55:48.743+0000 1694c700 -1 osd.7 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:53.842806+0000 front 2019-11-29T20:54:53.334172+0000 (oldest deadline 2019-11-29T20:55:33.764802+0000) 2019-11-29T20:55:48.955 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:55:48.949+0000 1694c700 -1 osd.4 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:50.992444+0000 front 2019-11-29T20:54:51.048024+0000 (oldest deadline 2019-11-29T20:55:35.026315+0000) 2019-11-29T20:55:48.962 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:55:48.957+0000 1694c700 -1 osd.2 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:54.024703+0000 front 2019-11-29T20:54:53.491222+0000 (oldest deadline 2019-11-29T20:55:38.758293+0000) 2019-11-29T20:55:49.139 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:55:49.134+0000 1694c700 -1 osd.0 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:53.562248+0000 front 2019-11-29T20:54:53.222953+0000 (oldest deadline 2019-11-29T20:55:38.505715+0000) 2019-11-29T20:55:49.623 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:55:49.616+0000 1694c700 -1 osd.6 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:51.891915+0000 front 2019-11-29T20:54:51.839064+0000 (oldest deadline 2019-11-29T20:55:36.987042+0000) 2019-11-29T20:55:49.651 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:55:49.645+0000 1694c700 -1 osd.5 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:54.035872+0000 front 2019-11-29T20:54:53.546829+0000 (oldest deadline 2019-11-29T20:55:35.191256+0000) 2019-11-29T20:55:49.725 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:55:49.719+0000 1694c700 -1 osd.7 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:53.842806+0000 front 2019-11-29T20:54:53.334172+0000 (oldest deadline 2019-11-29T20:55:33.764802+0000) 2019-11-29T20:55:49.955 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:55:49.949+0000 1694c700 -1 osd.4 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:50.992444+0000 front 2019-11-29T20:54:51.048024+0000 (oldest deadline 2019-11-29T20:55:35.026315+0000) 2019-11-29T20:55:49.999 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:55:49.993+0000 1694c700 -1 osd.2 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:54.024703+0000 front 2019-11-29T20:54:53.491222+0000 (oldest deadline 2019-11-29T20:55:38.758293+0000) 2019-11-29T20:55:50.118 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:55:50.113+0000 1694c700 -1 osd.0 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:53.562248+0000 front 2019-11-29T20:54:53.222953+0000 (oldest deadline 2019-11-29T20:55:38.505715+0000) 2019-11-29T20:55:50.600 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:55:50.594+0000 1694c700 -1 osd.6 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:51.891915+0000 front 2019-11-29T20:54:51.839064+0000 (oldest deadline 2019-11-29T20:55:36.987042+0000) 2019-11-29T20:55:50.707 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:55:50.701+0000 1694c700 -1 osd.5 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:54.035872+0000 front 2019-11-29T20:54:53.546829+0000 (oldest deadline 2019-11-29T20:55:35.191256+0000) 2019-11-29T20:55:50.736 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:55:50.728+0000 1694c700 -1 osd.7 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:53.842806+0000 front 2019-11-29T20:54:53.334172+0000 (oldest deadline 2019-11-29T20:55:33.764802+0000) 2019-11-29T20:55:50.992 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:55:50.985+0000 1694c700 -1 osd.2 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:54.024703+0000 front 2019-11-29T20:54:53.491222+0000 (oldest deadline 2019-11-29T20:55:38.758293+0000) 2019-11-29T20:55:51.005 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:55:51.000+0000 1694c700 -1 osd.4 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:50.992444+0000 front 2019-11-29T20:54:51.048024+0000 (oldest deadline 2019-11-29T20:55:35.026315+0000) 2019-11-29T20:55:51.100 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:55:51.093+0000 1694c700 -1 osd.0 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:53.562248+0000 front 2019-11-29T20:54:53.222953+0000 (oldest deadline 2019-11-29T20:55:38.505715+0000) 2019-11-29T20:55:51.623 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:55:51.617+0000 1694c700 -1 osd.6 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:51.891915+0000 front 2019-11-29T20:54:51.839064+0000 (oldest deadline 2019-11-29T20:55:36.987042+0000) 2019-11-29T20:55:51.692 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:55:51.685+0000 1694c700 -1 osd.5 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:54.035872+0000 front 2019-11-29T20:54:53.546829+0000 (oldest deadline 2019-11-29T20:55:35.191256+0000) 2019-11-29T20:55:51.702 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:55:51.696+0000 1694c700 -1 osd.7 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:53.842806+0000 front 2019-11-29T20:54:53.334172+0000 (oldest deadline 2019-11-29T20:55:33.764802+0000) 2019-11-29T20:55:52.040 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:55:52.035+0000 1694c700 -1 osd.2 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:54.024703+0000 front 2019-11-29T20:54:53.491222+0000 (oldest deadline 2019-11-29T20:55:38.758293+0000) 2019-11-29T20:55:52.047 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:55:52.041+0000 1694c700 -1 osd.4 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:50.992444+0000 front 2019-11-29T20:54:51.048024+0000 (oldest deadline 2019-11-29T20:55:35.026315+0000) 2019-11-29T20:55:52.146 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:55:52.141+0000 1694c700 -1 osd.0 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:53.562248+0000 front 2019-11-29T20:54:53.222953+0000 (oldest deadline 2019-11-29T20:55:38.505715+0000) 2019-11-29T20:55:52.604 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:55:52.597+0000 1694c700 -1 osd.6 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:51.891915+0000 front 2019-11-29T20:54:51.839064+0000 (oldest deadline 2019-11-29T20:55:36.987042+0000) 2019-11-29T20:55:52.723 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:55:52.717+0000 1694c700 -1 osd.7 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:53.842806+0000 front 2019-11-29T20:54:53.334172+0000 (oldest deadline 2019-11-29T20:55:33.764802+0000) 2019-11-29T20:55:52.739 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:55:52.733+0000 1694c700 -1 osd.5 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:54.035872+0000 front 2019-11-29T20:54:53.546829+0000 (oldest deadline 2019-11-29T20:55:35.191256+0000) 2019-11-29T20:55:52.994 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:55:52.989+0000 1694c700 -1 osd.2 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:54.024703+0000 front 2019-11-29T20:54:53.491222+0000 (oldest deadline 2019-11-29T20:55:38.758293+0000) 2019-11-29T20:55:53.071 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:55:53.066+0000 1694c700 -1 osd.4 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:50.992444+0000 front 2019-11-29T20:54:51.048024+0000 (oldest deadline 2019-11-29T20:55:35.026315+0000) 2019-11-29T20:55:53.162 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:55:53.157+0000 1694c700 -1 osd.0 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:53.562248+0000 front 2019-11-29T20:54:53.222953+0000 (oldest deadline 2019-11-29T20:55:38.505715+0000) 2019-11-29T20:55:53.569 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:55:53.562+0000 1694c700 -1 osd.6 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:51.891915+0000 front 2019-11-29T20:54:51.839064+0000 (oldest deadline 2019-11-29T20:55:36.987042+0000) 2019-11-29T20:55:53.728 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:55:53.721+0000 1694c700 -1 osd.5 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:54.035872+0000 front 2019-11-29T20:54:53.546829+0000 (oldest deadline 2019-11-29T20:55:35.191256+0000) 2019-11-29T20:55:53.768 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:55:53.763+0000 1694c700 -1 osd.7 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:53.842806+0000 front 2019-11-29T20:54:53.334172+0000 (oldest deadline 2019-11-29T20:55:33.764802+0000) 2019-11-29T20:55:53.952 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:55:53.946+0000 1694c700 -1 osd.2 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:54.024703+0000 front 2019-11-29T20:54:53.491222+0000 (oldest deadline 2019-11-29T20:55:38.758293+0000) 2019-11-29T20:55:54.104 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:55:54.099+0000 1694c700 -1 osd.4 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:50.992444+0000 front 2019-11-29T20:54:51.048024+0000 (oldest deadline 2019-11-29T20:55:35.026315+0000) 2019-11-29T20:55:54.185 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:55:54.180+0000 1694c700 -1 osd.0 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:53.562248+0000 front 2019-11-29T20:54:53.222953+0000 (oldest deadline 2019-11-29T20:55:38.505715+0000) 2019-11-29T20:55:54.538 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:55:54.532+0000 1694c700 -1 osd.6 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:51.891915+0000 front 2019-11-29T20:54:51.839064+0000 (oldest deadline 2019-11-29T20:55:36.987042+0000) 2019-11-29T20:55:54.694 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:55:54.688+0000 1694c700 -1 osd.5 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:54.035872+0000 front 2019-11-29T20:54:53.546829+0000 (oldest deadline 2019-11-29T20:55:35.191256+0000) 2019-11-29T20:55:54.788 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:55:54.783+0000 1694c700 -1 osd.7 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:53.842806+0000 front 2019-11-29T20:54:53.334172+0000 (oldest deadline 2019-11-29T20:55:33.764802+0000) 2019-11-29T20:55:54.981 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:55:54.976+0000 1694c700 -1 osd.2 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:54.024703+0000 front 2019-11-29T20:54:53.491222+0000 (oldest deadline 2019-11-29T20:55:38.758293+0000) 2019-11-29T20:55:55.070 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:55:55.065+0000 1694c700 -1 osd.4 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:50.992444+0000 front 2019-11-29T20:54:51.048024+0000 (oldest deadline 2019-11-29T20:55:35.026315+0000) 2019-11-29T20:55:55.153 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:55:55.148+0000 1694c700 -1 osd.0 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:53.562248+0000 front 2019-11-29T20:54:53.222953+0000 (oldest deadline 2019-11-29T20:55:38.505715+0000) 2019-11-29T20:55:55.556 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:55:55.550+0000 1694c700 -1 osd.6 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:51.891915+0000 front 2019-11-29T20:54:51.839064+0000 (oldest deadline 2019-11-29T20:55:36.987042+0000) 2019-11-29T20:55:55.711 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:55:55.705+0000 1694c700 -1 osd.5 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:54.035872+0000 front 2019-11-29T20:54:53.546829+0000 (oldest deadline 2019-11-29T20:55:35.191256+0000) 2019-11-29T20:55:55.745 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:55:55.739+0000 1694c700 -1 osd.7 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:53.842806+0000 front 2019-11-29T20:54:53.334172+0000 (oldest deadline 2019-11-29T20:55:33.764802+0000) 2019-11-29T20:55:55.961 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:55:55.955+0000 1694c700 -1 osd.2 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:54.024703+0000 front 2019-11-29T20:54:53.491222+0000 (oldest deadline 2019-11-29T20:55:38.758293+0000) 2019-11-29T20:55:56.108 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:55:56.102+0000 1694c700 -1 osd.4 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:50.992444+0000 front 2019-11-29T20:54:51.048024+0000 (oldest deadline 2019-11-29T20:55:35.026315+0000) 2019-11-29T20:55:56.202 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:55:56.196+0000 1694c700 -1 osd.0 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:53.562248+0000 front 2019-11-29T20:54:53.222953+0000 (oldest deadline 2019-11-29T20:55:38.505715+0000) 2019-11-29T20:55:56.588 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:55:56.583+0000 1694c700 -1 osd.6 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:51.891915+0000 front 2019-11-29T20:54:51.839064+0000 (oldest deadline 2019-11-29T20:55:36.987042+0000) 2019-11-29T20:55:56.688 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:55:56.682+0000 1694c700 -1 osd.5 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:54.035872+0000 front 2019-11-29T20:54:53.546829+0000 (oldest deadline 2019-11-29T20:55:35.191256+0000) 2019-11-29T20:55:56.738 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:55:56.732+0000 1694c700 -1 osd.7 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:53.842806+0000 front 2019-11-29T20:54:53.334172+0000 (oldest deadline 2019-11-29T20:55:33.764802+0000) 2019-11-29T20:55:56.937 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:55:56.931+0000 1694c700 -1 osd.2 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:54.024703+0000 front 2019-11-29T20:54:53.491222+0000 (oldest deadline 2019-11-29T20:55:38.758293+0000) 2019-11-29T20:55:57.130 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:55:57.124+0000 1694c700 -1 osd.4 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:50.992444+0000 front 2019-11-29T20:54:51.048024+0000 (oldest deadline 2019-11-29T20:55:35.026315+0000) 2019-11-29T20:55:57.239 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:55:57.232+0000 1694c700 -1 osd.0 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:53.562248+0000 front 2019-11-29T20:54:53.222953+0000 (oldest deadline 2019-11-29T20:55:38.505715+0000) 2019-11-29T20:55:57.549 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:55:57.544+0000 1694c700 -1 osd.6 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:51.891915+0000 front 2019-11-29T20:54:51.839064+0000 (oldest deadline 2019-11-29T20:55:36.987042+0000) 2019-11-29T20:55:57.687 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:55:57.676+0000 1694c700 -1 osd.5 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:54.035872+0000 front 2019-11-29T20:54:53.546829+0000 (oldest deadline 2019-11-29T20:55:35.191256+0000) 2019-11-29T20:55:57.699 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:55:57.693+0000 1694c700 -1 osd.7 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:53.842806+0000 front 2019-11-29T20:54:53.334172+0000 (oldest deadline 2019-11-29T20:55:33.764802+0000) 2019-11-29T20:55:57.916 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:55:57.911+0000 1694c700 -1 osd.2 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:54.024703+0000 front 2019-11-29T20:54:53.491222+0000 (oldest deadline 2019-11-29T20:55:38.758293+0000) 2019-11-29T20:55:58.128 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:55:58.122+0000 1694c700 -1 osd.4 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:50.992444+0000 front 2019-11-29T20:54:51.048024+0000 (oldest deadline 2019-11-29T20:55:35.026315+0000) 2019-11-29T20:55:58.204 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:55:58.198+0000 1694c700 -1 osd.0 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:53.562248+0000 front 2019-11-29T20:54:53.222953+0000 (oldest deadline 2019-11-29T20:55:38.505715+0000) 2019-11-29T20:55:58.586 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:55:58.580+0000 1694c700 -1 osd.6 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:51.891915+0000 front 2019-11-29T20:54:51.839064+0000 (oldest deadline 2019-11-29T20:55:36.987042+0000) 2019-11-29T20:55:58.663 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:55:58.657+0000 1694c700 -1 osd.5 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:54.035872+0000 front 2019-11-29T20:54:53.546829+0000 (oldest deadline 2019-11-29T20:55:35.191256+0000) 2019-11-29T20:55:58.683 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:55:58.678+0000 1694c700 -1 osd.7 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:53.842806+0000 front 2019-11-29T20:54:53.334172+0000 (oldest deadline 2019-11-29T20:55:33.764802+0000) 2019-11-29T20:55:58.939 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:55:58.933+0000 1694c700 -1 osd.2 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:54.024703+0000 front 2019-11-29T20:54:53.491222+0000 (oldest deadline 2019-11-29T20:55:38.758293+0000) 2019-11-29T20:55:59.164 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:55:59.157+0000 1694c700 -1 osd.4 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:50.992444+0000 front 2019-11-29T20:54:51.048024+0000 (oldest deadline 2019-11-29T20:55:35.026315+0000) 2019-11-29T20:55:59.202 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:55:59.198+0000 1694c700 -1 osd.0 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:53.562248+0000 front 2019-11-29T20:54:53.222953+0000 (oldest deadline 2019-11-29T20:55:38.505715+0000) 2019-11-29T20:55:59.636 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:55:59.630+0000 1694c700 -1 osd.6 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:51.891915+0000 front 2019-11-29T20:54:51.839064+0000 (oldest deadline 2019-11-29T20:55:36.987042+0000) 2019-11-29T20:55:59.639 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:55:59.633+0000 1694c700 -1 osd.7 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:53.842806+0000 front 2019-11-29T20:54:53.334172+0000 (oldest deadline 2019-11-29T20:55:33.764802+0000) 2019-11-29T20:55:59.699 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:55:59.693+0000 1694c700 -1 osd.5 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:54.035872+0000 front 2019-11-29T20:54:53.546829+0000 (oldest deadline 2019-11-29T20:55:35.191256+0000) 2019-11-29T20:55:59.952 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:55:59.947+0000 1694c700 -1 osd.2 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:54.024703+0000 front 2019-11-29T20:54:53.491222+0000 (oldest deadline 2019-11-29T20:55:38.758293+0000) 2019-11-29T20:56:00.142 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:56:00.136+0000 1694c700 -1 osd.4 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:50.992444+0000 front 2019-11-29T20:54:51.048024+0000 (oldest deadline 2019-11-29T20:55:35.026315+0000) 2019-11-29T20:56:00.191 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:56:00.186+0000 1694c700 -1 osd.0 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:53.562248+0000 front 2019-11-29T20:54:53.222953+0000 (oldest deadline 2019-11-29T20:55:38.505715+0000) 2019-11-29T20:56:00.592 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:56:00.586+0000 1694c700 -1 osd.6 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:51.891915+0000 front 2019-11-29T20:54:51.839064+0000 (oldest deadline 2019-11-29T20:55:36.987042+0000) 2019-11-29T20:56:00.624 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:56:00.618+0000 1694c700 -1 osd.7 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:53.842806+0000 front 2019-11-29T20:54:53.334172+0000 (oldest deadline 2019-11-29T20:55:33.764802+0000) 2019-11-29T20:56:00.672 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:56:00.666+0000 1694c700 -1 osd.5 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:54.035872+0000 front 2019-11-29T20:54:53.546829+0000 (oldest deadline 2019-11-29T20:55:35.191256+0000) 2019-11-29T20:56:00.918 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:56:00.912+0000 1694c700 -1 osd.2 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:54.024703+0000 front 2019-11-29T20:54:53.491222+0000 (oldest deadline 2019-11-29T20:55:38.758293+0000) 2019-11-29T20:56:01.183 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:56:01.177+0000 1694c700 -1 osd.0 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:53.562248+0000 front 2019-11-29T20:54:53.222953+0000 (oldest deadline 2019-11-29T20:55:38.505715+0000) 2019-11-29T20:56:01.196 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:56:01.190+0000 1694c700 -1 osd.4 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:50.992444+0000 front 2019-11-29T20:54:51.048024+0000 (oldest deadline 2019-11-29T20:55:35.026315+0000) 2019-11-29T20:56:01.581 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:56:01.575+0000 1694c700 -1 osd.7 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:53.842806+0000 front 2019-11-29T20:54:53.334172+0000 (oldest deadline 2019-11-29T20:55:33.764802+0000) 2019-11-29T20:56:01.641 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:56:01.635+0000 1694c700 -1 osd.6 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:51.891915+0000 front 2019-11-29T20:54:51.839064+0000 (oldest deadline 2019-11-29T20:55:36.987042+0000) 2019-11-29T20:56:01.653 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:56:01.647+0000 1694c700 -1 osd.5 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:54.035872+0000 front 2019-11-29T20:54:53.546829+0000 (oldest deadline 2019-11-29T20:55:35.191256+0000) 2019-11-29T20:56:01.930 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:56:01.924+0000 1694c700 -1 osd.2 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:54.024703+0000 front 2019-11-29T20:54:53.491222+0000 (oldest deadline 2019-11-29T20:55:38.758293+0000) 2019-11-29T20:56:02.200 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:56:02.195+0000 1694c700 -1 osd.0 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:53.562248+0000 front 2019-11-29T20:54:53.222953+0000 (oldest deadline 2019-11-29T20:55:38.505715+0000) 2019-11-29T20:56:02.215 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:56:02.210+0000 1694c700 -1 osd.4 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:50.992444+0000 front 2019-11-29T20:54:51.048024+0000 (oldest deadline 2019-11-29T20:55:35.026315+0000) 2019-11-29T20:56:02.570 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:56:02.565+0000 1694c700 -1 osd.7 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:53.842806+0000 front 2019-11-29T20:54:53.334172+0000 (oldest deadline 2019-11-29T20:55:33.764802+0000) 2019-11-29T20:56:02.636 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:56:02.629+0000 1694c700 -1 osd.5 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:54.035872+0000 front 2019-11-29T20:54:53.546829+0000 (oldest deadline 2019-11-29T20:55:35.191256+0000) 2019-11-29T20:56:02.685 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:56:02.679+0000 1694c700 -1 osd.6 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:51.891915+0000 front 2019-11-29T20:54:51.839064+0000 (oldest deadline 2019-11-29T20:55:36.987042+0000) 2019-11-29T20:56:02.962 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:56:02.955+0000 1694c700 -1 osd.2 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:54.024703+0000 front 2019-11-29T20:54:53.491222+0000 (oldest deadline 2019-11-29T20:55:38.758293+0000) 2019-11-29T20:56:03.156 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:56:03.150+0000 1694c700 -1 osd.0 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:53.562248+0000 front 2019-11-29T20:54:53.222953+0000 (oldest deadline 2019-11-29T20:55:38.505715+0000) 2019-11-29T20:56:03.250 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:56:03.244+0000 1694c700 -1 osd.4 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:50.992444+0000 front 2019-11-29T20:54:51.048024+0000 (oldest deadline 2019-11-29T20:55:35.026315+0000) 2019-11-29T20:56:03.596 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:56:03.591+0000 1694c700 -1 osd.7 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:53.842806+0000 front 2019-11-29T20:54:53.334172+0000 (oldest deadline 2019-11-29T20:55:33.764802+0000) 2019-11-29T20:56:03.636 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:56:03.631+0000 1694c700 -1 osd.5 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:54.035872+0000 front 2019-11-29T20:54:53.546829+0000 (oldest deadline 2019-11-29T20:55:35.191256+0000) 2019-11-29T20:56:03.669 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:56:03.664+0000 1694c700 -1 osd.6 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:51.891915+0000 front 2019-11-29T20:54:51.839064+0000 (oldest deadline 2019-11-29T20:55:36.987042+0000) 2019-11-29T20:56:03.952 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:56:03.947+0000 1694c700 -1 osd.2 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:54.024703+0000 front 2019-11-29T20:54:53.491222+0000 (oldest deadline 2019-11-29T20:55:38.758293+0000) 2019-11-29T20:56:04.175 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:56:04.168+0000 1694c700 -1 osd.0 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:53.562248+0000 front 2019-11-29T20:54:53.222953+0000 (oldest deadline 2019-11-29T20:55:38.505715+0000) 2019-11-29T20:56:04.217 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:56:04.211+0000 1694c700 -1 osd.4 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:50.992444+0000 front 2019-11-29T20:54:51.048024+0000 (oldest deadline 2019-11-29T20:55:35.026315+0000) 2019-11-29T20:56:04.584 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:56:04.578+0000 1694c700 -1 osd.7 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:53.842806+0000 front 2019-11-29T20:54:53.334172+0000 (oldest deadline 2019-11-29T20:55:33.764802+0000) 2019-11-29T20:56:04.677 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:56:04.671+0000 1694c700 -1 osd.5 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:54.035872+0000 front 2019-11-29T20:54:53.546829+0000 (oldest deadline 2019-11-29T20:55:35.191256+0000) 2019-11-29T20:56:04.683 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:56:04.677+0000 1694c700 -1 osd.6 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:51.891915+0000 front 2019-11-29T20:54:51.839064+0000 (oldest deadline 2019-11-29T20:55:36.987042+0000) 2019-11-29T20:56:04.961 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:56:04.955+0000 1694c700 -1 osd.2 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:54.024703+0000 front 2019-11-29T20:54:53.491222+0000 (oldest deadline 2019-11-29T20:55:38.758293+0000) 2019-11-29T20:56:05.201 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:56:05.194+0000 1694c700 -1 osd.0 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:53.562248+0000 front 2019-11-29T20:54:53.222953+0000 (oldest deadline 2019-11-29T20:55:38.505715+0000) 2019-11-29T20:56:05.246 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:56:05.242+0000 1694c700 -1 osd.4 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:50.992444+0000 front 2019-11-29T20:54:51.048024+0000 (oldest deadline 2019-11-29T20:55:35.026315+0000) 2019-11-29T20:56:05.594 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:56:05.588+0000 1694c700 -1 osd.7 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:53.842806+0000 front 2019-11-29T20:54:53.334172+0000 (oldest deadline 2019-11-29T20:55:33.764802+0000) 2019-11-29T20:56:05.696 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:56:05.690+0000 1694c700 -1 osd.6 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:51.891915+0000 front 2019-11-29T20:54:51.839064+0000 (oldest deadline 2019-11-29T20:55:36.987042+0000) 2019-11-29T20:56:05.726 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:56:05.719+0000 1694c700 -1 osd.5 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:54.035872+0000 front 2019-11-29T20:54:53.546829+0000 (oldest deadline 2019-11-29T20:55:35.191256+0000) 2019-11-29T20:56:05.945 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:56:05.939+0000 1694c700 -1 osd.2 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:54.024703+0000 front 2019-11-29T20:54:53.491222+0000 (oldest deadline 2019-11-29T20:55:38.758293+0000) 2019-11-29T20:56:06.227 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:56:06.222+0000 1694c700 -1 osd.0 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:53.562248+0000 front 2019-11-29T20:54:53.222953+0000 (oldest deadline 2019-11-29T20:55:38.505715+0000) 2019-11-29T20:56:06.275 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:56:06.268+0000 1694c700 -1 osd.4 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:50.992444+0000 front 2019-11-29T20:54:51.048024+0000 (oldest deadline 2019-11-29T20:55:35.026315+0000) 2019-11-29T20:56:06.608 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:56:06.602+0000 1694c700 -1 osd.7 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:53.842806+0000 front 2019-11-29T20:54:53.334172+0000 (oldest deadline 2019-11-29T20:55:33.764802+0000) 2019-11-29T20:56:06.683 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:56:06.677+0000 1694c700 -1 osd.6 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:51.891915+0000 front 2019-11-29T20:54:51.839064+0000 (oldest deadline 2019-11-29T20:55:36.987042+0000) 2019-11-29T20:56:06.686 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:56:06.680+0000 1694c700 -1 osd.5 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:54.035872+0000 front 2019-11-29T20:54:53.546829+0000 (oldest deadline 2019-11-29T20:55:35.191256+0000) 2019-11-29T20:56:06.955 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:56:06.949+0000 1694c700 -1 osd.2 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:54.024703+0000 front 2019-11-29T20:54:53.491222+0000 (oldest deadline 2019-11-29T20:55:38.758293+0000) 2019-11-29T20:56:07.272 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:56:07.266+0000 1694c700 -1 osd.0 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:53.562248+0000 front 2019-11-29T20:54:53.222953+0000 (oldest deadline 2019-11-29T20:55:38.505715+0000) 2019-11-29T20:56:07.300 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:56:07.290+0000 1694c700 -1 osd.4 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:50.992444+0000 front 2019-11-29T20:54:51.048024+0000 (oldest deadline 2019-11-29T20:55:35.026315+0000) 2019-11-29T20:56:07.633 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:56:07.623+0000 1694c700 -1 osd.7 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:53.842806+0000 front 2019-11-29T20:54:53.334172+0000 (oldest deadline 2019-11-29T20:55:33.764802+0000) 2019-11-29T20:56:07.706 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:56:07.700+0000 1694c700 -1 osd.6 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:51.891915+0000 front 2019-11-29T20:54:51.839064+0000 (oldest deadline 2019-11-29T20:55:36.987042+0000) 2019-11-29T20:56:07.710 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:56:07.703+0000 1694c700 -1 osd.5 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:54.035872+0000 front 2019-11-29T20:54:53.546829+0000 (oldest deadline 2019-11-29T20:55:35.191256+0000) 2019-11-29T20:56:07.973 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:56:07.967+0000 1694c700 -1 osd.2 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:54.024703+0000 front 2019-11-29T20:54:53.491222+0000 (oldest deadline 2019-11-29T20:55:38.758293+0000) 2019-11-29T20:56:08.319 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:56:08.313+0000 1694c700 -1 osd.0 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:53.562248+0000 front 2019-11-29T20:54:53.222953+0000 (oldest deadline 2019-11-29T20:55:38.505715+0000) 2019-11-29T20:56:08.329 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:56:08.324+0000 1694c700 -1 osd.4 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:50.992444+0000 front 2019-11-29T20:54:51.048024+0000 (oldest deadline 2019-11-29T20:55:35.026315+0000) 2019-11-29T20:56:08.674 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:56:08.668+0000 1694c700 -1 osd.7 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:53.842806+0000 front 2019-11-29T20:54:53.334172+0000 (oldest deadline 2019-11-29T20:55:33.764802+0000) 2019-11-29T20:56:08.693 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:56:08.688+0000 1694c700 -1 osd.6 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:51.891915+0000 front 2019-11-29T20:54:51.839064+0000 (oldest deadline 2019-11-29T20:55:36.987042+0000) 2019-11-29T20:56:08.718 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:56:08.713+0000 1694c700 -1 osd.5 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:54.035872+0000 front 2019-11-29T20:54:53.546829+0000 (oldest deadline 2019-11-29T20:55:35.191256+0000) 2019-11-29T20:56:08.869 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:56:08.864+0000 1694c700 -1 osd.1 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:52.155165+0000 front 2019-11-29T20:54:52.150249+0000 (oldest deadline 2019-11-29T20:56:08.617978+0000) 2019-11-29T20:56:08.978 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:56:08.972+0000 1694c700 -1 osd.2 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:54.024703+0000 front 2019-11-29T20:54:53.491222+0000 (oldest deadline 2019-11-29T20:55:38.758293+0000) 2019-11-29T20:56:09.099 INFO:tasks.ceph.mon.b.smithi022.stderr:2019-11-29T20:56:09.096+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.62:6823/10369,v1:172.21.15.62:6825/10369] for 42sec e219 v219) 2019-11-29T20:56:09.284 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:56:09.279+0000 1694c700 -1 osd.0 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:53.562248+0000 front 2019-11-29T20:54:53.222953+0000 (oldest deadline 2019-11-29T20:55:38.505715+0000) 2019-11-29T20:56:09.338 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:56:09.331+0000 1694c700 -1 osd.4 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:50.992444+0000 front 2019-11-29T20:54:51.048024+0000 (oldest deadline 2019-11-29T20:55:35.026315+0000) 2019-11-29T20:56:09.665 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:56:09.658+0000 1694c700 -1 osd.6 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:51.891915+0000 front 2019-11-29T20:54:51.839064+0000 (oldest deadline 2019-11-29T20:55:36.987042+0000) 2019-11-29T20:56:09.700 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:56:09.694+0000 1694c700 -1 osd.7 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:53.842806+0000 front 2019-11-29T20:54:53.334172+0000 (oldest deadline 2019-11-29T20:55:33.764802+0000) 2019-11-29T20:56:09.731 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:56:09.725+0000 1694c700 -1 osd.5 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:54.035872+0000 front 2019-11-29T20:54:53.546829+0000 (oldest deadline 2019-11-29T20:55:35.191256+0000) 2019-11-29T20:56:09.857 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:56:09.851+0000 1694c700 -1 osd.1 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:52.155165+0000 front 2019-11-29T20:54:52.150249+0000 (oldest deadline 2019-11-29T20:56:08.617978+0000) 2019-11-29T20:56:09.993 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:56:09.988+0000 1694c700 -1 osd.2 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:54.024703+0000 front 2019-11-29T20:54:53.491222+0000 (oldest deadline 2019-11-29T20:55:38.758293+0000) 2019-11-29T20:56:10.251 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:56:10.245+0000 1694c700 -1 osd.0 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:53.562248+0000 front 2019-11-29T20:54:53.222953+0000 (oldest deadline 2019-11-29T20:55:38.505715+0000) 2019-11-29T20:56:10.367 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:56:10.362+0000 1694c700 -1 osd.4 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:50.992444+0000 front 2019-11-29T20:54:51.048024+0000 (oldest deadline 2019-11-29T20:55:35.026315+0000) 2019-11-29T20:56:10.622 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:56:10.616+0000 1694c700 -1 osd.6 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:51.891915+0000 front 2019-11-29T20:54:51.839064+0000 (oldest deadline 2019-11-29T20:55:36.987042+0000) 2019-11-29T20:56:10.698 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:56:10.693+0000 1694c700 -1 osd.5 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:54.035872+0000 front 2019-11-29T20:54:53.546829+0000 (oldest deadline 2019-11-29T20:55:35.191256+0000) 2019-11-29T20:56:10.740 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:56:10.734+0000 1694c700 -1 osd.7 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:53.842806+0000 front 2019-11-29T20:54:53.334172+0000 (oldest deadline 2019-11-29T20:55:33.764802+0000) 2019-11-29T20:56:10.811 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:56:10.806+0000 1694c700 -1 osd.1 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:52.155165+0000 front 2019-11-29T20:54:52.150249+0000 (oldest deadline 2019-11-29T20:56:08.617978+0000) 2019-11-29T20:56:11.008 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:56:11.002+0000 1694c700 -1 osd.2 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:54.024703+0000 front 2019-11-29T20:54:53.491222+0000 (oldest deadline 2019-11-29T20:55:38.758293+0000) 2019-11-29T20:56:11.213 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:56:11.208+0000 1694c700 -1 osd.0 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:53.562248+0000 front 2019-11-29T20:54:53.222953+0000 (oldest deadline 2019-11-29T20:55:38.505715+0000) 2019-11-29T20:56:11.404 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:56:11.398+0000 1694c700 -1 osd.4 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:50.992444+0000 front 2019-11-29T20:54:51.048024+0000 (oldest deadline 2019-11-29T20:55:35.026315+0000) 2019-11-29T20:56:11.674 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:56:11.667+0000 1694c700 -1 osd.6 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:51.891915+0000 front 2019-11-29T20:54:51.839064+0000 (oldest deadline 2019-11-29T20:55:36.987042+0000) 2019-11-29T20:56:11.683 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:56:11.678+0000 1694c700 -1 osd.5 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:54.035872+0000 front 2019-11-29T20:54:53.546829+0000 (oldest deadline 2019-11-29T20:55:35.191256+0000) 2019-11-29T20:56:11.735 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:56:11.729+0000 1694c700 -1 osd.7 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:53.842806+0000 front 2019-11-29T20:54:53.334172+0000 (oldest deadline 2019-11-29T20:55:33.764802+0000) 2019-11-29T20:56:11.770 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:56:11.764+0000 1694c700 -1 osd.1 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:52.155165+0000 front 2019-11-29T20:54:52.150249+0000 (oldest deadline 2019-11-29T20:56:08.617978+0000) 2019-11-29T20:56:11.967 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:56:11.960+0000 1694c700 -1 osd.2 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:54.024703+0000 front 2019-11-29T20:54:53.491222+0000 (oldest deadline 2019-11-29T20:55:38.758293+0000) 2019-11-29T20:56:12.216 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:56:12.210+0000 1694c700 -1 osd.0 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:53.562248+0000 front 2019-11-29T20:54:53.222953+0000 (oldest deadline 2019-11-29T20:55:38.505715+0000) 2019-11-29T20:56:12.431 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:56:12.423+0000 1694c700 -1 osd.4 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:50.992444+0000 front 2019-11-29T20:54:51.048024+0000 (oldest deadline 2019-11-29T20:55:35.026315+0000) 2019-11-29T20:56:12.690 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:56:12.684+0000 1694c700 -1 osd.5 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:54.035872+0000 front 2019-11-29T20:54:53.546829+0000 (oldest deadline 2019-11-29T20:55:35.191256+0000) 2019-11-29T20:56:12.721 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:56:12.713+0000 1694c700 -1 osd.6 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:51.891915+0000 front 2019-11-29T20:54:51.839064+0000 (oldest deadline 2019-11-29T20:55:36.987042+0000) 2019-11-29T20:56:12.729 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:56:12.721+0000 1694c700 -1 osd.7 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:53.842806+0000 front 2019-11-29T20:54:53.334172+0000 (oldest deadline 2019-11-29T20:55:33.764802+0000) 2019-11-29T20:56:12.801 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:56:12.794+0000 1694c700 -1 osd.1 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:52.155165+0000 front 2019-11-29T20:54:52.150249+0000 (oldest deadline 2019-11-29T20:56:08.617978+0000) 2019-11-29T20:56:12.995 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:56:12.990+0000 1694c700 -1 osd.2 219 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:54:54.024703+0000 front 2019-11-29T20:54:53.491222+0000 (oldest deadline 2019-11-29T20:55:38.758293+0000) 2019-11-29T20:56:59.409 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:08:31:40.067 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T20:56:59.450 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:08:31:40.108 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T20:56:59.498 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:08:31:40.105 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T20:56:59.500 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:08:31:40.107 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T20:56:59.501 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:08:31:40.108 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T20:56:59.538 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:08:31:40.145 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T20:56:59.716 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:08:31:40.375 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T20:56:59.765 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:08:31:40.372 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T20:56:59.780 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:08:31:40.387 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T20:57:10.557 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:57:10.552+0000 1694c700 -1 osd.6 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:26.749543+0000 front 2019-11-29T20:56:31.042200+0000 (oldest deadline 2019-11-29T20:57:09.591312+0000) 2019-11-29T20:57:10.790 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:57:10.785+0000 1694c700 -1 osd.2 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:24.655771+0000 front 2019-11-29T20:56:30.497480+0000 (oldest deadline 2019-11-29T20:57:10.026776+0000) 2019-11-29T20:57:10.834 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:57:10.829+0000 1694c700 -1 osd.7 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:25.238947+0000 front 2019-11-29T20:56:25.232554+0000 (oldest deadline 2019-11-29T20:57:10.594155+0000) 2019-11-29T20:57:11.001 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:57:10.994+0000 1694c700 -1 osd.4 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:28.145133+0000 front 2019-11-29T20:56:28.289094+0000 (oldest deadline 2019-11-29T20:57:10.986644+0000) 2019-11-29T20:57:11.569 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:57:11.564+0000 1694c700 -1 osd.6 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:26.749543+0000 front 2019-11-29T20:56:31.042200+0000 (oldest deadline 2019-11-29T20:57:09.591312+0000) 2019-11-29T20:57:11.816 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:57:11.810+0000 1694c700 -1 osd.2 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:24.655771+0000 front 2019-11-29T20:56:30.497480+0000 (oldest deadline 2019-11-29T20:57:10.026776+0000) 2019-11-29T20:57:11.819 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:57:11.814+0000 1694c700 -1 osd.7 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:25.238947+0000 front 2019-11-29T20:56:25.232554+0000 (oldest deadline 2019-11-29T20:57:10.594155+0000) 2019-11-29T20:57:11.966 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:57:11.960+0000 1694c700 -1 osd.0 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:30.602908+0000 front 2019-11-29T20:56:30.339603+0000 (oldest deadline 2019-11-29T20:57:11.646510+0000) 2019-11-29T20:57:12.049 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:57:12.043+0000 1694c700 -1 osd.4 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:28.145133+0000 front 2019-11-29T20:56:28.289094+0000 (oldest deadline 2019-11-29T20:57:10.986644+0000) 2019-11-29T20:57:12.546 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:57:12.540+0000 1694c700 -1 osd.6 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:26.749543+0000 front 2019-11-29T20:56:31.042200+0000 (oldest deadline 2019-11-29T20:57:09.591312+0000) 2019-11-29T20:57:12.822 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:57:12.816+0000 1694c700 -1 osd.2 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:24.655771+0000 front 2019-11-29T20:56:30.497480+0000 (oldest deadline 2019-11-29T20:57:10.026776+0000) 2019-11-29T20:57:12.845 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:57:12.839+0000 1694c700 -1 osd.7 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:25.238947+0000 front 2019-11-29T20:56:25.232554+0000 (oldest deadline 2019-11-29T20:57:10.594155+0000) 2019-11-29T20:57:12.950 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:57:12.944+0000 1694c700 -1 osd.0 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:30.602908+0000 front 2019-11-29T20:56:30.339603+0000 (oldest deadline 2019-11-29T20:57:11.646510+0000) 2019-11-29T20:57:13.108 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:57:13.094+0000 1694c700 -1 osd.4 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:28.145133+0000 front 2019-11-29T20:56:28.289094+0000 (oldest deadline 2019-11-29T20:57:10.986644+0000) 2019-11-29T20:57:13.515 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:57:13.509+0000 1694c700 -1 osd.6 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:26.749543+0000 front 2019-11-29T20:56:31.042200+0000 (oldest deadline 2019-11-29T20:57:09.591312+0000) 2019-11-29T20:57:13.805 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:57:13.798+0000 1694c700 -1 osd.7 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:25.238947+0000 front 2019-11-29T20:56:25.232554+0000 (oldest deadline 2019-11-29T20:57:10.594155+0000) 2019-11-29T20:57:13.833 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:57:13.829+0000 1694c700 -1 osd.2 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:24.655771+0000 front 2019-11-29T20:56:30.497480+0000 (oldest deadline 2019-11-29T20:57:10.026776+0000) 2019-11-29T20:57:13.989 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:57:13.984+0000 1694c700 -1 osd.0 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:30.602908+0000 front 2019-11-29T20:56:30.339603+0000 (oldest deadline 2019-11-29T20:57:11.646510+0000) 2019-11-29T20:57:14.062 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:57:14.055+0000 1694c700 -1 osd.4 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:28.145133+0000 front 2019-11-29T20:56:28.289094+0000 (oldest deadline 2019-11-29T20:57:10.986644+0000) 2019-11-29T20:57:14.538 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:57:14.533+0000 1694c700 -1 osd.6 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:26.749543+0000 front 2019-11-29T20:56:31.042200+0000 (oldest deadline 2019-11-29T20:57:09.591312+0000) 2019-11-29T20:57:14.800 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:57:14.794+0000 1694c700 -1 osd.2 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:24.655771+0000 front 2019-11-29T20:56:30.497480+0000 (oldest deadline 2019-11-29T20:57:10.026776+0000) 2019-11-29T20:57:14.814 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:57:14.809+0000 1694c700 -1 osd.7 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:25.238947+0000 front 2019-11-29T20:56:25.232554+0000 (oldest deadline 2019-11-29T20:57:10.594155+0000) 2019-11-29T20:57:14.950 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:57:14.942+0000 1694c700 -1 osd.0 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:30.602908+0000 front 2019-11-29T20:56:30.339603+0000 (oldest deadline 2019-11-29T20:57:11.646510+0000) 2019-11-29T20:57:15.100 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:57:15.094+0000 1694c700 -1 osd.4 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:28.145133+0000 front 2019-11-29T20:56:28.289094+0000 (oldest deadline 2019-11-29T20:57:10.986644+0000) 2019-11-29T20:57:15.265 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:57:15.258+0000 1694c700 -1 osd.1 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:28.931735+0000 front 2019-11-29T20:56:28.971408+0000 (oldest deadline 2019-11-29T20:57:14.257436+0000) 2019-11-29T20:57:15.500 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:57:15.494+0000 1694c700 -1 osd.6 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:26.749543+0000 front 2019-11-29T20:56:31.042200+0000 (oldest deadline 2019-11-29T20:57:09.591312+0000) 2019-11-29T20:57:15.817 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:57:15.812+0000 1694c700 -1 osd.7 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:25.238947+0000 front 2019-11-29T20:56:25.232554+0000 (oldest deadline 2019-11-29T20:57:10.594155+0000) 2019-11-29T20:57:15.844 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:57:15.837+0000 1694c700 -1 osd.2 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:24.655771+0000 front 2019-11-29T20:56:30.497480+0000 (oldest deadline 2019-11-29T20:57:10.026776+0000) 2019-11-29T20:57:15.952 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:57:15.946+0000 1694c700 -1 osd.0 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:30.602908+0000 front 2019-11-29T20:56:30.339603+0000 (oldest deadline 2019-11-29T20:57:11.646510+0000) 2019-11-29T20:57:16.115 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:57:16.109+0000 1694c700 -1 osd.4 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:28.145133+0000 front 2019-11-29T20:56:28.289094+0000 (oldest deadline 2019-11-29T20:57:10.986644+0000) 2019-11-29T20:57:16.243 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:57:16.237+0000 1694c700 -1 osd.1 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:28.931735+0000 front 2019-11-29T20:56:28.971408+0000 (oldest deadline 2019-11-29T20:57:14.257436+0000) 2019-11-29T20:57:16.507 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:57:16.502+0000 1694c700 -1 osd.6 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:26.749543+0000 front 2019-11-29T20:56:31.042200+0000 (oldest deadline 2019-11-29T20:57:09.591312+0000) 2019-11-29T20:57:16.812 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:57:16.807+0000 1694c700 -1 osd.2 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:24.655771+0000 front 2019-11-29T20:56:30.497480+0000 (oldest deadline 2019-11-29T20:57:10.026776+0000) 2019-11-29T20:57:16.814 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:57:16.809+0000 1694c700 -1 osd.7 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:25.238947+0000 front 2019-11-29T20:56:25.232554+0000 (oldest deadline 2019-11-29T20:57:10.594155+0000) 2019-11-29T20:57:16.991 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:57:16.985+0000 1694c700 -1 osd.0 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:30.602908+0000 front 2019-11-29T20:56:30.339603+0000 (oldest deadline 2019-11-29T20:57:11.646510+0000) 2019-11-29T20:57:17.115 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:57:17.094+0000 1694c700 -1 osd.4 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:28.145133+0000 front 2019-11-29T20:56:28.289094+0000 (oldest deadline 2019-11-29T20:57:10.986644+0000) 2019-11-29T20:57:17.272 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:57:17.266+0000 1694c700 -1 osd.1 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:28.931735+0000 front 2019-11-29T20:56:28.971408+0000 (oldest deadline 2019-11-29T20:57:14.257436+0000) 2019-11-29T20:57:17.499 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:57:17.494+0000 1694c700 -1 osd.6 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:26.749543+0000 front 2019-11-29T20:56:31.042200+0000 (oldest deadline 2019-11-29T20:57:09.591312+0000) 2019-11-29T20:57:17.816 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:57:17.811+0000 1694c700 -1 osd.7 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:25.238947+0000 front 2019-11-29T20:56:25.232554+0000 (oldest deadline 2019-11-29T20:57:10.594155+0000) 2019-11-29T20:57:17.836 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:57:17.831+0000 1694c700 -1 osd.2 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:24.655771+0000 front 2019-11-29T20:56:30.497480+0000 (oldest deadline 2019-11-29T20:57:10.026776+0000) 2019-11-29T20:57:17.960 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:57:17.955+0000 1694c700 -1 osd.0 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:30.602908+0000 front 2019-11-29T20:56:30.339603+0000 (oldest deadline 2019-11-29T20:57:11.646510+0000) 2019-11-29T20:57:18.127 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:57:18.121+0000 1694c700 -1 osd.4 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:28.145133+0000 front 2019-11-29T20:56:28.289094+0000 (oldest deadline 2019-11-29T20:57:10.986644+0000) 2019-11-29T20:57:18.271 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:57:18.265+0000 1694c700 -1 osd.1 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:28.931735+0000 front 2019-11-29T20:56:28.971408+0000 (oldest deadline 2019-11-29T20:57:14.257436+0000) 2019-11-29T20:57:18.508 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:57:18.503+0000 1694c700 -1 osd.6 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:26.749543+0000 front 2019-11-29T20:56:31.042200+0000 (oldest deadline 2019-11-29T20:57:09.591312+0000) 2019-11-29T20:57:18.826 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:57:18.820+0000 1694c700 -1 osd.2 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:24.655771+0000 front 2019-11-29T20:56:30.497480+0000 (oldest deadline 2019-11-29T20:57:10.026776+0000) 2019-11-29T20:57:18.836 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:57:18.831+0000 1694c700 -1 osd.7 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:25.238947+0000 front 2019-11-29T20:56:25.232554+0000 (oldest deadline 2019-11-29T20:57:10.594155+0000) 2019-11-29T20:57:19.014 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:57:19.009+0000 1694c700 -1 osd.0 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:30.602908+0000 front 2019-11-29T20:56:30.339603+0000 (oldest deadline 2019-11-29T20:57:11.646510+0000) 2019-11-29T20:57:19.082 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:57:19.075+0000 1694c700 -1 osd.4 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:28.145133+0000 front 2019-11-29T20:56:28.289094+0000 (oldest deadline 2019-11-29T20:57:10.986644+0000) 2019-11-29T20:57:19.312 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:57:19.306+0000 1694c700 -1 osd.1 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:28.931735+0000 front 2019-11-29T20:56:28.971408+0000 (oldest deadline 2019-11-29T20:57:14.257436+0000) 2019-11-29T20:57:19.473 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:57:19.468+0000 1694c700 -1 osd.6 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:26.749543+0000 front 2019-11-29T20:56:31.042200+0000 (oldest deadline 2019-11-29T20:57:09.591312+0000) 2019-11-29T20:57:19.801 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:57:19.796+0000 1694c700 -1 osd.2 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:24.655771+0000 front 2019-11-29T20:56:30.497480+0000 (oldest deadline 2019-11-29T20:57:10.026776+0000) 2019-11-29T20:57:19.825 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:57:19.820+0000 1694c700 -1 osd.7 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:25.238947+0000 front 2019-11-29T20:56:25.232554+0000 (oldest deadline 2019-11-29T20:57:10.594155+0000) 2019-11-29T20:57:20.026 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:57:20.018+0000 1694c700 -1 osd.0 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:30.602908+0000 front 2019-11-29T20:56:30.339603+0000 (oldest deadline 2019-11-29T20:57:11.646510+0000) 2019-11-29T20:57:20.130 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:57:20.124+0000 1694c700 -1 osd.4 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:28.145133+0000 front 2019-11-29T20:56:28.289094+0000 (oldest deadline 2019-11-29T20:57:10.986644+0000) 2019-11-29T20:57:20.325 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:57:20.319+0000 1694c700 -1 osd.1 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:28.931735+0000 front 2019-11-29T20:56:28.971408+0000 (oldest deadline 2019-11-29T20:57:14.257436+0000) 2019-11-29T20:57:20.459 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:57:20.454+0000 1694c700 -1 osd.6 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:26.749543+0000 front 2019-11-29T20:56:31.042200+0000 (oldest deadline 2019-11-29T20:57:09.591312+0000) 2019-11-29T20:57:20.808 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:57:20.799+0000 1694c700 -1 osd.7 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:25.238947+0000 front 2019-11-29T20:56:25.232554+0000 (oldest deadline 2019-11-29T20:57:10.594155+0000) 2019-11-29T20:57:20.853 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:57:20.848+0000 1694c700 -1 osd.2 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:24.655771+0000 front 2019-11-29T20:56:30.497480+0000 (oldest deadline 2019-11-29T20:57:10.026776+0000) 2019-11-29T20:57:21.001 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:57:20.994+0000 1694c700 -1 osd.0 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:30.602908+0000 front 2019-11-29T20:56:30.339603+0000 (oldest deadline 2019-11-29T20:57:11.646510+0000) 2019-11-29T20:57:21.136 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:57:21.131+0000 1694c700 -1 osd.4 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:28.145133+0000 front 2019-11-29T20:56:28.289094+0000 (oldest deadline 2019-11-29T20:57:10.986644+0000) 2019-11-29T20:57:21.335 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:57:21.330+0000 1694c700 -1 osd.1 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:28.931735+0000 front 2019-11-29T20:56:28.971408+0000 (oldest deadline 2019-11-29T20:57:14.257436+0000) 2019-11-29T20:57:21.413 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:57:21.408+0000 1694c700 -1 osd.6 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:26.749543+0000 front 2019-11-29T20:56:31.042200+0000 (oldest deadline 2019-11-29T20:57:09.591312+0000) 2019-11-29T20:57:21.837 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:57:21.833+0000 1694c700 -1 osd.2 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:24.655771+0000 front 2019-11-29T20:56:30.497480+0000 (oldest deadline 2019-11-29T20:57:10.026776+0000) 2019-11-29T20:57:21.859 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:57:21.853+0000 1694c700 -1 osd.7 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:25.238947+0000 front 2019-11-29T20:56:25.232554+0000 (oldest deadline 2019-11-29T20:57:10.594155+0000) 2019-11-29T20:57:22.039 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:57:22.033+0000 1694c700 -1 osd.0 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:30.602908+0000 front 2019-11-29T20:56:30.339603+0000 (oldest deadline 2019-11-29T20:57:11.646510+0000) 2019-11-29T20:57:22.145 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:57:22.140+0000 1694c700 -1 osd.4 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:28.145133+0000 front 2019-11-29T20:56:28.289094+0000 (oldest deadline 2019-11-29T20:57:10.986644+0000) 2019-11-29T20:57:22.327 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:57:22.321+0000 1694c700 -1 osd.1 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:28.931735+0000 front 2019-11-29T20:56:28.971408+0000 (oldest deadline 2019-11-29T20:57:14.257436+0000) 2019-11-29T20:57:22.439 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:57:22.432+0000 1694c700 -1 osd.6 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:26.749543+0000 front 2019-11-29T20:56:31.042200+0000 (oldest deadline 2019-11-29T20:57:09.591312+0000) 2019-11-29T20:57:22.875 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:57:22.870+0000 1694c700 -1 osd.7 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:25.238947+0000 front 2019-11-29T20:56:25.232554+0000 (oldest deadline 2019-11-29T20:57:10.594155+0000) 2019-11-29T20:57:22.879 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:57:22.871+0000 1694c700 -1 osd.2 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:24.655771+0000 front 2019-11-29T20:56:30.497480+0000 (oldest deadline 2019-11-29T20:57:10.026776+0000) 2019-11-29T20:57:23.055 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:57:23.049+0000 1694c700 -1 osd.0 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:30.602908+0000 front 2019-11-29T20:56:30.339603+0000 (oldest deadline 2019-11-29T20:57:11.646510+0000) 2019-11-29T20:57:23.140 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:57:23.134+0000 1694c700 -1 osd.4 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:28.145133+0000 front 2019-11-29T20:56:28.289094+0000 (oldest deadline 2019-11-29T20:57:10.986644+0000) 2019-11-29T20:57:23.377 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:57:23.372+0000 1694c700 -1 osd.1 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:28.931735+0000 front 2019-11-29T20:56:28.971408+0000 (oldest deadline 2019-11-29T20:57:14.257436+0000) 2019-11-29T20:57:23.427 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:57:23.421+0000 1694c700 -1 osd.6 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:26.749543+0000 front 2019-11-29T20:56:31.042200+0000 (oldest deadline 2019-11-29T20:57:09.591312+0000) 2019-11-29T20:57:23.892 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:57:23.886+0000 1694c700 -1 osd.7 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:25.238947+0000 front 2019-11-29T20:56:25.232554+0000 (oldest deadline 2019-11-29T20:57:10.594155+0000) 2019-11-29T20:57:23.917 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:57:23.912+0000 1694c700 -1 osd.2 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:24.655771+0000 front 2019-11-29T20:56:30.497480+0000 (oldest deadline 2019-11-29T20:57:10.026776+0000) 2019-11-29T20:57:24.102 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:57:24.097+0000 1694c700 -1 osd.0 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:30.602908+0000 front 2019-11-29T20:56:30.339603+0000 (oldest deadline 2019-11-29T20:57:11.646510+0000) 2019-11-29T20:57:24.186 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:57:24.180+0000 1694c700 -1 osd.4 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:28.145133+0000 front 2019-11-29T20:56:28.289094+0000 (oldest deadline 2019-11-29T20:57:10.986644+0000) 2019-11-29T20:57:24.403 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:57:24.391+0000 1694c700 -1 osd.1 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:28.931735+0000 front 2019-11-29T20:56:28.971408+0000 (oldest deadline 2019-11-29T20:57:14.257436+0000) 2019-11-29T20:57:24.435 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:57:24.429+0000 1694c700 -1 osd.6 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:26.749543+0000 front 2019-11-29T20:56:31.042200+0000 (oldest deadline 2019-11-29T20:57:09.591312+0000) 2019-11-29T20:57:24.883 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:57:24.878+0000 1694c700 -1 osd.2 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:24.655771+0000 front 2019-11-29T20:56:30.497480+0000 (oldest deadline 2019-11-29T20:57:10.026776+0000) 2019-11-29T20:57:24.900 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:57:24.895+0000 1694c700 -1 osd.7 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:25.238947+0000 front 2019-11-29T20:56:25.232554+0000 (oldest deadline 2019-11-29T20:57:10.594155+0000) 2019-11-29T20:57:25.122 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:57:25.117+0000 1694c700 -1 osd.0 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:30.602908+0000 front 2019-11-29T20:56:30.339603+0000 (oldest deadline 2019-11-29T20:57:11.646510+0000) 2019-11-29T20:57:25.188 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:57:25.183+0000 1694c700 -1 osd.4 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:28.145133+0000 front 2019-11-29T20:56:28.289094+0000 (oldest deadline 2019-11-29T20:57:10.986644+0000) 2019-11-29T20:57:25.347 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:57:25.341+0000 1694c700 -1 osd.3 225 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4331.0:129962 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e223) 2019-11-29T20:57:25.395 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:57:25.390+0000 1694c700 -1 osd.1 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:28.931735+0000 front 2019-11-29T20:56:28.971408+0000 (oldest deadline 2019-11-29T20:57:14.257436+0000) 2019-11-29T20:57:25.458 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:57:25.452+0000 1694c700 -1 osd.6 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:26.749543+0000 front 2019-11-29T20:56:31.042200+0000 (oldest deadline 2019-11-29T20:57:09.591312+0000) 2019-11-29T20:57:25.694 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:08:32:06.353 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T20:57:25.704 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:08:32:06.362 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T20:57:25.708 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:08:32:06.315 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T20:57:25.710 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:08:32:06.317 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T20:57:25.712 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:08:32:06.319 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T20:57:25.716 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:08:32:06.323 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T20:57:25.770 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:08:32:06.377 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T20:57:25.776 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:08:32:06.434 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T20:57:25.777 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:08:32:06.384 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T20:57:25.885 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:57:25.879+0000 1694c700 -1 osd.7 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:25.238947+0000 front 2019-11-29T20:56:25.232554+0000 (oldest deadline 2019-11-29T20:57:10.594155+0000) 2019-11-29T20:57:25.901 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:57:25.894+0000 1694c700 -1 osd.2 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:24.655771+0000 front 2019-11-29T20:56:30.497480+0000 (oldest deadline 2019-11-29T20:57:10.026776+0000) 2019-11-29T20:57:26.135 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:57:26.130+0000 1694c700 -1 osd.0 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:30.602908+0000 front 2019-11-29T20:56:30.339603+0000 (oldest deadline 2019-11-29T20:57:11.646510+0000) 2019-11-29T20:57:26.152 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:57:26.146+0000 1694c700 -1 osd.4 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:28.145133+0000 front 2019-11-29T20:56:28.289094+0000 (oldest deadline 2019-11-29T20:57:10.986644+0000) 2019-11-29T20:57:26.321 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:57:26.317+0000 1694c700 -1 osd.3 225 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4331.0:129962 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e223) 2019-11-29T20:57:26.445 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:57:26.440+0000 1694c700 -1 osd.1 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:28.931735+0000 front 2019-11-29T20:56:28.971408+0000 (oldest deadline 2019-11-29T20:57:14.257436+0000) 2019-11-29T20:57:26.512 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:57:26.503+0000 1694c700 -1 osd.6 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:26.749543+0000 front 2019-11-29T20:56:31.042200+0000 (oldest deadline 2019-11-29T20:57:09.591312+0000) 2019-11-29T20:57:26.859 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:57:26.855+0000 1694c700 -1 osd.7 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:25.238947+0000 front 2019-11-29T20:56:25.232554+0000 (oldest deadline 2019-11-29T20:57:10.594155+0000) 2019-11-29T20:57:26.928 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:57:26.923+0000 1694c700 -1 osd.2 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:24.655771+0000 front 2019-11-29T20:56:30.497480+0000 (oldest deadline 2019-11-29T20:57:10.026776+0000) 2019-11-29T20:57:27.122 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:57:27.118+0000 1694c700 -1 osd.4 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:28.145133+0000 front 2019-11-29T20:56:28.289094+0000 (oldest deadline 2019-11-29T20:57:10.986644+0000) 2019-11-29T20:57:27.124 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:57:27.120+0000 1694c700 -1 osd.0 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:30.602908+0000 front 2019-11-29T20:56:30.339603+0000 (oldest deadline 2019-11-29T20:57:11.646510+0000) 2019-11-29T20:57:27.312 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:57:27.303+0000 1694c700 -1 osd.3 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:56:46.977517+0000 (oldest deadline 2019-11-29T20:57:26.977517+0000) 2019-11-29T20:57:27.313 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:57:27.306+0000 1694c700 -1 osd.3 225 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4331.0:129962 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e223) 2019-11-29T20:57:27.428 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:57:27.423+0000 1694c700 -1 osd.1 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:28.931735+0000 front 2019-11-29T20:56:28.971408+0000 (oldest deadline 2019-11-29T20:57:14.257436+0000) 2019-11-29T20:57:27.468 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:57:27.462+0000 1694c700 -1 osd.6 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:26.749543+0000 front 2019-11-29T20:56:31.042200+0000 (oldest deadline 2019-11-29T20:57:09.591312+0000) 2019-11-29T20:57:27.852 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:57:27.842+0000 1694c700 -1 osd.7 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:25.238947+0000 front 2019-11-29T20:56:25.232554+0000 (oldest deadline 2019-11-29T20:57:10.594155+0000) 2019-11-29T20:57:27.942 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:57:27.937+0000 1694c700 -1 osd.2 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:24.655771+0000 front 2019-11-29T20:56:30.497480+0000 (oldest deadline 2019-11-29T20:57:10.026776+0000) 2019-11-29T20:57:28.106 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:57:28.100+0000 1694c700 -1 osd.4 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:28.145133+0000 front 2019-11-29T20:56:28.289094+0000 (oldest deadline 2019-11-29T20:57:10.986644+0000) 2019-11-29T20:57:28.143 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:57:28.138+0000 1694c700 -1 osd.0 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:30.602908+0000 front 2019-11-29T20:56:30.339603+0000 (oldest deadline 2019-11-29T20:57:11.646510+0000) 2019-11-29T20:57:28.288 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:57:28.278+0000 1694c700 -1 osd.3 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:56:46.977517+0000 (oldest deadline 2019-11-29T20:57:26.977517+0000) 2019-11-29T20:57:28.288 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:57:28.280+0000 1694c700 -1 osd.3 225 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4331.0:129962 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e223) 2019-11-29T20:57:28.430 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:57:28.423+0000 1694c700 -1 osd.1 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:28.931735+0000 front 2019-11-29T20:56:28.971408+0000 (oldest deadline 2019-11-29T20:57:14.257436+0000) 2019-11-29T20:57:28.487 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:57:28.482+0000 1694c700 -1 osd.6 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:26.749543+0000 front 2019-11-29T20:56:31.042200+0000 (oldest deadline 2019-11-29T20:57:09.591312+0000) 2019-11-29T20:57:28.805 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:57:28.799+0000 1694c700 -1 osd.7 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:25.238947+0000 front 2019-11-29T20:56:25.232554+0000 (oldest deadline 2019-11-29T20:57:10.594155+0000) 2019-11-29T20:57:28.980 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:57:28.974+0000 1694c700 -1 osd.2 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:24.655771+0000 front 2019-11-29T20:56:30.497480+0000 (oldest deadline 2019-11-29T20:57:10.026776+0000) 2019-11-29T20:57:29.149 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:57:29.143+0000 1694c700 -1 osd.4 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:28.145133+0000 front 2019-11-29T20:56:28.289094+0000 (oldest deadline 2019-11-29T20:57:10.986644+0000) 2019-11-29T20:57:29.155 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:57:29.149+0000 1694c700 -1 osd.0 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:30.602908+0000 front 2019-11-29T20:56:30.339603+0000 (oldest deadline 2019-11-29T20:57:11.646510+0000) 2019-11-29T20:57:29.257 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:57:29.249+0000 1694c700 -1 osd.3 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:56:46.977517+0000 (oldest deadline 2019-11-29T20:57:26.977517+0000) 2019-11-29T20:57:29.258 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:57:29.251+0000 1694c700 -1 osd.3 225 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4331.0:129962 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e223) 2019-11-29T20:57:29.446 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:57:29.440+0000 1694c700 -1 osd.1 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:28.931735+0000 front 2019-11-29T20:56:28.971408+0000 (oldest deadline 2019-11-29T20:57:14.257436+0000) 2019-11-29T20:57:29.469 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:57:29.463+0000 1694c700 -1 osd.6 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:26.749543+0000 front 2019-11-29T20:56:31.042200+0000 (oldest deadline 2019-11-29T20:57:09.591312+0000) 2019-11-29T20:57:29.842 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:57:29.836+0000 1694c700 -1 osd.7 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:25.238947+0000 front 2019-11-29T20:56:25.232554+0000 (oldest deadline 2019-11-29T20:57:10.594155+0000) 2019-11-29T20:57:30.005 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:57:29.998+0000 1694c700 -1 osd.2 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:24.655771+0000 front 2019-11-29T20:56:30.497480+0000 (oldest deadline 2019-11-29T20:57:10.026776+0000) 2019-11-29T20:57:30.128 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:57:30.123+0000 1694c700 -1 osd.0 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:30.602908+0000 front 2019-11-29T20:56:30.339603+0000 (oldest deadline 2019-11-29T20:57:11.646510+0000) 2019-11-29T20:57:30.154 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:57:30.147+0000 1694c700 -1 osd.4 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:28.145133+0000 front 2019-11-29T20:56:28.289094+0000 (oldest deadline 2019-11-29T20:57:10.986644+0000) 2019-11-29T20:57:30.303 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:57:30.297+0000 1694c700 -1 osd.3 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:56:46.977517+0000 (oldest deadline 2019-11-29T20:57:26.977517+0000) 2019-11-29T20:57:30.303 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:57:30.298+0000 1694c700 -1 osd.3 225 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4331.0:129962 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e223) 2019-11-29T20:57:30.447 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:57:30.440+0000 1694c700 -1 osd.1 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:28.931735+0000 front 2019-11-29T20:56:28.971408+0000 (oldest deadline 2019-11-29T20:57:14.257436+0000) 2019-11-29T20:57:30.468 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:57:30.462+0000 1694c700 -1 osd.6 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:26.749543+0000 front 2019-11-29T20:56:31.042200+0000 (oldest deadline 2019-11-29T20:57:09.591312+0000) 2019-11-29T20:57:30.799 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:57:30.793+0000 1694c700 -1 osd.7 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:25.238947+0000 front 2019-11-29T20:56:25.232554+0000 (oldest deadline 2019-11-29T20:57:10.594155+0000) 2019-11-29T20:57:30.981 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:57:30.974+0000 1694c700 -1 osd.2 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:24.655771+0000 front 2019-11-29T20:56:30.497480+0000 (oldest deadline 2019-11-29T20:57:10.026776+0000) 2019-11-29T20:57:31.105 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:57:31.100+0000 1694c700 -1 osd.0 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:30.602908+0000 front 2019-11-29T20:56:30.339603+0000 (oldest deadline 2019-11-29T20:57:11.646510+0000) 2019-11-29T20:57:31.145 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:57:31.138+0000 1694c700 -1 osd.4 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:28.145133+0000 front 2019-11-29T20:56:28.289094+0000 (oldest deadline 2019-11-29T20:57:10.986644+0000) 2019-11-29T20:57:31.318 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:57:31.313+0000 1694c700 -1 osd.3 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:56:46.977517+0000 (oldest deadline 2019-11-29T20:57:26.977517+0000) 2019-11-29T20:57:31.321 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:57:31.317+0000 1694c700 -1 osd.3 225 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4331.0:129962 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e223) 2019-11-29T20:57:31.438 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:57:31.433+0000 1694c700 -1 osd.1 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:28.931735+0000 front 2019-11-29T20:56:28.971408+0000 (oldest deadline 2019-11-29T20:57:14.257436+0000) 2019-11-29T20:57:31.470 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:57:31.464+0000 1694c700 -1 osd.6 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:26.749543+0000 front 2019-11-29T20:56:31.042200+0000 (oldest deadline 2019-11-29T20:57:09.591312+0000) 2019-11-29T20:57:31.807 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:57:31.801+0000 1694c700 -1 osd.7 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:25.238947+0000 front 2019-11-29T20:56:25.232554+0000 (oldest deadline 2019-11-29T20:57:10.594155+0000) 2019-11-29T20:57:32.020 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:57:32.014+0000 1694c700 -1 osd.2 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:24.655771+0000 front 2019-11-29T20:56:30.497480+0000 (oldest deadline 2019-11-29T20:57:10.026776+0000) 2019-11-29T20:57:32.110 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:57:32.104+0000 1694c700 -1 osd.4 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:28.145133+0000 front 2019-11-29T20:56:28.289094+0000 (oldest deadline 2019-11-29T20:57:10.986644+0000) 2019-11-29T20:57:32.135 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:57:32.130+0000 1694c700 -1 osd.0 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:30.602908+0000 front 2019-11-29T20:56:30.339603+0000 (oldest deadline 2019-11-29T20:57:11.646510+0000) 2019-11-29T20:57:32.318 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:57:32.312+0000 1694c700 -1 osd.3 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:56:46.977517+0000 (oldest deadline 2019-11-29T20:57:26.977517+0000) 2019-11-29T20:57:32.319 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:57:32.313+0000 1694c700 -1 osd.3 225 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4331.0:129962 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e223) 2019-11-29T20:57:32.486 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:57:32.480+0000 1694c700 -1 osd.1 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:28.931735+0000 front 2019-11-29T20:56:28.971408+0000 (oldest deadline 2019-11-29T20:57:14.257436+0000) 2019-11-29T20:57:32.490 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:57:32.483+0000 1694c700 -1 osd.6 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:26.749543+0000 front 2019-11-29T20:56:31.042200+0000 (oldest deadline 2019-11-29T20:57:09.591312+0000) 2019-11-29T20:57:32.831 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:57:32.825+0000 1694c700 -1 osd.7 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:25.238947+0000 front 2019-11-29T20:56:25.232554+0000 (oldest deadline 2019-11-29T20:57:10.594155+0000) 2019-11-29T20:57:33.053 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:57:33.048+0000 1694c700 -1 osd.2 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:24.655771+0000 front 2019-11-29T20:56:30.497480+0000 (oldest deadline 2019-11-29T20:57:10.026776+0000) 2019-11-29T20:57:33.072 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:57:33.065+0000 1694c700 -1 osd.4 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:28.145133+0000 front 2019-11-29T20:56:28.289094+0000 (oldest deadline 2019-11-29T20:57:10.986644+0000) 2019-11-29T20:57:33.190 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:57:33.185+0000 1694c700 -1 osd.0 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:30.602908+0000 front 2019-11-29T20:56:30.339603+0000 (oldest deadline 2019-11-29T20:57:11.646510+0000) 2019-11-29T20:57:33.344 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:57:33.337+0000 1694c700 -1 osd.3 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:56:46.977517+0000 (oldest deadline 2019-11-29T20:57:26.977517+0000) 2019-11-29T20:57:33.348 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:57:33.339+0000 1694c700 -1 osd.3 225 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4331.0:129962 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e223) 2019-11-29T20:57:33.505 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:57:33.499+0000 1694c700 -1 osd.6 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:26.749543+0000 front 2019-11-29T20:56:31.042200+0000 (oldest deadline 2019-11-29T20:57:09.591312+0000) 2019-11-29T20:57:33.513 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:57:33.507+0000 1694c700 -1 osd.1 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:28.931735+0000 front 2019-11-29T20:56:28.971408+0000 (oldest deadline 2019-11-29T20:57:14.257436+0000) 2019-11-29T20:57:33.824 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:57:33.818+0000 1694c700 -1 osd.7 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:25.238947+0000 front 2019-11-29T20:56:25.232554+0000 (oldest deadline 2019-11-29T20:57:10.594155+0000) 2019-11-29T20:57:34.011 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:57:34.005+0000 1694c700 -1 osd.2 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:24.655771+0000 front 2019-11-29T20:56:30.497480+0000 (oldest deadline 2019-11-29T20:57:10.026776+0000) 2019-11-29T20:57:34.120 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:57:34.112+0000 1694c700 -1 osd.4 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:28.145133+0000 front 2019-11-29T20:56:28.289094+0000 (oldest deadline 2019-11-29T20:57:10.986644+0000) 2019-11-29T20:57:34.240 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:57:34.234+0000 1694c700 -1 osd.0 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:30.602908+0000 front 2019-11-29T20:56:30.339603+0000 (oldest deadline 2019-11-29T20:57:11.646510+0000) 2019-11-29T20:57:34.306 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:57:34.299+0000 1694c700 -1 osd.3 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:56:46.977517+0000 (oldest deadline 2019-11-29T20:57:26.977517+0000) 2019-11-29T20:57:34.308 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:57:34.301+0000 1694c700 -1 osd.3 225 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4331.0:129962 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e223) 2019-11-29T20:57:34.483 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:57:34.479+0000 1694c700 -1 osd.1 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:28.931735+0000 front 2019-11-29T20:56:28.971408+0000 (oldest deadline 2019-11-29T20:57:14.257436+0000) 2019-11-29T20:57:34.529 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:57:34.519+0000 1694c700 -1 osd.6 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:26.749543+0000 front 2019-11-29T20:56:31.042200+0000 (oldest deadline 2019-11-29T20:57:09.591312+0000) 2019-11-29T20:57:34.816 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:57:34.810+0000 1694c700 -1 osd.7 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:25.238947+0000 front 2019-11-29T20:56:25.232554+0000 (oldest deadline 2019-11-29T20:57:10.594155+0000) 2019-11-29T20:57:35.024 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:57:35.019+0000 1694c700 -1 osd.2 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:24.655771+0000 front 2019-11-29T20:56:30.497480+0000 (oldest deadline 2019-11-29T20:57:10.026776+0000) 2019-11-29T20:57:35.090 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:57:35.084+0000 1694c700 -1 osd.4 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:28.145133+0000 front 2019-11-29T20:56:28.289094+0000 (oldest deadline 2019-11-29T20:57:10.986644+0000) 2019-11-29T20:57:35.271 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:57:35.265+0000 1694c700 -1 osd.0 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:30.602908+0000 front 2019-11-29T20:56:30.339603+0000 (oldest deadline 2019-11-29T20:57:11.646510+0000) 2019-11-29T20:57:35.313 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:57:35.306+0000 1694c700 -1 osd.3 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:56:46.977517+0000 (oldest deadline 2019-11-29T20:57:26.977517+0000) 2019-11-29T20:57:35.314 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:57:35.308+0000 1694c700 -1 osd.3 225 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4331.0:129962 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e223) 2019-11-29T20:57:35.453 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:57:35.447+0000 1694c700 -1 osd.1 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:28.931735+0000 front 2019-11-29T20:56:28.971408+0000 (oldest deadline 2019-11-29T20:57:14.257436+0000) 2019-11-29T20:57:35.564 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:57:35.558+0000 1694c700 -1 osd.6 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:26.749543+0000 front 2019-11-29T20:56:31.042200+0000 (oldest deadline 2019-11-29T20:57:09.591312+0000) 2019-11-29T20:57:35.811 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:57:35.805+0000 1694c700 -1 osd.7 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:25.238947+0000 front 2019-11-29T20:56:25.232554+0000 (oldest deadline 2019-11-29T20:57:10.594155+0000) 2019-11-29T20:57:36.067 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:57:36.061+0000 1694c700 -1 osd.2 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:24.655771+0000 front 2019-11-29T20:56:30.497480+0000 (oldest deadline 2019-11-29T20:57:10.026776+0000) 2019-11-29T20:57:36.083 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:57:36.077+0000 1694c700 -1 osd.4 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:28.145133+0000 front 2019-11-29T20:56:28.289094+0000 (oldest deadline 2019-11-29T20:57:10.986644+0000) 2019-11-29T20:57:36.305 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:57:36.300+0000 1694c700 -1 osd.0 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:30.602908+0000 front 2019-11-29T20:56:30.339603+0000 (oldest deadline 2019-11-29T20:57:11.646510+0000) 2019-11-29T20:57:36.333 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:57:36.328+0000 1694c700 -1 osd.3 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:56:46.977517+0000 (oldest deadline 2019-11-29T20:57:26.977517+0000) 2019-11-29T20:57:36.334 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:57:36.329+0000 1694c700 -1 osd.3 225 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4331.0:129962 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e223) 2019-11-29T20:57:36.431 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:57:36.422+0000 1694c700 -1 osd.1 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:28.931735+0000 front 2019-11-29T20:56:28.971408+0000 (oldest deadline 2019-11-29T20:57:14.257436+0000) 2019-11-29T20:57:36.572 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:57:36.565+0000 1694c700 -1 osd.6 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:26.749543+0000 front 2019-11-29T20:56:31.042200+0000 (oldest deadline 2019-11-29T20:57:09.591312+0000) 2019-11-29T20:57:36.782 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:57:36.776+0000 1694c700 -1 osd.7 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:25.238947+0000 front 2019-11-29T20:56:25.232554+0000 (oldest deadline 2019-11-29T20:57:10.594155+0000) 2019-11-29T20:57:37.028 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:57:37.022+0000 1694c700 -1 osd.2 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:24.655771+0000 front 2019-11-29T20:56:30.497480+0000 (oldest deadline 2019-11-29T20:57:10.026776+0000) 2019-11-29T20:57:37.056 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:57:37.050+0000 1694c700 -1 osd.4 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:28.145133+0000 front 2019-11-29T20:56:28.289094+0000 (oldest deadline 2019-11-29T20:57:10.986644+0000) 2019-11-29T20:57:37.267 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:57:37.261+0000 1694c700 -1 osd.0 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:30.602908+0000 front 2019-11-29T20:56:30.339603+0000 (oldest deadline 2019-11-29T20:57:11.646510+0000) 2019-11-29T20:57:37.354 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:57:37.347+0000 1694c700 -1 osd.3 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:56:46.977517+0000 (oldest deadline 2019-11-29T20:57:26.977517+0000) 2019-11-29T20:57:37.354 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:57:37.349+0000 1694c700 -1 osd.3 225 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4331.0:129962 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e223) 2019-11-29T20:57:37.406 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:57:37.401+0000 1694c700 -1 osd.1 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:28.931735+0000 front 2019-11-29T20:56:28.971408+0000 (oldest deadline 2019-11-29T20:57:14.257436+0000) 2019-11-29T20:57:37.527 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:57:37.520+0000 1694c700 -1 osd.6 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:26.749543+0000 front 2019-11-29T20:56:31.042200+0000 (oldest deadline 2019-11-29T20:57:09.591312+0000) 2019-11-29T20:57:37.837 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:57:37.826+0000 1694c700 -1 osd.7 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:25.238947+0000 front 2019-11-29T20:56:25.232554+0000 (oldest deadline 2019-11-29T20:57:10.594155+0000) 2019-11-29T20:57:38.037 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:57:38.027+0000 1694c700 -1 osd.4 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:28.145133+0000 front 2019-11-29T20:56:28.289094+0000 (oldest deadline 2019-11-29T20:57:10.986644+0000) 2019-11-29T20:57:38.167 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:57:38.072+0000 1694c700 -1 osd.2 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:24.655771+0000 front 2019-11-29T20:56:30.497480+0000 (oldest deadline 2019-11-29T20:57:10.026776+0000) 2019-11-29T20:57:38.306 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:57:38.301+0000 1694c700 -1 osd.0 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:30.602908+0000 front 2019-11-29T20:56:30.339603+0000 (oldest deadline 2019-11-29T20:57:11.646510+0000) 2019-11-29T20:57:38.340 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:57:38.333+0000 1694c700 -1 osd.3 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:56:46.977517+0000 (oldest deadline 2019-11-29T20:57:26.977517+0000) 2019-11-29T20:57:38.341 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:57:38.335+0000 1694c700 -1 osd.3 225 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4331.0:129962 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e223) 2019-11-29T20:57:38.432 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:57:38.426+0000 1694c700 -1 osd.1 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:28.931735+0000 front 2019-11-29T20:56:28.971408+0000 (oldest deadline 2019-11-29T20:57:14.257436+0000) 2019-11-29T20:57:38.558 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:57:38.552+0000 1694c700 -1 osd.6 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:26.749543+0000 front 2019-11-29T20:56:31.042200+0000 (oldest deadline 2019-11-29T20:57:09.591312+0000) 2019-11-29T20:57:38.789 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:57:38.783+0000 1694c700 -1 osd.7 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:25.238947+0000 front 2019-11-29T20:56:25.232554+0000 (oldest deadline 2019-11-29T20:57:10.594155+0000) 2019-11-29T20:57:39.083 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:57:39.077+0000 1694c700 -1 osd.4 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:28.145133+0000 front 2019-11-29T20:56:28.289094+0000 (oldest deadline 2019-11-29T20:57:10.986644+0000) 2019-11-29T20:57:39.115 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:57:39.110+0000 1694c700 -1 osd.2 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:24.655771+0000 front 2019-11-29T20:56:30.497480+0000 (oldest deadline 2019-11-29T20:57:10.026776+0000) 2019-11-29T20:57:39.305 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:57:39.299+0000 1694c700 -1 osd.0 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:30.602908+0000 front 2019-11-29T20:56:30.339603+0000 (oldest deadline 2019-11-29T20:57:11.646510+0000) 2019-11-29T20:57:39.371 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:57:39.365+0000 1694c700 -1 osd.3 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:56:46.977517+0000 (oldest deadline 2019-11-29T20:57:26.977517+0000) 2019-11-29T20:57:39.372 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:57:39.367+0000 1694c700 -1 osd.3 225 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4331.0:129962 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e223) 2019-11-29T20:57:39.401 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:57:39.396+0000 1694c700 -1 osd.1 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:28.931735+0000 front 2019-11-29T20:56:28.971408+0000 (oldest deadline 2019-11-29T20:57:14.257436+0000) 2019-11-29T20:57:39.597 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:57:39.591+0000 1694c700 -1 osd.6 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:26.749543+0000 front 2019-11-29T20:56:31.042200+0000 (oldest deadline 2019-11-29T20:57:09.591312+0000) 2019-11-29T20:57:39.840 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:57:39.832+0000 1694c700 -1 osd.7 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:25.238947+0000 front 2019-11-29T20:56:25.232554+0000 (oldest deadline 2019-11-29T20:57:10.594155+0000) 2019-11-29T20:57:40.097 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:57:40.090+0000 1694c700 -1 osd.4 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:28.145133+0000 front 2019-11-29T20:56:28.289094+0000 (oldest deadline 2019-11-29T20:57:10.986644+0000) 2019-11-29T20:57:40.160 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:57:40.154+0000 1694c700 -1 osd.2 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:24.655771+0000 front 2019-11-29T20:56:30.497480+0000 (oldest deadline 2019-11-29T20:57:10.026776+0000) 2019-11-29T20:57:40.356 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:57:40.348+0000 1694c700 -1 osd.0 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:30.602908+0000 front 2019-11-29T20:56:30.339603+0000 (oldest deadline 2019-11-29T20:57:11.646510+0000) 2019-11-29T20:57:40.376 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:57:40.369+0000 1694c700 -1 osd.3 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:56:46.977517+0000 (oldest deadline 2019-11-29T20:57:26.977517+0000) 2019-11-29T20:57:40.376 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:57:40.371+0000 1694c700 -1 osd.3 225 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4331.0:129962 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e223) 2019-11-29T20:57:40.402 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:57:40.397+0000 1694c700 -1 osd.1 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:28.931735+0000 front 2019-11-29T20:56:28.971408+0000 (oldest deadline 2019-11-29T20:57:14.257436+0000) 2019-11-29T20:57:40.573 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:57:40.562+0000 1694c700 -1 osd.6 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:26.749543+0000 front 2019-11-29T20:56:31.042200+0000 (oldest deadline 2019-11-29T20:57:09.591312+0000) 2019-11-29T20:57:40.867 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:57:40.861+0000 1694c700 -1 osd.7 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:25.238947+0000 front 2019-11-29T20:56:25.232554+0000 (oldest deadline 2019-11-29T20:57:10.594155+0000) 2019-11-29T20:57:41.107 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:57:41.102+0000 1694c700 -1 osd.4 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:28.145133+0000 front 2019-11-29T20:56:28.289094+0000 (oldest deadline 2019-11-29T20:57:10.986644+0000) 2019-11-29T20:57:41.168 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:57:41.163+0000 1694c700 -1 osd.2 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:24.655771+0000 front 2019-11-29T20:56:30.497480+0000 (oldest deadline 2019-11-29T20:57:10.026776+0000) 2019-11-29T20:57:41.352 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:57:41.347+0000 1694c700 -1 osd.3 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:56:46.977517+0000 (oldest deadline 2019-11-29T20:57:26.977517+0000) 2019-11-29T20:57:41.355 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:57:41.350+0000 1694c700 -1 osd.3 225 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4331.0:129962 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e223) 2019-11-29T20:57:41.391 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:57:41.386+0000 1694c700 -1 osd.0 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:30.602908+0000 front 2019-11-29T20:56:30.339603+0000 (oldest deadline 2019-11-29T20:57:11.646510+0000) 2019-11-29T20:57:41.419 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:57:41.414+0000 1694c700 -1 osd.1 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:28.931735+0000 front 2019-11-29T20:56:28.971408+0000 (oldest deadline 2019-11-29T20:57:14.257436+0000) 2019-11-29T20:57:41.613 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:57:41.607+0000 1694c700 -1 osd.6 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:26.749543+0000 front 2019-11-29T20:56:31.042200+0000 (oldest deadline 2019-11-29T20:57:09.591312+0000) 2019-11-29T20:57:41.888 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:57:41.881+0000 1694c700 -1 osd.7 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:25.238947+0000 front 2019-11-29T20:56:25.232554+0000 (oldest deadline 2019-11-29T20:57:10.594155+0000) 2019-11-29T20:57:42.122 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:57:42.118+0000 1694c700 -1 osd.2 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:24.655771+0000 front 2019-11-29T20:56:30.497480+0000 (oldest deadline 2019-11-29T20:57:10.026776+0000) 2019-11-29T20:57:42.157 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:57:42.151+0000 1694c700 -1 osd.4 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:28.145133+0000 front 2019-11-29T20:56:28.289094+0000 (oldest deadline 2019-11-29T20:57:10.986644+0000) 2019-11-29T20:57:42.358 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:57:42.352+0000 1694c700 -1 osd.0 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:30.602908+0000 front 2019-11-29T20:56:30.339603+0000 (oldest deadline 2019-11-29T20:57:11.646510+0000) 2019-11-29T20:57:42.381 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:57:42.376+0000 1694c700 -1 osd.3 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:56:46.977517+0000 (oldest deadline 2019-11-29T20:57:26.977517+0000) 2019-11-29T20:57:42.382 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:57:42.377+0000 1694c700 -1 osd.3 225 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4331.0:129962 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e223) 2019-11-29T20:57:42.392 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:57:42.388+0000 1694c700 -1 osd.1 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:28.931735+0000 front 2019-11-29T20:56:28.971408+0000 (oldest deadline 2019-11-29T20:57:14.257436+0000) 2019-11-29T20:57:42.597 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:57:42.591+0000 1694c700 -1 osd.6 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:26.749543+0000 front 2019-11-29T20:56:31.042200+0000 (oldest deadline 2019-11-29T20:57:09.591312+0000) 2019-11-29T20:57:42.932 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:57:42.923+0000 1694c700 -1 osd.7 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:25.238947+0000 front 2019-11-29T20:56:25.232554+0000 (oldest deadline 2019-11-29T20:57:10.594155+0000) 2019-11-29T20:57:43.103 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:57:43.098+0000 1694c700 -1 osd.2 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:24.655771+0000 front 2019-11-29T20:56:30.497480+0000 (oldest deadline 2019-11-29T20:57:10.026776+0000) 2019-11-29T20:57:43.118 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:57:43.110+0000 1694c700 -1 osd.4 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:28.145133+0000 front 2019-11-29T20:56:28.289094+0000 (oldest deadline 2019-11-29T20:57:10.986644+0000) 2019-11-29T20:57:43.315 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:57:43.310+0000 1694c700 -1 osd.0 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:30.602908+0000 front 2019-11-29T20:56:30.339603+0000 (oldest deadline 2019-11-29T20:57:11.646510+0000) 2019-11-29T20:57:43.380 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:57:43.373+0000 1694c700 -1 osd.3 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:56:46.977517+0000 (oldest deadline 2019-11-29T20:57:26.977517+0000) 2019-11-29T20:57:43.381 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:57:43.375+0000 1694c700 -1 osd.3 225 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4331.0:129962 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e223) 2019-11-29T20:57:43.429 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:57:43.417+0000 1694c700 -1 osd.1 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:28.931735+0000 front 2019-11-29T20:56:28.971408+0000 (oldest deadline 2019-11-29T20:57:14.257436+0000) 2019-11-29T20:57:43.581 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:57:43.574+0000 1694c700 -1 osd.6 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:26.749543+0000 front 2019-11-29T20:56:31.042200+0000 (oldest deadline 2019-11-29T20:57:09.591312+0000) 2019-11-29T20:57:43.911 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:57:43.904+0000 1694c700 -1 osd.7 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:25.238947+0000 front 2019-11-29T20:56:25.232554+0000 (oldest deadline 2019-11-29T20:57:10.594155+0000) 2019-11-29T20:57:44.074 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:57:44.069+0000 1694c700 -1 osd.2 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:24.655771+0000 front 2019-11-29T20:56:30.497480+0000 (oldest deadline 2019-11-29T20:57:10.026776+0000) 2019-11-29T20:57:44.094 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:57:44.087+0000 1694c700 -1 osd.4 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:28.145133+0000 front 2019-11-29T20:56:28.289094+0000 (oldest deadline 2019-11-29T20:57:10.986644+0000) 2019-11-29T20:57:44.340 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:57:44.335+0000 1694c700 -1 osd.0 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:30.602908+0000 front 2019-11-29T20:56:30.339603+0000 (oldest deadline 2019-11-29T20:57:11.646510+0000) 2019-11-29T20:57:44.340 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:57:44.334+0000 1694c700 -1 osd.3 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:56:46.977517+0000 (oldest deadline 2019-11-29T20:57:26.977517+0000) 2019-11-29T20:57:44.352 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:57:44.336+0000 1694c700 -1 osd.3 225 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4331.0:129962 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e223) 2019-11-29T20:57:44.454 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:57:44.448+0000 1694c700 -1 osd.1 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:28.931735+0000 front 2019-11-29T20:56:28.971408+0000 (oldest deadline 2019-11-29T20:57:14.257436+0000) 2019-11-29T20:57:44.542 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:57:44.536+0000 1694c700 -1 osd.6 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:26.749543+0000 front 2019-11-29T20:56:31.042200+0000 (oldest deadline 2019-11-29T20:57:09.591312+0000) 2019-11-29T20:57:44.543 INFO:tasks.ceph.mon.b.smithi022.stderr:2019-11-29T20:57:44.533+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.22:6818/9264,v1:172.21.15.22:6819/9264] for 48sec e225 v225) 2019-11-29T20:57:44.884 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:57:44.877+0000 1694c700 -1 osd.7 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:25.238947+0000 front 2019-11-29T20:56:25.232554+0000 (oldest deadline 2019-11-29T20:57:10.594155+0000) 2019-11-29T20:57:45.054 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:57:45.049+0000 1694c700 -1 osd.4 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:28.145133+0000 front 2019-11-29T20:56:28.289094+0000 (oldest deadline 2019-11-29T20:57:10.986644+0000) 2019-11-29T20:57:45.065 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:57:45.059+0000 1694c700 -1 osd.2 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:24.655771+0000 front 2019-11-29T20:56:30.497480+0000 (oldest deadline 2019-11-29T20:57:10.026776+0000) 2019-11-29T20:57:45.352 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:57:45.345+0000 1694c700 -1 osd.3 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:56:46.977517+0000 (oldest deadline 2019-11-29T20:57:26.977517+0000) 2019-11-29T20:57:45.353 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:57:45.348+0000 1694c700 -1 osd.3 225 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4331.0:129962 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e223) 2019-11-29T20:57:45.382 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:57:45.377+0000 1694c700 -1 osd.0 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:30.602908+0000 front 2019-11-29T20:56:30.339603+0000 (oldest deadline 2019-11-29T20:57:11.646510+0000) 2019-11-29T20:57:45.450 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:57:45.445+0000 1694c700 -1 osd.1 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:28.931735+0000 front 2019-11-29T20:56:28.971408+0000 (oldest deadline 2019-11-29T20:57:14.257436+0000) 2019-11-29T20:57:45.583 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:57:45.577+0000 1694c700 -1 osd.6 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:26.749543+0000 front 2019-11-29T20:56:31.042200+0000 (oldest deadline 2019-11-29T20:57:09.591312+0000) 2019-11-29T20:57:45.856 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:57:45.851+0000 1694c700 -1 osd.7 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:25.238947+0000 front 2019-11-29T20:56:25.232554+0000 (oldest deadline 2019-11-29T20:57:10.594155+0000) 2019-11-29T20:57:46.029 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:57:46.023+0000 1694c700 -1 osd.2 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:24.655771+0000 front 2019-11-29T20:56:30.497480+0000 (oldest deadline 2019-11-29T20:57:10.026776+0000) 2019-11-29T20:57:46.076 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:57:46.070+0000 1694c700 -1 osd.4 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:28.145133+0000 front 2019-11-29T20:56:28.289094+0000 (oldest deadline 2019-11-29T20:57:10.986644+0000) 2019-11-29T20:57:46.374 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:57:46.368+0000 1694c700 -1 osd.3 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:56:46.977517+0000 (oldest deadline 2019-11-29T20:57:26.977517+0000) 2019-11-29T20:57:46.375 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:57:46.370+0000 1694c700 -1 osd.3 225 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4331.0:129962 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e223) 2019-11-29T20:57:46.377 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:57:46.372+0000 1694c700 -1 osd.0 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:30.602908+0000 front 2019-11-29T20:56:30.339603+0000 (oldest deadline 2019-11-29T20:57:11.646510+0000) 2019-11-29T20:57:46.471 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:57:46.466+0000 1694c700 -1 osd.1 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:28.931735+0000 front 2019-11-29T20:56:28.971408+0000 (oldest deadline 2019-11-29T20:57:14.257436+0000) 2019-11-29T20:57:46.597 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:57:46.591+0000 1694c700 -1 osd.6 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:26.749543+0000 front 2019-11-29T20:56:31.042200+0000 (oldest deadline 2019-11-29T20:57:09.591312+0000) 2019-11-29T20:57:46.891 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:57:46.886+0000 1694c700 -1 osd.7 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:25.238947+0000 front 2019-11-29T20:56:25.232554+0000 (oldest deadline 2019-11-29T20:57:10.594155+0000) 2019-11-29T20:57:47.036 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:57:47.029+0000 1694c700 -1 osd.4 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:28.145133+0000 front 2019-11-29T20:56:28.289094+0000 (oldest deadline 2019-11-29T20:57:10.986644+0000) 2019-11-29T20:57:47.081 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:57:47.073+0000 1694c700 -1 osd.2 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:24.655771+0000 front 2019-11-29T20:56:30.497480+0000 (oldest deadline 2019-11-29T20:57:10.026776+0000) 2019-11-29T20:57:47.330 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:57:47.324+0000 1694c700 -1 osd.3 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:56:46.977517+0000 (oldest deadline 2019-11-29T20:57:26.977517+0000) 2019-11-29T20:57:47.331 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:57:47.326+0000 1694c700 -1 osd.3 225 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4331.0:129962 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e223) 2019-11-29T20:57:47.417 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:57:47.411+0000 1694c700 -1 osd.0 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:30.602908+0000 front 2019-11-29T20:56:30.339603+0000 (oldest deadline 2019-11-29T20:57:11.646510+0000) 2019-11-29T20:57:47.480 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:57:47.475+0000 1694c700 -1 osd.1 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:28.931735+0000 front 2019-11-29T20:56:28.971408+0000 (oldest deadline 2019-11-29T20:57:14.257436+0000) 2019-11-29T20:57:47.555 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:57:47.548+0000 1694c700 -1 osd.6 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:26.749543+0000 front 2019-11-29T20:56:31.042200+0000 (oldest deadline 2019-11-29T20:57:09.591312+0000) 2019-11-29T20:57:47.859 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:57:47.853+0000 1694c700 -1 osd.7 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:25.238947+0000 front 2019-11-29T20:56:25.232554+0000 (oldest deadline 2019-11-29T20:57:10.594155+0000) 2019-11-29T20:57:48.044 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:57:48.039+0000 1694c700 -1 osd.2 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:24.655771+0000 front 2019-11-29T20:56:30.497480+0000 (oldest deadline 2019-11-29T20:57:10.026776+0000) 2019-11-29T20:57:48.072 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:57:48.066+0000 1694c700 -1 osd.4 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:28.145133+0000 front 2019-11-29T20:56:28.289094+0000 (oldest deadline 2019-11-29T20:57:10.986644+0000) 2019-11-29T20:57:48.311 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:57:48.305+0000 1694c700 -1 osd.3 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:56:46.977517+0000 (oldest deadline 2019-11-29T20:57:26.977517+0000) 2019-11-29T20:57:48.311 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:57:48.306+0000 1694c700 -1 osd.3 225 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4331.0:129962 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e223) 2019-11-29T20:57:48.464 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:57:48.458+0000 1694c700 -1 osd.0 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:30.602908+0000 front 2019-11-29T20:56:30.339603+0000 (oldest deadline 2019-11-29T20:57:11.646510+0000) 2019-11-29T20:57:48.482 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:57:48.477+0000 1694c700 -1 osd.1 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:28.931735+0000 front 2019-11-29T20:56:28.971408+0000 (oldest deadline 2019-11-29T20:57:14.257436+0000) 2019-11-29T20:57:48.597 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:57:48.591+0000 1694c700 -1 osd.6 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:26.749543+0000 front 2019-11-29T20:56:31.042200+0000 (oldest deadline 2019-11-29T20:57:09.591312+0000) 2019-11-29T20:57:48.855 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:57:48.850+0000 1694c700 -1 osd.7 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:25.238947+0000 front 2019-11-29T20:56:25.232554+0000 (oldest deadline 2019-11-29T20:57:10.594155+0000) 2019-11-29T20:57:49.029 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:57:49.022+0000 1694c700 -1 osd.4 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:28.145133+0000 front 2019-11-29T20:56:28.289094+0000 (oldest deadline 2019-11-29T20:57:10.986644+0000) 2019-11-29T20:57:49.030 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:57:49.025+0000 1694c700 -1 osd.2 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:24.655771+0000 front 2019-11-29T20:56:30.497480+0000 (oldest deadline 2019-11-29T20:57:10.026776+0000) 2019-11-29T20:57:49.315 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:57:49.309+0000 1694c700 -1 osd.3 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:56:46.977517+0000 (oldest deadline 2019-11-29T20:57:26.977517+0000) 2019-11-29T20:57:49.320 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:57:49.311+0000 1694c700 -1 osd.3 225 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4331.0:129962 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e223) 2019-11-29T20:57:49.443 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:57:49.437+0000 1694c700 -1 osd.0 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:30.602908+0000 front 2019-11-29T20:56:30.339603+0000 (oldest deadline 2019-11-29T20:57:11.646510+0000) 2019-11-29T20:57:49.455 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:57:49.449+0000 1694c700 -1 osd.1 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:28.931735+0000 front 2019-11-29T20:56:28.971408+0000 (oldest deadline 2019-11-29T20:57:14.257436+0000) 2019-11-29T20:57:49.559 INFO:tasks.ceph.mon.b.smithi022.stderr:2019-11-29T20:57:49.553+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.22:6818/9264,v1:172.21.15.22:6819/9264] for 48sec e225 v225) 2019-11-29T20:57:49.622 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:57:49.616+0000 1694c700 -1 osd.6 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:26.749543+0000 front 2019-11-29T20:56:31.042200+0000 (oldest deadline 2019-11-29T20:57:09.591312+0000) 2019-11-29T20:57:49.836 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:57:49.830+0000 1694c700 -1 osd.7 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:25.238947+0000 front 2019-11-29T20:56:25.232554+0000 (oldest deadline 2019-11-29T20:57:10.594155+0000) 2019-11-29T20:57:50.028 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:57:50.021+0000 1694c700 -1 osd.4 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:28.145133+0000 front 2019-11-29T20:56:28.289094+0000 (oldest deadline 2019-11-29T20:57:10.986644+0000) 2019-11-29T20:57:50.047 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:57:50.041+0000 1694c700 -1 osd.2 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:24.655771+0000 front 2019-11-29T20:56:30.497480+0000 (oldest deadline 2019-11-29T20:57:10.026776+0000) 2019-11-29T20:57:50.325 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:57:50.320+0000 1694c700 -1 osd.3 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:56:46.977517+0000 (oldest deadline 2019-11-29T20:57:26.977517+0000) 2019-11-29T20:57:50.326 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:57:50.322+0000 1694c700 -1 osd.3 225 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4331.0:129962 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e223) 2019-11-29T20:57:50.490 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:57:50.484+0000 1694c700 -1 osd.0 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:30.602908+0000 front 2019-11-29T20:56:30.339603+0000 (oldest deadline 2019-11-29T20:57:11.646510+0000) 2019-11-29T20:57:50.499 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:57:50.493+0000 1694c700 -1 osd.1 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:28.931735+0000 front 2019-11-29T20:56:28.971408+0000 (oldest deadline 2019-11-29T20:57:14.257436+0000) 2019-11-29T20:57:50.638 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:57:50.631+0000 1694c700 -1 osd.6 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:26.749543+0000 front 2019-11-29T20:56:31.042200+0000 (oldest deadline 2019-11-29T20:57:09.591312+0000) 2019-11-29T20:57:50.795 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:57:50.789+0000 1694c700 -1 osd.7 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:25.238947+0000 front 2019-11-29T20:56:25.232554+0000 (oldest deadline 2019-11-29T20:57:10.594155+0000) 2019-11-29T20:57:51.007 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:57:51.001+0000 1694c700 -1 osd.4 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:28.145133+0000 front 2019-11-29T20:56:28.289094+0000 (oldest deadline 2019-11-29T20:57:10.986644+0000) 2019-11-29T20:57:51.046 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:57:51.041+0000 1694c700 -1 osd.2 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:24.655771+0000 front 2019-11-29T20:56:30.497480+0000 (oldest deadline 2019-11-29T20:57:10.026776+0000) 2019-11-29T20:57:51.344 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:57:51.338+0000 1694c700 -1 osd.3 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:56:46.977517+0000 (oldest deadline 2019-11-29T20:57:26.977517+0000) 2019-11-29T20:57:51.345 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:57:51.340+0000 1694c700 -1 osd.3 225 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4331.0:129962 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e223) 2019-11-29T20:57:51.539 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:57:51.534+0000 1694c700 -1 osd.0 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:30.602908+0000 front 2019-11-29T20:56:30.339603+0000 (oldest deadline 2019-11-29T20:57:11.646510+0000) 2019-11-29T20:57:51.541 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:57:51.535+0000 1694c700 -1 osd.1 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:28.931735+0000 front 2019-11-29T20:56:28.971408+0000 (oldest deadline 2019-11-29T20:57:14.257436+0000) 2019-11-29T20:57:51.632 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:57:51.626+0000 1694c700 -1 osd.6 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:26.749543+0000 front 2019-11-29T20:56:31.042200+0000 (oldest deadline 2019-11-29T20:57:09.591312+0000) 2019-11-29T20:57:51.764 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:57:51.757+0000 1694c700 -1 osd.7 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:25.238947+0000 front 2019-11-29T20:56:25.232554+0000 (oldest deadline 2019-11-29T20:57:10.594155+0000) 2019-11-29T20:57:51.981 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:57:51.974+0000 1694c700 -1 osd.4 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:28.145133+0000 front 2019-11-29T20:56:28.289094+0000 (oldest deadline 2019-11-29T20:57:10.986644+0000) 2019-11-29T20:57:52.025 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:57:52.018+0000 1694c700 -1 osd.2 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:24.655771+0000 front 2019-11-29T20:56:30.497480+0000 (oldest deadline 2019-11-29T20:57:10.026776+0000) 2019-11-29T20:57:52.303 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:57:52.298+0000 1694c700 -1 osd.3 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:56:46.977517+0000 (oldest deadline 2019-11-29T20:57:26.977517+0000) 2019-11-29T20:57:52.304 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:57:52.299+0000 1694c700 -1 osd.3 225 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4331.0:129962 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e223) 2019-11-29T20:57:52.516 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:57:52.511+0000 1694c700 -1 osd.0 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:30.602908+0000 front 2019-11-29T20:56:30.339603+0000 (oldest deadline 2019-11-29T20:57:11.646510+0000) 2019-11-29T20:57:52.578 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:57:52.572+0000 1694c700 -1 osd.1 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:28.931735+0000 front 2019-11-29T20:56:28.971408+0000 (oldest deadline 2019-11-29T20:57:14.257436+0000) 2019-11-29T20:57:52.621 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:57:52.615+0000 1694c700 -1 osd.6 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:26.749543+0000 front 2019-11-29T20:56:31.042200+0000 (oldest deadline 2019-11-29T20:57:09.591312+0000) 2019-11-29T20:57:52.722 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:57:52.716+0000 1694c700 -1 osd.7 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:25.238947+0000 front 2019-11-29T20:56:25.232554+0000 (oldest deadline 2019-11-29T20:57:10.594155+0000) 2019-11-29T20:57:52.948 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:57:52.942+0000 1694c700 -1 osd.4 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:28.145133+0000 front 2019-11-29T20:56:28.289094+0000 (oldest deadline 2019-11-29T20:57:10.986644+0000) 2019-11-29T20:57:53.053 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:57:53.047+0000 1694c700 -1 osd.2 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:24.655771+0000 front 2019-11-29T20:56:30.497480+0000 (oldest deadline 2019-11-29T20:57:10.026776+0000) 2019-11-29T20:57:53.296 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:57:53.288+0000 1694c700 -1 osd.3 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:56:46.977517+0000 (oldest deadline 2019-11-29T20:57:26.977517+0000) 2019-11-29T20:57:53.297 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:57:53.291+0000 1694c700 -1 osd.3 225 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4331.0:129962 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e223) 2019-11-29T20:57:53.481 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:57:53.475+0000 1694c700 -1 osd.0 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:30.602908+0000 front 2019-11-29T20:56:30.339603+0000 (oldest deadline 2019-11-29T20:57:11.646510+0000) 2019-11-29T20:57:53.550 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:57:53.544+0000 1694c700 -1 osd.1 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:28.931735+0000 front 2019-11-29T20:56:28.971408+0000 (oldest deadline 2019-11-29T20:57:14.257436+0000) 2019-11-29T20:57:53.664 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:57:53.658+0000 1694c700 -1 osd.6 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:26.749543+0000 front 2019-11-29T20:56:31.042200+0000 (oldest deadline 2019-11-29T20:57:09.591312+0000) 2019-11-29T20:57:53.739 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:57:53.733+0000 1694c700 -1 osd.7 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:25.238947+0000 front 2019-11-29T20:56:25.232554+0000 (oldest deadline 2019-11-29T20:57:10.594155+0000) 2019-11-29T20:57:53.945 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:57:53.938+0000 1694c700 -1 osd.4 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:28.145133+0000 front 2019-11-29T20:56:28.289094+0000 (oldest deadline 2019-11-29T20:57:10.986644+0000) 2019-11-29T20:57:54.069 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:57:54.063+0000 1694c700 -1 osd.2 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:24.655771+0000 front 2019-11-29T20:56:30.497480+0000 (oldest deadline 2019-11-29T20:57:10.026776+0000) 2019-11-29T20:57:54.264 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:57:54.259+0000 1694c700 -1 osd.3 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:56:46.977517+0000 (oldest deadline 2019-11-29T20:57:26.977517+0000) 2019-11-29T20:57:54.268 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:57:54.263+0000 1694c700 -1 osd.3 225 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4331.0:129962 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e223) 2019-11-29T20:57:54.445 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:57:54.440+0000 1694c700 -1 osd.0 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:30.602908+0000 front 2019-11-29T20:56:30.339603+0000 (oldest deadline 2019-11-29T20:57:11.646510+0000) 2019-11-29T20:57:54.530 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:57:54.526+0000 1694c700 -1 osd.1 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:28.931735+0000 front 2019-11-29T20:56:28.971408+0000 (oldest deadline 2019-11-29T20:57:14.257436+0000) 2019-11-29T20:57:54.578 INFO:tasks.ceph.mon.b.smithi022.stderr:2019-11-29T20:57:54.569+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.22:6818/9264,v1:172.21.15.22:6819/9264] for 48sec e225 v225) 2019-11-29T20:57:54.679 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:57:54.673+0000 1694c700 -1 osd.6 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:26.749543+0000 front 2019-11-29T20:56:31.042200+0000 (oldest deadline 2019-11-29T20:57:09.591312+0000) 2019-11-29T20:57:54.784 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:57:54.779+0000 1694c700 -1 osd.7 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:25.238947+0000 front 2019-11-29T20:56:25.232554+0000 (oldest deadline 2019-11-29T20:57:10.594155+0000) 2019-11-29T20:57:54.974 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:57:54.968+0000 1694c700 -1 osd.4 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:28.145133+0000 front 2019-11-29T20:56:28.289094+0000 (oldest deadline 2019-11-29T20:57:10.986644+0000) 2019-11-29T20:57:55.053 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:57:55.048+0000 1694c700 -1 osd.2 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:24.655771+0000 front 2019-11-29T20:56:30.497480+0000 (oldest deadline 2019-11-29T20:57:10.026776+0000) 2019-11-29T20:57:55.269 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:57:55.264+0000 1694c700 -1 osd.3 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:56:46.977517+0000 (oldest deadline 2019-11-29T20:57:26.977517+0000) 2019-11-29T20:57:55.272 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:57:55.268+0000 1694c700 -1 osd.3 225 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4331.0:129962 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e223) 2019-11-29T20:57:55.486 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:57:55.480+0000 1694c700 -1 osd.0 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:30.602908+0000 front 2019-11-29T20:56:30.339603+0000 (oldest deadline 2019-11-29T20:57:11.646510+0000) 2019-11-29T20:57:55.542 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:57:55.536+0000 1694c700 -1 osd.1 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:28.931735+0000 front 2019-11-29T20:56:28.971408+0000 (oldest deadline 2019-11-29T20:57:14.257436+0000) 2019-11-29T20:57:55.697 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:57:55.691+0000 1694c700 -1 osd.6 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:26.749543+0000 front 2019-11-29T20:56:31.042200+0000 (oldest deadline 2019-11-29T20:57:09.591312+0000) 2019-11-29T20:57:55.760 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:57:55.754+0000 1694c700 -1 osd.7 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:25.238947+0000 front 2019-11-29T20:56:25.232554+0000 (oldest deadline 2019-11-29T20:57:10.594155+0000) 2019-11-29T20:57:55.989 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:57:55.983+0000 1694c700 -1 osd.4 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:28.145133+0000 front 2019-11-29T20:56:28.289094+0000 (oldest deadline 2019-11-29T20:57:10.986644+0000) 2019-11-29T20:57:56.105 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:57:56.099+0000 1694c700 -1 osd.2 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:24.655771+0000 front 2019-11-29T20:56:30.497480+0000 (oldest deadline 2019-11-29T20:57:10.026776+0000) 2019-11-29T20:57:56.295 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:57:56.289+0000 1694c700 -1 osd.3 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:56:46.977517+0000 (oldest deadline 2019-11-29T20:57:26.977517+0000) 2019-11-29T20:57:56.296 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:57:56.291+0000 1694c700 -1 osd.3 225 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4331.0:129962 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e223) 2019-11-29T20:57:56.461 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:57:56.455+0000 1694c700 -1 osd.0 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:30.602908+0000 front 2019-11-29T20:56:30.339603+0000 (oldest deadline 2019-11-29T20:57:11.646510+0000) 2019-11-29T20:57:56.511 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:57:56.505+0000 1694c700 -1 osd.1 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:28.931735+0000 front 2019-11-29T20:56:28.971408+0000 (oldest deadline 2019-11-29T20:57:14.257436+0000) 2019-11-29T20:57:56.722 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:57:56.717+0000 1694c700 -1 osd.6 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:26.749543+0000 front 2019-11-29T20:56:31.042200+0000 (oldest deadline 2019-11-29T20:57:09.591312+0000) 2019-11-29T20:57:56.741 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:57:56.735+0000 1694c700 -1 osd.7 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:25.238947+0000 front 2019-11-29T20:56:25.232554+0000 (oldest deadline 2019-11-29T20:57:10.594155+0000) 2019-11-29T20:57:56.959 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:57:56.952+0000 1694c700 -1 osd.4 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:28.145133+0000 front 2019-11-29T20:56:28.289094+0000 (oldest deadline 2019-11-29T20:57:10.986644+0000) 2019-11-29T20:57:57.156 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:57:57.150+0000 1694c700 -1 osd.2 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:24.655771+0000 front 2019-11-29T20:56:30.497480+0000 (oldest deadline 2019-11-29T20:57:10.026776+0000) 2019-11-29T20:57:57.340 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:57:57.334+0000 1694c700 -1 osd.3 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:56:46.977517+0000 (oldest deadline 2019-11-29T20:57:26.977517+0000) 2019-11-29T20:57:57.341 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:57:57.335+0000 1694c700 -1 osd.3 225 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4331.0:129962 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e223) 2019-11-29T20:57:57.438 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:57:57.433+0000 1694c700 -1 osd.0 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:30.602908+0000 front 2019-11-29T20:56:30.339603+0000 (oldest deadline 2019-11-29T20:57:11.646510+0000) 2019-11-29T20:57:57.506 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:57:57.501+0000 1694c700 -1 osd.1 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:28.931735+0000 front 2019-11-29T20:56:28.971408+0000 (oldest deadline 2019-11-29T20:57:14.257436+0000) 2019-11-29T20:57:57.765 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:57:57.758+0000 1694c700 -1 osd.6 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:26.749543+0000 front 2019-11-29T20:56:31.042200+0000 (oldest deadline 2019-11-29T20:57:09.591312+0000) 2019-11-29T20:57:57.766 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:57:57.759+0000 1694c700 -1 osd.7 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:25.238947+0000 front 2019-11-29T20:56:25.232554+0000 (oldest deadline 2019-11-29T20:57:10.594155+0000) 2019-11-29T20:57:57.996 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:57:57.991+0000 1694c700 -1 osd.4 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:28.145133+0000 front 2019-11-29T20:56:28.289094+0000 (oldest deadline 2019-11-29T20:57:10.986644+0000) 2019-11-29T20:57:58.146 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:57:58.140+0000 1694c700 -1 osd.2 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:24.655771+0000 front 2019-11-29T20:56:30.497480+0000 (oldest deadline 2019-11-29T20:57:10.026776+0000) 2019-11-29T20:57:58.324 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:57:58.317+0000 1694c700 -1 osd.3 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:56:46.977517+0000 (oldest deadline 2019-11-29T20:57:26.977517+0000) 2019-11-29T20:57:58.325 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:57:58.319+0000 1694c700 -1 osd.3 225 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4331.0:129962 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e223) 2019-11-29T20:57:58.434 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:57:58.429+0000 1694c700 -1 osd.0 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:30.602908+0000 front 2019-11-29T20:56:30.339603+0000 (oldest deadline 2019-11-29T20:57:11.646510+0000) 2019-11-29T20:57:58.475 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:57:58.470+0000 1694c700 -1 osd.1 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:28.931735+0000 front 2019-11-29T20:56:28.971408+0000 (oldest deadline 2019-11-29T20:57:14.257436+0000) 2019-11-29T20:57:58.797 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T20:57:58.791+0000 1694c700 -1 osd.6 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:26.749543+0000 front 2019-11-29T20:56:31.042200+0000 (oldest deadline 2019-11-29T20:57:09.591312+0000) 2019-11-29T20:57:58.799 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:57:58.793+0000 1694c700 -1 osd.7 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:25.238947+0000 front 2019-11-29T20:56:25.232554+0000 (oldest deadline 2019-11-29T20:57:10.594155+0000) 2019-11-29T20:57:58.998 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:57:58.993+0000 1694c700 -1 osd.4 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:28.145133+0000 front 2019-11-29T20:56:28.289094+0000 (oldest deadline 2019-11-29T20:57:10.986644+0000) 2019-11-29T20:57:59.106 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:57:59.101+0000 1694c700 -1 osd.2 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:24.655771+0000 front 2019-11-29T20:56:30.497480+0000 (oldest deadline 2019-11-29T20:57:10.026776+0000) 2019-11-29T20:57:59.331 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:57:59.324+0000 1694c700 -1 osd.3 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 ever on either front or back, first ping sent 2019-11-29T20:56:46.977517+0000 (oldest deadline 2019-11-29T20:57:26.977517+0000) 2019-11-29T20:57:59.332 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:57:59.326+0000 1694c700 -1 osd.3 225 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4331.0:129962 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e223) 2019-11-29T20:57:59.468 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:57:59.459+0000 1694c700 -1 osd.0 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:30.602908+0000 front 2019-11-29T20:56:30.339603+0000 (oldest deadline 2019-11-29T20:57:11.646510+0000) 2019-11-29T20:57:59.488 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:57:59.483+0000 1694c700 -1 osd.1 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:28.931735+0000 front 2019-11-29T20:56:28.971408+0000 (oldest deadline 2019-11-29T20:57:14.257436+0000) 2019-11-29T20:57:59.642 INFO:tasks.ceph.mon.b.smithi022.stderr:2019-11-29T20:57:59.634+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.22:6818/9264,v1:172.21.15.22:6819/9264] for 48sec e225 v225) 2019-11-29T20:58:00.074 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:58:00.070+0000 1694c700 -1 osd.2 225 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T20:56:24.655771+0000 front 2019-11-29T20:56:30.497480+0000 (oldest deadline 2019-11-29T20:57:10.026776+0000) 2019-11-29T20:58:00.489 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T20:58:00.403+0000 1694c700 -1 osd.3 226 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4331.0:129962 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e223) 2019-11-29T20:59:32.413 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:59:32.406+0000 1694c700 -1 osd.5 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:48.939827+0000 front 2019-11-29T20:58:51.858498+0000 (oldest deadline 2019-11-29T20:59:31.806469+0000) 2019-11-29T20:59:33.356 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:59:33.350+0000 1694c700 -1 osd.2 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:48.820083+0000 front 2019-11-29T20:58:48.819313+0000 (oldest deadline 2019-11-29T20:59:32.895760+0000) 2019-11-29T20:59:33.403 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:59:33.397+0000 1694c700 -1 osd.5 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:48.939827+0000 front 2019-11-29T20:58:51.858498+0000 (oldest deadline 2019-11-29T20:59:31.806469+0000) 2019-11-29T20:59:33.822 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:59:33.816+0000 1694c700 -1 osd.0 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:50.333359+0000 front 2019-11-29T20:58:50.178687+0000 (oldest deadline 2019-11-29T20:59:33.499384+0000) 2019-11-29T20:59:34.102 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:59:34.096+0000 1694c700 -1 osd.7 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:50.033132+0000 front 2019-11-29T20:58:50.125318+0000 (oldest deadline 2019-11-29T20:59:33.380596+0000) 2019-11-29T20:59:34.348 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:59:34.342+0000 1694c700 -1 osd.2 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:48.820083+0000 front 2019-11-29T20:58:48.819313+0000 (oldest deadline 2019-11-29T20:59:32.895760+0000) 2019-11-29T20:59:34.400 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:59:34.394+0000 1694c700 -1 osd.5 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:48.939827+0000 front 2019-11-29T20:58:51.858498+0000 (oldest deadline 2019-11-29T20:59:31.806469+0000) 2019-11-29T20:59:34.654 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:59:34.649+0000 1694c700 -1 osd.4 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:51.989016+0000 front 2019-11-29T20:58:51.977328+0000 (oldest deadline 2019-11-29T20:59:34.244545+0000) 2019-11-29T20:59:34.804 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:59:34.797+0000 1694c700 -1 osd.0 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:50.333359+0000 front 2019-11-29T20:58:50.178687+0000 (oldest deadline 2019-11-29T20:59:33.499384+0000) 2019-11-29T20:59:35.076 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:59:35.070+0000 1694c700 -1 osd.7 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:50.033132+0000 front 2019-11-29T20:58:50.125318+0000 (oldest deadline 2019-11-29T20:59:33.380596+0000) 2019-11-29T20:59:35.083 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:59:35.078+0000 1694c700 -1 osd.1 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:49.183561+0000 front 2019-11-29T20:58:49.261762+0000 (oldest deadline 2019-11-29T20:59:34.424391+0000) 2019-11-29T20:59:35.342 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:59:35.337+0000 1694c700 -1 osd.2 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:48.820083+0000 front 2019-11-29T20:58:48.819313+0000 (oldest deadline 2019-11-29T20:59:32.895760+0000) 2019-11-29T20:59:35.400 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:59:35.394+0000 1694c700 -1 osd.5 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:48.939827+0000 front 2019-11-29T20:58:51.858498+0000 (oldest deadline 2019-11-29T20:59:31.806469+0000) 2019-11-29T20:59:35.675 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:59:35.669+0000 1694c700 -1 osd.4 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:51.989016+0000 front 2019-11-29T20:58:51.977328+0000 (oldest deadline 2019-11-29T20:59:34.244545+0000) 2019-11-29T20:59:35.769 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:59:35.763+0000 1694c700 -1 osd.0 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:50.333359+0000 front 2019-11-29T20:58:50.178687+0000 (oldest deadline 2019-11-29T20:59:33.499384+0000) 2019-11-29T20:59:36.053 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:59:36.047+0000 1694c700 -1 osd.7 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:50.033132+0000 front 2019-11-29T20:58:50.125318+0000 (oldest deadline 2019-11-29T20:59:33.380596+0000) 2019-11-29T20:59:36.095 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:59:36.089+0000 1694c700 -1 osd.1 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:49.183561+0000 front 2019-11-29T20:58:49.261762+0000 (oldest deadline 2019-11-29T20:59:34.424391+0000) 2019-11-29T20:59:36.393 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:59:36.388+0000 1694c700 -1 osd.2 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:48.820083+0000 front 2019-11-29T20:58:48.819313+0000 (oldest deadline 2019-11-29T20:59:32.895760+0000) 2019-11-29T20:59:36.423 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:59:36.416+0000 1694c700 -1 osd.5 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:48.939827+0000 front 2019-11-29T20:58:51.858498+0000 (oldest deadline 2019-11-29T20:59:31.806469+0000) 2019-11-29T20:59:36.648 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:59:36.642+0000 1694c700 -1 osd.4 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:51.989016+0000 front 2019-11-29T20:58:51.977328+0000 (oldest deadline 2019-11-29T20:59:34.244545+0000) 2019-11-29T20:59:36.794 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:59:36.785+0000 1694c700 -1 osd.0 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:50.333359+0000 front 2019-11-29T20:58:50.178687+0000 (oldest deadline 2019-11-29T20:59:33.499384+0000) 2019-11-29T20:59:37.096 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:59:37.089+0000 1694c700 -1 osd.7 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:50.033132+0000 front 2019-11-29T20:58:50.125318+0000 (oldest deadline 2019-11-29T20:59:33.380596+0000) 2019-11-29T20:59:37.144 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:59:37.139+0000 1694c700 -1 osd.1 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:49.183561+0000 front 2019-11-29T20:58:49.261762+0000 (oldest deadline 2019-11-29T20:59:34.424391+0000) 2019-11-29T20:59:37.441 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:59:37.425+0000 1694c700 -1 osd.2 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:48.820083+0000 front 2019-11-29T20:58:48.819313+0000 (oldest deadline 2019-11-29T20:59:32.895760+0000) 2019-11-29T20:59:37.457 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:59:37.449+0000 1694c700 -1 osd.5 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:48.939827+0000 front 2019-11-29T20:58:51.858498+0000 (oldest deadline 2019-11-29T20:59:31.806469+0000) 2019-11-29T20:59:37.629 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:59:37.622+0000 1694c700 -1 osd.4 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:51.989016+0000 front 2019-11-29T20:58:51.977328+0000 (oldest deadline 2019-11-29T20:59:34.244545+0000) 2019-11-29T20:59:37.767 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:59:37.762+0000 1694c700 -1 osd.0 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:50.333359+0000 front 2019-11-29T20:58:50.178687+0000 (oldest deadline 2019-11-29T20:59:33.499384+0000) 2019-11-29T20:59:38.093 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:59:38.088+0000 1694c700 -1 osd.7 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:50.033132+0000 front 2019-11-29T20:58:50.125318+0000 (oldest deadline 2019-11-29T20:59:33.380596+0000) 2019-11-29T20:59:38.168 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:59:38.159+0000 1694c700 -1 osd.1 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:49.183561+0000 front 2019-11-29T20:58:49.261762+0000 (oldest deadline 2019-11-29T20:59:34.424391+0000) 2019-11-29T20:59:38.397 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:59:38.391+0000 1694c700 -1 osd.2 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:48.820083+0000 front 2019-11-29T20:58:48.819313+0000 (oldest deadline 2019-11-29T20:59:32.895760+0000) 2019-11-29T20:59:38.442 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:59:38.437+0000 1694c700 -1 osd.5 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:48.939827+0000 front 2019-11-29T20:58:51.858498+0000 (oldest deadline 2019-11-29T20:59:31.806469+0000) 2019-11-29T20:59:38.602 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:59:38.596+0000 1694c700 -1 osd.4 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:51.989016+0000 front 2019-11-29T20:58:51.977328+0000 (oldest deadline 2019-11-29T20:59:34.244545+0000) 2019-11-29T20:59:38.750 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:59:38.745+0000 1694c700 -1 osd.0 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:50.333359+0000 front 2019-11-29T20:58:50.178687+0000 (oldest deadline 2019-11-29T20:59:33.499384+0000) 2019-11-29T20:59:39.063 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:59:39.057+0000 1694c700 -1 osd.7 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:50.033132+0000 front 2019-11-29T20:58:50.125318+0000 (oldest deadline 2019-11-29T20:59:33.380596+0000) 2019-11-29T20:59:39.139 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:59:39.132+0000 1694c700 -1 osd.1 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:49.183561+0000 front 2019-11-29T20:58:49.261762+0000 (oldest deadline 2019-11-29T20:59:34.424391+0000) 2019-11-29T20:59:39.394 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:59:39.389+0000 1694c700 -1 osd.2 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:48.820083+0000 front 2019-11-29T20:58:48.819313+0000 (oldest deadline 2019-11-29T20:59:32.895760+0000) 2019-11-29T20:59:39.402 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:59:39.395+0000 1694c700 -1 osd.5 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:48.939827+0000 front 2019-11-29T20:58:51.858498+0000 (oldest deadline 2019-11-29T20:59:31.806469+0000) 2019-11-29T20:59:39.631 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:59:39.625+0000 1694c700 -1 osd.4 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:51.989016+0000 front 2019-11-29T20:58:51.977328+0000 (oldest deadline 2019-11-29T20:59:34.244545+0000) 2019-11-29T20:59:39.748 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:59:39.742+0000 1694c700 -1 osd.0 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:50.333359+0000 front 2019-11-29T20:58:50.178687+0000 (oldest deadline 2019-11-29T20:59:33.499384+0000) 2019-11-29T20:59:40.043 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:59:40.035+0000 1694c700 -1 osd.7 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:50.033132+0000 front 2019-11-29T20:58:50.125318+0000 (oldest deadline 2019-11-29T20:59:33.380596+0000) 2019-11-29T20:59:40.170 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:59:40.164+0000 1694c700 -1 osd.1 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:49.183561+0000 front 2019-11-29T20:58:49.261762+0000 (oldest deadline 2019-11-29T20:59:34.424391+0000) 2019-11-29T20:59:40.363 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:59:40.356+0000 1694c700 -1 osd.2 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:48.820083+0000 front 2019-11-29T20:58:48.819313+0000 (oldest deadline 2019-11-29T20:59:32.895760+0000) 2019-11-29T20:59:40.403 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:59:40.396+0000 1694c700 -1 osd.5 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:48.939827+0000 front 2019-11-29T20:58:51.858498+0000 (oldest deadline 2019-11-29T20:59:31.806469+0000) 2019-11-29T20:59:40.646 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:59:40.640+0000 1694c700 -1 osd.4 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:51.989016+0000 front 2019-11-29T20:58:51.977328+0000 (oldest deadline 2019-11-29T20:59:34.244545+0000) 2019-11-29T20:59:40.782 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:59:40.777+0000 1694c700 -1 osd.0 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:50.333359+0000 front 2019-11-29T20:58:50.178687+0000 (oldest deadline 2019-11-29T20:59:33.499384+0000) 2019-11-29T20:59:41.045 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:59:41.040+0000 1694c700 -1 osd.7 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:50.033132+0000 front 2019-11-29T20:58:50.125318+0000 (oldest deadline 2019-11-29T20:59:33.380596+0000) 2019-11-29T20:59:41.217 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:59:41.212+0000 1694c700 -1 osd.1 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:49.183561+0000 front 2019-11-29T20:58:49.261762+0000 (oldest deadline 2019-11-29T20:59:34.424391+0000) 2019-11-29T20:59:41.372 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:59:41.367+0000 1694c700 -1 osd.2 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:48.820083+0000 front 2019-11-29T20:58:48.819313+0000 (oldest deadline 2019-11-29T20:59:32.895760+0000) 2019-11-29T20:59:41.400 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:59:41.394+0000 1694c700 -1 osd.5 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:48.939827+0000 front 2019-11-29T20:58:51.858498+0000 (oldest deadline 2019-11-29T20:59:31.806469+0000) 2019-11-29T20:59:41.608 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:59:41.602+0000 1694c700 -1 osd.4 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:51.989016+0000 front 2019-11-29T20:58:51.977328+0000 (oldest deadline 2019-11-29T20:59:34.244545+0000) 2019-11-29T20:59:41.840 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:59:41.827+0000 1694c700 -1 osd.0 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:50.333359+0000 front 2019-11-29T20:58:50.178687+0000 (oldest deadline 2019-11-29T20:59:33.499384+0000) 2019-11-29T20:59:42.097 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:59:42.088+0000 1694c700 -1 osd.7 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:50.033132+0000 front 2019-11-29T20:58:50.125318+0000 (oldest deadline 2019-11-29T20:59:33.380596+0000) 2019-11-29T20:59:42.180 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:59:42.174+0000 1694c700 -1 osd.1 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:49.183561+0000 front 2019-11-29T20:58:49.261762+0000 (oldest deadline 2019-11-29T20:59:34.424391+0000) 2019-11-29T20:59:42.335 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:59:42.329+0000 1694c700 -1 osd.2 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:48.820083+0000 front 2019-11-29T20:58:48.819313+0000 (oldest deadline 2019-11-29T20:59:32.895760+0000) 2019-11-29T20:59:42.431 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:59:42.425+0000 1694c700 -1 osd.5 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:48.939827+0000 front 2019-11-29T20:58:51.858498+0000 (oldest deadline 2019-11-29T20:59:31.806469+0000) 2019-11-29T20:59:42.571 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:59:42.564+0000 1694c700 -1 osd.4 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:51.989016+0000 front 2019-11-29T20:58:51.977328+0000 (oldest deadline 2019-11-29T20:59:34.244545+0000) 2019-11-29T20:59:42.817 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:59:42.811+0000 1694c700 -1 osd.0 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:50.333359+0000 front 2019-11-29T20:58:50.178687+0000 (oldest deadline 2019-11-29T20:59:33.499384+0000) 2019-11-29T20:59:43.053 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:59:43.048+0000 1694c700 -1 osd.7 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:50.033132+0000 front 2019-11-29T20:58:50.125318+0000 (oldest deadline 2019-11-29T20:59:33.380596+0000) 2019-11-29T20:59:43.136 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:59:43.130+0000 1694c700 -1 osd.1 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:49.183561+0000 front 2019-11-29T20:58:49.261762+0000 (oldest deadline 2019-11-29T20:59:34.424391+0000) 2019-11-29T20:59:43.383 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:59:43.378+0000 1694c700 -1 osd.2 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:48.820083+0000 front 2019-11-29T20:58:48.819313+0000 (oldest deadline 2019-11-29T20:59:32.895760+0000) 2019-11-29T20:59:43.417 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:59:43.411+0000 1694c700 -1 osd.5 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:48.939827+0000 front 2019-11-29T20:58:51.858498+0000 (oldest deadline 2019-11-29T20:59:31.806469+0000) 2019-11-29T20:59:43.564 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:59:43.557+0000 1694c700 -1 osd.4 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:51.989016+0000 front 2019-11-29T20:58:51.977328+0000 (oldest deadline 2019-11-29T20:59:34.244545+0000) 2019-11-29T20:59:43.813 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:59:43.807+0000 1694c700 -1 osd.0 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:50.333359+0000 front 2019-11-29T20:58:50.178687+0000 (oldest deadline 2019-11-29T20:59:33.499384+0000) 2019-11-29T20:59:44.058 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:59:44.052+0000 1694c700 -1 osd.7 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:50.033132+0000 front 2019-11-29T20:58:50.125318+0000 (oldest deadline 2019-11-29T20:59:33.380596+0000) 2019-11-29T20:59:44.123 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:59:44.118+0000 1694c700 -1 osd.1 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:49.183561+0000 front 2019-11-29T20:58:49.261762+0000 (oldest deadline 2019-11-29T20:59:34.424391+0000) 2019-11-29T20:59:44.409 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:59:44.399+0000 1694c700 -1 osd.2 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:48.820083+0000 front 2019-11-29T20:58:48.819313+0000 (oldest deadline 2019-11-29T20:59:32.895760+0000) 2019-11-29T20:59:44.409 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:59:44.391+0000 1694c700 -1 osd.5 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:48.939827+0000 front 2019-11-29T20:58:51.858498+0000 (oldest deadline 2019-11-29T20:59:31.806469+0000) 2019-11-29T20:59:44.604 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:59:44.596+0000 1694c700 -1 osd.4 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:51.989016+0000 front 2019-11-29T20:58:51.977328+0000 (oldest deadline 2019-11-29T20:59:34.244545+0000) 2019-11-29T20:59:44.790 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:59:44.785+0000 1694c700 -1 osd.0 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:50.333359+0000 front 2019-11-29T20:58:50.178687+0000 (oldest deadline 2019-11-29T20:59:33.499384+0000) 2019-11-29T20:59:45.085 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:59:45.079+0000 1694c700 -1 osd.7 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:50.033132+0000 front 2019-11-29T20:58:50.125318+0000 (oldest deadline 2019-11-29T20:59:33.380596+0000) 2019-11-29T20:59:45.121 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:59:45.116+0000 1694c700 -1 osd.1 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:49.183561+0000 front 2019-11-29T20:58:49.261762+0000 (oldest deadline 2019-11-29T20:59:34.424391+0000) 2019-11-29T20:59:45.422 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:59:45.417+0000 1694c700 -1 osd.2 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:48.820083+0000 front 2019-11-29T20:58:48.819313+0000 (oldest deadline 2019-11-29T20:59:32.895760+0000) 2019-11-29T20:59:45.426 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:59:45.419+0000 1694c700 -1 osd.5 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:48.939827+0000 front 2019-11-29T20:58:51.858498+0000 (oldest deadline 2019-11-29T20:59:31.806469+0000) 2019-11-29T20:59:45.592 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:59:45.586+0000 1694c700 -1 osd.4 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:51.989016+0000 front 2019-11-29T20:58:51.977328+0000 (oldest deadline 2019-11-29T20:59:34.244545+0000) 2019-11-29T20:59:45.760 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:59:45.754+0000 1694c700 -1 osd.0 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:50.333359+0000 front 2019-11-29T20:58:50.178687+0000 (oldest deadline 2019-11-29T20:59:33.499384+0000) 2019-11-29T20:59:46.088 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:59:46.083+0000 1694c700 -1 osd.1 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:49.183561+0000 front 2019-11-29T20:58:49.261762+0000 (oldest deadline 2019-11-29T20:59:34.424391+0000) 2019-11-29T20:59:46.142 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:59:46.135+0000 1694c700 -1 osd.7 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:50.033132+0000 front 2019-11-29T20:58:50.125318+0000 (oldest deadline 2019-11-29T20:59:33.380596+0000) 2019-11-29T20:59:46.394 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:59:46.388+0000 1694c700 -1 osd.5 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:48.939827+0000 front 2019-11-29T20:58:51.858498+0000 (oldest deadline 2019-11-29T20:59:31.806469+0000) 2019-11-29T20:59:46.423 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:59:46.418+0000 1694c700 -1 osd.2 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:48.820083+0000 front 2019-11-29T20:58:48.819313+0000 (oldest deadline 2019-11-29T20:59:32.895760+0000) 2019-11-29T20:59:46.606 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:59:46.600+0000 1694c700 -1 osd.4 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:51.989016+0000 front 2019-11-29T20:58:51.977328+0000 (oldest deadline 2019-11-29T20:59:34.244545+0000) 2019-11-29T20:59:46.805 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:59:46.800+0000 1694c700 -1 osd.0 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:50.333359+0000 front 2019-11-29T20:58:50.178687+0000 (oldest deadline 2019-11-29T20:59:33.499384+0000) 2019-11-29T20:59:47.102 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:59:47.095+0000 1694c700 -1 osd.7 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:50.033132+0000 front 2019-11-29T20:58:50.125318+0000 (oldest deadline 2019-11-29T20:59:33.380596+0000) 2019-11-29T20:59:47.113 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:59:47.108+0000 1694c700 -1 osd.1 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:49.183561+0000 front 2019-11-29T20:58:49.261762+0000 (oldest deadline 2019-11-29T20:59:34.424391+0000) 2019-11-29T20:59:47.396 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:59:47.389+0000 1694c700 -1 osd.5 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:48.939827+0000 front 2019-11-29T20:58:51.858498+0000 (oldest deadline 2019-11-29T20:59:31.806469+0000) 2019-11-29T20:59:47.480 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:59:47.473+0000 1694c700 -1 osd.2 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:48.820083+0000 front 2019-11-29T20:58:48.819313+0000 (oldest deadline 2019-11-29T20:59:32.895760+0000) 2019-11-29T20:59:47.598 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:59:47.591+0000 1694c700 -1 osd.4 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:51.989016+0000 front 2019-11-29T20:58:51.977328+0000 (oldest deadline 2019-11-29T20:59:34.244545+0000) 2019-11-29T20:59:47.780 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:59:47.774+0000 1694c700 -1 osd.0 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:50.333359+0000 front 2019-11-29T20:58:50.178687+0000 (oldest deadline 2019-11-29T20:59:33.499384+0000) 2019-11-29T20:59:48.141 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:59:48.136+0000 1694c700 -1 osd.1 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:49.183561+0000 front 2019-11-29T20:58:49.261762+0000 (oldest deadline 2019-11-29T20:59:34.424391+0000) 2019-11-29T20:59:48.158 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:59:48.148+0000 1694c700 -1 osd.7 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:50.033132+0000 front 2019-11-29T20:58:50.125318+0000 (oldest deadline 2019-11-29T20:59:33.380596+0000) 2019-11-29T20:59:48.414 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:59:48.407+0000 1694c700 -1 osd.5 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:48.939827+0000 front 2019-11-29T20:58:51.858498+0000 (oldest deadline 2019-11-29T20:59:31.806469+0000) 2019-11-29T20:59:48.445 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:59:48.441+0000 1694c700 -1 osd.2 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:48.820083+0000 front 2019-11-29T20:58:48.819313+0000 (oldest deadline 2019-11-29T20:59:32.895760+0000) 2019-11-29T20:59:48.621 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:59:48.616+0000 1694c700 -1 osd.4 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:51.989016+0000 front 2019-11-29T20:58:51.977328+0000 (oldest deadline 2019-11-29T20:59:34.244545+0000) 2019-11-29T20:59:48.735 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:59:48.730+0000 1694c700 -1 osd.0 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:50.333359+0000 front 2019-11-29T20:58:50.178687+0000 (oldest deadline 2019-11-29T20:59:33.499384+0000) 2019-11-29T20:59:49.118 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:59:49.113+0000 1694c700 -1 osd.7 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:50.033132+0000 front 2019-11-29T20:58:50.125318+0000 (oldest deadline 2019-11-29T20:59:33.380596+0000) 2019-11-29T20:59:49.151 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:59:49.145+0000 1694c700 -1 osd.1 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:49.183561+0000 front 2019-11-29T20:58:49.261762+0000 (oldest deadline 2019-11-29T20:59:34.424391+0000) 2019-11-29T20:59:49.399 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:59:49.395+0000 1694c700 -1 osd.2 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:48.820083+0000 front 2019-11-29T20:58:48.819313+0000 (oldest deadline 2019-11-29T20:59:32.895760+0000) 2019-11-29T20:59:49.410 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:59:49.405+0000 1694c700 -1 osd.5 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:48.939827+0000 front 2019-11-29T20:58:51.858498+0000 (oldest deadline 2019-11-29T20:59:31.806469+0000) 2019-11-29T20:59:49.672 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:59:49.665+0000 1694c700 -1 osd.4 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:51.989016+0000 front 2019-11-29T20:58:51.977328+0000 (oldest deadline 2019-11-29T20:59:34.244545+0000) 2019-11-29T20:59:49.706 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:59:49.700+0000 1694c700 -1 osd.0 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:50.333359+0000 front 2019-11-29T20:58:50.178687+0000 (oldest deadline 2019-11-29T20:59:33.499384+0000) 2019-11-29T20:59:50.138 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:59:50.133+0000 1694c700 -1 osd.7 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:50.033132+0000 front 2019-11-29T20:58:50.125318+0000 (oldest deadline 2019-11-29T20:59:33.380596+0000) 2019-11-29T20:59:50.161 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:59:50.157+0000 1694c700 -1 osd.1 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:49.183561+0000 front 2019-11-29T20:58:49.261762+0000 (oldest deadline 2019-11-29T20:59:34.424391+0000) 2019-11-29T20:59:50.371 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:59:50.366+0000 1694c700 -1 osd.2 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:48.820083+0000 front 2019-11-29T20:58:48.819313+0000 (oldest deadline 2019-11-29T20:59:32.895760+0000) 2019-11-29T20:59:50.459 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:59:50.453+0000 1694c700 -1 osd.5 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:48.939827+0000 front 2019-11-29T20:58:51.858498+0000 (oldest deadline 2019-11-29T20:59:31.806469+0000) 2019-11-29T20:59:50.646 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:59:50.640+0000 1694c700 -1 osd.4 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:51.989016+0000 front 2019-11-29T20:58:51.977328+0000 (oldest deadline 2019-11-29T20:59:34.244545+0000) 2019-11-29T20:59:50.685 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:59:50.679+0000 1694c700 -1 osd.0 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:50.333359+0000 front 2019-11-29T20:58:50.178687+0000 (oldest deadline 2019-11-29T20:59:33.499384+0000) 2019-11-29T20:59:51.145 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:59:51.140+0000 1694c700 -1 osd.7 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:50.033132+0000 front 2019-11-29T20:58:50.125318+0000 (oldest deadline 2019-11-29T20:59:33.380596+0000) 2019-11-29T20:59:51.185 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:59:51.180+0000 1694c700 -1 osd.1 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:49.183561+0000 front 2019-11-29T20:58:49.261762+0000 (oldest deadline 2019-11-29T20:59:34.424391+0000) 2019-11-29T20:59:51.333 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:59:51.328+0000 1694c700 -1 osd.2 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:48.820083+0000 front 2019-11-29T20:58:48.819313+0000 (oldest deadline 2019-11-29T20:59:32.895760+0000) 2019-11-29T20:59:51.469 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:59:51.463+0000 1694c700 -1 osd.5 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:48.939827+0000 front 2019-11-29T20:58:51.858498+0000 (oldest deadline 2019-11-29T20:59:31.806469+0000) 2019-11-29T20:59:51.648 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:59:51.642+0000 1694c700 -1 osd.4 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:51.989016+0000 front 2019-11-29T20:58:51.977328+0000 (oldest deadline 2019-11-29T20:59:34.244545+0000) 2019-11-29T20:59:51.724 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:59:51.718+0000 1694c700 -1 osd.0 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:50.333359+0000 front 2019-11-29T20:58:50.178687+0000 (oldest deadline 2019-11-29T20:59:33.499384+0000) 2019-11-29T20:59:52.108 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:59:52.102+0000 1694c700 -1 osd.7 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:50.033132+0000 front 2019-11-29T20:58:50.125318+0000 (oldest deadline 2019-11-29T20:59:33.380596+0000) 2019-11-29T20:59:52.159 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:59:52.153+0000 1694c700 -1 osd.1 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:49.183561+0000 front 2019-11-29T20:58:49.261762+0000 (oldest deadline 2019-11-29T20:59:34.424391+0000) 2019-11-29T20:59:52.344 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:59:52.337+0000 1694c700 -1 osd.2 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:48.820083+0000 front 2019-11-29T20:58:48.819313+0000 (oldest deadline 2019-11-29T20:59:32.895760+0000) 2019-11-29T20:59:52.471 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:59:52.464+0000 1694c700 -1 osd.5 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:48.939827+0000 front 2019-11-29T20:58:51.858498+0000 (oldest deadline 2019-11-29T20:59:31.806469+0000) 2019-11-29T20:59:52.660 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:59:52.655+0000 1694c700 -1 osd.4 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:51.989016+0000 front 2019-11-29T20:58:51.977328+0000 (oldest deadline 2019-11-29T20:59:34.244545+0000) 2019-11-29T20:59:52.769 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:59:52.763+0000 1694c700 -1 osd.0 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:50.333359+0000 front 2019-11-29T20:58:50.178687+0000 (oldest deadline 2019-11-29T20:59:33.499384+0000) 2019-11-29T20:59:53.127 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:59:53.120+0000 1694c700 -1 osd.1 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:49.183561+0000 front 2019-11-29T20:58:49.261762+0000 (oldest deadline 2019-11-29T20:59:34.424391+0000) 2019-11-29T20:59:53.147 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:59:53.141+0000 1694c700 -1 osd.7 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:50.033132+0000 front 2019-11-29T20:58:50.125318+0000 (oldest deadline 2019-11-29T20:59:33.380596+0000) 2019-11-29T20:59:53.388 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:59:53.382+0000 1694c700 -1 osd.2 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:48.820083+0000 front 2019-11-29T20:58:48.819313+0000 (oldest deadline 2019-11-29T20:59:32.895760+0000) 2019-11-29T20:59:53.443 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:59:53.437+0000 1694c700 -1 osd.5 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:48.939827+0000 front 2019-11-29T20:58:51.858498+0000 (oldest deadline 2019-11-29T20:59:31.806469+0000) 2019-11-29T20:59:53.700 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:59:53.694+0000 1694c700 -1 osd.4 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:51.989016+0000 front 2019-11-29T20:58:51.977328+0000 (oldest deadline 2019-11-29T20:59:34.244545+0000) 2019-11-29T20:59:53.786 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:59:53.780+0000 1694c700 -1 osd.0 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:50.333359+0000 front 2019-11-29T20:58:50.178687+0000 (oldest deadline 2019-11-29T20:59:33.499384+0000) 2019-11-29T20:59:54.100 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:59:54.095+0000 1694c700 -1 osd.1 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:49.183561+0000 front 2019-11-29T20:58:49.261762+0000 (oldest deadline 2019-11-29T20:59:34.424391+0000) 2019-11-29T20:59:54.133 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:59:54.127+0000 1694c700 -1 osd.7 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:50.033132+0000 front 2019-11-29T20:58:50.125318+0000 (oldest deadline 2019-11-29T20:59:33.380596+0000) 2019-11-29T20:59:54.372 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:59:54.365+0000 1694c700 -1 osd.2 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:48.820083+0000 front 2019-11-29T20:58:48.819313+0000 (oldest deadline 2019-11-29T20:59:32.895760+0000) 2019-11-29T20:59:54.467 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:59:54.460+0000 1694c700 -1 osd.5 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:48.939827+0000 front 2019-11-29T20:58:51.858498+0000 (oldest deadline 2019-11-29T20:59:31.806469+0000) 2019-11-29T20:59:54.664 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:59:54.657+0000 1694c700 -1 osd.4 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:51.989016+0000 front 2019-11-29T20:58:51.977328+0000 (oldest deadline 2019-11-29T20:59:34.244545+0000) 2019-11-29T20:59:54.777 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:59:54.771+0000 1694c700 -1 osd.0 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:50.333359+0000 front 2019-11-29T20:58:50.178687+0000 (oldest deadline 2019-11-29T20:59:33.499384+0000) 2019-11-29T20:59:55.066 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:59:55.060+0000 1694c700 -1 osd.1 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:49.183561+0000 front 2019-11-29T20:58:49.261762+0000 (oldest deadline 2019-11-29T20:59:34.424391+0000) 2019-11-29T20:59:55.182 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:59:55.177+0000 1694c700 -1 osd.7 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:50.033132+0000 front 2019-11-29T20:58:50.125318+0000 (oldest deadline 2019-11-29T20:59:33.380596+0000) 2019-11-29T20:59:55.340 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:59:55.333+0000 1694c700 -1 osd.2 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:48.820083+0000 front 2019-11-29T20:58:48.819313+0000 (oldest deadline 2019-11-29T20:59:32.895760+0000) 2019-11-29T20:59:55.499 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:59:55.493+0000 1694c700 -1 osd.5 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:48.939827+0000 front 2019-11-29T20:58:51.858498+0000 (oldest deadline 2019-11-29T20:59:31.806469+0000) 2019-11-29T20:59:55.718 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:59:55.712+0000 1694c700 -1 osd.4 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:51.989016+0000 front 2019-11-29T20:58:51.977328+0000 (oldest deadline 2019-11-29T20:59:34.244545+0000) 2019-11-29T20:59:55.816 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:59:55.810+0000 1694c700 -1 osd.0 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:50.333359+0000 front 2019-11-29T20:58:50.178687+0000 (oldest deadline 2019-11-29T20:59:33.499384+0000) 2019-11-29T20:59:56.033 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:59:56.028+0000 1694c700 -1 osd.1 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:49.183561+0000 front 2019-11-29T20:58:49.261762+0000 (oldest deadline 2019-11-29T20:59:34.424391+0000) 2019-11-29T20:59:56.236 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:59:56.230+0000 1694c700 -1 osd.7 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:50.033132+0000 front 2019-11-29T20:58:50.125318+0000 (oldest deadline 2019-11-29T20:59:33.380596+0000) 2019-11-29T20:59:56.312 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:59:56.306+0000 1694c700 -1 osd.2 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:48.820083+0000 front 2019-11-29T20:58:48.819313+0000 (oldest deadline 2019-11-29T20:59:32.895760+0000) 2019-11-29T20:59:56.460 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:59:56.454+0000 1694c700 -1 osd.5 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:48.939827+0000 front 2019-11-29T20:58:51.858498+0000 (oldest deadline 2019-11-29T20:59:31.806469+0000) 2019-11-29T20:59:56.687 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:59:56.682+0000 1694c700 -1 osd.4 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:51.989016+0000 front 2019-11-29T20:58:51.977328+0000 (oldest deadline 2019-11-29T20:59:34.244545+0000) 2019-11-29T20:59:56.811 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:59:56.805+0000 1694c700 -1 osd.0 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:50.333359+0000 front 2019-11-29T20:58:50.178687+0000 (oldest deadline 2019-11-29T20:59:33.499384+0000) 2019-11-29T20:59:57.043 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:59:57.037+0000 1694c700 -1 osd.1 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:49.183561+0000 front 2019-11-29T20:58:49.261762+0000 (oldest deadline 2019-11-29T20:59:34.424391+0000) 2019-11-29T20:59:57.213 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:59:57.207+0000 1694c700 -1 osd.7 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:50.033132+0000 front 2019-11-29T20:58:50.125318+0000 (oldest deadline 2019-11-29T20:59:33.380596+0000) 2019-11-29T20:59:57.306 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:59:57.301+0000 1694c700 -1 osd.2 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:48.820083+0000 front 2019-11-29T20:58:48.819313+0000 (oldest deadline 2019-11-29T20:59:32.895760+0000) 2019-11-29T20:59:57.473 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:59:57.466+0000 1694c700 -1 osd.5 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:48.939827+0000 front 2019-11-29T20:58:51.858498+0000 (oldest deadline 2019-11-29T20:59:31.806469+0000) 2019-11-29T20:59:57.666 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:59:57.659+0000 1694c700 -1 osd.4 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:51.989016+0000 front 2019-11-29T20:58:51.977328+0000 (oldest deadline 2019-11-29T20:59:34.244545+0000) 2019-11-29T20:59:57.819 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:59:57.815+0000 1694c700 -1 osd.0 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:50.333359+0000 front 2019-11-29T20:58:50.178687+0000 (oldest deadline 2019-11-29T20:59:33.499384+0000) 2019-11-29T20:59:58.022 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:59:58.017+0000 1694c700 -1 osd.1 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:49.183561+0000 front 2019-11-29T20:58:49.261762+0000 (oldest deadline 2019-11-29T20:59:34.424391+0000) 2019-11-29T20:59:58.260 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:59:58.244+0000 1694c700 -1 osd.7 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:50.033132+0000 front 2019-11-29T20:58:50.125318+0000 (oldest deadline 2019-11-29T20:59:33.380596+0000) 2019-11-29T20:59:58.261 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:59:58.255+0000 1694c700 -1 osd.2 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:48.820083+0000 front 2019-11-29T20:58:48.819313+0000 (oldest deadline 2019-11-29T20:59:32.895760+0000) 2019-11-29T20:59:58.470 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:59:58.462+0000 1694c700 -1 osd.5 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:48.939827+0000 front 2019-11-29T20:58:51.858498+0000 (oldest deadline 2019-11-29T20:59:31.806469+0000) 2019-11-29T20:59:58.632 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:59:58.625+0000 1694c700 -1 osd.4 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:51.989016+0000 front 2019-11-29T20:58:51.977328+0000 (oldest deadline 2019-11-29T20:59:34.244545+0000) 2019-11-29T20:59:58.830 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:59:58.825+0000 1694c700 -1 osd.0 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:50.333359+0000 front 2019-11-29T20:58:50.178687+0000 (oldest deadline 2019-11-29T20:59:33.499384+0000) 2019-11-29T20:59:59.017 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T20:59:59.011+0000 1694c700 -1 osd.1 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:49.183561+0000 front 2019-11-29T20:58:49.261762+0000 (oldest deadline 2019-11-29T20:59:34.424391+0000) 2019-11-29T20:59:59.277 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T20:59:59.272+0000 1694c700 -1 osd.2 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:48.820083+0000 front 2019-11-29T20:58:48.819313+0000 (oldest deadline 2019-11-29T20:59:32.895760+0000) 2019-11-29T20:59:59.289 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T20:59:59.283+0000 1694c700 -1 osd.7 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:50.033132+0000 front 2019-11-29T20:58:50.125318+0000 (oldest deadline 2019-11-29T20:59:33.380596+0000) 2019-11-29T20:59:59.516 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T20:59:59.510+0000 1694c700 -1 osd.5 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:48.939827+0000 front 2019-11-29T20:58:51.858498+0000 (oldest deadline 2019-11-29T20:59:31.806469+0000) 2019-11-29T20:59:59.670 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T20:59:59.664+0000 1694c700 -1 osd.4 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:51.989016+0000 front 2019-11-29T20:58:51.977328+0000 (oldest deadline 2019-11-29T20:59:34.244545+0000) 2019-11-29T20:59:59.812 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T20:59:59.806+0000 1694c700 -1 osd.0 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:50.333359+0000 front 2019-11-29T20:58:50.178687+0000 (oldest deadline 2019-11-29T20:59:33.499384+0000) 2019-11-29T21:00:00.017 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:00:00.011+0000 1694c700 -1 osd.1 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:49.183561+0000 front 2019-11-29T20:58:49.261762+0000 (oldest deadline 2019-11-29T20:59:34.424391+0000) 2019-11-29T21:00:00.326 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:00:00.320+0000 1694c700 -1 osd.2 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:48.820083+0000 front 2019-11-29T20:58:48.819313+0000 (oldest deadline 2019-11-29T20:59:32.895760+0000) 2019-11-29T21:00:00.326 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:00:00.320+0000 1694c700 -1 osd.7 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:50.033132+0000 front 2019-11-29T20:58:50.125318+0000 (oldest deadline 2019-11-29T20:59:33.380596+0000) 2019-11-29T21:00:00.508 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:00:00.502+0000 1694c700 -1 osd.5 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:48.939827+0000 front 2019-11-29T20:58:51.858498+0000 (oldest deadline 2019-11-29T20:59:31.806469+0000) 2019-11-29T21:00:00.681 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:00:00.675+0000 1694c700 -1 osd.4 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:51.989016+0000 front 2019-11-29T20:58:51.977328+0000 (oldest deadline 2019-11-29T20:59:34.244545+0000) 2019-11-29T21:00:00.779 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:00:00.774+0000 1694c700 -1 osd.0 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:50.333359+0000 front 2019-11-29T20:58:50.178687+0000 (oldest deadline 2019-11-29T20:59:33.499384+0000) 2019-11-29T21:00:01.011 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:00:01.005+0000 1694c700 -1 osd.1 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:49.183561+0000 front 2019-11-29T20:58:49.261762+0000 (oldest deadline 2019-11-29T20:59:34.424391+0000) 2019-11-29T21:00:01.334 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:00:01.328+0000 1694c700 -1 osd.7 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:50.033132+0000 front 2019-11-29T20:58:50.125318+0000 (oldest deadline 2019-11-29T20:59:33.380596+0000) 2019-11-29T21:00:01.350 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:00:01.345+0000 1694c700 -1 osd.2 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:48.820083+0000 front 2019-11-29T20:58:48.819313+0000 (oldest deadline 2019-11-29T20:59:32.895760+0000) 2019-11-29T21:00:01.554 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:00:01.548+0000 1694c700 -1 osd.5 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:48.939827+0000 front 2019-11-29T20:58:51.858498+0000 (oldest deadline 2019-11-29T20:59:31.806469+0000) 2019-11-29T21:00:01.732 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:00:01.727+0000 1694c700 -1 osd.4 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:51.989016+0000 front 2019-11-29T20:58:51.977328+0000 (oldest deadline 2019-11-29T20:59:34.244545+0000) 2019-11-29T21:00:01.774 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:00:01.768+0000 1694c700 -1 osd.0 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:50.333359+0000 front 2019-11-29T20:58:50.178687+0000 (oldest deadline 2019-11-29T20:59:33.499384+0000) 2019-11-29T21:00:02.027 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:00:02.022+0000 1694c700 -1 osd.1 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:49.183561+0000 front 2019-11-29T20:58:49.261762+0000 (oldest deadline 2019-11-29T20:59:34.424391+0000) 2019-11-29T21:00:02.311 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:00:02.305+0000 1694c700 -1 osd.7 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:50.033132+0000 front 2019-11-29T20:58:50.125318+0000 (oldest deadline 2019-11-29T20:59:33.380596+0000) 2019-11-29T21:00:02.355 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:00:02.350+0000 1694c700 -1 osd.2 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:48.820083+0000 front 2019-11-29T20:58:48.819313+0000 (oldest deadline 2019-11-29T20:59:32.895760+0000) 2019-11-29T21:00:02.519 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:00:02.513+0000 1694c700 -1 osd.5 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:48.939827+0000 front 2019-11-29T20:58:51.858498+0000 (oldest deadline 2019-11-29T20:59:31.806469+0000) 2019-11-29T21:00:02.754 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:00:02.748+0000 1694c700 -1 osd.4 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:51.989016+0000 front 2019-11-29T20:58:51.977328+0000 (oldest deadline 2019-11-29T20:59:34.244545+0000) 2019-11-29T21:00:02.829 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:00:02.823+0000 1694c700 -1 osd.0 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:50.333359+0000 front 2019-11-29T20:58:50.178687+0000 (oldest deadline 2019-11-29T20:59:33.499384+0000) 2019-11-29T21:00:03.068 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:00:03.063+0000 1694c700 -1 osd.1 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:49.183561+0000 front 2019-11-29T20:58:49.261762+0000 (oldest deadline 2019-11-29T20:59:34.424391+0000) 2019-11-29T21:00:03.324 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:00:03.318+0000 1694c700 -1 osd.2 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:48.820083+0000 front 2019-11-29T20:58:48.819313+0000 (oldest deadline 2019-11-29T20:59:32.895760+0000) 2019-11-29T21:00:03.356 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:00:03.350+0000 1694c700 -1 osd.7 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:50.033132+0000 front 2019-11-29T20:58:50.125318+0000 (oldest deadline 2019-11-29T20:59:33.380596+0000) 2019-11-29T21:00:03.432 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:00:03.426+0000 1694c700 -1 osd.6 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:51.441954+0000 front 2019-11-29T20:58:51.863757+0000 (oldest deadline 2019-11-29T21:00:03.416647+0000) 2019-11-29T21:00:03.526 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:00:03.520+0000 1694c700 -1 osd.5 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:48.939827+0000 front 2019-11-29T20:58:51.858498+0000 (oldest deadline 2019-11-29T20:59:31.806469+0000) 2019-11-29T21:00:03.725 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:00:03.719+0000 1694c700 -1 osd.4 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:51.989016+0000 front 2019-11-29T20:58:51.977328+0000 (oldest deadline 2019-11-29T20:59:34.244545+0000) 2019-11-29T21:00:03.851 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:00:03.845+0000 1694c700 -1 osd.0 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:50.333359+0000 front 2019-11-29T20:58:50.178687+0000 (oldest deadline 2019-11-29T20:59:33.499384+0000) 2019-11-29T21:00:04.081 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:00:04.075+0000 1694c700 -1 osd.1 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:49.183561+0000 front 2019-11-29T20:58:49.261762+0000 (oldest deadline 2019-11-29T20:59:34.424391+0000) 2019-11-29T21:00:04.311 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:00:04.305+0000 1694c700 -1 osd.2 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:48.820083+0000 front 2019-11-29T20:58:48.819313+0000 (oldest deadline 2019-11-29T20:59:32.895760+0000) 2019-11-29T21:00:04.400 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:00:04.393+0000 1694c700 -1 osd.7 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:50.033132+0000 front 2019-11-29T20:58:50.125318+0000 (oldest deadline 2019-11-29T20:59:33.380596+0000) 2019-11-29T21:00:04.455 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:00:04.448+0000 1694c700 -1 osd.6 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:51.441954+0000 front 2019-11-29T20:58:51.863757+0000 (oldest deadline 2019-11-29T21:00:03.416647+0000) 2019-11-29T21:00:04.507 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:00:04.502+0000 1694c700 -1 osd.5 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:48.939827+0000 front 2019-11-29T20:58:51.858498+0000 (oldest deadline 2019-11-29T20:59:31.806469+0000) 2019-11-29T21:00:04.769 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:00:04.762+0000 1694c700 -1 osd.4 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:51.989016+0000 front 2019-11-29T20:58:51.977328+0000 (oldest deadline 2019-11-29T20:59:34.244545+0000) 2019-11-29T21:00:04.894 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:00:04.889+0000 1694c700 -1 osd.0 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:50.333359+0000 front 2019-11-29T20:58:50.178687+0000 (oldest deadline 2019-11-29T20:59:33.499384+0000) 2019-11-29T21:00:05.098 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:00:05.092+0000 1694c700 -1 osd.1 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:49.183561+0000 front 2019-11-29T20:58:49.261762+0000 (oldest deadline 2019-11-29T20:59:34.424391+0000) 2019-11-29T21:00:05.145 INFO:tasks.ceph.mon.b.smithi022.stderr:2019-11-29T21:00:05.140+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.62:6823/10369,v1:172.21.15.62:6825/10369] for 43sec e231 v231) 2019-11-29T21:00:05.325 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:00:05.319+0000 1694c700 -1 osd.2 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:48.820083+0000 front 2019-11-29T20:58:48.819313+0000 (oldest deadline 2019-11-29T20:59:32.895760+0000) 2019-11-29T21:00:05.417 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:00:05.407+0000 1694c700 -1 osd.7 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:50.033132+0000 front 2019-11-29T20:58:50.125318+0000 (oldest deadline 2019-11-29T20:59:33.380596+0000) 2019-11-29T21:00:05.477 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:00:05.470+0000 1694c700 -1 osd.6 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:51.441954+0000 front 2019-11-29T20:58:51.863757+0000 (oldest deadline 2019-11-29T21:00:03.416647+0000) 2019-11-29T21:00:05.552 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:00:05.545+0000 1694c700 -1 osd.5 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:48.939827+0000 front 2019-11-29T20:58:51.858498+0000 (oldest deadline 2019-11-29T20:59:31.806469+0000) 2019-11-29T21:00:05.755 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:00:05.748+0000 1694c700 -1 osd.4 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:51.989016+0000 front 2019-11-29T20:58:51.977328+0000 (oldest deadline 2019-11-29T20:59:34.244545+0000) 2019-11-29T21:00:05.849 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:00:05.843+0000 1694c700 -1 osd.0 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:50.333359+0000 front 2019-11-29T20:58:50.178687+0000 (oldest deadline 2019-11-29T20:59:33.499384+0000) 2019-11-29T21:00:06.126 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:00:06.121+0000 1694c700 -1 osd.1 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:49.183561+0000 front 2019-11-29T20:58:49.261762+0000 (oldest deadline 2019-11-29T20:59:34.424391+0000) 2019-11-29T21:00:06.359 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:00:06.353+0000 1694c700 -1 osd.2 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:48.820083+0000 front 2019-11-29T20:58:48.819313+0000 (oldest deadline 2019-11-29T20:59:32.895760+0000) 2019-11-29T21:00:06.453 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:00:06.446+0000 1694c700 -1 osd.7 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:50.033132+0000 front 2019-11-29T20:58:50.125318+0000 (oldest deadline 2019-11-29T20:59:33.380596+0000) 2019-11-29T21:00:06.501 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:00:06.493+0000 1694c700 -1 osd.6 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:51.441954+0000 front 2019-11-29T20:58:51.863757+0000 (oldest deadline 2019-11-29T21:00:03.416647+0000) 2019-11-29T21:00:06.529 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:00:06.522+0000 1694c700 -1 osd.5 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:48.939827+0000 front 2019-11-29T20:58:51.858498+0000 (oldest deadline 2019-11-29T20:59:31.806469+0000) 2019-11-29T21:00:06.803 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:00:06.796+0000 1694c700 -1 osd.4 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:51.989016+0000 front 2019-11-29T20:58:51.977328+0000 (oldest deadline 2019-11-29T20:59:34.244545+0000) 2019-11-29T21:00:06.831 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:00:06.825+0000 1694c700 -1 osd.0 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:50.333359+0000 front 2019-11-29T20:58:50.178687+0000 (oldest deadline 2019-11-29T20:59:33.499384+0000) 2019-11-29T21:00:07.100 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:00:07.096+0000 1694c700 -1 osd.1 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:49.183561+0000 front 2019-11-29T20:58:49.261762+0000 (oldest deadline 2019-11-29T20:59:34.424391+0000) 2019-11-29T21:00:07.411 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:00:07.405+0000 1694c700 -1 osd.2 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:48.820083+0000 front 2019-11-29T20:58:48.819313+0000 (oldest deadline 2019-11-29T20:59:32.895760+0000) 2019-11-29T21:00:07.460 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:00:07.453+0000 1694c700 -1 osd.7 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:50.033132+0000 front 2019-11-29T20:58:50.125318+0000 (oldest deadline 2019-11-29T20:59:33.380596+0000) 2019-11-29T21:00:07.476 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:00:07.469+0000 1694c700 -1 osd.6 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:51.441954+0000 front 2019-11-29T20:58:51.863757+0000 (oldest deadline 2019-11-29T21:00:03.416647+0000) 2019-11-29T21:00:07.496 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:00:07.489+0000 1694c700 -1 osd.5 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:48.939827+0000 front 2019-11-29T20:58:51.858498+0000 (oldest deadline 2019-11-29T20:59:31.806469+0000) 2019-11-29T21:00:07.795 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:00:07.787+0000 1694c700 -1 osd.4 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:51.989016+0000 front 2019-11-29T20:58:51.977328+0000 (oldest deadline 2019-11-29T20:59:34.244545+0000) 2019-11-29T21:00:07.839 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:00:07.834+0000 1694c700 -1 osd.0 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:50.333359+0000 front 2019-11-29T20:58:50.178687+0000 (oldest deadline 2019-11-29T20:59:33.499384+0000) 2019-11-29T21:00:08.116 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:00:08.111+0000 1694c700 -1 osd.1 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:49.183561+0000 front 2019-11-29T20:58:49.261762+0000 (oldest deadline 2019-11-29T20:59:34.424391+0000) 2019-11-29T21:00:08.395 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:00:08.390+0000 1694c700 -1 osd.2 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:48.820083+0000 front 2019-11-29T20:58:48.819313+0000 (oldest deadline 2019-11-29T20:59:32.895760+0000) 2019-11-29T21:00:08.469 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:00:08.462+0000 1694c700 -1 osd.6 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:51.441954+0000 front 2019-11-29T20:58:51.863757+0000 (oldest deadline 2019-11-29T21:00:03.416647+0000) 2019-11-29T21:00:08.499 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:00:08.492+0000 1694c700 -1 osd.7 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:50.033132+0000 front 2019-11-29T20:58:50.125318+0000 (oldest deadline 2019-11-29T20:59:33.380596+0000) 2019-11-29T21:00:08.524 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:00:08.516+0000 1694c700 -1 osd.5 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:48.939827+0000 front 2019-11-29T20:58:51.858498+0000 (oldest deadline 2019-11-29T20:59:31.806469+0000) 2019-11-29T21:00:08.797 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:00:08.790+0000 1694c700 -1 osd.4 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:51.989016+0000 front 2019-11-29T20:58:51.977328+0000 (oldest deadline 2019-11-29T20:59:34.244545+0000) 2019-11-29T21:00:08.818 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:00:08.812+0000 1694c700 -1 osd.0 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:50.333359+0000 front 2019-11-29T20:58:50.178687+0000 (oldest deadline 2019-11-29T20:59:33.499384+0000) 2019-11-29T21:00:09.072 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:00:09.066+0000 1694c700 -1 osd.1 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:49.183561+0000 front 2019-11-29T20:58:49.261762+0000 (oldest deadline 2019-11-29T20:59:34.424391+0000) 2019-11-29T21:00:09.373 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:00:09.367+0000 1694c700 -1 osd.2 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:48.820083+0000 front 2019-11-29T20:58:48.819313+0000 (oldest deadline 2019-11-29T20:59:32.895760+0000) 2019-11-29T21:00:09.482 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:00:09.475+0000 1694c700 -1 osd.6 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:51.441954+0000 front 2019-11-29T20:58:51.863757+0000 (oldest deadline 2019-11-29T21:00:03.416647+0000) 2019-11-29T21:00:09.485 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:00:09.479+0000 1694c700 -1 osd.7 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:50.033132+0000 front 2019-11-29T20:58:50.125318+0000 (oldest deadline 2019-11-29T20:59:33.380596+0000) 2019-11-29T21:00:09.575 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:00:09.567+0000 1694c700 -1 osd.5 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:48.939827+0000 front 2019-11-29T20:58:51.858498+0000 (oldest deadline 2019-11-29T20:59:31.806469+0000) 2019-11-29T21:00:09.784 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:00:09.777+0000 1694c700 -1 osd.0 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:50.333359+0000 front 2019-11-29T20:58:50.178687+0000 (oldest deadline 2019-11-29T20:59:33.499384+0000) 2019-11-29T21:00:09.805 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:00:09.798+0000 1694c700 -1 osd.4 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:51.989016+0000 front 2019-11-29T20:58:51.977328+0000 (oldest deadline 2019-11-29T20:59:34.244545+0000) 2019-11-29T21:00:10.082 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:00:10.076+0000 1694c700 -1 osd.1 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:49.183561+0000 front 2019-11-29T20:58:49.261762+0000 (oldest deadline 2019-11-29T20:59:34.424391+0000) 2019-11-29T21:00:10.219 INFO:tasks.ceph.mon.b.smithi022.stderr:2019-11-29T21:00:10.209+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.62:6823/10369,v1:172.21.15.62:6825/10369] for 43sec e231 v231) 2019-11-29T21:00:10.401 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:00:10.396+0000 1694c700 -1 osd.2 231 heartbeat_check: no reply from 172.21.15.62:6828 osd.3 since back 2019-11-29T20:58:48.820083+0000 front 2019-11-29T20:58:48.819313+0000 (oldest deadline 2019-11-29T20:59:32.895760+0000) 2019-11-29T21:00:45.661 INFO:tasks.ceph.osd.3.smithi062.stderr:*** Caught signal (Segmentation fault) ** 2019-11-29T21:00:45.661 INFO:tasks.ceph.osd.3.smithi062.stderr: in thread 124ad700 thread_name:msgr-worker-2 2019-11-29T21:00:45.719 INFO:tasks.ceph.osd.3.smithi062.stderr: ceph version 15.0.0-7809-g656c8e8 (656c8e8049c2c1acd363143c842c2edf1fe09b64) octopus (dev) 2019-11-29T21:00:45.719 INFO:tasks.ceph.osd.3.smithi062.stderr: 1: (()+0xf5f0) [0xc09b5f0] 2019-11-29T21:00:45.719 INFO:tasks.ceph.osd.3.smithi062.stderr: 2: (MonClient::handle_auth_done(Connection*, AuthConnectionMeta*, unsigned long, unsigned int, ceph::buffer::v14_2_0::list const&, CryptoKey*, std::string*)+0x71) [0xe89561] 2019-11-29T21:00:45.719 INFO:tasks.ceph.osd.3.smithi062.stderr: 3: (ProtocolV2::handle_auth_done(ceph::buffer::v14_2_0::list&)+0x2e0) [0x100abc0] 2019-11-29T21:00:45.719 INFO:tasks.ceph.osd.3.smithi062.stderr: 4: (ProtocolV2::handle_frame_payload()+0x1d3) [0x1017963] 2019-11-29T21:00:45.719 INFO:tasks.ceph.osd.3.smithi062.stderr: 5: (ProtocolV2::handle_read_frame_dispatch()+0x150) [0x1017be0] 2019-11-29T21:00:45.719 INFO:tasks.ceph.osd.3.smithi062.stderr: 6: (ProtocolV2::handle_read_frame_epilogue_main(std::unique_ptr&&, int)+0x44d) [0x101813d] 2019-11-29T21:00:45.720 INFO:tasks.ceph.osd.3.smithi062.stderr: 7: (ProtocolV2::run_continuation(Ct&)+0x34) [0x1000dc4] 2019-11-29T21:00:45.720 INFO:tasks.ceph.osd.3.smithi062.stderr: 8: (AsyncConnection::process()+0x794) [0xfdb414] 2019-11-29T21:00:45.720 INFO:tasks.ceph.osd.3.smithi062.stderr: 9: (EventCenter::process_events(unsigned int, std::chrono::duration >*)+0xa25) [0xe3c905] 2019-11-29T21:00:45.720 INFO:tasks.ceph.osd.3.smithi062.stderr: 10: (()+0xd3a317) [0xe42317] 2019-11-29T21:00:45.720 INFO:tasks.ceph.osd.3.smithi062.stderr: 11: (()+0x12121ff) [0x131a1ff] 2019-11-29T21:00:45.720 INFO:tasks.ceph.osd.3.smithi062.stderr: 12: (()+0x7e65) [0xc093e65] 2019-11-29T21:00:45.720 INFO:tasks.ceph.osd.3.smithi062.stderr: 13: (clone()+0x6d) [0xd20b88d] 2019-11-29T21:00:45.748 INFO:tasks.ceph.osd.3.smithi062.stderr:2019-11-29T21:00:45.743+0000 124ad700 -1 *** Caught signal (Segmentation fault) ** 2019-11-29T21:00:45.748 INFO:tasks.ceph.osd.3.smithi062.stderr: in thread 124ad700 thread_name:msgr-worker-2 2019-11-29T21:00:45.748 INFO:tasks.ceph.osd.3.smithi062.stderr: 2019-11-29T21:00:45.748 INFO:tasks.ceph.osd.3.smithi062.stderr: ceph version 15.0.0-7809-g656c8e8 (656c8e8049c2c1acd363143c842c2edf1fe09b64) octopus (dev) 2019-11-29T21:00:45.749 INFO:tasks.ceph.osd.3.smithi062.stderr: 1: (()+0xf5f0) [0xc09b5f0] 2019-11-29T21:00:45.749 INFO:tasks.ceph.osd.3.smithi062.stderr: 2: (MonClient::handle_auth_done(Connection*, AuthConnectionMeta*, unsigned long, unsigned int, ceph::buffer::v14_2_0::list const&, CryptoKey*, std::string*)+0x71) [0xe89561] 2019-11-29T21:00:45.749 INFO:tasks.ceph.osd.3.smithi062.stderr: 3: (ProtocolV2::handle_auth_done(ceph::buffer::v14_2_0::list&)+0x2e0) [0x100abc0] 2019-11-29T21:00:45.749 INFO:tasks.ceph.osd.3.smithi062.stderr: 4: (ProtocolV2::handle_frame_payload()+0x1d3) [0x1017963] 2019-11-29T21:00:45.749 INFO:tasks.ceph.osd.3.smithi062.stderr: 5: (ProtocolV2::handle_read_frame_dispatch()+0x150) [0x1017be0] 2019-11-29T21:00:45.749 INFO:tasks.ceph.osd.3.smithi062.stderr: 6: (ProtocolV2::handle_read_frame_epilogue_main(std::unique_ptr&&, int)+0x44d) [0x101813d] 2019-11-29T21:00:45.749 INFO:tasks.ceph.osd.3.smithi062.stderr: 7: (ProtocolV2::run_continuation(Ct&)+0x34) [0x1000dc4] 2019-11-29T21:00:45.750 INFO:tasks.ceph.osd.3.smithi062.stderr: 8: (AsyncConnection::process()+0x794) [0xfdb414] 2019-11-29T21:00:45.750 INFO:tasks.ceph.osd.3.smithi062.stderr: 9: (EventCenter::process_events(unsigned int, std::chrono::duration >*)+0xa25) [0xe3c905] 2019-11-29T21:00:45.750 INFO:tasks.ceph.osd.3.smithi062.stderr: 10: (()+0xd3a317) [0xe42317] 2019-11-29T21:00:45.750 INFO:tasks.ceph.osd.3.smithi062.stderr: 11: (()+0x12121ff) [0x131a1ff] 2019-11-29T21:00:45.750 INFO:tasks.ceph.osd.3.smithi062.stderr: 12: (()+0x7e65) [0xc093e65] 2019-11-29T21:00:45.750 INFO:tasks.ceph.osd.3.smithi062.stderr: 13: (clone()+0x6d) [0xd20b88d] 2019-11-29T21:00:45.750 INFO:tasks.ceph.osd.3.smithi062.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2019-11-29T21:00:45.750 INFO:tasks.ceph.osd.3.smithi062.stderr: 2019-11-29T21:00:46.146 INFO:tasks.ceph.osd.3.smithi062.stderr: -9> 2019-11-29T21:00:45.743+0000 124ad700 -1 *** Caught signal (Segmentation fault) ** 2019-11-29T21:00:46.146 INFO:tasks.ceph.osd.3.smithi062.stderr: in thread 124ad700 thread_name:msgr-worker-2 2019-11-29T21:00:46.146 INFO:tasks.ceph.osd.3.smithi062.stderr: 2019-11-29T21:00:46.146 INFO:tasks.ceph.osd.3.smithi062.stderr: ceph version 15.0.0-7809-g656c8e8 (656c8e8049c2c1acd363143c842c2edf1fe09b64) octopus (dev) 2019-11-29T21:00:46.147 INFO:tasks.ceph.osd.3.smithi062.stderr: 1: (()+0xf5f0) [0xc09b5f0] 2019-11-29T21:00:46.147 INFO:tasks.ceph.osd.3.smithi062.stderr: 2: (MonClient::handle_auth_done(Connection*, AuthConnectionMeta*, unsigned long, unsigned int, ceph::buffer::v14_2_0::list const&, CryptoKey*, std::string*)+0x71) [0xe89561] 2019-11-29T21:00:46.147 INFO:tasks.ceph.osd.3.smithi062.stderr: 3: (ProtocolV2::handle_auth_done(ceph::buffer::v14_2_0::list&)+0x2e0) [0x100abc0] 2019-11-29T21:00:46.147 INFO:tasks.ceph.osd.3.smithi062.stderr: 4: (ProtocolV2::handle_frame_payload()+0x1d3) [0x1017963] 2019-11-29T21:00:46.147 INFO:tasks.ceph.osd.3.smithi062.stderr: 5: (ProtocolV2::handle_read_frame_dispatch()+0x150) [0x1017be0] 2019-11-29T21:00:46.147 INFO:tasks.ceph.osd.3.smithi062.stderr: 6: (ProtocolV2::handle_read_frame_epilogue_main(std::unique_ptr&&, int)+0x44d) [0x101813d] 2019-11-29T21:00:46.147 INFO:tasks.ceph.osd.3.smithi062.stderr: 7: (ProtocolV2::run_continuation(Ct&)+0x34) [0x1000dc4] 2019-11-29T21:00:46.148 INFO:tasks.ceph.osd.3.smithi062.stderr: 8: (AsyncConnection::process()+0x794) [0xfdb414] 2019-11-29T21:00:46.148 INFO:tasks.ceph.osd.3.smithi062.stderr: 9: (EventCenter::process_events(unsigned int, std::chrono::duration >*)+0xa25) [0xe3c905] 2019-11-29T21:00:46.148 INFO:tasks.ceph.osd.3.smithi062.stderr: 10: (()+0xd3a317) [0xe42317] 2019-11-29T21:00:46.148 INFO:tasks.ceph.osd.3.smithi062.stderr: 11: (()+0x12121ff) [0x131a1ff] 2019-11-29T21:00:46.148 INFO:tasks.ceph.osd.3.smithi062.stderr: 12: (()+0x7e65) [0xc093e65] 2019-11-29T21:00:46.148 INFO:tasks.ceph.osd.3.smithi062.stderr: 13: (clone()+0x6d) [0xd20b88d] 2019-11-29T21:00:46.148 INFO:tasks.ceph.osd.3.smithi062.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2019-11-29T21:00:46.148 INFO:tasks.ceph.osd.3.smithi062.stderr: 2019-11-29T21:00:46.525 INFO:tasks.ceph.osd.3.smithi062.stderr: -60> 2019-11-29T21:00:45.743+0000 124ad700 -1 *** Caught signal (Segmentation fault) ** 2019-11-29T21:00:46.525 INFO:tasks.ceph.osd.3.smithi062.stderr: in thread 124ad700 thread_name:msgr-worker-2 2019-11-29T21:00:46.525 INFO:tasks.ceph.osd.3.smithi062.stderr: 2019-11-29T21:00:46.525 INFO:tasks.ceph.osd.3.smithi062.stderr: ceph version 15.0.0-7809-g656c8e8 (656c8e8049c2c1acd363143c842c2edf1fe09b64) octopus (dev) 2019-11-29T21:00:46.525 INFO:tasks.ceph.osd.3.smithi062.stderr: 1: (()+0xf5f0) [0xc09b5f0] 2019-11-29T21:00:46.525 INFO:tasks.ceph.osd.3.smithi062.stderr: 2: (MonClient::handle_auth_done(Connection*, AuthConnectionMeta*, unsigned long, unsigned int, ceph::buffer::v14_2_0::list const&, CryptoKey*, std::string*)+0x71) [0xe89561] 2019-11-29T21:00:46.526 INFO:tasks.ceph.osd.3.smithi062.stderr: 3: (ProtocolV2::handle_auth_done(ceph::buffer::v14_2_0::list&)+0x2e0) [0x100abc0] 2019-11-29T21:00:46.526 INFO:tasks.ceph.osd.3.smithi062.stderr: 4: (ProtocolV2::handle_frame_payload()+0x1d3) [0x1017963] 2019-11-29T21:00:46.526 INFO:tasks.ceph.osd.3.smithi062.stderr: 5: (ProtocolV2::handle_read_frame_dispatch()+0x150) [0x1017be0] 2019-11-29T21:00:46.526 INFO:tasks.ceph.osd.3.smithi062.stderr: 6: (ProtocolV2::handle_read_frame_epilogue_main(std::unique_ptr&&, int)+0x44d) [0x101813d] 2019-11-29T21:00:46.526 INFO:tasks.ceph.osd.3.smithi062.stderr: 7: (ProtocolV2::run_continuation(Ct&)+0x34) [0x1000dc4] 2019-11-29T21:00:46.526 INFO:tasks.ceph.osd.3.smithi062.stderr: 8: (AsyncConnection::process()+0x794) [0xfdb414] 2019-11-29T21:00:46.526 INFO:tasks.ceph.osd.3.smithi062.stderr: 9: (EventCenter::process_events(unsigned int, std::chrono::duration >*)+0xa25) [0xe3c905] 2019-11-29T21:00:46.527 INFO:tasks.ceph.osd.3.smithi062.stderr: 10: (()+0xd3a317) [0xe42317] 2019-11-29T21:00:46.527 INFO:tasks.ceph.osd.3.smithi062.stderr: 11: (()+0x12121ff) [0x131a1ff] 2019-11-29T21:00:46.527 INFO:tasks.ceph.osd.3.smithi062.stderr: 12: (()+0x7e65) [0xc093e65] 2019-11-29T21:00:46.527 INFO:tasks.ceph.osd.3.smithi062.stderr: 13: (clone()+0x6d) [0xd20b88d] 2019-11-29T21:00:46.527 INFO:tasks.ceph.osd.3.smithi062.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2019-11-29T21:00:46.527 INFO:tasks.ceph.osd.3.smithi062.stderr: 2019-11-29T21:00:51.179 INFO:tasks.ceph.osd.3.smithi062.stderr:daemon-helper: command crashed with signal 11 2019-11-29T21:00:54.636 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2019-11-29T21:01:00.948 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~6s 2019-11-29T21:01:07.261 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~13s 2019-11-29T21:01:08.684 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:01:08.675+0000 1694c700 -1 osd.7 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:25.372404+0000 front 2019-11-29T21:00:25.371419+0000 (oldest deadline 2019-11-29T21:01:07.647502+0000) 2019-11-29T21:01:08.920 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:01:08.914+0000 1694c700 -1 osd.6 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:26.793488+0000 front 2019-11-29T21:00:26.512756+0000 (oldest deadline 2019-11-29T21:01:08.231536+0000) 2019-11-29T21:01:09.658 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:01:09.652+0000 1694c700 -1 osd.7 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:25.372404+0000 front 2019-11-29T21:00:25.371419+0000 (oldest deadline 2019-11-29T21:01:07.647502+0000) 2019-11-29T21:01:09.904 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:01:09.898+0000 1694c700 -1 osd.6 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:26.793488+0000 front 2019-11-29T21:00:26.512756+0000 (oldest deadline 2019-11-29T21:01:08.231536+0000) 2019-11-29T21:01:10.641 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:01:10.636+0000 1694c700 -1 osd.7 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:25.372404+0000 front 2019-11-29T21:00:25.371419+0000 (oldest deadline 2019-11-29T21:01:07.647502+0000) 2019-11-29T21:01:10.921 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:01:10.916+0000 1694c700 -1 osd.6 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:26.793488+0000 front 2019-11-29T21:00:26.512756+0000 (oldest deadline 2019-11-29T21:01:08.231536+0000) 2019-11-29T21:01:10.942 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:01:10.937+0000 1694c700 -1 osd.2 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:24.473522+0000 front 2019-11-29T21:00:24.211462+0000 (oldest deadline 2019-11-29T21:01:10.098799+0000) 2019-11-29T21:01:11.338 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:01:11.330+0000 1694c700 -1 osd.0 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:25.271183+0000 front 2019-11-29T21:00:25.222639+0000 (oldest deadline 2019-11-29T21:01:11.083002+0000) 2019-11-29T21:01:11.497 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:01:11.491+0000 1694c700 -1 osd.4 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:25.941743+0000 front 2019-11-29T21:00:25.936235+0000 (oldest deadline 2019-11-29T21:01:11.037685+0000) 2019-11-29T21:01:11.645 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:01:11.639+0000 1694c700 -1 osd.1 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:26.609525+0000 front 2019-11-29T21:00:26.572537+0000 (oldest deadline 2019-11-29T21:01:11.546232+0000) 2019-11-29T21:01:11.672 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:01:11.666+0000 1694c700 -1 osd.7 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:25.372404+0000 front 2019-11-29T21:00:25.371419+0000 (oldest deadline 2019-11-29T21:01:07.647502+0000) 2019-11-29T21:01:11.942 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:01:11.936+0000 1694c700 -1 osd.2 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:24.473522+0000 front 2019-11-29T21:00:24.211462+0000 (oldest deadline 2019-11-29T21:01:10.098799+0000) 2019-11-29T21:01:11.966 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:01:11.959+0000 1694c700 -1 osd.6 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:26.793488+0000 front 2019-11-29T21:00:26.512756+0000 (oldest deadline 2019-11-29T21:01:08.231536+0000) 2019-11-29T21:01:12.313 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:01:12.308+0000 1694c700 -1 osd.0 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:25.271183+0000 front 2019-11-29T21:00:25.222639+0000 (oldest deadline 2019-11-29T21:01:11.083002+0000) 2019-11-29T21:01:12.496 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:01:12.491+0000 1694c700 -1 osd.4 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:25.941743+0000 front 2019-11-29T21:00:25.936235+0000 (oldest deadline 2019-11-29T21:01:11.037685+0000) 2019-11-29T21:01:12.659 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:01:12.653+0000 1694c700 -1 osd.1 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:26.609525+0000 front 2019-11-29T21:00:26.572537+0000 (oldest deadline 2019-11-29T21:01:11.546232+0000) 2019-11-29T21:01:12.709 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:01:12.705+0000 1694c700 -1 osd.7 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:25.372404+0000 front 2019-11-29T21:00:25.371419+0000 (oldest deadline 2019-11-29T21:01:07.647502+0000) 2019-11-29T21:01:12.925 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:01:12.919+0000 1694c700 -1 osd.2 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:24.473522+0000 front 2019-11-29T21:00:24.211462+0000 (oldest deadline 2019-11-29T21:01:10.098799+0000) 2019-11-29T21:01:12.967 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:01:12.962+0000 1694c700 -1 osd.6 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:26.793488+0000 front 2019-11-29T21:00:26.512756+0000 (oldest deadline 2019-11-29T21:01:08.231536+0000) 2019-11-29T21:01:13.361 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:01:13.356+0000 1694c700 -1 osd.0 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:25.271183+0000 front 2019-11-29T21:00:25.222639+0000 (oldest deadline 2019-11-29T21:01:11.083002+0000) 2019-11-29T21:01:13.472 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:01:13.467+0000 1694c700 -1 osd.4 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:25.941743+0000 front 2019-11-29T21:00:25.936235+0000 (oldest deadline 2019-11-29T21:01:11.037685+0000) 2019-11-29T21:01:13.571 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~19s 2019-11-29T21:01:13.618 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:01:13.612+0000 1694c700 -1 osd.1 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:26.609525+0000 front 2019-11-29T21:00:26.572537+0000 (oldest deadline 2019-11-29T21:01:11.546232+0000) 2019-11-29T21:01:13.750 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:01:13.745+0000 1694c700 -1 osd.7 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:25.372404+0000 front 2019-11-29T21:00:25.371419+0000 (oldest deadline 2019-11-29T21:01:07.647502+0000) 2019-11-29T21:01:13.942 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:01:13.937+0000 1694c700 -1 osd.6 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:26.793488+0000 front 2019-11-29T21:00:26.512756+0000 (oldest deadline 2019-11-29T21:01:08.231536+0000) 2019-11-29T21:01:13.946 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:01:13.942+0000 1694c700 -1 osd.2 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:24.473522+0000 front 2019-11-29T21:00:24.211462+0000 (oldest deadline 2019-11-29T21:01:10.098799+0000) 2019-11-29T21:01:14.344 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:01:14.339+0000 1694c700 -1 osd.0 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:25.271183+0000 front 2019-11-29T21:00:25.222639+0000 (oldest deadline 2019-11-29T21:01:11.083002+0000) 2019-11-29T21:01:14.512 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:01:14.507+0000 1694c700 -1 osd.4 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:25.941743+0000 front 2019-11-29T21:00:25.936235+0000 (oldest deadline 2019-11-29T21:01:11.037685+0000) 2019-11-29T21:01:14.573 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:01:14.568+0000 1694c700 -1 osd.1 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:26.609525+0000 front 2019-11-29T21:00:26.572537+0000 (oldest deadline 2019-11-29T21:01:11.546232+0000) 2019-11-29T21:01:14.720 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:01:14.714+0000 1694c700 -1 osd.7 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:25.372404+0000 front 2019-11-29T21:00:25.371419+0000 (oldest deadline 2019-11-29T21:01:07.647502+0000) 2019-11-29T21:01:14.967 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:01:14.962+0000 1694c700 -1 osd.6 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:26.793488+0000 front 2019-11-29T21:00:26.512756+0000 (oldest deadline 2019-11-29T21:01:08.231536+0000) 2019-11-29T21:01:14.975 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:01:14.970+0000 1694c700 -1 osd.2 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:24.473522+0000 front 2019-11-29T21:00:24.211462+0000 (oldest deadline 2019-11-29T21:01:10.098799+0000) 2019-11-29T21:01:15.361 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:01:15.355+0000 1694c700 -1 osd.0 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:25.271183+0000 front 2019-11-29T21:00:25.222639+0000 (oldest deadline 2019-11-29T21:01:11.083002+0000) 2019-11-29T21:01:15.528 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:01:15.523+0000 1694c700 -1 osd.1 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:26.609525+0000 front 2019-11-29T21:00:26.572537+0000 (oldest deadline 2019-11-29T21:01:11.546232+0000) 2019-11-29T21:01:15.553 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:01:15.548+0000 1694c700 -1 osd.4 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:25.941743+0000 front 2019-11-29T21:00:25.936235+0000 (oldest deadline 2019-11-29T21:01:11.037685+0000) 2019-11-29T21:01:15.694 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:01:15.688+0000 1694c700 -1 osd.7 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:25.372404+0000 front 2019-11-29T21:00:25.371419+0000 (oldest deadline 2019-11-29T21:01:07.647502+0000) 2019-11-29T21:01:15.964 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:01:15.959+0000 1694c700 -1 osd.6 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:26.793488+0000 front 2019-11-29T21:00:26.512756+0000 (oldest deadline 2019-11-29T21:01:08.231536+0000) 2019-11-29T21:01:15.989 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:01:15.983+0000 1694c700 -1 osd.2 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:24.473522+0000 front 2019-11-29T21:00:24.211462+0000 (oldest deadline 2019-11-29T21:01:10.098799+0000) 2019-11-29T21:01:16.363 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:01:16.357+0000 1694c700 -1 osd.0 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:25.271183+0000 front 2019-11-29T21:00:25.222639+0000 (oldest deadline 2019-11-29T21:01:11.083002+0000) 2019-11-29T21:01:16.512 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:01:16.505+0000 1694c700 -1 osd.1 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:26.609525+0000 front 2019-11-29T21:00:26.572537+0000 (oldest deadline 2019-11-29T21:01:11.546232+0000) 2019-11-29T21:01:16.547 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:01:16.542+0000 1694c700 -1 osd.4 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:25.941743+0000 front 2019-11-29T21:00:25.936235+0000 (oldest deadline 2019-11-29T21:01:11.037685+0000) 2019-11-29T21:01:16.650 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:01:16.645+0000 1694c700 -1 osd.7 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:25.372404+0000 front 2019-11-29T21:00:25.371419+0000 (oldest deadline 2019-11-29T21:01:07.647502+0000) 2019-11-29T21:01:16.955 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:01:16.947+0000 1694c700 -1 osd.2 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:24.473522+0000 front 2019-11-29T21:00:24.211462+0000 (oldest deadline 2019-11-29T21:01:10.098799+0000) 2019-11-29T21:01:16.995 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:01:16.991+0000 1694c700 -1 osd.6 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:26.793488+0000 front 2019-11-29T21:00:26.512756+0000 (oldest deadline 2019-11-29T21:01:08.231536+0000) 2019-11-29T21:01:17.398 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:01:17.393+0000 1694c700 -1 osd.0 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:25.271183+0000 front 2019-11-29T21:00:25.222639+0000 (oldest deadline 2019-11-29T21:01:11.083002+0000) 2019-11-29T21:01:17.512 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:01:17.506+0000 1694c700 -1 osd.1 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:26.609525+0000 front 2019-11-29T21:00:26.572537+0000 (oldest deadline 2019-11-29T21:01:11.546232+0000) 2019-11-29T21:01:17.546 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:01:17.540+0000 1694c700 -1 osd.4 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:25.941743+0000 front 2019-11-29T21:00:25.936235+0000 (oldest deadline 2019-11-29T21:01:11.037685+0000) 2019-11-29T21:01:17.631 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:01:17.623+0000 1694c700 -1 osd.7 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:25.372404+0000 front 2019-11-29T21:00:25.371419+0000 (oldest deadline 2019-11-29T21:01:07.647502+0000) 2019-11-29T21:01:17.939 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:01:17.933+0000 1694c700 -1 osd.2 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:24.473522+0000 front 2019-11-29T21:00:24.211462+0000 (oldest deadline 2019-11-29T21:01:10.098799+0000) 2019-11-29T21:01:18.015 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:01:18.010+0000 1694c700 -1 osd.6 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:26.793488+0000 front 2019-11-29T21:00:26.512756+0000 (oldest deadline 2019-11-29T21:01:08.231536+0000) 2019-11-29T21:01:18.428 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:01:18.423+0000 1694c700 -1 osd.0 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:25.271183+0000 front 2019-11-29T21:00:25.222639+0000 (oldest deadline 2019-11-29T21:01:11.083002+0000) 2019-11-29T21:01:18.544 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:01:18.538+0000 1694c700 -1 osd.4 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:25.941743+0000 front 2019-11-29T21:00:25.936235+0000 (oldest deadline 2019-11-29T21:01:11.037685+0000) 2019-11-29T21:01:18.556 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:01:18.550+0000 1694c700 -1 osd.1 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:26.609525+0000 front 2019-11-29T21:00:26.572537+0000 (oldest deadline 2019-11-29T21:01:11.546232+0000) 2019-11-29T21:01:18.679 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:01:18.674+0000 1694c700 -1 osd.7 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:25.372404+0000 front 2019-11-29T21:00:25.371419+0000 (oldest deadline 2019-11-29T21:01:07.647502+0000) 2019-11-29T21:01:18.897 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:01:18.891+0000 1694c700 -1 osd.2 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:24.473522+0000 front 2019-11-29T21:00:24.211462+0000 (oldest deadline 2019-11-29T21:01:10.098799+0000) 2019-11-29T21:01:19.070 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:01:19.065+0000 1694c700 -1 osd.6 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:26.793488+0000 front 2019-11-29T21:00:26.512756+0000 (oldest deadline 2019-11-29T21:01:08.231536+0000) 2019-11-29T21:01:19.444 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:01:19.439+0000 1694c700 -1 osd.0 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:25.271183+0000 front 2019-11-29T21:00:25.222639+0000 (oldest deadline 2019-11-29T21:01:11.083002+0000) 2019-11-29T21:01:19.551 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:01:19.546+0000 1694c700 -1 osd.4 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:25.941743+0000 front 2019-11-29T21:00:25.936235+0000 (oldest deadline 2019-11-29T21:01:11.037685+0000) 2019-11-29T21:01:19.559 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:01:19.554+0000 1694c700 -1 osd.1 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:26.609525+0000 front 2019-11-29T21:00:26.572537+0000 (oldest deadline 2019-11-29T21:01:11.546232+0000) 2019-11-29T21:01:19.656 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:01:19.650+0000 1694c700 -1 osd.7 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:25.372404+0000 front 2019-11-29T21:00:25.371419+0000 (oldest deadline 2019-11-29T21:01:07.647502+0000) 2019-11-29T21:01:19.879 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~25s 2019-11-29T21:01:19.904 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:01:19.898+0000 1694c700 -1 osd.2 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:24.473522+0000 front 2019-11-29T21:00:24.211462+0000 (oldest deadline 2019-11-29T21:01:10.098799+0000) 2019-11-29T21:01:20.110 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:01:20.105+0000 1694c700 -1 osd.6 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:26.793488+0000 front 2019-11-29T21:00:26.512756+0000 (oldest deadline 2019-11-29T21:01:08.231536+0000) 2019-11-29T21:01:20.443 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:01:20.438+0000 1694c700 -1 osd.0 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:25.271183+0000 front 2019-11-29T21:00:25.222639+0000 (oldest deadline 2019-11-29T21:01:11.083002+0000) 2019-11-29T21:01:20.516 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:01:20.510+0000 1694c700 -1 osd.4 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:25.941743+0000 front 2019-11-29T21:00:25.936235+0000 (oldest deadline 2019-11-29T21:01:11.037685+0000) 2019-11-29T21:01:20.585 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:01:20.580+0000 1694c700 -1 osd.1 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:26.609525+0000 front 2019-11-29T21:00:26.572537+0000 (oldest deadline 2019-11-29T21:01:11.546232+0000) 2019-11-29T21:01:20.678 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:01:20.673+0000 1694c700 -1 osd.7 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:25.372404+0000 front 2019-11-29T21:00:25.371419+0000 (oldest deadline 2019-11-29T21:01:07.647502+0000) 2019-11-29T21:01:20.879 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:01:20.873+0000 1694c700 -1 osd.2 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:24.473522+0000 front 2019-11-29T21:00:24.211462+0000 (oldest deadline 2019-11-29T21:01:10.098799+0000) 2019-11-29T21:01:21.085 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:01:21.073+0000 1694c700 -1 osd.6 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:26.793488+0000 front 2019-11-29T21:00:26.512756+0000 (oldest deadline 2019-11-29T21:01:08.231536+0000) 2019-11-29T21:01:21.402 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:01:21.396+0000 1694c700 -1 osd.0 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:25.271183+0000 front 2019-11-29T21:00:25.222639+0000 (oldest deadline 2019-11-29T21:01:11.083002+0000) 2019-11-29T21:01:21.483 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:01:21.477+0000 1694c700 -1 osd.4 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:25.941743+0000 front 2019-11-29T21:00:25.936235+0000 (oldest deadline 2019-11-29T21:01:11.037685+0000) 2019-11-29T21:01:21.591 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:01:21.586+0000 1694c700 -1 osd.1 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:26.609525+0000 front 2019-11-29T21:00:26.572537+0000 (oldest deadline 2019-11-29T21:01:11.546232+0000) 2019-11-29T21:01:21.643 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:01:21.637+0000 1694c700 -1 osd.7 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:25.372404+0000 front 2019-11-29T21:00:25.371419+0000 (oldest deadline 2019-11-29T21:01:07.647502+0000) 2019-11-29T21:01:21.920 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:01:21.915+0000 1694c700 -1 osd.2 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:24.473522+0000 front 2019-11-29T21:00:24.211462+0000 (oldest deadline 2019-11-29T21:01:10.098799+0000) 2019-11-29T21:01:22.080 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:01:22.074+0000 1694c700 -1 osd.6 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:26.793488+0000 front 2019-11-29T21:00:26.512756+0000 (oldest deadline 2019-11-29T21:01:08.231536+0000) 2019-11-29T21:01:22.449 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:01:22.444+0000 1694c700 -1 osd.0 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:25.271183+0000 front 2019-11-29T21:00:25.222639+0000 (oldest deadline 2019-11-29T21:01:11.083002+0000) 2019-11-29T21:01:22.451 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:01:22.445+0000 1694c700 -1 osd.4 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:25.941743+0000 front 2019-11-29T21:00:25.936235+0000 (oldest deadline 2019-11-29T21:01:11.037685+0000) 2019-11-29T21:01:22.579 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:01:22.574+0000 1694c700 -1 osd.1 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:26.609525+0000 front 2019-11-29T21:00:26.572537+0000 (oldest deadline 2019-11-29T21:01:11.546232+0000) 2019-11-29T21:01:22.642 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:01:22.636+0000 1694c700 -1 osd.7 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:25.372404+0000 front 2019-11-29T21:00:25.371419+0000 (oldest deadline 2019-11-29T21:01:07.647502+0000) 2019-11-29T21:01:22.912 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:01:22.906+0000 1694c700 -1 osd.2 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:24.473522+0000 front 2019-11-29T21:00:24.211462+0000 (oldest deadline 2019-11-29T21:01:10.098799+0000) 2019-11-29T21:01:23.076 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:01:23.069+0000 1694c700 -1 osd.6 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:26.793488+0000 front 2019-11-29T21:00:26.512756+0000 (oldest deadline 2019-11-29T21:01:08.231536+0000) 2019-11-29T21:01:23.416 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:01:23.410+0000 1694c700 -1 osd.4 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:25.941743+0000 front 2019-11-29T21:00:25.936235+0000 (oldest deadline 2019-11-29T21:01:11.037685+0000) 2019-11-29T21:01:23.417 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:01:23.412+0000 1694c700 -1 osd.0 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:25.271183+0000 front 2019-11-29T21:00:25.222639+0000 (oldest deadline 2019-11-29T21:01:11.083002+0000) 2019-11-29T21:01:23.572 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:01:23.566+0000 1694c700 -1 osd.1 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:26.609525+0000 front 2019-11-29T21:00:26.572537+0000 (oldest deadline 2019-11-29T21:01:11.546232+0000) 2019-11-29T21:01:23.619 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:01:23.603+0000 1694c700 -1 osd.7 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:25.372404+0000 front 2019-11-29T21:00:25.371419+0000 (oldest deadline 2019-11-29T21:01:07.647502+0000) 2019-11-29T21:01:23.893 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:01:23.888+0000 1694c700 -1 osd.2 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:24.473522+0000 front 2019-11-29T21:00:24.211462+0000 (oldest deadline 2019-11-29T21:01:10.098799+0000) 2019-11-29T21:01:24.108 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:01:24.102+0000 1694c700 -1 osd.6 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:26.793488+0000 front 2019-11-29T21:00:26.512756+0000 (oldest deadline 2019-11-29T21:01:08.231536+0000) 2019-11-29T21:01:24.391 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:01:24.385+0000 1694c700 -1 osd.0 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:25.271183+0000 front 2019-11-29T21:00:25.222639+0000 (oldest deadline 2019-11-29T21:01:11.083002+0000) 2019-11-29T21:01:24.394 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:01:24.387+0000 1694c700 -1 osd.4 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:25.941743+0000 front 2019-11-29T21:00:25.936235+0000 (oldest deadline 2019-11-29T21:01:11.037685+0000) 2019-11-29T21:01:24.531 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:01:24.525+0000 1694c700 -1 osd.1 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:26.609525+0000 front 2019-11-29T21:00:26.572537+0000 (oldest deadline 2019-11-29T21:01:11.546232+0000) 2019-11-29T21:01:24.630 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:01:24.624+0000 1694c700 -1 osd.7 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:25.372404+0000 front 2019-11-29T21:00:25.371419+0000 (oldest deadline 2019-11-29T21:01:07.647502+0000) 2019-11-29T21:01:24.910 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:01:24.904+0000 1694c700 -1 osd.2 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:24.473522+0000 front 2019-11-29T21:00:24.211462+0000 (oldest deadline 2019-11-29T21:01:10.098799+0000) 2019-11-29T21:01:25.144 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:01:25.138+0000 1694c700 -1 osd.6 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:26.793488+0000 front 2019-11-29T21:00:26.512756+0000 (oldest deadline 2019-11-29T21:01:08.231536+0000) 2019-11-29T21:01:25.348 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:01:25.342+0000 1694c700 -1 osd.0 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:25.271183+0000 front 2019-11-29T21:00:25.222639+0000 (oldest deadline 2019-11-29T21:01:11.083002+0000) 2019-11-29T21:01:25.368 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:01:25.361+0000 1694c700 -1 osd.4 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:25.941743+0000 front 2019-11-29T21:00:25.936235+0000 (oldest deadline 2019-11-29T21:01:11.037685+0000) 2019-11-29T21:01:25.519 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:01:25.514+0000 1694c700 -1 osd.1 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:26.609525+0000 front 2019-11-29T21:00:26.572537+0000 (oldest deadline 2019-11-29T21:01:11.546232+0000) 2019-11-29T21:01:25.675 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:01:25.668+0000 1694c700 -1 osd.7 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:25.372404+0000 front 2019-11-29T21:00:25.371419+0000 (oldest deadline 2019-11-29T21:01:07.647502+0000) 2019-11-29T21:01:25.916 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:01:25.910+0000 1694c700 -1 osd.2 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:24.473522+0000 front 2019-11-29T21:00:24.211462+0000 (oldest deadline 2019-11-29T21:01:10.098799+0000) 2019-11-29T21:01:26.145 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:01:26.138+0000 1694c700 -1 osd.6 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:26.793488+0000 front 2019-11-29T21:00:26.512756+0000 (oldest deadline 2019-11-29T21:01:08.231536+0000) 2019-11-29T21:01:26.191 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~32s 2019-11-29T21:01:26.364 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:01:26.358+0000 1694c700 -1 osd.4 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:25.941743+0000 front 2019-11-29T21:00:25.936235+0000 (oldest deadline 2019-11-29T21:01:11.037685+0000) 2019-11-29T21:01:26.390 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:01:26.385+0000 1694c700 -1 osd.0 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:25.271183+0000 front 2019-11-29T21:00:25.222639+0000 (oldest deadline 2019-11-29T21:01:11.083002+0000) 2019-11-29T21:01:26.556 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:01:26.550+0000 1694c700 -1 osd.1 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:26.609525+0000 front 2019-11-29T21:00:26.572537+0000 (oldest deadline 2019-11-29T21:01:11.546232+0000) 2019-11-29T21:01:26.721 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:01:26.715+0000 1694c700 -1 osd.7 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:25.372404+0000 front 2019-11-29T21:00:25.371419+0000 (oldest deadline 2019-11-29T21:01:07.647502+0000) 2019-11-29T21:01:26.946 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:01:26.940+0000 1694c700 -1 osd.2 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:24.473522+0000 front 2019-11-29T21:00:24.211462+0000 (oldest deadline 2019-11-29T21:01:10.098799+0000) 2019-11-29T21:01:27.159 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:01:27.152+0000 1694c700 -1 osd.6 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:26.793488+0000 front 2019-11-29T21:00:26.512756+0000 (oldest deadline 2019-11-29T21:01:08.231536+0000) 2019-11-29T21:01:27.382 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:01:27.376+0000 1694c700 -1 osd.4 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:25.941743+0000 front 2019-11-29T21:00:25.936235+0000 (oldest deadline 2019-11-29T21:01:11.037685+0000) 2019-11-29T21:01:27.512 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:01:27.422+0000 1694c700 -1 osd.0 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:25.271183+0000 front 2019-11-29T21:00:25.222639+0000 (oldest deadline 2019-11-29T21:01:11.083002+0000) 2019-11-29T21:01:27.513 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:01:27.505+0000 1694c700 -1 osd.1 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:26.609525+0000 front 2019-11-29T21:00:26.572537+0000 (oldest deadline 2019-11-29T21:01:11.546232+0000) 2019-11-29T21:01:27.765 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:01:27.758+0000 1694c700 -1 osd.7 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:25.372404+0000 front 2019-11-29T21:00:25.371419+0000 (oldest deadline 2019-11-29T21:01:07.647502+0000) 2019-11-29T21:01:27.967 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:01:27.961+0000 1694c700 -1 osd.2 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:24.473522+0000 front 2019-11-29T21:00:24.211462+0000 (oldest deadline 2019-11-29T21:01:10.098799+0000) 2019-11-29T21:01:28.183 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:01:28.177+0000 1694c700 -1 osd.6 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:26.793488+0000 front 2019-11-29T21:00:26.512756+0000 (oldest deadline 2019-11-29T21:01:08.231536+0000) 2019-11-29T21:01:28.347 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:01:28.340+0000 1694c700 -1 osd.4 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:25.941743+0000 front 2019-11-29T21:00:25.936235+0000 (oldest deadline 2019-11-29T21:01:11.037685+0000) 2019-11-29T21:01:28.428 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:01:28.422+0000 1694c700 -1 osd.0 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:25.271183+0000 front 2019-11-29T21:00:25.222639+0000 (oldest deadline 2019-11-29T21:01:11.083002+0000) 2019-11-29T21:01:28.526 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:01:28.520+0000 1694c700 -1 osd.1 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:26.609525+0000 front 2019-11-29T21:00:26.572537+0000 (oldest deadline 2019-11-29T21:01:11.546232+0000) 2019-11-29T21:01:28.775 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:01:28.768+0000 1694c700 -1 osd.7 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:25.372404+0000 front 2019-11-29T21:00:25.371419+0000 (oldest deadline 2019-11-29T21:01:07.647502+0000) 2019-11-29T21:01:28.965 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:01:28.959+0000 1694c700 -1 osd.2 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:24.473522+0000 front 2019-11-29T21:00:24.211462+0000 (oldest deadline 2019-11-29T21:01:10.098799+0000) 2019-11-29T21:01:29.159 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:01:29.153+0000 1694c700 -1 osd.6 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:26.793488+0000 front 2019-11-29T21:00:26.512756+0000 (oldest deadline 2019-11-29T21:01:08.231536+0000) 2019-11-29T21:01:29.333 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:01:29.327+0000 1694c700 -1 osd.4 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:25.941743+0000 front 2019-11-29T21:00:25.936235+0000 (oldest deadline 2019-11-29T21:01:11.037685+0000) 2019-11-29T21:01:29.438 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:01:29.432+0000 1694c700 -1 osd.0 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:25.271183+0000 front 2019-11-29T21:00:25.222639+0000 (oldest deadline 2019-11-29T21:01:11.083002+0000) 2019-11-29T21:01:29.551 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:01:29.546+0000 1694c700 -1 osd.1 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:26.609525+0000 front 2019-11-29T21:00:26.572537+0000 (oldest deadline 2019-11-29T21:01:11.546232+0000) 2019-11-29T21:01:29.816 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:01:29.808+0000 1694c700 -1 osd.7 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:25.372404+0000 front 2019-11-29T21:00:25.371419+0000 (oldest deadline 2019-11-29T21:01:07.647502+0000) 2019-11-29T21:01:30.002 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:01:29.996+0000 1694c700 -1 osd.2 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:24.473522+0000 front 2019-11-29T21:00:24.211462+0000 (oldest deadline 2019-11-29T21:01:10.098799+0000) 2019-11-29T21:01:30.133 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:01:30.128+0000 1694c700 -1 osd.6 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:26.793488+0000 front 2019-11-29T21:00:26.512756+0000 (oldest deadline 2019-11-29T21:01:08.231536+0000) 2019-11-29T21:01:30.287 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:01:30.280+0000 1694c700 -1 osd.4 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:25.941743+0000 front 2019-11-29T21:00:25.936235+0000 (oldest deadline 2019-11-29T21:01:11.037685+0000) 2019-11-29T21:01:30.438 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:01:30.433+0000 1694c700 -1 osd.0 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:25.271183+0000 front 2019-11-29T21:00:25.222639+0000 (oldest deadline 2019-11-29T21:01:11.083002+0000) 2019-11-29T21:01:30.515 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:01:30.509+0000 1694c700 -1 osd.1 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:26.609525+0000 front 2019-11-29T21:00:26.572537+0000 (oldest deadline 2019-11-29T21:01:11.546232+0000) 2019-11-29T21:01:30.822 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:01:30.816+0000 1694c700 -1 osd.7 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:25.372404+0000 front 2019-11-29T21:00:25.371419+0000 (oldest deadline 2019-11-29T21:01:07.647502+0000) 2019-11-29T21:01:30.975 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:01:30.969+0000 1694c700 -1 osd.2 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:24.473522+0000 front 2019-11-29T21:00:24.211462+0000 (oldest deadline 2019-11-29T21:01:10.098799+0000) 2019-11-29T21:01:31.179 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:01:31.173+0000 1694c700 -1 osd.6 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:26.793488+0000 front 2019-11-29T21:00:26.512756+0000 (oldest deadline 2019-11-29T21:01:08.231536+0000) 2019-11-29T21:01:31.279 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:01:31.272+0000 1694c700 -1 osd.4 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:25.941743+0000 front 2019-11-29T21:00:25.936235+0000 (oldest deadline 2019-11-29T21:01:11.037685+0000) 2019-11-29T21:01:31.466 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:01:31.460+0000 1694c700 -1 osd.0 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:25.271183+0000 front 2019-11-29T21:00:25.222639+0000 (oldest deadline 2019-11-29T21:01:11.083002+0000) 2019-11-29T21:01:31.521 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:01:31.515+0000 1694c700 -1 osd.1 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:26.609525+0000 front 2019-11-29T21:00:26.572537+0000 (oldest deadline 2019-11-29T21:01:11.546232+0000) 2019-11-29T21:01:31.657 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:08:36:12.315 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T21:01:31.666 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:08:36:12.324 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T21:01:31.676 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:08:36:12.283 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T21:01:31.681 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:08:36:12.288 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T21:01:31.682 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:08:36:12.289 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T21:01:31.687 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:08:36:12.295 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T21:01:31.843 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:01:31.838+0000 1694c700 -1 osd.7 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:25.372404+0000 front 2019-11-29T21:00:25.371419+0000 (oldest deadline 2019-11-29T21:01:07.647502+0000) 2019-11-29T21:01:31.926 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:08:36:12.584 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T21:01:31.938 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:08:36:12.545 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T21:01:31.952 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:08:36:12.559 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T21:01:31.953 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:01:31.949+0000 1694c700 -1 osd.2 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:24.473522+0000 front 2019-11-29T21:00:24.211462+0000 (oldest deadline 2019-11-29T21:01:10.098799+0000) 2019-11-29T21:01:32.159 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:01:32.154+0000 1694c700 -1 osd.6 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:26.793488+0000 front 2019-11-29T21:00:26.512756+0000 (oldest deadline 2019-11-29T21:01:08.231536+0000) 2019-11-29T21:01:32.248 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:01:32.242+0000 1694c700 -1 osd.4 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:25.941743+0000 front 2019-11-29T21:00:25.936235+0000 (oldest deadline 2019-11-29T21:01:11.037685+0000) 2019-11-29T21:01:32.458 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:01:32.454+0000 1694c700 -1 osd.0 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:25.271183+0000 front 2019-11-29T21:00:25.222639+0000 (oldest deadline 2019-11-29T21:01:11.083002+0000) 2019-11-29T21:01:32.502 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~38s 2019-11-29T21:01:32.535 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:01:32.529+0000 1694c700 -1 osd.1 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:26.609525+0000 front 2019-11-29T21:00:26.572537+0000 (oldest deadline 2019-11-29T21:01:11.546232+0000) 2019-11-29T21:01:32.876 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:01:32.870+0000 1694c700 -1 osd.7 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:25.372404+0000 front 2019-11-29T21:00:25.371419+0000 (oldest deadline 2019-11-29T21:01:07.647502+0000) 2019-11-29T21:01:32.925 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:01:32.919+0000 1694c700 -1 osd.2 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:24.473522+0000 front 2019-11-29T21:00:24.211462+0000 (oldest deadline 2019-11-29T21:01:10.098799+0000) 2019-11-29T21:01:33.207 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:01:33.201+0000 1694c700 -1 osd.6 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:26.793488+0000 front 2019-11-29T21:00:26.512756+0000 (oldest deadline 2019-11-29T21:01:08.231536+0000) 2019-11-29T21:01:33.256 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:01:33.251+0000 1694c700 -1 osd.4 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:25.941743+0000 front 2019-11-29T21:00:25.936235+0000 (oldest deadline 2019-11-29T21:01:11.037685+0000) 2019-11-29T21:01:33.439 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:01:33.435+0000 1694c700 -1 osd.0 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:25.271183+0000 front 2019-11-29T21:00:25.222639+0000 (oldest deadline 2019-11-29T21:01:11.083002+0000) 2019-11-29T21:01:33.489 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:01:33.483+0000 1694c700 -1 osd.1 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:26.609525+0000 front 2019-11-29T21:00:26.572537+0000 (oldest deadline 2019-11-29T21:01:11.546232+0000) 2019-11-29T21:01:33.872 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:01:33.867+0000 1694c700 -1 osd.7 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:25.372404+0000 front 2019-11-29T21:00:25.371419+0000 (oldest deadline 2019-11-29T21:01:07.647502+0000) 2019-11-29T21:01:33.887 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:01:33.882+0000 1694c700 -1 osd.2 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:24.473522+0000 front 2019-11-29T21:00:24.211462+0000 (oldest deadline 2019-11-29T21:01:10.098799+0000) 2019-11-29T21:01:34.216 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:01:34.210+0000 1694c700 -1 osd.6 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:26.793488+0000 front 2019-11-29T21:00:26.512756+0000 (oldest deadline 2019-11-29T21:01:08.231536+0000) 2019-11-29T21:01:34.291 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:01:34.285+0000 1694c700 -1 osd.4 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:25.941743+0000 front 2019-11-29T21:00:25.936235+0000 (oldest deadline 2019-11-29T21:01:11.037685+0000) 2019-11-29T21:01:34.431 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:01:34.427+0000 1694c700 -1 osd.0 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:25.271183+0000 front 2019-11-29T21:00:25.222639+0000 (oldest deadline 2019-11-29T21:01:11.083002+0000) 2019-11-29T21:01:34.525 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:01:34.520+0000 1694c700 -1 osd.1 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:26.609525+0000 front 2019-11-29T21:00:26.572537+0000 (oldest deadline 2019-11-29T21:01:11.546232+0000) 2019-11-29T21:01:34.876 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:01:34.871+0000 1694c700 -1 osd.2 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:24.473522+0000 front 2019-11-29T21:00:24.211462+0000 (oldest deadline 2019-11-29T21:01:10.098799+0000) 2019-11-29T21:01:34.891 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:01:34.886+0000 1694c700 -1 osd.7 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:25.372404+0000 front 2019-11-29T21:00:25.371419+0000 (oldest deadline 2019-11-29T21:01:07.647502+0000) 2019-11-29T21:01:35.192 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:01:35.186+0000 1694c700 -1 osd.6 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:26.793488+0000 front 2019-11-29T21:00:26.512756+0000 (oldest deadline 2019-11-29T21:01:08.231536+0000) 2019-11-29T21:01:35.334 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:01:35.329+0000 1694c700 -1 osd.4 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:25.941743+0000 front 2019-11-29T21:00:25.936235+0000 (oldest deadline 2019-11-29T21:01:11.037685+0000) 2019-11-29T21:01:35.481 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:01:35.475+0000 1694c700 -1 osd.0 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:25.271183+0000 front 2019-11-29T21:00:25.222639+0000 (oldest deadline 2019-11-29T21:01:11.083002+0000) 2019-11-29T21:01:35.539 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:01:35.534+0000 1694c700 -1 osd.1 234 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:00:26.609525+0000 front 2019-11-29T21:00:26.572537+0000 (oldest deadline 2019-11-29T21:01:11.546232+0000) 2019-11-29T21:01:38.811 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~44s 2019-11-29T21:01:45.122 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~50s 2019-11-29T21:01:51.432 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~57s 2019-11-29T21:01:57.744 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~63s 2019-11-29T21:02:04.054 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~69s 2019-11-29T21:02:10.364 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~76s 2019-11-29T21:02:16.679 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~82s 2019-11-29T21:02:22.990 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~88s 2019-11-29T21:02:29.303 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~95s 2019-11-29T21:02:35.616 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~101s 2019-11-29T21:02:41.930 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~107s 2019-11-29T21:02:48.243 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~114s 2019-11-29T21:02:54.560 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~120s 2019-11-29T21:03:00.873 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~126s 2019-11-29T21:03:07.185 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~133s 2019-11-29T21:03:13.501 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~139s 2019-11-29T21:03:19.813 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~145s 2019-11-29T21:03:26.126 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~151s 2019-11-29T21:03:27.680 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:03:27.674+0000 1694c700 -1 osd.6 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:46.601702+0000 front 2019-11-29T21:02:46.989189+0000 (oldest deadline 2019-11-29T21:03:27.618846+0000) 2019-11-29T21:03:28.071 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:03:28.065+0000 1694c700 -1 osd.4 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:44.928864+0000 front 2019-11-29T21:02:44.897514+0000 (oldest deadline 2019-11-29T21:03:28.046054+0000) 2019-11-29T21:03:28.567 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:03:28.561+0000 1694c700 -1 osd.2 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:43.309786+0000 front 2019-11-29T21:02:43.209094+0000 (oldest deadline 2019-11-29T21:03:27.825514+0000) 2019-11-29T21:03:28.697 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:03:28.691+0000 1694c700 -1 osd.6 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:46.601702+0000 front 2019-11-29T21:02:46.989189+0000 (oldest deadline 2019-11-29T21:03:27.618846+0000) 2019-11-29T21:03:28.745 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:03:28.739+0000 1694c700 -1 osd.7 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:46.899082+0000 front 2019-11-29T21:02:46.900046+0000 (oldest deadline 2019-11-29T21:03:28.123679+0000) 2019-11-29T21:03:29.035 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:03:29.030+0000 1694c700 -1 osd.4 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:44.928864+0000 front 2019-11-29T21:02:44.897514+0000 (oldest deadline 2019-11-29T21:03:28.046054+0000) 2019-11-29T21:03:29.116 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:03:29.110+0000 1694c700 -1 osd.1 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:46.637095+0000 front 2019-11-29T21:02:47.107894+0000 (oldest deadline 2019-11-29T21:03:28.517720+0000) 2019-11-29T21:03:29.522 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:03:29.517+0000 1694c700 -1 osd.2 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:43.309786+0000 front 2019-11-29T21:02:43.209094+0000 (oldest deadline 2019-11-29T21:03:27.825514+0000) 2019-11-29T21:03:29.715 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:03:29.704+0000 1694c700 -1 osd.6 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:46.601702+0000 front 2019-11-29T21:02:46.989189+0000 (oldest deadline 2019-11-29T21:03:27.618846+0000) 2019-11-29T21:03:29.732 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:03:29.722+0000 1694c700 -1 osd.7 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:46.899082+0000 front 2019-11-29T21:02:46.900046+0000 (oldest deadline 2019-11-29T21:03:28.123679+0000) 2019-11-29T21:03:30.015 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:03:30.000+0000 1694c700 -1 osd.4 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:44.928864+0000 front 2019-11-29T21:02:44.897514+0000 (oldest deadline 2019-11-29T21:03:28.046054+0000) 2019-11-29T21:03:30.135 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:03:30.110+0000 1694c700 -1 osd.1 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:46.637095+0000 front 2019-11-29T21:02:47.107894+0000 (oldest deadline 2019-11-29T21:03:28.517720+0000) 2019-11-29T21:03:30.515 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:03:30.506+0000 1694c700 -1 osd.2 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:43.309786+0000 front 2019-11-29T21:02:43.209094+0000 (oldest deadline 2019-11-29T21:03:27.825514+0000) 2019-11-29T21:03:30.669 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:03:30.660+0000 1694c700 -1 osd.6 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:46.601702+0000 front 2019-11-29T21:02:46.989189+0000 (oldest deadline 2019-11-29T21:03:27.618846+0000) 2019-11-29T21:03:30.755 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:03:30.750+0000 1694c700 -1 osd.7 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:46.899082+0000 front 2019-11-29T21:02:46.900046+0000 (oldest deadline 2019-11-29T21:03:28.123679+0000) 2019-11-29T21:03:31.028 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:03:31.020+0000 1694c700 -1 osd.4 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:44.928864+0000 front 2019-11-29T21:02:44.897514+0000 (oldest deadline 2019-11-29T21:03:28.046054+0000) 2019-11-29T21:03:31.135 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:03:31.129+0000 1694c700 -1 osd.1 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:46.637095+0000 front 2019-11-29T21:02:47.107894+0000 (oldest deadline 2019-11-29T21:03:28.517720+0000) 2019-11-29T21:03:31.511 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:03:31.504+0000 1694c700 -1 osd.2 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:43.309786+0000 front 2019-11-29T21:02:43.209094+0000 (oldest deadline 2019-11-29T21:03:27.825514+0000) 2019-11-29T21:03:31.638 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:03:31.633+0000 1694c700 -1 osd.6 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:46.601702+0000 front 2019-11-29T21:02:46.989189+0000 (oldest deadline 2019-11-29T21:03:27.618846+0000) 2019-11-29T21:03:31.772 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:03:31.767+0000 1694c700 -1 osd.7 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:46.899082+0000 front 2019-11-29T21:02:46.900046+0000 (oldest deadline 2019-11-29T21:03:28.123679+0000) 2019-11-29T21:03:32.069 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:03:32.063+0000 1694c700 -1 osd.4 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:44.928864+0000 front 2019-11-29T21:02:44.897514+0000 (oldest deadline 2019-11-29T21:03:28.046054+0000) 2019-11-29T21:03:32.189 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:03:32.183+0000 1694c700 -1 osd.1 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:46.637095+0000 front 2019-11-29T21:02:47.107894+0000 (oldest deadline 2019-11-29T21:03:28.517720+0000) 2019-11-29T21:03:32.439 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~158s 2019-11-29T21:03:32.515 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:03:32.510+0000 1694c700 -1 osd.2 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:43.309786+0000 front 2019-11-29T21:02:43.209094+0000 (oldest deadline 2019-11-29T21:03:27.825514+0000) 2019-11-29T21:03:32.641 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:03:32.635+0000 1694c700 -1 osd.6 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:46.601702+0000 front 2019-11-29T21:02:46.989189+0000 (oldest deadline 2019-11-29T21:03:27.618846+0000) 2019-11-29T21:03:32.795 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:03:32.789+0000 1694c700 -1 osd.7 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:46.899082+0000 front 2019-11-29T21:02:46.900046+0000 (oldest deadline 2019-11-29T21:03:28.123679+0000) 2019-11-29T21:03:33.037 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:03:33.031+0000 1694c700 -1 osd.4 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:44.928864+0000 front 2019-11-29T21:02:44.897514+0000 (oldest deadline 2019-11-29T21:03:28.046054+0000) 2019-11-29T21:03:33.225 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:03:33.219+0000 1694c700 -1 osd.1 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:46.637095+0000 front 2019-11-29T21:02:47.107894+0000 (oldest deadline 2019-11-29T21:03:28.517720+0000) 2019-11-29T21:03:33.546 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:03:33.541+0000 1694c700 -1 osd.0 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:47.593232+0000 front 2019-11-29T21:02:47.595174+0000 (oldest deadline 2019-11-29T21:03:32.843794+0000) 2019-11-29T21:03:33.560 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:03:33.555+0000 1694c700 -1 osd.2 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:43.309786+0000 front 2019-11-29T21:02:43.209094+0000 (oldest deadline 2019-11-29T21:03:27.825514+0000) 2019-11-29T21:03:33.678 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:03:33.674+0000 1694c700 -1 osd.6 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:46.601702+0000 front 2019-11-29T21:02:46.989189+0000 (oldest deadline 2019-11-29T21:03:27.618846+0000) 2019-11-29T21:03:33.807 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:03:33.803+0000 1694c700 -1 osd.7 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:46.899082+0000 front 2019-11-29T21:02:46.900046+0000 (oldest deadline 2019-11-29T21:03:28.123679+0000) 2019-11-29T21:03:34.024 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:03:34.017+0000 1694c700 -1 osd.4 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:44.928864+0000 front 2019-11-29T21:02:44.897514+0000 (oldest deadline 2019-11-29T21:03:28.046054+0000) 2019-11-29T21:03:34.239 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:03:34.234+0000 1694c700 -1 osd.1 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:46.637095+0000 front 2019-11-29T21:02:47.107894+0000 (oldest deadline 2019-11-29T21:03:28.517720+0000) 2019-11-29T21:03:34.533 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:03:34.527+0000 1694c700 -1 osd.0 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:47.593232+0000 front 2019-11-29T21:02:47.595174+0000 (oldest deadline 2019-11-29T21:03:32.843794+0000) 2019-11-29T21:03:34.549 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:03:34.543+0000 1694c700 -1 osd.2 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:43.309786+0000 front 2019-11-29T21:02:43.209094+0000 (oldest deadline 2019-11-29T21:03:27.825514+0000) 2019-11-29T21:03:34.680 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:03:34.675+0000 1694c700 -1 osd.6 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:46.601702+0000 front 2019-11-29T21:02:46.989189+0000 (oldest deadline 2019-11-29T21:03:27.618846+0000) 2019-11-29T21:03:34.808 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:03:34.804+0000 1694c700 -1 osd.7 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:46.899082+0000 front 2019-11-29T21:02:46.900046+0000 (oldest deadline 2019-11-29T21:03:28.123679+0000) 2019-11-29T21:03:35.037 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:03:35.031+0000 1694c700 -1 osd.4 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:44.928864+0000 front 2019-11-29T21:02:44.897514+0000 (oldest deadline 2019-11-29T21:03:28.046054+0000) 2019-11-29T21:03:35.243 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:03:35.238+0000 1694c700 -1 osd.1 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:46.637095+0000 front 2019-11-29T21:02:47.107894+0000 (oldest deadline 2019-11-29T21:03:28.517720+0000) 2019-11-29T21:03:35.532 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:03:35.526+0000 1694c700 -1 osd.2 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:43.309786+0000 front 2019-11-29T21:02:43.209094+0000 (oldest deadline 2019-11-29T21:03:27.825514+0000) 2019-11-29T21:03:35.570 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:03:35.565+0000 1694c700 -1 osd.0 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:47.593232+0000 front 2019-11-29T21:02:47.595174+0000 (oldest deadline 2019-11-29T21:03:32.843794+0000) 2019-11-29T21:03:35.681 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:03:35.676+0000 1694c700 -1 osd.6 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:46.601702+0000 front 2019-11-29T21:02:46.989189+0000 (oldest deadline 2019-11-29T21:03:27.618846+0000) 2019-11-29T21:03:35.795 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:03:35.790+0000 1694c700 -1 osd.7 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:46.899082+0000 front 2019-11-29T21:02:46.900046+0000 (oldest deadline 2019-11-29T21:03:28.123679+0000) 2019-11-29T21:03:36.068 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:03:36.063+0000 1694c700 -1 osd.4 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:44.928864+0000 front 2019-11-29T21:02:44.897514+0000 (oldest deadline 2019-11-29T21:03:28.046054+0000) 2019-11-29T21:03:36.263 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:03:36.257+0000 1694c700 -1 osd.1 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:46.637095+0000 front 2019-11-29T21:02:47.107894+0000 (oldest deadline 2019-11-29T21:03:28.517720+0000) 2019-11-29T21:03:36.567 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:03:36.562+0000 1694c700 -1 osd.2 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:43.309786+0000 front 2019-11-29T21:02:43.209094+0000 (oldest deadline 2019-11-29T21:03:27.825514+0000) 2019-11-29T21:03:36.571 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:03:36.565+0000 1694c700 -1 osd.0 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:47.593232+0000 front 2019-11-29T21:02:47.595174+0000 (oldest deadline 2019-11-29T21:03:32.843794+0000) 2019-11-29T21:03:36.709 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:03:36.705+0000 1694c700 -1 osd.6 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:46.601702+0000 front 2019-11-29T21:02:46.989189+0000 (oldest deadline 2019-11-29T21:03:27.618846+0000) 2019-11-29T21:03:36.806 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:03:36.801+0000 1694c700 -1 osd.7 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:46.899082+0000 front 2019-11-29T21:02:46.900046+0000 (oldest deadline 2019-11-29T21:03:28.123679+0000) 2019-11-29T21:03:37.072 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:03:37.066+0000 1694c700 -1 osd.4 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:44.928864+0000 front 2019-11-29T21:02:44.897514+0000 (oldest deadline 2019-11-29T21:03:28.046054+0000) 2019-11-29T21:03:37.257 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:03:37.252+0000 1694c700 -1 osd.1 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:46.637095+0000 front 2019-11-29T21:02:47.107894+0000 (oldest deadline 2019-11-29T21:03:28.517720+0000) 2019-11-29T21:03:37.553 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:03:37.548+0000 1694c700 -1 osd.0 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:47.593232+0000 front 2019-11-29T21:02:47.595174+0000 (oldest deadline 2019-11-29T21:03:32.843794+0000) 2019-11-29T21:03:37.581 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:03:37.575+0000 1694c700 -1 osd.2 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:43.309786+0000 front 2019-11-29T21:02:43.209094+0000 (oldest deadline 2019-11-29T21:03:27.825514+0000) 2019-11-29T21:03:37.732 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:03:37.726+0000 1694c700 -1 osd.6 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:46.601702+0000 front 2019-11-29T21:02:46.989189+0000 (oldest deadline 2019-11-29T21:03:27.618846+0000) 2019-11-29T21:03:37.816 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:03:37.811+0000 1694c700 -1 osd.7 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:46.899082+0000 front 2019-11-29T21:02:46.900046+0000 (oldest deadline 2019-11-29T21:03:28.123679+0000) 2019-11-29T21:03:38.044 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:03:38.033+0000 1694c700 -1 osd.4 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:44.928864+0000 front 2019-11-29T21:02:44.897514+0000 (oldest deadline 2019-11-29T21:03:28.046054+0000) 2019-11-29T21:03:38.273 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:03:38.267+0000 1694c700 -1 osd.1 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:46.637095+0000 front 2019-11-29T21:02:47.107894+0000 (oldest deadline 2019-11-29T21:03:28.517720+0000) 2019-11-29T21:03:38.576 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:03:38.571+0000 1694c700 -1 osd.0 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:47.593232+0000 front 2019-11-29T21:02:47.595174+0000 (oldest deadline 2019-11-29T21:03:32.843794+0000) 2019-11-29T21:03:38.614 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:03:38.608+0000 1694c700 -1 osd.2 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:43.309786+0000 front 2019-11-29T21:02:43.209094+0000 (oldest deadline 2019-11-29T21:03:27.825514+0000) 2019-11-29T21:03:38.751 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~164s 2019-11-29T21:03:38.770 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:03:38.766+0000 1694c700 -1 osd.6 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:46.601702+0000 front 2019-11-29T21:02:46.989189+0000 (oldest deadline 2019-11-29T21:03:27.618846+0000) 2019-11-29T21:03:38.778 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:03:38.774+0000 1694c700 -1 osd.7 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:46.899082+0000 front 2019-11-29T21:02:46.900046+0000 (oldest deadline 2019-11-29T21:03:28.123679+0000) 2019-11-29T21:03:38.995 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:03:38.990+0000 1694c700 -1 osd.4 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:44.928864+0000 front 2019-11-29T21:02:44.897514+0000 (oldest deadline 2019-11-29T21:03:28.046054+0000) 2019-11-29T21:03:39.266 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:03:39.261+0000 1694c700 -1 osd.1 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:46.637095+0000 front 2019-11-29T21:02:47.107894+0000 (oldest deadline 2019-11-29T21:03:28.517720+0000) 2019-11-29T21:03:39.579 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:03:39.573+0000 1694c700 -1 osd.0 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:47.593232+0000 front 2019-11-29T21:02:47.595174+0000 (oldest deadline 2019-11-29T21:03:32.843794+0000) 2019-11-29T21:03:39.593 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:03:39.587+0000 1694c700 -1 osd.2 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:43.309786+0000 front 2019-11-29T21:02:43.209094+0000 (oldest deadline 2019-11-29T21:03:27.825514+0000) 2019-11-29T21:03:39.745 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:03:39.739+0000 1694c700 -1 osd.7 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:46.899082+0000 front 2019-11-29T21:02:46.900046+0000 (oldest deadline 2019-11-29T21:03:28.123679+0000) 2019-11-29T21:03:39.766 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:03:39.761+0000 1694c700 -1 osd.6 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:46.601702+0000 front 2019-11-29T21:02:46.989189+0000 (oldest deadline 2019-11-29T21:03:27.618846+0000) 2019-11-29T21:03:39.954 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:03:39.948+0000 1694c700 -1 osd.4 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:44.928864+0000 front 2019-11-29T21:02:44.897514+0000 (oldest deadline 2019-11-29T21:03:28.046054+0000) 2019-11-29T21:03:40.272 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:03:40.266+0000 1694c700 -1 osd.1 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:46.637095+0000 front 2019-11-29T21:02:47.107894+0000 (oldest deadline 2019-11-29T21:03:28.517720+0000) 2019-11-29T21:03:40.594 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:03:40.583+0000 1694c700 -1 osd.2 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:43.309786+0000 front 2019-11-29T21:02:43.209094+0000 (oldest deadline 2019-11-29T21:03:27.825514+0000) 2019-11-29T21:03:40.611 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:03:40.606+0000 1694c700 -1 osd.0 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:47.593232+0000 front 2019-11-29T21:02:47.595174+0000 (oldest deadline 2019-11-29T21:03:32.843794+0000) 2019-11-29T21:03:40.700 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:03:40.695+0000 1694c700 -1 osd.7 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:46.899082+0000 front 2019-11-29T21:02:46.900046+0000 (oldest deadline 2019-11-29T21:03:28.123679+0000) 2019-11-29T21:03:40.759 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:03:40.753+0000 1694c700 -1 osd.6 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:46.601702+0000 front 2019-11-29T21:02:46.989189+0000 (oldest deadline 2019-11-29T21:03:27.618846+0000) 2019-11-29T21:03:40.952 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:03:40.947+0000 1694c700 -1 osd.4 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:44.928864+0000 front 2019-11-29T21:02:44.897514+0000 (oldest deadline 2019-11-29T21:03:28.046054+0000) 2019-11-29T21:03:41.263 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:03:41.257+0000 1694c700 -1 osd.1 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:46.637095+0000 front 2019-11-29T21:02:47.107894+0000 (oldest deadline 2019-11-29T21:03:28.517720+0000) 2019-11-29T21:03:41.592 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:03:41.586+0000 1694c700 -1 osd.2 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:43.309786+0000 front 2019-11-29T21:02:43.209094+0000 (oldest deadline 2019-11-29T21:03:27.825514+0000) 2019-11-29T21:03:41.654 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:03:41.649+0000 1694c700 -1 osd.0 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:47.593232+0000 front 2019-11-29T21:02:47.595174+0000 (oldest deadline 2019-11-29T21:03:32.843794+0000) 2019-11-29T21:03:41.714 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:03:41.709+0000 1694c700 -1 osd.7 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:46.899082+0000 front 2019-11-29T21:02:46.900046+0000 (oldest deadline 2019-11-29T21:03:28.123679+0000) 2019-11-29T21:03:41.773 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:03:41.767+0000 1694c700 -1 osd.6 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:46.601702+0000 front 2019-11-29T21:02:46.989189+0000 (oldest deadline 2019-11-29T21:03:27.618846+0000) 2019-11-29T21:03:42.003 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:03:41.997+0000 1694c700 -1 osd.4 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:44.928864+0000 front 2019-11-29T21:02:44.897514+0000 (oldest deadline 2019-11-29T21:03:28.046054+0000) 2019-11-29T21:03:42.309 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:03:42.301+0000 1694c700 -1 osd.1 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:46.637095+0000 front 2019-11-29T21:02:47.107894+0000 (oldest deadline 2019-11-29T21:03:28.517720+0000) 2019-11-29T21:03:42.635 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:03:42.629+0000 1694c700 -1 osd.2 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:43.309786+0000 front 2019-11-29T21:02:43.209094+0000 (oldest deadline 2019-11-29T21:03:27.825514+0000) 2019-11-29T21:03:42.676 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:03:42.671+0000 1694c700 -1 osd.0 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:47.593232+0000 front 2019-11-29T21:02:47.595174+0000 (oldest deadline 2019-11-29T21:03:32.843794+0000) 2019-11-29T21:03:42.718 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:03:42.712+0000 1694c700 -1 osd.7 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:46.899082+0000 front 2019-11-29T21:02:46.900046+0000 (oldest deadline 2019-11-29T21:03:28.123679+0000) 2019-11-29T21:03:42.767 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:03:42.762+0000 1694c700 -1 osd.6 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:46.601702+0000 front 2019-11-29T21:02:46.989189+0000 (oldest deadline 2019-11-29T21:03:27.618846+0000) 2019-11-29T21:03:42.966 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:03:42.960+0000 1694c700 -1 osd.4 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:44.928864+0000 front 2019-11-29T21:02:44.897514+0000 (oldest deadline 2019-11-29T21:03:28.046054+0000) 2019-11-29T21:03:43.266 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:03:43.260+0000 1694c700 -1 osd.1 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:46.637095+0000 front 2019-11-29T21:02:47.107894+0000 (oldest deadline 2019-11-29T21:03:28.517720+0000) 2019-11-29T21:03:43.647 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:03:43.642+0000 1694c700 -1 osd.2 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:43.309786+0000 front 2019-11-29T21:02:43.209094+0000 (oldest deadline 2019-11-29T21:03:27.825514+0000) 2019-11-29T21:03:43.687 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:03:43.681+0000 1694c700 -1 osd.0 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:47.593232+0000 front 2019-11-29T21:02:47.595174+0000 (oldest deadline 2019-11-29T21:03:32.843794+0000) 2019-11-29T21:03:43.774 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:03:43.768+0000 1694c700 -1 osd.7 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:46.899082+0000 front 2019-11-29T21:02:46.900046+0000 (oldest deadline 2019-11-29T21:03:28.123679+0000) 2019-11-29T21:03:43.819 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:03:43.809+0000 1694c700 -1 osd.6 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:46.601702+0000 front 2019-11-29T21:02:46.989189+0000 (oldest deadline 2019-11-29T21:03:27.618846+0000) 2019-11-29T21:03:44.017 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:03:44.011+0000 1694c700 -1 osd.4 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:44.928864+0000 front 2019-11-29T21:02:44.897514+0000 (oldest deadline 2019-11-29T21:03:28.046054+0000) 2019-11-29T21:03:44.293 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:03:44.287+0000 1694c700 -1 osd.1 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:46.637095+0000 front 2019-11-29T21:02:47.107894+0000 (oldest deadline 2019-11-29T21:03:28.517720+0000) 2019-11-29T21:03:44.607 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:03:44.602+0000 1694c700 -1 osd.2 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:43.309786+0000 front 2019-11-29T21:02:43.209094+0000 (oldest deadline 2019-11-29T21:03:27.825514+0000) 2019-11-29T21:03:44.680 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:03:44.674+0000 1694c700 -1 osd.0 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:47.593232+0000 front 2019-11-29T21:02:47.595174+0000 (oldest deadline 2019-11-29T21:03:32.843794+0000) 2019-11-29T21:03:44.776 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:03:44.770+0000 1694c700 -1 osd.7 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:46.899082+0000 front 2019-11-29T21:02:46.900046+0000 (oldest deadline 2019-11-29T21:03:28.123679+0000) 2019-11-29T21:03:44.796 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:03:44.792+0000 1694c700 -1 osd.6 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:46.601702+0000 front 2019-11-29T21:02:46.989189+0000 (oldest deadline 2019-11-29T21:03:27.618846+0000) 2019-11-29T21:03:44.996 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:03:44.991+0000 1694c700 -1 osd.4 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:44.928864+0000 front 2019-11-29T21:02:44.897514+0000 (oldest deadline 2019-11-29T21:03:28.046054+0000) 2019-11-29T21:03:45.063 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~170s 2019-11-29T21:03:45.345 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:03:45.339+0000 1694c700 -1 osd.1 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:46.637095+0000 front 2019-11-29T21:02:47.107894+0000 (oldest deadline 2019-11-29T21:03:28.517720+0000) 2019-11-29T21:03:45.617 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:03:45.611+0000 1694c700 -1 osd.2 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:43.309786+0000 front 2019-11-29T21:02:43.209094+0000 (oldest deadline 2019-11-29T21:03:27.825514+0000) 2019-11-29T21:03:45.643 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:03:45.637+0000 1694c700 -1 osd.0 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:47.593232+0000 front 2019-11-29T21:02:47.595174+0000 (oldest deadline 2019-11-29T21:03:32.843794+0000) 2019-11-29T21:03:45.813 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:03:45.785+0000 1694c700 -1 osd.6 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:46.601702+0000 front 2019-11-29T21:02:46.989189+0000 (oldest deadline 2019-11-29T21:03:27.618846+0000) 2019-11-29T21:03:45.818 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:03:45.791+0000 1694c700 -1 osd.7 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:46.899082+0000 front 2019-11-29T21:02:46.900046+0000 (oldest deadline 2019-11-29T21:03:28.123679+0000) 2019-11-29T21:03:46.010 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:03:45.992+0000 1694c700 -1 osd.4 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:44.928864+0000 front 2019-11-29T21:02:44.897514+0000 (oldest deadline 2019-11-29T21:03:28.046054+0000) 2019-11-29T21:03:46.324 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:03:46.312+0000 1694c700 -1 osd.1 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:46.637095+0000 front 2019-11-29T21:02:47.107894+0000 (oldest deadline 2019-11-29T21:03:28.517720+0000) 2019-11-29T21:03:46.627 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:03:46.622+0000 1694c700 -1 osd.0 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:47.593232+0000 front 2019-11-29T21:02:47.595174+0000 (oldest deadline 2019-11-29T21:03:32.843794+0000) 2019-11-29T21:03:46.642 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:03:46.636+0000 1694c700 -1 osd.2 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:43.309786+0000 front 2019-11-29T21:02:43.209094+0000 (oldest deadline 2019-11-29T21:03:27.825514+0000) 2019-11-29T21:03:46.780 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:03:46.775+0000 1694c700 -1 osd.7 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:46.899082+0000 front 2019-11-29T21:02:46.900046+0000 (oldest deadline 2019-11-29T21:03:28.123679+0000) 2019-11-29T21:03:46.837 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:03:46.832+0000 1694c700 -1 osd.6 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:46.601702+0000 front 2019-11-29T21:02:46.989189+0000 (oldest deadline 2019-11-29T21:03:27.618846+0000) 2019-11-29T21:03:46.969 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:03:46.963+0000 1694c700 -1 osd.4 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:44.928864+0000 front 2019-11-29T21:02:44.897514+0000 (oldest deadline 2019-11-29T21:03:28.046054+0000) 2019-11-29T21:03:47.281 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:03:47.275+0000 1694c700 -1 osd.1 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:46.637095+0000 front 2019-11-29T21:02:47.107894+0000 (oldest deadline 2019-11-29T21:03:28.517720+0000) 2019-11-29T21:03:47.595 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:03:47.590+0000 1694c700 -1 osd.0 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:47.593232+0000 front 2019-11-29T21:02:47.595174+0000 (oldest deadline 2019-11-29T21:03:32.843794+0000) 2019-11-29T21:03:47.627 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:03:47.617+0000 1694c700 -1 osd.2 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:43.309786+0000 front 2019-11-29T21:02:43.209094+0000 (oldest deadline 2019-11-29T21:03:27.825514+0000) 2019-11-29T21:03:47.762 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:03:47.757+0000 1694c700 -1 osd.7 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:46.899082+0000 front 2019-11-29T21:02:46.900046+0000 (oldest deadline 2019-11-29T21:03:28.123679+0000) 2019-11-29T21:03:47.860 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:03:47.854+0000 1694c700 -1 osd.6 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:46.601702+0000 front 2019-11-29T21:02:46.989189+0000 (oldest deadline 2019-11-29T21:03:27.618846+0000) 2019-11-29T21:03:47.998 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:03:47.991+0000 1694c700 -1 osd.4 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:44.928864+0000 front 2019-11-29T21:02:44.897514+0000 (oldest deadline 2019-11-29T21:03:28.046054+0000) 2019-11-29T21:03:48.285 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:03:48.280+0000 1694c700 -1 osd.1 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:46.637095+0000 front 2019-11-29T21:02:47.107894+0000 (oldest deadline 2019-11-29T21:03:28.517720+0000) 2019-11-29T21:03:48.579 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:03:48.574+0000 1694c700 -1 osd.0 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:47.593232+0000 front 2019-11-29T21:02:47.595174+0000 (oldest deadline 2019-11-29T21:03:32.843794+0000) 2019-11-29T21:03:48.637 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:03:48.630+0000 1694c700 -1 osd.2 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:43.309786+0000 front 2019-11-29T21:02:43.209094+0000 (oldest deadline 2019-11-29T21:03:27.825514+0000) 2019-11-29T21:03:48.761 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:03:48.752+0000 1694c700 -1 osd.7 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:46.899082+0000 front 2019-11-29T21:02:46.900046+0000 (oldest deadline 2019-11-29T21:03:28.123679+0000) 2019-11-29T21:03:48.846 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:03:48.840+0000 1694c700 -1 osd.6 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:46.601702+0000 front 2019-11-29T21:02:46.989189+0000 (oldest deadline 2019-11-29T21:03:27.618846+0000) 2019-11-29T21:03:48.982 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:03:48.977+0000 1694c700 -1 osd.4 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:44.928864+0000 front 2019-11-29T21:02:44.897514+0000 (oldest deadline 2019-11-29T21:03:28.046054+0000) 2019-11-29T21:03:49.276 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:03:49.270+0000 1694c700 -1 osd.1 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:46.637095+0000 front 2019-11-29T21:02:47.107894+0000 (oldest deadline 2019-11-29T21:03:28.517720+0000) 2019-11-29T21:03:49.563 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:03:49.556+0000 1694c700 -1 osd.0 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:47.593232+0000 front 2019-11-29T21:02:47.595174+0000 (oldest deadline 2019-11-29T21:03:32.843794+0000) 2019-11-29T21:03:49.646 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:03:49.641+0000 1694c700 -1 osd.2 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:43.309786+0000 front 2019-11-29T21:02:43.209094+0000 (oldest deadline 2019-11-29T21:03:27.825514+0000) 2019-11-29T21:03:49.790 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:03:49.785+0000 1694c700 -1 osd.7 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:46.899082+0000 front 2019-11-29T21:02:46.900046+0000 (oldest deadline 2019-11-29T21:03:28.123679+0000) 2019-11-29T21:03:49.837 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:03:49.832+0000 1694c700 -1 osd.6 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:46.601702+0000 front 2019-11-29T21:02:46.989189+0000 (oldest deadline 2019-11-29T21:03:27.618846+0000) 2019-11-29T21:03:49.950 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:03:49.945+0000 1694c700 -1 osd.4 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:44.928864+0000 front 2019-11-29T21:02:44.897514+0000 (oldest deadline 2019-11-29T21:03:28.046054+0000) 2019-11-29T21:03:50.235 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:03:50.230+0000 1694c700 -1 osd.1 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:46.637095+0000 front 2019-11-29T21:02:47.107894+0000 (oldest deadline 2019-11-29T21:03:28.517720+0000) 2019-11-29T21:03:50.611 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:03:50.606+0000 1694c700 -1 osd.0 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:47.593232+0000 front 2019-11-29T21:02:47.595174+0000 (oldest deadline 2019-11-29T21:03:32.843794+0000) 2019-11-29T21:03:50.635 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:03:50.630+0000 1694c700 -1 osd.2 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:43.309786+0000 front 2019-11-29T21:02:43.209094+0000 (oldest deadline 2019-11-29T21:03:27.825514+0000) 2019-11-29T21:03:50.820 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:03:50.814+0000 1694c700 -1 osd.6 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:46.601702+0000 front 2019-11-29T21:02:46.989189+0000 (oldest deadline 2019-11-29T21:03:27.618846+0000) 2019-11-29T21:03:50.820 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:03:50.814+0000 1694c700 -1 osd.7 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:46.899082+0000 front 2019-11-29T21:02:46.900046+0000 (oldest deadline 2019-11-29T21:03:28.123679+0000) 2019-11-29T21:03:50.948 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:03:50.943+0000 1694c700 -1 osd.4 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:44.928864+0000 front 2019-11-29T21:02:44.897514+0000 (oldest deadline 2019-11-29T21:03:28.046054+0000) 2019-11-29T21:03:51.268 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:03:51.261+0000 1694c700 -1 osd.1 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:46.637095+0000 front 2019-11-29T21:02:47.107894+0000 (oldest deadline 2019-11-29T21:03:28.517720+0000) 2019-11-29T21:03:51.377 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~177s 2019-11-29T21:03:51.598 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:03:51.592+0000 1694c700 -1 osd.0 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:47.593232+0000 front 2019-11-29T21:02:47.595174+0000 (oldest deadline 2019-11-29T21:03:32.843794+0000) 2019-11-29T21:03:51.616 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:03:51.610+0000 1694c700 -1 osd.2 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:43.309786+0000 front 2019-11-29T21:02:43.209094+0000 (oldest deadline 2019-11-29T21:03:27.825514+0000) 2019-11-29T21:03:51.813 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:03:51.807+0000 1694c700 -1 osd.7 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:46.899082+0000 front 2019-11-29T21:02:46.900046+0000 (oldest deadline 2019-11-29T21:03:28.123679+0000) 2019-11-29T21:03:51.870 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:03:51.865+0000 1694c700 -1 osd.6 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:46.601702+0000 front 2019-11-29T21:02:46.989189+0000 (oldest deadline 2019-11-29T21:03:27.618846+0000) 2019-11-29T21:03:51.953 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:03:51.948+0000 1694c700 -1 osd.4 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:44.928864+0000 front 2019-11-29T21:02:44.897514+0000 (oldest deadline 2019-11-29T21:03:28.046054+0000) 2019-11-29T21:03:52.321 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:03:52.315+0000 1694c700 -1 osd.1 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:46.637095+0000 front 2019-11-29T21:02:47.107894+0000 (oldest deadline 2019-11-29T21:03:28.517720+0000) 2019-11-29T21:03:52.596 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:03:52.590+0000 1694c700 -1 osd.0 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:47.593232+0000 front 2019-11-29T21:02:47.595174+0000 (oldest deadline 2019-11-29T21:03:32.843794+0000) 2019-11-29T21:03:52.635 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:03:52.629+0000 1694c700 -1 osd.2 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:43.309786+0000 front 2019-11-29T21:02:43.209094+0000 (oldest deadline 2019-11-29T21:03:27.825514+0000) 2019-11-29T21:03:52.863 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:03:52.859+0000 1694c700 -1 osd.7 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:46.899082+0000 front 2019-11-29T21:02:46.900046+0000 (oldest deadline 2019-11-29T21:03:28.123679+0000) 2019-11-29T21:03:52.883 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:03:52.878+0000 1694c700 -1 osd.6 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:46.601702+0000 front 2019-11-29T21:02:46.989189+0000 (oldest deadline 2019-11-29T21:03:27.618846+0000) 2019-11-29T21:03:52.971 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:03:52.966+0000 1694c700 -1 osd.4 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:44.928864+0000 front 2019-11-29T21:02:44.897514+0000 (oldest deadline 2019-11-29T21:03:28.046054+0000) 2019-11-29T21:03:53.321 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:03:53.316+0000 1694c700 -1 osd.1 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:46.637095+0000 front 2019-11-29T21:02:47.107894+0000 (oldest deadline 2019-11-29T21:03:28.517720+0000) 2019-11-29T21:03:53.603 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:03:53.597+0000 1694c700 -1 osd.0 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:47.593232+0000 front 2019-11-29T21:02:47.595174+0000 (oldest deadline 2019-11-29T21:03:32.843794+0000) 2019-11-29T21:03:53.648 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:03:53.642+0000 1694c700 -1 osd.2 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:43.309786+0000 front 2019-11-29T21:02:43.209094+0000 (oldest deadline 2019-11-29T21:03:27.825514+0000) 2019-11-29T21:03:53.855 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:03:53.851+0000 1694c700 -1 osd.6 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:46.601702+0000 front 2019-11-29T21:02:46.989189+0000 (oldest deadline 2019-11-29T21:03:27.618846+0000) 2019-11-29T21:03:53.867 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:03:53.862+0000 1694c700 -1 osd.7 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:46.899082+0000 front 2019-11-29T21:02:46.900046+0000 (oldest deadline 2019-11-29T21:03:28.123679+0000) 2019-11-29T21:03:53.965 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:03:53.959+0000 1694c700 -1 osd.4 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:44.928864+0000 front 2019-11-29T21:02:44.897514+0000 (oldest deadline 2019-11-29T21:03:28.046054+0000) 2019-11-29T21:03:54.339 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:03:54.332+0000 1694c700 -1 osd.1 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:46.637095+0000 front 2019-11-29T21:02:47.107894+0000 (oldest deadline 2019-11-29T21:03:28.517720+0000) 2019-11-29T21:03:54.563 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:03:54.556+0000 1694c700 -1 osd.0 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:47.593232+0000 front 2019-11-29T21:02:47.595174+0000 (oldest deadline 2019-11-29T21:03:32.843794+0000) 2019-11-29T21:03:54.704 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:03:54.698+0000 1694c700 -1 osd.2 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:43.309786+0000 front 2019-11-29T21:02:43.209094+0000 (oldest deadline 2019-11-29T21:03:27.825514+0000) 2019-11-29T21:03:54.821 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:03:54.816+0000 1694c700 -1 osd.7 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:46.899082+0000 front 2019-11-29T21:02:46.900046+0000 (oldest deadline 2019-11-29T21:03:28.123679+0000) 2019-11-29T21:03:54.830 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:03:54.824+0000 1694c700 -1 osd.6 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:46.601702+0000 front 2019-11-29T21:02:46.989189+0000 (oldest deadline 2019-11-29T21:03:27.618846+0000) 2019-11-29T21:03:55.012 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:03:55.007+0000 1694c700 -1 osd.4 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:44.928864+0000 front 2019-11-29T21:02:44.897514+0000 (oldest deadline 2019-11-29T21:03:28.046054+0000) 2019-11-29T21:03:55.389 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:03:55.383+0000 1694c700 -1 osd.1 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:46.637095+0000 front 2019-11-29T21:02:47.107894+0000 (oldest deadline 2019-11-29T21:03:28.517720+0000) 2019-11-29T21:03:55.612 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:03:55.606+0000 1694c700 -1 osd.0 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:47.593232+0000 front 2019-11-29T21:02:47.595174+0000 (oldest deadline 2019-11-29T21:03:32.843794+0000) 2019-11-29T21:03:55.701 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:03:55.652+0000 1694c700 -1 osd.2 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:43.309786+0000 front 2019-11-29T21:02:43.209094+0000 (oldest deadline 2019-11-29T21:03:27.825514+0000) 2019-11-29T21:03:55.793 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:03:55.787+0000 1694c700 -1 osd.6 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:46.601702+0000 front 2019-11-29T21:02:46.989189+0000 (oldest deadline 2019-11-29T21:03:27.618846+0000) 2019-11-29T21:03:55.843 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:03:55.837+0000 1694c700 -1 osd.7 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:46.899082+0000 front 2019-11-29T21:02:46.900046+0000 (oldest deadline 2019-11-29T21:03:28.123679+0000) 2019-11-29T21:03:55.977 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:03:55.972+0000 1694c700 -1 osd.4 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:44.928864+0000 front 2019-11-29T21:02:44.897514+0000 (oldest deadline 2019-11-29T21:03:28.046054+0000) 2019-11-29T21:03:56.356 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:03:56.351+0000 1694c700 -1 osd.1 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:46.637095+0000 front 2019-11-29T21:02:47.107894+0000 (oldest deadline 2019-11-29T21:03:28.517720+0000) 2019-11-29T21:03:56.585 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:03:56.579+0000 1694c700 -1 osd.0 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:47.593232+0000 front 2019-11-29T21:02:47.595174+0000 (oldest deadline 2019-11-29T21:03:32.843794+0000) 2019-11-29T21:03:56.662 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:03:56.656+0000 1694c700 -1 osd.2 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:43.309786+0000 front 2019-11-29T21:02:43.209094+0000 (oldest deadline 2019-11-29T21:03:27.825514+0000) 2019-11-29T21:03:56.807 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:03:56.802+0000 1694c700 -1 osd.6 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:46.601702+0000 front 2019-11-29T21:02:46.989189+0000 (oldest deadline 2019-11-29T21:03:27.618846+0000) 2019-11-29T21:03:56.846 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:03:56.841+0000 1694c700 -1 osd.7 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:46.899082+0000 front 2019-11-29T21:02:46.900046+0000 (oldest deadline 2019-11-29T21:03:28.123679+0000) 2019-11-29T21:03:57.012 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:03:57.006+0000 1694c700 -1 osd.4 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:44.928864+0000 front 2019-11-29T21:02:44.897514+0000 (oldest deadline 2019-11-29T21:03:28.046054+0000) 2019-11-29T21:03:57.354 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:03:57.349+0000 1694c700 -1 osd.1 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:46.637095+0000 front 2019-11-29T21:02:47.107894+0000 (oldest deadline 2019-11-29T21:03:28.517720+0000) 2019-11-29T21:03:57.597 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:03:57.592+0000 1694c700 -1 osd.0 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:47.593232+0000 front 2019-11-29T21:02:47.595174+0000 (oldest deadline 2019-11-29T21:03:32.843794+0000) 2019-11-29T21:03:57.634 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:03:57.629+0000 1694c700 -1 osd.2 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:43.309786+0000 front 2019-11-29T21:02:43.209094+0000 (oldest deadline 2019-11-29T21:03:27.825514+0000) 2019-11-29T21:03:57.689 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~183s 2019-11-29T21:03:57.802 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:03:57.796+0000 1694c700 -1 osd.6 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:46.601702+0000 front 2019-11-29T21:02:46.989189+0000 (oldest deadline 2019-11-29T21:03:27.618846+0000) 2019-11-29T21:03:57.851 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:03:57.842+0000 1694c700 -1 osd.7 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:46.899082+0000 front 2019-11-29T21:02:46.900046+0000 (oldest deadline 2019-11-29T21:03:28.123679+0000) 2019-11-29T21:03:57.973 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:03:57.966+0000 1694c700 -1 osd.4 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:44.928864+0000 front 2019-11-29T21:02:44.897514+0000 (oldest deadline 2019-11-29T21:03:28.046054+0000) 2019-11-29T21:03:58.382 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:03:58.377+0000 1694c700 -1 osd.1 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:46.637095+0000 front 2019-11-29T21:02:47.107894+0000 (oldest deadline 2019-11-29T21:03:28.517720+0000) 2019-11-29T21:03:58.584 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:03:58.579+0000 1694c700 -1 osd.0 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:47.593232+0000 front 2019-11-29T21:02:47.595174+0000 (oldest deadline 2019-11-29T21:03:32.843794+0000) 2019-11-29T21:03:58.650 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:03:58.644+0000 1694c700 -1 osd.2 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:43.309786+0000 front 2019-11-29T21:02:43.209094+0000 (oldest deadline 2019-11-29T21:03:27.825514+0000) 2019-11-29T21:03:58.814 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:03:58.807+0000 1694c700 -1 osd.6 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:46.601702+0000 front 2019-11-29T21:02:46.989189+0000 (oldest deadline 2019-11-29T21:03:27.618846+0000) 2019-11-29T21:03:58.830 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:03:58.823+0000 1694c700 -1 osd.7 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:46.899082+0000 front 2019-11-29T21:02:46.900046+0000 (oldest deadline 2019-11-29T21:03:28.123679+0000) 2019-11-29T21:03:58.980 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:03:58.974+0000 1694c700 -1 osd.4 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:44.928864+0000 front 2019-11-29T21:02:44.897514+0000 (oldest deadline 2019-11-29T21:03:28.046054+0000) 2019-11-29T21:03:59.427 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:03:59.421+0000 1694c700 -1 osd.1 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:46.637095+0000 front 2019-11-29T21:02:47.107894+0000 (oldest deadline 2019-11-29T21:03:28.517720+0000) 2019-11-29T21:03:59.549 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:03:59.543+0000 1694c700 -1 osd.0 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:47.593232+0000 front 2019-11-29T21:02:47.595174+0000 (oldest deadline 2019-11-29T21:03:32.843794+0000) 2019-11-29T21:03:59.608 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:03:59.602+0000 1694c700 -1 osd.2 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:43.309786+0000 front 2019-11-29T21:02:43.209094+0000 (oldest deadline 2019-11-29T21:03:27.825514+0000) 2019-11-29T21:03:59.838 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:03:59.831+0000 1694c700 -1 osd.6 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:46.601702+0000 front 2019-11-29T21:02:46.989189+0000 (oldest deadline 2019-11-29T21:03:27.618846+0000) 2019-11-29T21:03:59.869 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:03:59.862+0000 1694c700 -1 osd.7 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:46.899082+0000 front 2019-11-29T21:02:46.900046+0000 (oldest deadline 2019-11-29T21:03:28.123679+0000) 2019-11-29T21:03:59.999 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:03:59.992+0000 1694c700 -1 osd.4 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:44.928864+0000 front 2019-11-29T21:02:44.897514+0000 (oldest deadline 2019-11-29T21:03:28.046054+0000) 2019-11-29T21:04:00.406 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:04:00.400+0000 1694c700 -1 osd.1 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:46.637095+0000 front 2019-11-29T21:02:47.107894+0000 (oldest deadline 2019-11-29T21:03:28.517720+0000) 2019-11-29T21:04:00.547 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:04:00.540+0000 1694c700 -1 osd.0 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:47.593232+0000 front 2019-11-29T21:02:47.595174+0000 (oldest deadline 2019-11-29T21:03:32.843794+0000) 2019-11-29T21:04:00.650 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:04:00.644+0000 1694c700 -1 osd.2 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:43.309786+0000 front 2019-11-29T21:02:43.209094+0000 (oldest deadline 2019-11-29T21:03:27.825514+0000) 2019-11-29T21:04:00.844 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:04:00.837+0000 1694c700 -1 osd.7 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:46.899082+0000 front 2019-11-29T21:02:46.900046+0000 (oldest deadline 2019-11-29T21:03:28.123679+0000) 2019-11-29T21:04:00.889 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:04:00.883+0000 1694c700 -1 osd.6 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:46.601702+0000 front 2019-11-29T21:02:46.989189+0000 (oldest deadline 2019-11-29T21:03:27.618846+0000) 2019-11-29T21:04:00.983 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:04:00.977+0000 1694c700 -1 osd.4 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:44.928864+0000 front 2019-11-29T21:02:44.897514+0000 (oldest deadline 2019-11-29T21:03:28.046054+0000) 2019-11-29T21:04:01.053 INFO:tasks.ceph.mon.b.smithi022.stderr:2019-11-29T21:04:01.047+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 3 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.22:6818/9264,v1:172.21.15.22:6819/9264] for 41sec e241 v241) 2019-11-29T21:04:01.426 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:04:01.420+0000 1694c700 -1 osd.1 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:46.637095+0000 front 2019-11-29T21:02:47.107894+0000 (oldest deadline 2019-11-29T21:03:28.517720+0000) 2019-11-29T21:04:01.546 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:04:01.540+0000 1694c700 -1 osd.0 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:47.593232+0000 front 2019-11-29T21:02:47.595174+0000 (oldest deadline 2019-11-29T21:03:32.843794+0000) 2019-11-29T21:04:01.608 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:04:01.602+0000 1694c700 -1 osd.2 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:43.309786+0000 front 2019-11-29T21:02:43.209094+0000 (oldest deadline 2019-11-29T21:03:27.825514+0000) 2019-11-29T21:04:01.880 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:04:01.873+0000 1694c700 -1 osd.7 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:46.899082+0000 front 2019-11-29T21:02:46.900046+0000 (oldest deadline 2019-11-29T21:03:28.123679+0000) 2019-11-29T21:04:01.919 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:04:01.912+0000 1694c700 -1 osd.6 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:46.601702+0000 front 2019-11-29T21:02:46.989189+0000 (oldest deadline 2019-11-29T21:03:27.618846+0000) 2019-11-29T21:04:01.974 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:04:01.968+0000 1694c700 -1 osd.4 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:44.928864+0000 front 2019-11-29T21:02:44.897514+0000 (oldest deadline 2019-11-29T21:03:28.046054+0000) 2019-11-29T21:04:02.400 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:04:02.395+0000 1694c700 -1 osd.1 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:46.637095+0000 front 2019-11-29T21:02:47.107894+0000 (oldest deadline 2019-11-29T21:03:28.517720+0000) 2019-11-29T21:04:02.524 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:04:02.517+0000 1694c700 -1 osd.0 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:47.593232+0000 front 2019-11-29T21:02:47.595174+0000 (oldest deadline 2019-11-29T21:03:32.843794+0000) 2019-11-29T21:04:02.578 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:04:02.571+0000 1694c700 -1 osd.2 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:43.309786+0000 front 2019-11-29T21:02:43.209094+0000 (oldest deadline 2019-11-29T21:03:27.825514+0000) 2019-11-29T21:04:02.892 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:04:02.886+0000 1694c700 -1 osd.6 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:46.601702+0000 front 2019-11-29T21:02:46.989189+0000 (oldest deadline 2019-11-29T21:03:27.618846+0000) 2019-11-29T21:04:02.915 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:04:02.909+0000 1694c700 -1 osd.7 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:46.899082+0000 front 2019-11-29T21:02:46.900046+0000 (oldest deadline 2019-11-29T21:03:28.123679+0000) 2019-11-29T21:04:02.958 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:04:02.952+0000 1694c700 -1 osd.4 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:44.928864+0000 front 2019-11-29T21:02:44.897514+0000 (oldest deadline 2019-11-29T21:03:28.046054+0000) 2019-11-29T21:04:03.417 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:04:03.410+0000 1694c700 -1 osd.1 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:46.637095+0000 front 2019-11-29T21:02:47.107894+0000 (oldest deadline 2019-11-29T21:03:28.517720+0000) 2019-11-29T21:04:03.512 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:04:03.508+0000 1694c700 -1 osd.0 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:47.593232+0000 front 2019-11-29T21:02:47.595174+0000 (oldest deadline 2019-11-29T21:03:32.843794+0000) 2019-11-29T21:04:03.577 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:04:03.571+0000 1694c700 -1 osd.2 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:43.309786+0000 front 2019-11-29T21:02:43.209094+0000 (oldest deadline 2019-11-29T21:03:27.825514+0000) 2019-11-29T21:04:03.848 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:04:03.842+0000 1694c700 -1 osd.6 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:46.601702+0000 front 2019-11-29T21:02:46.989189+0000 (oldest deadline 2019-11-29T21:03:27.618846+0000) 2019-11-29T21:04:03.908 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:04:03.902+0000 1694c700 -1 osd.7 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:46.899082+0000 front 2019-11-29T21:02:46.900046+0000 (oldest deadline 2019-11-29T21:03:28.123679+0000) 2019-11-29T21:04:03.970 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:04:03.963+0000 1694c700 -1 osd.4 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:44.928864+0000 front 2019-11-29T21:02:44.897514+0000 (oldest deadline 2019-11-29T21:03:28.046054+0000) 2019-11-29T21:04:04.003 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~189s 2019-11-29T21:04:04.466 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:04:04.460+0000 1694c700 -1 osd.1 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:46.637095+0000 front 2019-11-29T21:02:47.107894+0000 (oldest deadline 2019-11-29T21:03:28.517720+0000) 2019-11-29T21:04:04.518 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:04:04.513+0000 1694c700 -1 osd.0 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:47.593232+0000 front 2019-11-29T21:02:47.595174+0000 (oldest deadline 2019-11-29T21:03:32.843794+0000) 2019-11-29T21:04:04.618 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:04:04.612+0000 1694c700 -1 osd.2 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:43.309786+0000 front 2019-11-29T21:02:43.209094+0000 (oldest deadline 2019-11-29T21:03:27.825514+0000) 2019-11-29T21:04:04.815 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:04:04.809+0000 1694c700 -1 osd.6 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:46.601702+0000 front 2019-11-29T21:02:46.989189+0000 (oldest deadline 2019-11-29T21:03:27.618846+0000) 2019-11-29T21:04:04.884 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:04:04.877+0000 1694c700 -1 osd.7 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:46.899082+0000 front 2019-11-29T21:02:46.900046+0000 (oldest deadline 2019-11-29T21:03:28.123679+0000) 2019-11-29T21:04:04.984 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:04:04.979+0000 1694c700 -1 osd.4 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:44.928864+0000 front 2019-11-29T21:02:44.897514+0000 (oldest deadline 2019-11-29T21:03:28.046054+0000) 2019-11-29T21:04:05.479 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:04:05.473+0000 1694c700 -1 osd.1 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:46.637095+0000 front 2019-11-29T21:02:47.107894+0000 (oldest deadline 2019-11-29T21:03:28.517720+0000) 2019-11-29T21:04:05.509 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:04:05.504+0000 1694c700 -1 osd.0 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:47.593232+0000 front 2019-11-29T21:02:47.595174+0000 (oldest deadline 2019-11-29T21:03:32.843794+0000) 2019-11-29T21:04:05.616 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:04:05.611+0000 1694c700 -1 osd.2 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:43.309786+0000 front 2019-11-29T21:02:43.209094+0000 (oldest deadline 2019-11-29T21:03:27.825514+0000) 2019-11-29T21:04:05.792 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:04:05.785+0000 1694c700 -1 osd.6 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:46.601702+0000 front 2019-11-29T21:02:46.989189+0000 (oldest deadline 2019-11-29T21:03:27.618846+0000) 2019-11-29T21:04:05.871 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:04:05.865+0000 1694c700 -1 osd.7 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:46.899082+0000 front 2019-11-29T21:02:46.900046+0000 (oldest deadline 2019-11-29T21:03:28.123679+0000) 2019-11-29T21:04:06.009 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:04:06.002+0000 1694c700 -1 osd.4 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:44.928864+0000 front 2019-11-29T21:02:44.897514+0000 (oldest deadline 2019-11-29T21:03:28.046054+0000) 2019-11-29T21:04:06.101 INFO:tasks.ceph.mon.b.smithi022.stderr:2019-11-29T21:04:06.093+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.22:6818/9264,v1:172.21.15.22:6819/9264] for 41sec e241 v241) 2019-11-29T21:04:06.574 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:04:06.569+0000 1694c700 -1 osd.2 241 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:02:43.309786+0000 front 2019-11-29T21:02:43.209094+0000 (oldest deadline 2019-11-29T21:03:27.825514+0000) 2019-11-29T21:04:10.321 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~196s 2019-11-29T21:04:16.635 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~202s 2019-11-29T21:04:22.946 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~208s 2019-11-29T21:04:29.265 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~215s 2019-11-29T21:04:35.578 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~221s 2019-11-29T21:04:41.891 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~227s 2019-11-29T21:04:48.203 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~234s 2019-11-29T21:04:53.200 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:04:53.194+0000 31783700 -1 osd.5 246 build_incremental_map_msg missing incremental map 246 2019-11-29T21:04:53.643 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:04:53.460+0000 38791700 -1 osd.5 246 build_incremental_map_msg missing incremental map 246 2019-11-29T21:04:53.668 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:04:53.474+0000 3578b700 -1 osd.5 246 build_incremental_map_msg missing incremental map 246 2019-11-29T21:04:54.515 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~240s 2019-11-29T21:05:00.833 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~246s 2019-11-29T21:05:07.144 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~253s 2019-11-29T21:05:13.454 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~259s 2019-11-29T21:05:19.764 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~265s 2019-11-29T21:05:21.504 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:08:40:02.163 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T21:05:21.556 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:08:40:02.214 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T21:05:21.567 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:08:40:02.173 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T21:05:21.573 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:08:40:02.180 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T21:05:21.633 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:08:40:02.239 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T21:05:21.635 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:08:40:02.242 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T21:05:21.773 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:08:40:02.432 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T21:05:21.793 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:08:40:02.400 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T21:05:21.858 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:08:40:02.465 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T21:05:26.077 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~271s 2019-11-29T21:05:32.389 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~278s 2019-11-29T21:05:38.700 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~284s 2019-11-29T21:05:41.069 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:08:40:21.727 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T21:05:41.077 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:08:40:21.731 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T21:05:41.092 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:08:40:21.699 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T21:05:41.095 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:08:40:21.702 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T21:05:41.097 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:08:40:21.703 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T21:05:41.110 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:08:40:21.717 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T21:05:41.138 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:08:40:21.796 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T21:05:41.163 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:08:40:21.770 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T21:05:41.168 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:08:40:21.775 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T21:05:45.012 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~290s 2019-11-29T21:05:50.534 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:05:50.529+0000 1694c700 -1 osd.2 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:04.748365+0000 front 2019-11-29T21:05:05.274013+0000 (oldest deadline 2019-11-29T21:05:50.341532+0000) 2019-11-29T21:05:50.548 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:05:50.543+0000 1694c700 -1 osd.7 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:10.543833+0000 front 2019-11-29T21:05:04.257072+0000 (oldest deadline 2019-11-29T21:05:49.721745+0000) 2019-11-29T21:05:51.329 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~297s 2019-11-29T21:05:51.553 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:05:51.547+0000 1694c700 -1 osd.7 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:10.543833+0000 front 2019-11-29T21:05:04.257072+0000 (oldest deadline 2019-11-29T21:05:49.721745+0000) 2019-11-29T21:05:51.589 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:05:51.584+0000 1694c700 -1 osd.2 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:04.748365+0000 front 2019-11-29T21:05:05.274013+0000 (oldest deadline 2019-11-29T21:05:50.341532+0000) 2019-11-29T21:05:51.899 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:05:51.892+0000 1694c700 -1 osd.0 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:05.721190+0000 front 2019-11-29T21:05:05.514982+0000 (oldest deadline 2019-11-29T21:05:51.105472+0000) 2019-11-29T21:05:52.573 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:05:52.566+0000 1694c700 -1 osd.7 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:10.543833+0000 front 2019-11-29T21:05:04.257072+0000 (oldest deadline 2019-11-29T21:05:49.721745+0000) 2019-11-29T21:05:52.587 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:05:52.582+0000 1694c700 -1 osd.2 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:04.748365+0000 front 2019-11-29T21:05:05.274013+0000 (oldest deadline 2019-11-29T21:05:50.341532+0000) 2019-11-29T21:05:52.781 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:05:52.776+0000 1694c700 -1 osd.1 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:06.460628+0000 front 2019-11-29T21:05:06.818032+0000 (oldest deadline 2019-11-29T21:05:51.837565+0000) 2019-11-29T21:05:52.915 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:05:52.907+0000 1694c700 -1 osd.0 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:05.721190+0000 front 2019-11-29T21:05:05.514982+0000 (oldest deadline 2019-11-29T21:05:51.105472+0000) 2019-11-29T21:05:53.444 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:05:53.437+0000 1694c700 -1 osd.4 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:08.915767+0000 front 2019-11-29T21:05:08.803496+0000 (oldest deadline 2019-11-29T21:05:52.959209+0000) 2019-11-29T21:05:53.586 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:05:53.580+0000 1694c700 -1 osd.7 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:10.543833+0000 front 2019-11-29T21:05:04.257072+0000 (oldest deadline 2019-11-29T21:05:49.721745+0000) 2019-11-29T21:05:53.621 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:05:53.615+0000 1694c700 -1 osd.2 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:04.748365+0000 front 2019-11-29T21:05:05.274013+0000 (oldest deadline 2019-11-29T21:05:50.341532+0000) 2019-11-29T21:05:53.758 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:05:53.753+0000 1694c700 -1 osd.1 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:06.460628+0000 front 2019-11-29T21:05:06.818032+0000 (oldest deadline 2019-11-29T21:05:51.837565+0000) 2019-11-29T21:05:53.912 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:05:53.907+0000 1694c700 -1 osd.0 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:05.721190+0000 front 2019-11-29T21:05:05.514982+0000 (oldest deadline 2019-11-29T21:05:51.105472+0000) 2019-11-29T21:05:54.282 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:05:54.276+0000 1694c700 -1 osd.6 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:08.259562+0000 front 2019-11-29T21:05:08.280173+0000 (oldest deadline 2019-11-29T21:05:54.038962+0000) 2019-11-29T21:05:54.500 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:05:54.492+0000 1694c700 -1 osd.4 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:08.915767+0000 front 2019-11-29T21:05:08.803496+0000 (oldest deadline 2019-11-29T21:05:52.959209+0000) 2019-11-29T21:05:54.578 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:05:54.573+0000 1694c700 -1 osd.2 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:04.748365+0000 front 2019-11-29T21:05:05.274013+0000 (oldest deadline 2019-11-29T21:05:50.341532+0000) 2019-11-29T21:05:54.609 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:05:54.604+0000 1694c700 -1 osd.7 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:10.543833+0000 front 2019-11-29T21:05:04.257072+0000 (oldest deadline 2019-11-29T21:05:49.721745+0000) 2019-11-29T21:05:54.788 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:05:54.783+0000 1694c700 -1 osd.1 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:06.460628+0000 front 2019-11-29T21:05:06.818032+0000 (oldest deadline 2019-11-29T21:05:51.837565+0000) 2019-11-29T21:05:54.917 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:05:54.911+0000 1694c700 -1 osd.0 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:05.721190+0000 front 2019-11-29T21:05:05.514982+0000 (oldest deadline 2019-11-29T21:05:51.105472+0000) 2019-11-29T21:05:55.259 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:05:55.254+0000 1694c700 -1 osd.6 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:08.259562+0000 front 2019-11-29T21:05:08.280173+0000 (oldest deadline 2019-11-29T21:05:54.038962+0000) 2019-11-29T21:05:55.535 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:05:55.529+0000 1694c700 -1 osd.4 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:08.915767+0000 front 2019-11-29T21:05:08.803496+0000 (oldest deadline 2019-11-29T21:05:52.959209+0000) 2019-11-29T21:05:55.601 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:05:55.595+0000 1694c700 -1 osd.7 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:10.543833+0000 front 2019-11-29T21:05:04.257072+0000 (oldest deadline 2019-11-29T21:05:49.721745+0000) 2019-11-29T21:05:55.630 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:05:55.625+0000 1694c700 -1 osd.2 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:04.748365+0000 front 2019-11-29T21:05:05.274013+0000 (oldest deadline 2019-11-29T21:05:50.341532+0000) 2019-11-29T21:05:55.754 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:05:55.747+0000 1694c700 -1 osd.1 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:06.460628+0000 front 2019-11-29T21:05:06.818032+0000 (oldest deadline 2019-11-29T21:05:51.837565+0000) 2019-11-29T21:05:55.961 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:05:55.956+0000 1694c700 -1 osd.0 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:05.721190+0000 front 2019-11-29T21:05:05.514982+0000 (oldest deadline 2019-11-29T21:05:51.105472+0000) 2019-11-29T21:05:56.243 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:05:56.237+0000 1694c700 -1 osd.6 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:08.259562+0000 front 2019-11-29T21:05:08.280173+0000 (oldest deadline 2019-11-29T21:05:54.038962+0000) 2019-11-29T21:05:56.566 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:05:56.560+0000 1694c700 -1 osd.4 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:08.915767+0000 front 2019-11-29T21:05:08.803496+0000 (oldest deadline 2019-11-29T21:05:52.959209+0000) 2019-11-29T21:05:56.590 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:05:56.586+0000 1694c700 -1 osd.2 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:04.748365+0000 front 2019-11-29T21:05:05.274013+0000 (oldest deadline 2019-11-29T21:05:50.341532+0000) 2019-11-29T21:05:56.622 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:05:56.618+0000 1694c700 -1 osd.7 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:10.543833+0000 front 2019-11-29T21:05:04.257072+0000 (oldest deadline 2019-11-29T21:05:49.721745+0000) 2019-11-29T21:05:56.774 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:05:56.768+0000 1694c700 -1 osd.1 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:06.460628+0000 front 2019-11-29T21:05:06.818032+0000 (oldest deadline 2019-11-29T21:05:51.837565+0000) 2019-11-29T21:05:56.917 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:05:56.912+0000 1694c700 -1 osd.0 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:05.721190+0000 front 2019-11-29T21:05:05.514982+0000 (oldest deadline 2019-11-29T21:05:51.105472+0000) 2019-11-29T21:05:57.295 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:05:57.289+0000 1694c700 -1 osd.6 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:08.259562+0000 front 2019-11-29T21:05:08.280173+0000 (oldest deadline 2019-11-29T21:05:54.038962+0000) 2019-11-29T21:05:57.533 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:05:57.521+0000 1694c700 -1 osd.4 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:08.915767+0000 front 2019-11-29T21:05:08.803496+0000 (oldest deadline 2019-11-29T21:05:52.959209+0000) 2019-11-29T21:05:57.588 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:05:57.572+0000 1694c700 -1 osd.7 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:10.543833+0000 front 2019-11-29T21:05:04.257072+0000 (oldest deadline 2019-11-29T21:05:49.721745+0000) 2019-11-29T21:05:57.637 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:05:57.618+0000 1694c700 -1 osd.2 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:04.748365+0000 front 2019-11-29T21:05:05.274013+0000 (oldest deadline 2019-11-29T21:05:50.341532+0000) 2019-11-29T21:05:57.668 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~303s 2019-11-29T21:05:57.668 INFO:tasks.daemonwatchdog.daemon_watchdog:BARK! unmounting mounts and killing all daemons 2019-11-29T21:05:57.669 ERROR:tasks.daemonwatchdog.daemon_watchdog:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-yuval-master/qa/tasks/daemonwatchdog.py", line 38, in _run self.watch() File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-yuval-master/qa/tasks/daemonwatchdog.py", line 114, in watch self.bark() File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-yuval-master/qa/tasks/daemonwatchdog.py", line 54, in bark for mount in self.ctx.mounts.values(): File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/config.py", line 253, in __getattr__ raise AttributeError(name) AttributeError: mounts 2019-11-29T21:05:57.771 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:05:57.764+0000 1694c700 -1 osd.1 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:06.460628+0000 front 2019-11-29T21:05:06.818032+0000 (oldest deadline 2019-11-29T21:05:51.837565+0000) 2019-11-29T21:05:57.888 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:05:57.883+0000 1694c700 -1 osd.0 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:05.721190+0000 front 2019-11-29T21:05:05.514982+0000 (oldest deadline 2019-11-29T21:05:51.105472+0000) 2019-11-29T21:05:58.272 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:05:58.266+0000 1694c700 -1 osd.6 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:08.259562+0000 front 2019-11-29T21:05:08.280173+0000 (oldest deadline 2019-11-29T21:05:54.038962+0000) 2019-11-29T21:05:58.492 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:05:58.485+0000 1694c700 -1 osd.4 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:08.915767+0000 front 2019-11-29T21:05:08.803496+0000 (oldest deadline 2019-11-29T21:05:52.959209+0000) 2019-11-29T21:05:58.596 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:05:58.592+0000 1694c700 -1 osd.7 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:10.543833+0000 front 2019-11-29T21:05:04.257072+0000 (oldest deadline 2019-11-29T21:05:49.721745+0000) 2019-11-29T21:05:58.637 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:05:58.632+0000 1694c700 -1 osd.2 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:04.748365+0000 front 2019-11-29T21:05:05.274013+0000 (oldest deadline 2019-11-29T21:05:50.341532+0000) 2019-11-29T21:05:58.805 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:05:58.799+0000 1694c700 -1 osd.1 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:06.460628+0000 front 2019-11-29T21:05:06.818032+0000 (oldest deadline 2019-11-29T21:05:51.837565+0000) 2019-11-29T21:05:58.858 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:05:58.853+0000 1694c700 -1 osd.0 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:05.721190+0000 front 2019-11-29T21:05:05.514982+0000 (oldest deadline 2019-11-29T21:05:51.105472+0000) 2019-11-29T21:05:59.264 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:05:59.257+0000 1694c700 -1 osd.6 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:08.259562+0000 front 2019-11-29T21:05:08.280173+0000 (oldest deadline 2019-11-29T21:05:54.038962+0000) 2019-11-29T21:05:59.467 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:05:59.462+0000 1694c700 -1 osd.4 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:08.915767+0000 front 2019-11-29T21:05:08.803496+0000 (oldest deadline 2019-11-29T21:05:52.959209+0000) 2019-11-29T21:05:59.594 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:05:59.588+0000 1694c700 -1 osd.2 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:04.748365+0000 front 2019-11-29T21:05:05.274013+0000 (oldest deadline 2019-11-29T21:05:50.341532+0000) 2019-11-29T21:05:59.641 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:05:59.636+0000 1694c700 -1 osd.7 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:10.543833+0000 front 2019-11-29T21:05:04.257072+0000 (oldest deadline 2019-11-29T21:05:49.721745+0000) 2019-11-29T21:05:59.780 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:05:59.775+0000 1694c700 -1 osd.1 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:06.460628+0000 front 2019-11-29T21:05:06.818032+0000 (oldest deadline 2019-11-29T21:05:51.837565+0000) 2019-11-29T21:05:59.914 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:05:59.900+0000 1694c700 -1 osd.0 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:05.721190+0000 front 2019-11-29T21:05:05.514982+0000 (oldest deadline 2019-11-29T21:05:51.105472+0000) 2019-11-29T21:06:00.256 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:06:00.250+0000 1694c700 -1 osd.6 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:08.259562+0000 front 2019-11-29T21:05:08.280173+0000 (oldest deadline 2019-11-29T21:05:54.038962+0000) 2019-11-29T21:06:00.504 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:06:00.499+0000 1694c700 -1 osd.4 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:08.915767+0000 front 2019-11-29T21:05:08.803496+0000 (oldest deadline 2019-11-29T21:05:52.959209+0000) 2019-11-29T21:06:00.556 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:06:00.551+0000 1694c700 -1 osd.2 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:04.748365+0000 front 2019-11-29T21:05:05.274013+0000 (oldest deadline 2019-11-29T21:05:50.341532+0000) 2019-11-29T21:06:00.615 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:06:00.611+0000 1694c700 -1 osd.7 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:10.543833+0000 front 2019-11-29T21:05:04.257072+0000 (oldest deadline 2019-11-29T21:05:49.721745+0000) 2019-11-29T21:06:00.765 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:06:00.760+0000 1694c700 -1 osd.1 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:06.460628+0000 front 2019-11-29T21:05:06.818032+0000 (oldest deadline 2019-11-29T21:05:51.837565+0000) 2019-11-29T21:06:00.926 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:06:00.921+0000 1694c700 -1 osd.0 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:05.721190+0000 front 2019-11-29T21:05:05.514982+0000 (oldest deadline 2019-11-29T21:05:51.105472+0000) 2019-11-29T21:06:01.248 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:06:01.242+0000 1694c700 -1 osd.6 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:08.259562+0000 front 2019-11-29T21:05:08.280173+0000 (oldest deadline 2019-11-29T21:05:54.038962+0000) 2019-11-29T21:06:01.474 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:06:01.469+0000 1694c700 -1 osd.4 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:08.915767+0000 front 2019-11-29T21:05:08.803496+0000 (oldest deadline 2019-11-29T21:05:52.959209+0000) 2019-11-29T21:06:01.569 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:06:01.560+0000 1694c700 -1 osd.2 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:04.748365+0000 front 2019-11-29T21:05:05.274013+0000 (oldest deadline 2019-11-29T21:05:50.341532+0000) 2019-11-29T21:06:01.620 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:06:01.614+0000 1694c700 -1 osd.7 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:10.543833+0000 front 2019-11-29T21:05:04.257072+0000 (oldest deadline 2019-11-29T21:05:49.721745+0000) 2019-11-29T21:06:01.772 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:06:01.767+0000 1694c700 -1 osd.1 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:06.460628+0000 front 2019-11-29T21:05:06.818032+0000 (oldest deadline 2019-11-29T21:05:51.837565+0000) 2019-11-29T21:06:01.967 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:06:01.961+0000 1694c700 -1 osd.0 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:05.721190+0000 front 2019-11-29T21:05:05.514982+0000 (oldest deadline 2019-11-29T21:05:51.105472+0000) 2019-11-29T21:06:02.221 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:06:02.217+0000 1694c700 -1 osd.6 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:08.259562+0000 front 2019-11-29T21:05:08.280173+0000 (oldest deadline 2019-11-29T21:05:54.038962+0000) 2019-11-29T21:06:02.466 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:06:02.459+0000 1694c700 -1 osd.4 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:08.915767+0000 front 2019-11-29T21:05:08.803496+0000 (oldest deadline 2019-11-29T21:05:52.959209+0000) 2019-11-29T21:06:02.594 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:06:02.589+0000 1694c700 -1 osd.2 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:04.748365+0000 front 2019-11-29T21:05:05.274013+0000 (oldest deadline 2019-11-29T21:05:50.341532+0000) 2019-11-29T21:06:02.676 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:06:02.667+0000 1694c700 -1 osd.7 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:10.543833+0000 front 2019-11-29T21:05:04.257072+0000 (oldest deadline 2019-11-29T21:05:49.721745+0000) 2019-11-29T21:06:02.784 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:06:02.778+0000 1694c700 -1 osd.1 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:06.460628+0000 front 2019-11-29T21:05:06.818032+0000 (oldest deadline 2019-11-29T21:05:51.837565+0000) 2019-11-29T21:06:02.981 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:06:02.977+0000 1694c700 -1 osd.0 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:05.721190+0000 front 2019-11-29T21:05:05.514982+0000 (oldest deadline 2019-11-29T21:05:51.105472+0000) 2019-11-29T21:06:03.268 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:06:03.263+0000 1694c700 -1 osd.6 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:08.259562+0000 front 2019-11-29T21:05:08.280173+0000 (oldest deadline 2019-11-29T21:05:54.038962+0000) 2019-11-29T21:06:03.423 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:06:03.417+0000 1694c700 -1 osd.4 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:08.915767+0000 front 2019-11-29T21:05:08.803496+0000 (oldest deadline 2019-11-29T21:05:52.959209+0000) 2019-11-29T21:06:03.588 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:06:03.583+0000 1694c700 -1 osd.2 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:04.748365+0000 front 2019-11-29T21:05:05.274013+0000 (oldest deadline 2019-11-29T21:05:50.341532+0000) 2019-11-29T21:06:03.686 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:06:03.681+0000 1694c700 -1 osd.7 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:10.543833+0000 front 2019-11-29T21:05:04.257072+0000 (oldest deadline 2019-11-29T21:05:49.721745+0000) 2019-11-29T21:06:03.747 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:06:03.742+0000 1694c700 -1 osd.1 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:06.460628+0000 front 2019-11-29T21:05:06.818032+0000 (oldest deadline 2019-11-29T21:05:51.837565+0000) 2019-11-29T21:06:03.945 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:06:03.939+0000 1694c700 -1 osd.0 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:05.721190+0000 front 2019-11-29T21:05:05.514982+0000 (oldest deadline 2019-11-29T21:05:51.105472+0000) 2019-11-29T21:06:04.267 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:06:04.259+0000 1694c700 -1 osd.6 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:08.259562+0000 front 2019-11-29T21:05:08.280173+0000 (oldest deadline 2019-11-29T21:05:54.038962+0000) 2019-11-29T21:06:04.465 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:06:04.459+0000 1694c700 -1 osd.4 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:08.915767+0000 front 2019-11-29T21:05:08.803496+0000 (oldest deadline 2019-11-29T21:05:52.959209+0000) 2019-11-29T21:06:04.603 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:06:04.597+0000 1694c700 -1 osd.2 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:04.748365+0000 front 2019-11-29T21:05:05.274013+0000 (oldest deadline 2019-11-29T21:05:50.341532+0000) 2019-11-29T21:06:04.722 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:06:04.716+0000 1694c700 -1 osd.1 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:06.460628+0000 front 2019-11-29T21:05:06.818032+0000 (oldest deadline 2019-11-29T21:05:51.837565+0000) 2019-11-29T21:06:04.725 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:06:04.719+0000 1694c700 -1 osd.7 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:10.543833+0000 front 2019-11-29T21:05:04.257072+0000 (oldest deadline 2019-11-29T21:05:49.721745+0000) 2019-11-29T21:06:04.950 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:06:04.945+0000 1694c700 -1 osd.0 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:05.721190+0000 front 2019-11-29T21:05:05.514982+0000 (oldest deadline 2019-11-29T21:05:51.105472+0000) 2019-11-29T21:06:05.299 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:06:05.293+0000 1694c700 -1 osd.6 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:08.259562+0000 front 2019-11-29T21:05:08.280173+0000 (oldest deadline 2019-11-29T21:05:54.038962+0000) 2019-11-29T21:06:05.514 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:06:05.509+0000 1694c700 -1 osd.4 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:08.915767+0000 front 2019-11-29T21:05:08.803496+0000 (oldest deadline 2019-11-29T21:05:52.959209+0000) 2019-11-29T21:06:05.603 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:06:05.597+0000 1694c700 -1 osd.2 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:04.748365+0000 front 2019-11-29T21:05:05.274013+0000 (oldest deadline 2019-11-29T21:05:50.341532+0000) 2019-11-29T21:06:05.720 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:06:05.714+0000 1694c700 -1 osd.1 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:06.460628+0000 front 2019-11-29T21:05:06.818032+0000 (oldest deadline 2019-11-29T21:05:51.837565+0000) 2019-11-29T21:06:05.741 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:06:05.736+0000 1694c700 -1 osd.7 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:10.543833+0000 front 2019-11-29T21:05:04.257072+0000 (oldest deadline 2019-11-29T21:05:49.721745+0000) 2019-11-29T21:06:05.918 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:06:05.913+0000 1694c700 -1 osd.0 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:05.721190+0000 front 2019-11-29T21:05:05.514982+0000 (oldest deadline 2019-11-29T21:05:51.105472+0000) 2019-11-29T21:06:06.266 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:06:06.260+0000 1694c700 -1 osd.6 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:08.259562+0000 front 2019-11-29T21:05:08.280173+0000 (oldest deadline 2019-11-29T21:05:54.038962+0000) 2019-11-29T21:06:06.532 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:06:06.526+0000 1694c700 -1 osd.4 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:08.915767+0000 front 2019-11-29T21:05:08.803496+0000 (oldest deadline 2019-11-29T21:05:52.959209+0000) 2019-11-29T21:06:06.623 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:06:06.618+0000 1694c700 -1 osd.2 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:04.748365+0000 front 2019-11-29T21:05:05.274013+0000 (oldest deadline 2019-11-29T21:05:50.341532+0000) 2019-11-29T21:06:06.702 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:06:06.697+0000 1694c700 -1 osd.7 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:10.543833+0000 front 2019-11-29T21:05:04.257072+0000 (oldest deadline 2019-11-29T21:05:49.721745+0000) 2019-11-29T21:06:06.748 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:06:06.742+0000 1694c700 -1 osd.1 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:06.460628+0000 front 2019-11-29T21:05:06.818032+0000 (oldest deadline 2019-11-29T21:05:51.837565+0000) 2019-11-29T21:06:06.949 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:06:06.944+0000 1694c700 -1 osd.0 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:05.721190+0000 front 2019-11-29T21:05:05.514982+0000 (oldest deadline 2019-11-29T21:05:51.105472+0000) 2019-11-29T21:06:07.296 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:06:07.291+0000 1694c700 -1 osd.6 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:08.259562+0000 front 2019-11-29T21:05:08.280173+0000 (oldest deadline 2019-11-29T21:05:54.038962+0000) 2019-11-29T21:06:07.534 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:06:07.528+0000 1694c700 -1 osd.4 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:08.915767+0000 front 2019-11-29T21:05:08.803496+0000 (oldest deadline 2019-11-29T21:05:52.959209+0000) 2019-11-29T21:06:07.669 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:06:07.663+0000 1694c700 -1 osd.2 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:04.748365+0000 front 2019-11-29T21:05:05.274013+0000 (oldest deadline 2019-11-29T21:05:50.341532+0000) 2019-11-29T21:06:07.737 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:06:07.732+0000 1694c700 -1 osd.7 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:10.543833+0000 front 2019-11-29T21:05:04.257072+0000 (oldest deadline 2019-11-29T21:05:49.721745+0000) 2019-11-29T21:06:07.803 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:06:07.797+0000 1694c700 -1 osd.1 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:06.460628+0000 front 2019-11-29T21:05:06.818032+0000 (oldest deadline 2019-11-29T21:05:51.837565+0000) 2019-11-29T21:06:07.934 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:06:07.930+0000 1694c700 -1 osd.0 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:05.721190+0000 front 2019-11-29T21:05:05.514982+0000 (oldest deadline 2019-11-29T21:05:51.105472+0000) 2019-11-29T21:06:08.321 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:06:08.316+0000 1694c700 -1 osd.6 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:08.259562+0000 front 2019-11-29T21:05:08.280173+0000 (oldest deadline 2019-11-29T21:05:54.038962+0000) 2019-11-29T21:06:08.498 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:06:08.492+0000 1694c700 -1 osd.4 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:08.915767+0000 front 2019-11-29T21:05:08.803496+0000 (oldest deadline 2019-11-29T21:05:52.959209+0000) 2019-11-29T21:06:08.689 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:06:08.684+0000 1694c700 -1 osd.2 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:04.748365+0000 front 2019-11-29T21:05:05.274013+0000 (oldest deadline 2019-11-29T21:05:50.341532+0000) 2019-11-29T21:06:08.773 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:06:08.766+0000 1694c700 -1 osd.7 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:10.543833+0000 front 2019-11-29T21:05:04.257072+0000 (oldest deadline 2019-11-29T21:05:49.721745+0000) 2019-11-29T21:06:08.832 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:06:08.826+0000 1694c700 -1 osd.1 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:06.460628+0000 front 2019-11-29T21:05:06.818032+0000 (oldest deadline 2019-11-29T21:05:51.837565+0000) 2019-11-29T21:06:08.905 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:06:08.899+0000 1694c700 -1 osd.0 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:05.721190+0000 front 2019-11-29T21:05:05.514982+0000 (oldest deadline 2019-11-29T21:05:51.105472+0000) 2019-11-29T21:06:09.346 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:06:09.341+0000 1694c700 -1 osd.6 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:08.259562+0000 front 2019-11-29T21:05:08.280173+0000 (oldest deadline 2019-11-29T21:05:54.038962+0000) 2019-11-29T21:06:09.484 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:06:09.479+0000 1694c700 -1 osd.4 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:08.915767+0000 front 2019-11-29T21:05:08.803496+0000 (oldest deadline 2019-11-29T21:05:52.959209+0000) 2019-11-29T21:06:09.721 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:06:09.715+0000 1694c700 -1 osd.2 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:04.748365+0000 front 2019-11-29T21:05:05.274013+0000 (oldest deadline 2019-11-29T21:05:50.341532+0000) 2019-11-29T21:06:09.796 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:06:09.791+0000 1694c700 -1 osd.7 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:10.543833+0000 front 2019-11-29T21:05:04.257072+0000 (oldest deadline 2019-11-29T21:05:49.721745+0000) 2019-11-29T21:06:09.863 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:06:09.857+0000 1694c700 -1 osd.1 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:06.460628+0000 front 2019-11-29T21:05:06.818032+0000 (oldest deadline 2019-11-29T21:05:51.837565+0000) 2019-11-29T21:06:09.926 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:06:09.921+0000 1694c700 -1 osd.0 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:05.721190+0000 front 2019-11-29T21:05:05.514982+0000 (oldest deadline 2019-11-29T21:05:51.105472+0000) 2019-11-29T21:06:10.339 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:06:10.334+0000 1694c700 -1 osd.6 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:08.259562+0000 front 2019-11-29T21:05:08.280173+0000 (oldest deadline 2019-11-29T21:05:54.038962+0000) 2019-11-29T21:06:10.481 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:06:10.475+0000 1694c700 -1 osd.4 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:08.915767+0000 front 2019-11-29T21:05:08.803496+0000 (oldest deadline 2019-11-29T21:05:52.959209+0000) 2019-11-29T21:06:10.748 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:06:10.743+0000 1694c700 -1 osd.2 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:04.748365+0000 front 2019-11-29T21:05:05.274013+0000 (oldest deadline 2019-11-29T21:05:50.341532+0000) 2019-11-29T21:06:10.756 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:06:10.750+0000 1694c700 -1 osd.7 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:10.543833+0000 front 2019-11-29T21:05:04.257072+0000 (oldest deadline 2019-11-29T21:05:49.721745+0000) 2019-11-29T21:06:10.904 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:06:10.898+0000 1694c700 -1 osd.1 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:06.460628+0000 front 2019-11-29T21:05:06.818032+0000 (oldest deadline 2019-11-29T21:05:51.837565+0000) 2019-11-29T21:06:10.952 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:06:10.947+0000 1694c700 -1 osd.0 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:05.721190+0000 front 2019-11-29T21:05:05.514982+0000 (oldest deadline 2019-11-29T21:05:51.105472+0000) 2019-11-29T21:06:11.336 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:06:11.330+0000 1694c700 -1 osd.6 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:08.259562+0000 front 2019-11-29T21:05:08.280173+0000 (oldest deadline 2019-11-29T21:05:54.038962+0000) 2019-11-29T21:06:11.485 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:06:11.478+0000 1694c700 -1 osd.4 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:08.915767+0000 front 2019-11-29T21:05:08.803496+0000 (oldest deadline 2019-11-29T21:05:52.959209+0000) 2019-11-29T21:06:11.762 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:06:11.756+0000 1694c700 -1 osd.2 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:04.748365+0000 front 2019-11-29T21:05:05.274013+0000 (oldest deadline 2019-11-29T21:05:50.341532+0000) 2019-11-29T21:06:11.767 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:06:11.762+0000 1694c700 -1 osd.7 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:10.543833+0000 front 2019-11-29T21:05:04.257072+0000 (oldest deadline 2019-11-29T21:05:49.721745+0000) 2019-11-29T21:06:11.881 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:06:11.875+0000 1694c700 -1 osd.1 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:06.460628+0000 front 2019-11-29T21:05:06.818032+0000 (oldest deadline 2019-11-29T21:05:51.837565+0000) 2019-11-29T21:06:11.957 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:06:11.952+0000 1694c700 -1 osd.0 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:05.721190+0000 front 2019-11-29T21:05:05.514982+0000 (oldest deadline 2019-11-29T21:05:51.105472+0000) 2019-11-29T21:06:12.310 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:06:12.304+0000 1694c700 -1 osd.6 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:08.259562+0000 front 2019-11-29T21:05:08.280173+0000 (oldest deadline 2019-11-29T21:05:54.038962+0000) 2019-11-29T21:06:12.503 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:06:12.496+0000 1694c700 -1 osd.4 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:08.915767+0000 front 2019-11-29T21:05:08.803496+0000 (oldest deadline 2019-11-29T21:05:52.959209+0000) 2019-11-29T21:06:12.765 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:06:12.760+0000 1694c700 -1 osd.2 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:04.748365+0000 front 2019-11-29T21:05:05.274013+0000 (oldest deadline 2019-11-29T21:05:50.341532+0000) 2019-11-29T21:06:12.796 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:06:12.791+0000 1694c700 -1 osd.7 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:10.543833+0000 front 2019-11-29T21:05:04.257072+0000 (oldest deadline 2019-11-29T21:05:49.721745+0000) 2019-11-29T21:06:12.854 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:06:12.848+0000 1694c700 -1 osd.1 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:06.460628+0000 front 2019-11-29T21:05:06.818032+0000 (oldest deadline 2019-11-29T21:05:51.837565+0000) 2019-11-29T21:06:12.928 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:06:12.923+0000 1694c700 -1 osd.0 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:05.721190+0000 front 2019-11-29T21:05:05.514982+0000 (oldest deadline 2019-11-29T21:05:51.105472+0000) 2019-11-29T21:06:13.323 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:06:13.318+0000 1694c700 -1 osd.6 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:08.259562+0000 front 2019-11-29T21:05:08.280173+0000 (oldest deadline 2019-11-29T21:05:54.038962+0000) 2019-11-29T21:06:13.498 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:06:13.493+0000 1694c700 -1 osd.4 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:08.915767+0000 front 2019-11-29T21:05:08.803496+0000 (oldest deadline 2019-11-29T21:05:52.959209+0000) 2019-11-29T21:06:13.776 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:06:13.770+0000 1694c700 -1 osd.2 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:04.748365+0000 front 2019-11-29T21:05:05.274013+0000 (oldest deadline 2019-11-29T21:05:50.341532+0000) 2019-11-29T21:06:13.827 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:06:13.821+0000 1694c700 -1 osd.7 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:10.543833+0000 front 2019-11-29T21:05:04.257072+0000 (oldest deadline 2019-11-29T21:05:49.721745+0000) 2019-11-29T21:06:13.885 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:06:13.880+0000 1694c700 -1 osd.1 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:06.460628+0000 front 2019-11-29T21:05:06.818032+0000 (oldest deadline 2019-11-29T21:05:51.837565+0000) 2019-11-29T21:06:13.943 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:06:13.938+0000 1694c700 -1 osd.0 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:05.721190+0000 front 2019-11-29T21:05:05.514982+0000 (oldest deadline 2019-11-29T21:05:51.105472+0000) 2019-11-29T21:06:14.315 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:06:14.309+0000 1694c700 -1 osd.6 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:08.259562+0000 front 2019-11-29T21:05:08.280173+0000 (oldest deadline 2019-11-29T21:05:54.038962+0000) 2019-11-29T21:06:14.462 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:06:14.453+0000 1694c700 -1 osd.4 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:08.915767+0000 front 2019-11-29T21:05:08.803496+0000 (oldest deadline 2019-11-29T21:05:52.959209+0000) 2019-11-29T21:06:14.790 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:06:14.784+0000 1694c700 -1 osd.7 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:10.543833+0000 front 2019-11-29T21:05:04.257072+0000 (oldest deadline 2019-11-29T21:05:49.721745+0000) 2019-11-29T21:06:14.790 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:06:14.784+0000 1694c700 -1 osd.2 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:04.748365+0000 front 2019-11-29T21:05:05.274013+0000 (oldest deadline 2019-11-29T21:05:50.341532+0000) 2019-11-29T21:06:14.908 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:06:14.903+0000 1694c700 -1 osd.0 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:05.721190+0000 front 2019-11-29T21:05:05.514982+0000 (oldest deadline 2019-11-29T21:05:51.105472+0000) 2019-11-29T21:06:14.931 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:06:14.925+0000 1694c700 -1 osd.1 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:06.460628+0000 front 2019-11-29T21:05:06.818032+0000 (oldest deadline 2019-11-29T21:05:51.837565+0000) 2019-11-29T21:06:15.357 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:06:15.351+0000 1694c700 -1 osd.6 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:08.259562+0000 front 2019-11-29T21:05:08.280173+0000 (oldest deadline 2019-11-29T21:05:54.038962+0000) 2019-11-29T21:06:15.502 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:06:15.496+0000 1694c700 -1 osd.4 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:08.915767+0000 front 2019-11-29T21:05:08.803496+0000 (oldest deadline 2019-11-29T21:05:52.959209+0000) 2019-11-29T21:06:15.786 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:06:15.781+0000 1694c700 -1 osd.2 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:04.748365+0000 front 2019-11-29T21:05:05.274013+0000 (oldest deadline 2019-11-29T21:05:50.341532+0000) 2019-11-29T21:06:15.807 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:06:15.802+0000 1694c700 -1 osd.7 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:10.543833+0000 front 2019-11-29T21:05:04.257072+0000 (oldest deadline 2019-11-29T21:05:49.721745+0000) 2019-11-29T21:06:15.890 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:06:15.883+0000 1694c700 -1 osd.1 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:06.460628+0000 front 2019-11-29T21:05:06.818032+0000 (oldest deadline 2019-11-29T21:05:51.837565+0000) 2019-11-29T21:06:15.938 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:06:15.931+0000 1694c700 -1 osd.0 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:05.721190+0000 front 2019-11-29T21:05:05.514982+0000 (oldest deadline 2019-11-29T21:05:51.105472+0000) 2019-11-29T21:06:16.344 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:06:16.339+0000 1694c700 -1 osd.6 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:08.259562+0000 front 2019-11-29T21:05:08.280173+0000 (oldest deadline 2019-11-29T21:05:54.038962+0000) 2019-11-29T21:06:16.500 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:06:16.494+0000 1694c700 -1 osd.4 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:08.915767+0000 front 2019-11-29T21:05:08.803496+0000 (oldest deadline 2019-11-29T21:05:52.959209+0000) 2019-11-29T21:06:16.803 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:06:16.798+0000 1694c700 -1 osd.2 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:04.748365+0000 front 2019-11-29T21:05:05.274013+0000 (oldest deadline 2019-11-29T21:05:50.341532+0000) 2019-11-29T21:06:16.853 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:06:16.848+0000 1694c700 -1 osd.7 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:10.543833+0000 front 2019-11-29T21:05:04.257072+0000 (oldest deadline 2019-11-29T21:05:49.721745+0000) 2019-11-29T21:06:16.872 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:06:16.867+0000 1694c700 -1 osd.1 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:06.460628+0000 front 2019-11-29T21:05:06.818032+0000 (oldest deadline 2019-11-29T21:05:51.837565+0000) 2019-11-29T21:06:16.896 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:06:16.891+0000 1694c700 -1 osd.0 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:05.721190+0000 front 2019-11-29T21:05:05.514982+0000 (oldest deadline 2019-11-29T21:05:51.105472+0000) 2019-11-29T21:06:17.357 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:06:17.352+0000 1694c700 -1 osd.6 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:08.259562+0000 front 2019-11-29T21:05:08.280173+0000 (oldest deadline 2019-11-29T21:05:54.038962+0000) 2019-11-29T21:06:17.512 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:06:17.506+0000 1694c700 -1 osd.4 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:08.915767+0000 front 2019-11-29T21:05:08.803496+0000 (oldest deadline 2019-11-29T21:05:52.959209+0000) 2019-11-29T21:06:17.797 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:06:17.790+0000 1694c700 -1 osd.2 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:04.748365+0000 front 2019-11-29T21:05:05.274013+0000 (oldest deadline 2019-11-29T21:05:50.341532+0000) 2019-11-29T21:06:17.857 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:06:17.851+0000 1694c700 -1 osd.7 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:10.543833+0000 front 2019-11-29T21:05:04.257072+0000 (oldest deadline 2019-11-29T21:05:49.721745+0000) 2019-11-29T21:06:17.897 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:06:17.892+0000 1694c700 -1 osd.1 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:06.460628+0000 front 2019-11-29T21:05:06.818032+0000 (oldest deadline 2019-11-29T21:05:51.837565+0000) 2019-11-29T21:06:17.916 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:06:17.911+0000 1694c700 -1 osd.0 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:05.721190+0000 front 2019-11-29T21:05:05.514982+0000 (oldest deadline 2019-11-29T21:05:51.105472+0000) 2019-11-29T21:06:18.340 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:06:18.334+0000 1694c700 -1 osd.6 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:08.259562+0000 front 2019-11-29T21:05:08.280173+0000 (oldest deadline 2019-11-29T21:05:54.038962+0000) 2019-11-29T21:06:18.473 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:06:18.467+0000 1694c700 -1 osd.4 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:08.915767+0000 front 2019-11-29T21:05:08.803496+0000 (oldest deadline 2019-11-29T21:05:52.959209+0000) 2019-11-29T21:06:18.791 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:06:18.783+0000 1694c700 -1 osd.2 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:04.748365+0000 front 2019-11-29T21:05:05.274013+0000 (oldest deadline 2019-11-29T21:05:50.341532+0000) 2019-11-29T21:06:18.850 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:06:18.845+0000 1694c700 -1 osd.7 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:10.543833+0000 front 2019-11-29T21:05:04.257072+0000 (oldest deadline 2019-11-29T21:05:49.721745+0000) 2019-11-29T21:06:18.868 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:06:18.862+0000 1694c700 -1 osd.1 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:06.460628+0000 front 2019-11-29T21:05:06.818032+0000 (oldest deadline 2019-11-29T21:05:51.837565+0000) 2019-11-29T21:06:18.933 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:06:18.927+0000 1694c700 -1 osd.0 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:05.721190+0000 front 2019-11-29T21:05:05.514982+0000 (oldest deadline 2019-11-29T21:05:51.105472+0000) 2019-11-29T21:06:19.350 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:06:19.345+0000 1694c700 -1 osd.6 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:08.259562+0000 front 2019-11-29T21:05:08.280173+0000 (oldest deadline 2019-11-29T21:05:54.038962+0000) 2019-11-29T21:06:19.522 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:06:19.516+0000 1694c700 -1 osd.4 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:08.915767+0000 front 2019-11-29T21:05:08.803496+0000 (oldest deadline 2019-11-29T21:05:52.959209+0000) 2019-11-29T21:06:19.765 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:06:19.760+0000 1694c700 -1 osd.2 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:04.748365+0000 front 2019-11-29T21:05:05.274013+0000 (oldest deadline 2019-11-29T21:05:50.341532+0000) 2019-11-29T21:06:19.903 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:06:19.897+0000 1694c700 -1 osd.7 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:10.543833+0000 front 2019-11-29T21:05:04.257072+0000 (oldest deadline 2019-11-29T21:05:49.721745+0000) 2019-11-29T21:06:19.917 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:06:19.913+0000 1694c700 -1 osd.1 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:06.460628+0000 front 2019-11-29T21:05:06.818032+0000 (oldest deadline 2019-11-29T21:05:51.837565+0000) 2019-11-29T21:06:19.976 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:06:19.970+0000 1694c700 -1 osd.0 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:05.721190+0000 front 2019-11-29T21:05:05.514982+0000 (oldest deadline 2019-11-29T21:05:51.105472+0000) 2019-11-29T21:06:20.309 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:06:20.304+0000 1694c700 -1 osd.6 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:08.259562+0000 front 2019-11-29T21:05:08.280173+0000 (oldest deadline 2019-11-29T21:05:54.038962+0000) 2019-11-29T21:06:20.533 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:06:20.528+0000 1694c700 -1 osd.4 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:08.915767+0000 front 2019-11-29T21:05:08.803496+0000 (oldest deadline 2019-11-29T21:05:52.959209+0000) 2019-11-29T21:06:20.765 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:06:20.756+0000 1694c700 -1 osd.2 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:04.748365+0000 front 2019-11-29T21:05:05.274013+0000 (oldest deadline 2019-11-29T21:05:50.341532+0000) 2019-11-29T21:06:20.946 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:06:20.941+0000 1694c700 -1 osd.7 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:10.543833+0000 front 2019-11-29T21:05:04.257072+0000 (oldest deadline 2019-11-29T21:05:49.721745+0000) 2019-11-29T21:06:20.947 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:06:20.943+0000 1694c700 -1 osd.1 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:06.460628+0000 front 2019-11-29T21:05:06.818032+0000 (oldest deadline 2019-11-29T21:05:51.837565+0000) 2019-11-29T21:06:21.019 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:06:21.013+0000 1694c700 -1 osd.0 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:05.721190+0000 front 2019-11-29T21:05:05.514982+0000 (oldest deadline 2019-11-29T21:05:51.105472+0000) 2019-11-29T21:06:21.334 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:06:21.329+0000 1694c700 -1 osd.6 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:08.259562+0000 front 2019-11-29T21:05:08.280173+0000 (oldest deadline 2019-11-29T21:05:54.038962+0000) 2019-11-29T21:06:21.568 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:06:21.563+0000 1694c700 -1 osd.4 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:08.915767+0000 front 2019-11-29T21:05:08.803496+0000 (oldest deadline 2019-11-29T21:05:52.959209+0000) 2019-11-29T21:06:21.717 INFO:tasks.ceph.mon.b.smithi022.stderr:2019-11-29T21:06:21.711+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.22:6818/9264,v1:172.21.15.22:6819/9264] for 46sec e248 v248) 2019-11-29T21:06:21.763 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:06:21.758+0000 1694c700 -1 osd.2 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:04.748365+0000 front 2019-11-29T21:05:05.274013+0000 (oldest deadline 2019-11-29T21:05:50.341532+0000) 2019-11-29T21:06:21.918 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:06:21.913+0000 1694c700 -1 osd.1 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:06.460628+0000 front 2019-11-29T21:05:06.818032+0000 (oldest deadline 2019-11-29T21:05:51.837565+0000) 2019-11-29T21:06:21.930 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:06:21.924+0000 1694c700 -1 osd.7 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:10.543833+0000 front 2019-11-29T21:05:04.257072+0000 (oldest deadline 2019-11-29T21:05:49.721745+0000) 2019-11-29T21:06:21.995 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:06:21.989+0000 1694c700 -1 osd.0 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:05.721190+0000 front 2019-11-29T21:05:05.514982+0000 (oldest deadline 2019-11-29T21:05:51.105472+0000) 2019-11-29T21:06:22.329 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:06:22.324+0000 1694c700 -1 osd.6 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:08.259562+0000 front 2019-11-29T21:05:08.280173+0000 (oldest deadline 2019-11-29T21:05:54.038962+0000) 2019-11-29T21:06:22.589 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:06:22.583+0000 1694c700 -1 osd.4 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:08.915767+0000 front 2019-11-29T21:05:08.803496+0000 (oldest deadline 2019-11-29T21:05:52.959209+0000) 2019-11-29T21:06:22.803 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:06:22.798+0000 1694c700 -1 osd.2 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:04.748365+0000 front 2019-11-29T21:05:05.274013+0000 (oldest deadline 2019-11-29T21:05:50.341532+0000) 2019-11-29T21:06:22.893 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:06:22.887+0000 1694c700 -1 osd.7 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:10.543833+0000 front 2019-11-29T21:05:04.257072+0000 (oldest deadline 2019-11-29T21:05:49.721745+0000) 2019-11-29T21:06:22.935 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:06:22.930+0000 1694c700 -1 osd.1 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:06.460628+0000 front 2019-11-29T21:05:06.818032+0000 (oldest deadline 2019-11-29T21:05:51.837565+0000) 2019-11-29T21:06:23.008 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:06:23.003+0000 1694c700 -1 osd.0 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:05.721190+0000 front 2019-11-29T21:05:05.514982+0000 (oldest deadline 2019-11-29T21:05:51.105472+0000) 2019-11-29T21:06:23.374 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:06:23.368+0000 1694c700 -1 osd.6 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:08.259562+0000 front 2019-11-29T21:05:08.280173+0000 (oldest deadline 2019-11-29T21:05:54.038962+0000) 2019-11-29T21:06:23.569 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:06:23.557+0000 1694c700 -1 osd.4 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:08.915767+0000 front 2019-11-29T21:05:08.803496+0000 (oldest deadline 2019-11-29T21:05:52.959209+0000) 2019-11-29T21:06:23.763 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:06:23.757+0000 1694c700 -1 osd.2 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:04.748365+0000 front 2019-11-29T21:05:05.274013+0000 (oldest deadline 2019-11-29T21:05:50.341532+0000) 2019-11-29T21:06:23.883 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:06:23.873+0000 1694c700 -1 osd.7 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:10.543833+0000 front 2019-11-29T21:05:04.257072+0000 (oldest deadline 2019-11-29T21:05:49.721745+0000) 2019-11-29T21:06:23.980 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:06:23.975+0000 1694c700 -1 osd.0 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:05.721190+0000 front 2019-11-29T21:05:05.514982+0000 (oldest deadline 2019-11-29T21:05:51.105472+0000) 2019-11-29T21:06:23.985 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:06:23.981+0000 1694c700 -1 osd.1 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:06.460628+0000 front 2019-11-29T21:05:06.818032+0000 (oldest deadline 2019-11-29T21:05:51.837565+0000) 2019-11-29T21:06:24.401 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:06:24.395+0000 1694c700 -1 osd.6 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:08.259562+0000 front 2019-11-29T21:05:08.280173+0000 (oldest deadline 2019-11-29T21:05:54.038962+0000) 2019-11-29T21:06:24.538 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:06:24.533+0000 1694c700 -1 osd.4 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:08.915767+0000 front 2019-11-29T21:05:08.803496+0000 (oldest deadline 2019-11-29T21:05:52.959209+0000) 2019-11-29T21:06:24.735 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:06:24.730+0000 1694c700 -1 osd.2 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:04.748365+0000 front 2019-11-29T21:05:05.274013+0000 (oldest deadline 2019-11-29T21:05:50.341532+0000) 2019-11-29T21:06:24.863 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:06:24.859+0000 1694c700 -1 osd.7 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:10.543833+0000 front 2019-11-29T21:05:04.257072+0000 (oldest deadline 2019-11-29T21:05:49.721745+0000) 2019-11-29T21:06:24.973 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:06:24.967+0000 1694c700 -1 osd.0 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:05.721190+0000 front 2019-11-29T21:05:05.514982+0000 (oldest deadline 2019-11-29T21:05:51.105472+0000) 2019-11-29T21:06:24.975 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:06:24.970+0000 1694c700 -1 osd.1 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:06.460628+0000 front 2019-11-29T21:05:06.818032+0000 (oldest deadline 2019-11-29T21:05:51.837565+0000) 2019-11-29T21:06:25.439 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:06:25.434+0000 1694c700 -1 osd.6 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:08.259562+0000 front 2019-11-29T21:05:08.280173+0000 (oldest deadline 2019-11-29T21:05:54.038962+0000) 2019-11-29T21:06:25.522 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:06:25.517+0000 1694c700 -1 osd.4 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:08.915767+0000 front 2019-11-29T21:05:08.803496+0000 (oldest deadline 2019-11-29T21:05:52.959209+0000) 2019-11-29T21:06:25.760 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:06:25.753+0000 1694c700 -1 osd.2 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:04.748365+0000 front 2019-11-29T21:05:05.274013+0000 (oldest deadline 2019-11-29T21:05:50.341532+0000) 2019-11-29T21:06:25.864 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:06:25.859+0000 1694c700 -1 osd.7 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:10.543833+0000 front 2019-11-29T21:05:04.257072+0000 (oldest deadline 2019-11-29T21:05:49.721745+0000) 2019-11-29T21:06:25.966 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:06:25.959+0000 1694c700 -1 osd.0 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:05.721190+0000 front 2019-11-29T21:05:05.514982+0000 (oldest deadline 2019-11-29T21:05:51.105472+0000) 2019-11-29T21:06:25.983 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:06:25.978+0000 1694c700 -1 osd.1 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:06.460628+0000 front 2019-11-29T21:05:06.818032+0000 (oldest deadline 2019-11-29T21:05:51.837565+0000) 2019-11-29T21:06:26.470 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:06:26.465+0000 1694c700 -1 osd.6 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:08.259562+0000 front 2019-11-29T21:05:08.280173+0000 (oldest deadline 2019-11-29T21:05:54.038962+0000) 2019-11-29T21:06:26.480 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:06:26.474+0000 1694c700 -1 osd.4 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:08.915767+0000 front 2019-11-29T21:05:08.803496+0000 (oldest deadline 2019-11-29T21:05:52.959209+0000) 2019-11-29T21:06:26.729 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:06:26.724+0000 1694c700 -1 osd.2 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:04.748365+0000 front 2019-11-29T21:05:05.274013+0000 (oldest deadline 2019-11-29T21:05:50.341532+0000) 2019-11-29T21:06:26.848 INFO:tasks.ceph.mon.b.smithi022.stderr:2019-11-29T21:06:26.841+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.22:6818/9264,v1:172.21.15.22:6819/9264] for 46sec e248 v248) 2019-11-29T21:06:26.848 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:06:26.843+0000 1694c700 -1 osd.7 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:10.543833+0000 front 2019-11-29T21:05:04.257072+0000 (oldest deadline 2019-11-29T21:05:49.721745+0000) 2019-11-29T21:06:26.948 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:06:26.937+0000 1694c700 -1 osd.1 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:06.460628+0000 front 2019-11-29T21:05:06.818032+0000 (oldest deadline 2019-11-29T21:05:51.837565+0000) 2019-11-29T21:06:26.972 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:06:26.948+0000 1694c700 -1 osd.0 248 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:05:05.721190+0000 front 2019-11-29T21:05:05.514982+0000 (oldest deadline 2019-11-29T21:05:51.105472+0000) 2019-11-29T21:07:12.483 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:07:12.459+0000 3778f700 -1 osd.5 253 build_incremental_map_msg missing incremental map 253 2019-11-29T21:07:12.583 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:07:12.545+0000 33787700 -1 osd.5 253 build_incremental_map_msg missing incremental map 253 2019-11-29T21:07:12.617 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:07:12.550+0000 3778f700 -1 osd.5 253 build_incremental_map_msg missing incremental map 253 2019-11-29T21:07:12.681 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:07:12.621+0000 34789700 -1 osd.5 253 build_incremental_map_msg missing incremental map 253 2019-11-29T21:07:12.708 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:07:12.677+0000 34789700 -1 osd.5 253 build_incremental_map_msg missing incremental map 253 2019-11-29T21:07:12.733 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:07:12.687+0000 31f84700 -1 osd.5 253 build_incremental_map_msg missing incremental map 253 2019-11-29T21:07:12.748 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:07:12.717+0000 3578b700 -1 osd.5 253 build_incremental_map_msg missing incremental map 253 2019-11-29T21:07:13.560 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:07:13.551+0000 34f8a700 -1 osd.1 254 build_incremental_map_msg missing incremental map 252 2019-11-29T21:07:17.380 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:08:41:58.038 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T21:07:17.416 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:08:41:58.074 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T21:07:17.486 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:08:41:58.093 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T21:07:17.488 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:08:41:58.095 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T21:07:17.492 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:08:41:58.099 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T21:07:17.494 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:08:41:58.101 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T21:07:17.539 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:08:41:58.197 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T21:07:17.623 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:08:41:58.230 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T21:07:17.666 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:08:41:58.273 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T21:08:55.783 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:08:55.777+0000 1694c700 -1 osd.0 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:11.025811+0000 front 2019-11-29T21:08:11.024457+0000 (oldest deadline 2019-11-29T21:08:55.616375+0000) 2019-11-29T21:08:56.050 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:08:56.045+0000 1694c700 -1 osd.1 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:10.927167+0000 front 2019-11-29T21:08:15.847163+0000 (oldest deadline 2019-11-29T21:08:55.724531+0000) 2019-11-29T21:08:56.579 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:08:56.574+0000 1694c700 -1 osd.2 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:12.928257+0000 front 2019-11-29T21:08:16.066366+0000 (oldest deadline 2019-11-29T21:08:55.743597+0000) 2019-11-29T21:08:56.659 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:08:56.653+0000 1694c700 -1 osd.6 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:11.750292+0000 front 2019-11-29T21:08:11.949697+0000 (oldest deadline 2019-11-29T21:08:56.089689+0000) 2019-11-29T21:08:56.822 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:08:56.815+0000 1694c700 -1 osd.0 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:11.025811+0000 front 2019-11-29T21:08:11.024457+0000 (oldest deadline 2019-11-29T21:08:55.616375+0000) 2019-11-29T21:08:57.053 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:08:57.048+0000 1694c700 -1 osd.1 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:10.927167+0000 front 2019-11-29T21:08:15.847163+0000 (oldest deadline 2019-11-29T21:08:55.724531+0000) 2019-11-29T21:08:57.546 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:08:57.540+0000 1694c700 -1 osd.2 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:12.928257+0000 front 2019-11-29T21:08:16.066366+0000 (oldest deadline 2019-11-29T21:08:55.743597+0000) 2019-11-29T21:08:57.687 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:08:57.682+0000 1694c700 -1 osd.6 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:11.750292+0000 front 2019-11-29T21:08:11.949697+0000 (oldest deadline 2019-11-29T21:08:56.089689+0000) 2019-11-29T21:08:57.841 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:08:57.835+0000 1694c700 -1 osd.0 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:11.025811+0000 front 2019-11-29T21:08:11.024457+0000 (oldest deadline 2019-11-29T21:08:55.616375+0000) 2019-11-29T21:08:57.882 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:08:57.877+0000 1694c700 -1 osd.4 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:15.846819+0000 front 2019-11-29T21:08:15.848973+0000 (oldest deadline 2019-11-29T21:08:57.555070+0000) 2019-11-29T21:08:58.053 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:08:58.047+0000 1694c700 -1 osd.1 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:10.927167+0000 front 2019-11-29T21:08:15.847163+0000 (oldest deadline 2019-11-29T21:08:55.724531+0000) 2019-11-29T21:08:58.529 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:08:58.524+0000 1694c700 -1 osd.2 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:12.928257+0000 front 2019-11-29T21:08:16.066366+0000 (oldest deadline 2019-11-29T21:08:55.743597+0000) 2019-11-29T21:08:58.690 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:08:58.684+0000 1694c700 -1 osd.6 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:11.750292+0000 front 2019-11-29T21:08:11.949697+0000 (oldest deadline 2019-11-29T21:08:56.089689+0000) 2019-11-29T21:08:58.830 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:08:58.824+0000 1694c700 -1 osd.0 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:11.025811+0000 front 2019-11-29T21:08:11.024457+0000 (oldest deadline 2019-11-29T21:08:55.616375+0000) 2019-11-29T21:08:58.919 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:08:58.910+0000 1694c700 -1 osd.4 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:15.846819+0000 front 2019-11-29T21:08:15.848973+0000 (oldest deadline 2019-11-29T21:08:57.555070+0000) 2019-11-29T21:08:59.089 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:08:59.076+0000 1694c700 -1 osd.1 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:10.927167+0000 front 2019-11-29T21:08:15.847163+0000 (oldest deadline 2019-11-29T21:08:55.724531+0000) 2019-11-29T21:08:59.298 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:08:59.292+0000 1694c700 -1 osd.7 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:15.847085+0000 front 2019-11-29T21:08:15.123564+0000 (oldest deadline 2019-11-29T21:08:58.796991+0000) 2019-11-29T21:08:59.495 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:08:59.489+0000 1694c700 -1 osd.2 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:12.928257+0000 front 2019-11-29T21:08:16.066366+0000 (oldest deadline 2019-11-29T21:08:55.743597+0000) 2019-11-29T21:08:59.719 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:08:59.711+0000 1694c700 -1 osd.6 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:11.750292+0000 front 2019-11-29T21:08:11.949697+0000 (oldest deadline 2019-11-29T21:08:56.089689+0000) 2019-11-29T21:08:59.836 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:08:59.829+0000 1694c700 -1 osd.0 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:11.025811+0000 front 2019-11-29T21:08:11.024457+0000 (oldest deadline 2019-11-29T21:08:55.616375+0000) 2019-11-29T21:08:59.964 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:08:59.960+0000 1694c700 -1 osd.4 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:15.846819+0000 front 2019-11-29T21:08:15.848973+0000 (oldest deadline 2019-11-29T21:08:57.555070+0000) 2019-11-29T21:09:00.092 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:09:00.087+0000 1694c700 -1 osd.1 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:10.927167+0000 front 2019-11-29T21:08:15.847163+0000 (oldest deadline 2019-11-29T21:08:55.724531+0000) 2019-11-29T21:09:00.329 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:09:00.324+0000 1694c700 -1 osd.7 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:15.847085+0000 front 2019-11-29T21:08:15.123564+0000 (oldest deadline 2019-11-29T21:08:58.796991+0000) 2019-11-29T21:09:00.465 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:09:00.459+0000 1694c700 -1 osd.2 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:12.928257+0000 front 2019-11-29T21:08:16.066366+0000 (oldest deadline 2019-11-29T21:08:55.743597+0000) 2019-11-29T21:09:00.678 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:09:00.672+0000 1694c700 -1 osd.6 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:11.750292+0000 front 2019-11-29T21:08:11.949697+0000 (oldest deadline 2019-11-29T21:08:56.089689+0000) 2019-11-29T21:09:00.834 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:09:00.828+0000 1694c700 -1 osd.0 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:11.025811+0000 front 2019-11-29T21:08:11.024457+0000 (oldest deadline 2019-11-29T21:08:55.616375+0000) 2019-11-29T21:09:00.944 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:09:00.938+0000 1694c700 -1 osd.4 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:15.846819+0000 front 2019-11-29T21:08:15.848973+0000 (oldest deadline 2019-11-29T21:08:57.555070+0000) 2019-11-29T21:09:01.117 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:09:01.112+0000 1694c700 -1 osd.1 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:10.927167+0000 front 2019-11-29T21:08:15.847163+0000 (oldest deadline 2019-11-29T21:08:55.724531+0000) 2019-11-29T21:09:01.308 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:09:01.303+0000 1694c700 -1 osd.7 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:15.847085+0000 front 2019-11-29T21:08:15.123564+0000 (oldest deadline 2019-11-29T21:08:58.796991+0000) 2019-11-29T21:09:01.513 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:09:01.508+0000 1694c700 -1 osd.2 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:12.928257+0000 front 2019-11-29T21:08:16.066366+0000 (oldest deadline 2019-11-29T21:08:55.743597+0000) 2019-11-29T21:09:01.638 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:09:01.632+0000 1694c700 -1 osd.6 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:11.750292+0000 front 2019-11-29T21:08:11.949697+0000 (oldest deadline 2019-11-29T21:08:56.089689+0000) 2019-11-29T21:09:01.837 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:09:01.830+0000 1694c700 -1 osd.0 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:11.025811+0000 front 2019-11-29T21:08:11.024457+0000 (oldest deadline 2019-11-29T21:08:55.616375+0000) 2019-11-29T21:09:01.932 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:09:01.925+0000 1694c700 -1 osd.4 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:15.846819+0000 front 2019-11-29T21:08:15.848973+0000 (oldest deadline 2019-11-29T21:08:57.555070+0000) 2019-11-29T21:09:02.085 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:09:02.079+0000 1694c700 -1 osd.1 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:10.927167+0000 front 2019-11-29T21:08:15.847163+0000 (oldest deadline 2019-11-29T21:08:55.724531+0000) 2019-11-29T21:09:02.300 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:09:02.294+0000 1694c700 -1 osd.7 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:15.847085+0000 front 2019-11-29T21:08:15.123564+0000 (oldest deadline 2019-11-29T21:08:58.796991+0000) 2019-11-29T21:09:02.512 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:09:02.507+0000 1694c700 -1 osd.2 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:12.928257+0000 front 2019-11-29T21:08:16.066366+0000 (oldest deadline 2019-11-29T21:08:55.743597+0000) 2019-11-29T21:09:02.596 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:09:02.591+0000 1694c700 -1 osd.6 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:11.750292+0000 front 2019-11-29T21:08:11.949697+0000 (oldest deadline 2019-11-29T21:08:56.089689+0000) 2019-11-29T21:09:02.884 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:09:02.874+0000 1694c700 -1 osd.0 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:11.025811+0000 front 2019-11-29T21:08:11.024457+0000 (oldest deadline 2019-11-29T21:08:55.616375+0000) 2019-11-29T21:09:02.944 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:09:02.938+0000 1694c700 -1 osd.4 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:15.846819+0000 front 2019-11-29T21:08:15.848973+0000 (oldest deadline 2019-11-29T21:08:57.555070+0000) 2019-11-29T21:09:03.113 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:09:03.107+0000 1694c700 -1 osd.1 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:10.927167+0000 front 2019-11-29T21:08:15.847163+0000 (oldest deadline 2019-11-29T21:08:55.724531+0000) 2019-11-29T21:09:03.336 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:09:03.331+0000 1694c700 -1 osd.7 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:15.847085+0000 front 2019-11-29T21:08:15.123564+0000 (oldest deadline 2019-11-29T21:08:58.796991+0000) 2019-11-29T21:09:03.511 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:09:03.506+0000 1694c700 -1 osd.2 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:12.928257+0000 front 2019-11-29T21:08:16.066366+0000 (oldest deadline 2019-11-29T21:08:55.743597+0000) 2019-11-29T21:09:03.591 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:09:03.586+0000 1694c700 -1 osd.6 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:11.750292+0000 front 2019-11-29T21:08:11.949697+0000 (oldest deadline 2019-11-29T21:08:56.089689+0000) 2019-11-29T21:09:03.870 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:09:03.864+0000 1694c700 -1 osd.0 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:11.025811+0000 front 2019-11-29T21:08:11.024457+0000 (oldest deadline 2019-11-29T21:08:55.616375+0000) 2019-11-29T21:09:03.904 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:09:03.899+0000 1694c700 -1 osd.4 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:15.846819+0000 front 2019-11-29T21:08:15.848973+0000 (oldest deadline 2019-11-29T21:08:57.555070+0000) 2019-11-29T21:09:04.102 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:09:04.096+0000 1694c700 -1 osd.1 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:10.927167+0000 front 2019-11-29T21:08:15.847163+0000 (oldest deadline 2019-11-29T21:08:55.724531+0000) 2019-11-29T21:09:04.298 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:09:04.293+0000 1694c700 -1 osd.7 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:15.847085+0000 front 2019-11-29T21:08:15.123564+0000 (oldest deadline 2019-11-29T21:08:58.796991+0000) 2019-11-29T21:09:04.500 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:09:04.494+0000 1694c700 -1 osd.2 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:12.928257+0000 front 2019-11-29T21:08:16.066366+0000 (oldest deadline 2019-11-29T21:08:55.743597+0000) 2019-11-29T21:09:04.574 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:09:04.568+0000 1694c700 -1 osd.6 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:11.750292+0000 front 2019-11-29T21:08:11.949697+0000 (oldest deadline 2019-11-29T21:08:56.089689+0000) 2019-11-29T21:09:04.893 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:09:04.887+0000 1694c700 -1 osd.4 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:15.846819+0000 front 2019-11-29T21:08:15.848973+0000 (oldest deadline 2019-11-29T21:08:57.555070+0000) 2019-11-29T21:09:04.900 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:09:04.894+0000 1694c700 -1 osd.0 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:11.025811+0000 front 2019-11-29T21:08:11.024457+0000 (oldest deadline 2019-11-29T21:08:55.616375+0000) 2019-11-29T21:09:05.083 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:09:05.077+0000 1694c700 -1 osd.1 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:10.927167+0000 front 2019-11-29T21:08:15.847163+0000 (oldest deadline 2019-11-29T21:08:55.724531+0000) 2019-11-29T21:09:05.273 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:09:05.269+0000 1694c700 -1 osd.7 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:15.847085+0000 front 2019-11-29T21:08:15.123564+0000 (oldest deadline 2019-11-29T21:08:58.796991+0000) 2019-11-29T21:09:05.550 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:09:05.540+0000 1694c700 -1 osd.6 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:11.750292+0000 front 2019-11-29T21:08:11.949697+0000 (oldest deadline 2019-11-29T21:08:56.089689+0000) 2019-11-29T21:09:05.552 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:09:05.546+0000 1694c700 -1 osd.2 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:12.928257+0000 front 2019-11-29T21:08:16.066366+0000 (oldest deadline 2019-11-29T21:08:55.743597+0000) 2019-11-29T21:09:05.908 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:09:05.902+0000 1694c700 -1 osd.0 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:11.025811+0000 front 2019-11-29T21:08:11.024457+0000 (oldest deadline 2019-11-29T21:08:55.616375+0000) 2019-11-29T21:09:05.926 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:09:05.920+0000 1694c700 -1 osd.4 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:15.846819+0000 front 2019-11-29T21:08:15.848973+0000 (oldest deadline 2019-11-29T21:08:57.555070+0000) 2019-11-29T21:09:06.098 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:09:06.092+0000 1694c700 -1 osd.1 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:10.927167+0000 front 2019-11-29T21:08:15.847163+0000 (oldest deadline 2019-11-29T21:08:55.724531+0000) 2019-11-29T21:09:06.269 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:09:06.264+0000 1694c700 -1 osd.7 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:15.847085+0000 front 2019-11-29T21:08:15.123564+0000 (oldest deadline 2019-11-29T21:08:58.796991+0000) 2019-11-29T21:09:06.514 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:09:06.508+0000 1694c700 -1 osd.2 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:12.928257+0000 front 2019-11-29T21:08:16.066366+0000 (oldest deadline 2019-11-29T21:08:55.743597+0000) 2019-11-29T21:09:06.589 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:09:06.583+0000 1694c700 -1 osd.6 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:11.750292+0000 front 2019-11-29T21:08:11.949697+0000 (oldest deadline 2019-11-29T21:08:56.089689+0000) 2019-11-29T21:09:06.923 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:09:06.917+0000 1694c700 -1 osd.4 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:15.846819+0000 front 2019-11-29T21:08:15.848973+0000 (oldest deadline 2019-11-29T21:08:57.555070+0000) 2019-11-29T21:09:06.951 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:09:06.946+0000 1694c700 -1 osd.0 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:11.025811+0000 front 2019-11-29T21:08:11.024457+0000 (oldest deadline 2019-11-29T21:08:55.616375+0000) 2019-11-29T21:09:07.139 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:09:07.133+0000 1694c700 -1 osd.1 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:10.927167+0000 front 2019-11-29T21:08:15.847163+0000 (oldest deadline 2019-11-29T21:08:55.724531+0000) 2019-11-29T21:09:07.308 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:09:07.302+0000 1694c700 -1 osd.7 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:15.847085+0000 front 2019-11-29T21:08:15.123564+0000 (oldest deadline 2019-11-29T21:08:58.796991+0000) 2019-11-29T21:09:07.502 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:09:07.496+0000 1694c700 -1 osd.2 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:12.928257+0000 front 2019-11-29T21:08:16.066366+0000 (oldest deadline 2019-11-29T21:08:55.743597+0000) 2019-11-29T21:09:07.547 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:09:07.542+0000 1694c700 -1 osd.6 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:11.750292+0000 front 2019-11-29T21:08:11.949697+0000 (oldest deadline 2019-11-29T21:08:56.089689+0000) 2019-11-29T21:09:07.961 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:09:07.955+0000 1694c700 -1 osd.4 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:15.846819+0000 front 2019-11-29T21:08:15.848973+0000 (oldest deadline 2019-11-29T21:08:57.555070+0000) 2019-11-29T21:09:07.965 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:09:07.959+0000 1694c700 -1 osd.0 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:11.025811+0000 front 2019-11-29T21:08:11.024457+0000 (oldest deadline 2019-11-29T21:08:55.616375+0000) 2019-11-29T21:09:08.168 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:09:08.163+0000 1694c700 -1 osd.1 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:10.927167+0000 front 2019-11-29T21:08:15.847163+0000 (oldest deadline 2019-11-29T21:08:55.724531+0000) 2019-11-29T21:09:08.319 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:09:08.312+0000 1694c700 -1 osd.7 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:15.847085+0000 front 2019-11-29T21:08:15.123564+0000 (oldest deadline 2019-11-29T21:08:58.796991+0000) 2019-11-29T21:09:08.508 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:09:08.503+0000 1694c700 -1 osd.2 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:12.928257+0000 front 2019-11-29T21:08:16.066366+0000 (oldest deadline 2019-11-29T21:08:55.743597+0000) 2019-11-29T21:09:08.533 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:09:08.527+0000 1694c700 -1 osd.6 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:11.750292+0000 front 2019-11-29T21:08:11.949697+0000 (oldest deadline 2019-11-29T21:08:56.089689+0000) 2019-11-29T21:09:08.924 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:09:08.919+0000 1694c700 -1 osd.0 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:11.025811+0000 front 2019-11-29T21:08:11.024457+0000 (oldest deadline 2019-11-29T21:08:55.616375+0000) 2019-11-29T21:09:08.976 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:09:08.969+0000 1694c700 -1 osd.4 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:15.846819+0000 front 2019-11-29T21:08:15.848973+0000 (oldest deadline 2019-11-29T21:08:57.555070+0000) 2019-11-29T21:09:09.156 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:09:09.146+0000 1694c700 -1 osd.1 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:10.927167+0000 front 2019-11-29T21:08:15.847163+0000 (oldest deadline 2019-11-29T21:08:55.724531+0000) 2019-11-29T21:09:09.320 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:09:09.313+0000 1694c700 -1 osd.7 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:15.847085+0000 front 2019-11-29T21:08:15.123564+0000 (oldest deadline 2019-11-29T21:08:58.796991+0000) 2019-11-29T21:09:09.491 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:09:09.485+0000 1694c700 -1 osd.2 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:12.928257+0000 front 2019-11-29T21:08:16.066366+0000 (oldest deadline 2019-11-29T21:08:55.743597+0000) 2019-11-29T21:09:09.511 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:09:09.505+0000 1694c700 -1 osd.6 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:11.750292+0000 front 2019-11-29T21:08:11.949697+0000 (oldest deadline 2019-11-29T21:08:56.089689+0000) 2019-11-29T21:09:09.926 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:09:09.920+0000 1694c700 -1 osd.0 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:11.025811+0000 front 2019-11-29T21:08:11.024457+0000 (oldest deadline 2019-11-29T21:08:55.616375+0000) 2019-11-29T21:09:10.007 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:09:10.000+0000 1694c700 -1 osd.4 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:15.846819+0000 front 2019-11-29T21:08:15.848973+0000 (oldest deadline 2019-11-29T21:08:57.555070+0000) 2019-11-29T21:09:10.130 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:09:10.124+0000 1694c700 -1 osd.1 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:10.927167+0000 front 2019-11-29T21:08:15.847163+0000 (oldest deadline 2019-11-29T21:08:55.724531+0000) 2019-11-29T21:09:10.292 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:09:10.286+0000 1694c700 -1 osd.7 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:15.847085+0000 front 2019-11-29T21:08:15.123564+0000 (oldest deadline 2019-11-29T21:08:58.796991+0000) 2019-11-29T21:09:10.476 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:09:10.469+0000 1694c700 -1 osd.6 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:11.750292+0000 front 2019-11-29T21:08:11.949697+0000 (oldest deadline 2019-11-29T21:08:56.089689+0000) 2019-11-29T21:09:10.503 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:09:10.493+0000 1694c700 -1 osd.2 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:12.928257+0000 front 2019-11-29T21:08:16.066366+0000 (oldest deadline 2019-11-29T21:08:55.743597+0000) 2019-11-29T21:09:10.953 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:09:10.948+0000 1694c700 -1 osd.0 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:11.025811+0000 front 2019-11-29T21:08:11.024457+0000 (oldest deadline 2019-11-29T21:08:55.616375+0000) 2019-11-29T21:09:11.053 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:09:11.047+0000 1694c700 -1 osd.4 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:15.846819+0000 front 2019-11-29T21:08:15.848973+0000 (oldest deadline 2019-11-29T21:08:57.555070+0000) 2019-11-29T21:09:11.151 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:09:11.146+0000 1694c700 -1 osd.1 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:10.927167+0000 front 2019-11-29T21:08:15.847163+0000 (oldest deadline 2019-11-29T21:08:55.724531+0000) 2019-11-29T21:09:11.270 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:09:11.264+0000 1694c700 -1 osd.7 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:15.847085+0000 front 2019-11-29T21:08:15.123564+0000 (oldest deadline 2019-11-29T21:08:58.796991+0000) 2019-11-29T21:09:11.484 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:09:11.477+0000 1694c700 -1 osd.6 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:11.750292+0000 front 2019-11-29T21:08:11.949697+0000 (oldest deadline 2019-11-29T21:08:56.089689+0000) 2019-11-29T21:09:11.551 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:09:11.546+0000 1694c700 -1 osd.2 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:12.928257+0000 front 2019-11-29T21:08:16.066366+0000 (oldest deadline 2019-11-29T21:08:55.743597+0000) 2019-11-29T21:09:11.960 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:09:11.953+0000 1694c700 -1 osd.0 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:11.025811+0000 front 2019-11-29T21:08:11.024457+0000 (oldest deadline 2019-11-29T21:08:55.616375+0000) 2019-11-29T21:09:12.096 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:09:12.089+0000 1694c700 -1 osd.4 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:15.846819+0000 front 2019-11-29T21:08:15.848973+0000 (oldest deadline 2019-11-29T21:08:57.555070+0000) 2019-11-29T21:09:12.156 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:09:12.148+0000 1694c700 -1 osd.1 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:10.927167+0000 front 2019-11-29T21:08:15.847163+0000 (oldest deadline 2019-11-29T21:08:55.724531+0000) 2019-11-29T21:09:12.311 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:09:12.305+0000 1694c700 -1 osd.7 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:15.847085+0000 front 2019-11-29T21:08:15.123564+0000 (oldest deadline 2019-11-29T21:08:58.796991+0000) 2019-11-29T21:09:12.481 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:09:12.475+0000 1694c700 -1 osd.6 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:11.750292+0000 front 2019-11-29T21:08:11.949697+0000 (oldest deadline 2019-11-29T21:08:56.089689+0000) 2019-11-29T21:09:12.540 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:09:12.534+0000 1694c700 -1 osd.2 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:12.928257+0000 front 2019-11-29T21:08:16.066366+0000 (oldest deadline 2019-11-29T21:08:55.743597+0000) 2019-11-29T21:09:12.926 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:09:12.921+0000 1694c700 -1 osd.0 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:11.025811+0000 front 2019-11-29T21:08:11.024457+0000 (oldest deadline 2019-11-29T21:08:55.616375+0000) 2019-11-29T21:09:13.067 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:09:13.060+0000 1694c700 -1 osd.4 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:15.846819+0000 front 2019-11-29T21:08:15.848973+0000 (oldest deadline 2019-11-29T21:08:57.555070+0000) 2019-11-29T21:09:13.179 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:09:13.174+0000 1694c700 -1 osd.1 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:10.927167+0000 front 2019-11-29T21:08:15.847163+0000 (oldest deadline 2019-11-29T21:08:55.724531+0000) 2019-11-29T21:09:13.279 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:09:13.274+0000 1694c700 -1 osd.7 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:15.847085+0000 front 2019-11-29T21:08:15.123564+0000 (oldest deadline 2019-11-29T21:08:58.796991+0000) 2019-11-29T21:09:13.506 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:09:13.500+0000 1694c700 -1 osd.6 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:11.750292+0000 front 2019-11-29T21:08:11.949697+0000 (oldest deadline 2019-11-29T21:08:56.089689+0000) 2019-11-29T21:09:13.578 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:09:13.572+0000 1694c700 -1 osd.2 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:12.928257+0000 front 2019-11-29T21:08:16.066366+0000 (oldest deadline 2019-11-29T21:08:55.743597+0000) 2019-11-29T21:09:13.973 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:09:13.967+0000 1694c700 -1 osd.0 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:11.025811+0000 front 2019-11-29T21:08:11.024457+0000 (oldest deadline 2019-11-29T21:08:55.616375+0000) 2019-11-29T21:09:14.090 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:09:14.081+0000 1694c700 -1 osd.4 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:15.846819+0000 front 2019-11-29T21:08:15.848973+0000 (oldest deadline 2019-11-29T21:08:57.555070+0000) 2019-11-29T21:09:14.235 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:09:14.229+0000 1694c700 -1 osd.1 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:10.927167+0000 front 2019-11-29T21:08:15.847163+0000 (oldest deadline 2019-11-29T21:08:55.724531+0000) 2019-11-29T21:09:14.236 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:09:14.230+0000 1694c700 -1 osd.7 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:15.847085+0000 front 2019-11-29T21:08:15.123564+0000 (oldest deadline 2019-11-29T21:08:58.796991+0000) 2019-11-29T21:09:14.501 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:09:14.495+0000 1694c700 -1 osd.6 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:11.750292+0000 front 2019-11-29T21:08:11.949697+0000 (oldest deadline 2019-11-29T21:08:56.089689+0000) 2019-11-29T21:09:14.620 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:09:14.614+0000 1694c700 -1 osd.2 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:12.928257+0000 front 2019-11-29T21:08:16.066366+0000 (oldest deadline 2019-11-29T21:08:55.743597+0000) 2019-11-29T21:09:15.025 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:09:15.018+0000 1694c700 -1 osd.0 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:11.025811+0000 front 2019-11-29T21:08:11.024457+0000 (oldest deadline 2019-11-29T21:08:55.616375+0000) 2019-11-29T21:09:15.051 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:09:15.046+0000 1694c700 -1 osd.4 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:15.846819+0000 front 2019-11-29T21:08:15.848973+0000 (oldest deadline 2019-11-29T21:08:57.555070+0000) 2019-11-29T21:09:15.202 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:09:15.196+0000 1694c700 -1 osd.1 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:10.927167+0000 front 2019-11-29T21:08:15.847163+0000 (oldest deadline 2019-11-29T21:08:55.724531+0000) 2019-11-29T21:09:15.261 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:09:15.255+0000 1694c700 -1 osd.7 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:15.847085+0000 front 2019-11-29T21:08:15.123564+0000 (oldest deadline 2019-11-29T21:08:58.796991+0000) 2019-11-29T21:09:15.490 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:09:15.484+0000 1694c700 -1 osd.6 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:11.750292+0000 front 2019-11-29T21:08:11.949697+0000 (oldest deadline 2019-11-29T21:08:56.089689+0000) 2019-11-29T21:09:15.603 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:09:15.597+0000 1694c700 -1 osd.2 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:12.928257+0000 front 2019-11-29T21:08:16.066366+0000 (oldest deadline 2019-11-29T21:08:55.743597+0000) 2019-11-29T21:09:16.005 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:09:15.999+0000 1694c700 -1 osd.4 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:15.846819+0000 front 2019-11-29T21:08:15.848973+0000 (oldest deadline 2019-11-29T21:08:57.555070+0000) 2019-11-29T21:09:16.044 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:09:16.037+0000 1694c700 -1 osd.0 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:11.025811+0000 front 2019-11-29T21:08:11.024457+0000 (oldest deadline 2019-11-29T21:08:55.616375+0000) 2019-11-29T21:09:16.221 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:09:16.214+0000 1694c700 -1 osd.1 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:10.927167+0000 front 2019-11-29T21:08:15.847163+0000 (oldest deadline 2019-11-29T21:08:55.724531+0000) 2019-11-29T21:09:16.275 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:09:16.267+0000 1694c700 -1 osd.7 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:15.847085+0000 front 2019-11-29T21:08:15.123564+0000 (oldest deadline 2019-11-29T21:08:58.796991+0000) 2019-11-29T21:09:16.448 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:09:16.442+0000 1694c700 -1 osd.6 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:11.750292+0000 front 2019-11-29T21:08:11.949697+0000 (oldest deadline 2019-11-29T21:08:56.089689+0000) 2019-11-29T21:09:16.642 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:09:16.637+0000 1694c700 -1 osd.2 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:12.928257+0000 front 2019-11-29T21:08:16.066366+0000 (oldest deadline 2019-11-29T21:08:55.743597+0000) 2019-11-29T21:09:17.040 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:09:17.034+0000 1694c700 -1 osd.4 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:15.846819+0000 front 2019-11-29T21:08:15.848973+0000 (oldest deadline 2019-11-29T21:08:57.555070+0000) 2019-11-29T21:09:17.057 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:09:17.051+0000 1694c700 -1 osd.0 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:11.025811+0000 front 2019-11-29T21:08:11.024457+0000 (oldest deadline 2019-11-29T21:08:55.616375+0000) 2019-11-29T21:09:17.205 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:09:17.200+0000 1694c700 -1 osd.1 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:10.927167+0000 front 2019-11-29T21:08:15.847163+0000 (oldest deadline 2019-11-29T21:08:55.724531+0000) 2019-11-29T21:09:17.316 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:09:17.310+0000 1694c700 -1 osd.7 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:15.847085+0000 front 2019-11-29T21:08:15.123564+0000 (oldest deadline 2019-11-29T21:08:58.796991+0000) 2019-11-29T21:09:17.430 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:09:17.423+0000 1694c700 -1 osd.6 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:11.750292+0000 front 2019-11-29T21:08:11.949697+0000 (oldest deadline 2019-11-29T21:08:56.089689+0000) 2019-11-29T21:09:17.671 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:09:17.665+0000 1694c700 -1 osd.2 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:12.928257+0000 front 2019-11-29T21:08:16.066366+0000 (oldest deadline 2019-11-29T21:08:55.743597+0000) 2019-11-29T21:09:18.011 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:09:18.005+0000 1694c700 -1 osd.4 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:15.846819+0000 front 2019-11-29T21:08:15.848973+0000 (oldest deadline 2019-11-29T21:08:57.555070+0000) 2019-11-29T21:09:18.084 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:09:18.078+0000 1694c700 -1 osd.0 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:11.025811+0000 front 2019-11-29T21:08:11.024457+0000 (oldest deadline 2019-11-29T21:08:55.616375+0000) 2019-11-29T21:09:18.253 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:09:18.247+0000 1694c700 -1 osd.1 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:10.927167+0000 front 2019-11-29T21:08:15.847163+0000 (oldest deadline 2019-11-29T21:08:55.724531+0000) 2019-11-29T21:09:18.273 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:09:18.267+0000 1694c700 -1 osd.7 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:15.847085+0000 front 2019-11-29T21:08:15.123564+0000 (oldest deadline 2019-11-29T21:08:58.796991+0000) 2019-11-29T21:09:18.390 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:09:18.383+0000 1694c700 -1 osd.6 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:11.750292+0000 front 2019-11-29T21:08:11.949697+0000 (oldest deadline 2019-11-29T21:08:56.089689+0000) 2019-11-29T21:09:18.680 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:09:18.675+0000 1694c700 -1 osd.2 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:12.928257+0000 front 2019-11-29T21:08:16.066366+0000 (oldest deadline 2019-11-29T21:08:55.743597+0000) 2019-11-29T21:09:18.992 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:09:18.986+0000 1694c700 -1 osd.4 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:15.846819+0000 front 2019-11-29T21:08:15.848973+0000 (oldest deadline 2019-11-29T21:08:57.555070+0000) 2019-11-29T21:09:19.055 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:09:19.049+0000 1694c700 -1 osd.0 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:11.025811+0000 front 2019-11-29T21:08:11.024457+0000 (oldest deadline 2019-11-29T21:08:55.616375+0000) 2019-11-29T21:09:19.246 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:09:19.240+0000 1694c700 -1 osd.1 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:10.927167+0000 front 2019-11-29T21:08:15.847163+0000 (oldest deadline 2019-11-29T21:08:55.724531+0000) 2019-11-29T21:09:19.290 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:09:19.284+0000 1694c700 -1 osd.7 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:15.847085+0000 front 2019-11-29T21:08:15.123564+0000 (oldest deadline 2019-11-29T21:08:58.796991+0000) 2019-11-29T21:09:19.392 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:09:19.386+0000 1694c700 -1 osd.6 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:11.750292+0000 front 2019-11-29T21:08:11.949697+0000 (oldest deadline 2019-11-29T21:08:56.089689+0000) 2019-11-29T21:09:19.670 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:09:19.665+0000 1694c700 -1 osd.2 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:12.928257+0000 front 2019-11-29T21:08:16.066366+0000 (oldest deadline 2019-11-29T21:08:55.743597+0000) 2019-11-29T21:09:19.971 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:09:19.964+0000 1694c700 -1 osd.4 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:15.846819+0000 front 2019-11-29T21:08:15.848973+0000 (oldest deadline 2019-11-29T21:08:57.555070+0000) 2019-11-29T21:09:20.089 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:09:20.083+0000 1694c700 -1 osd.0 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:11.025811+0000 front 2019-11-29T21:08:11.024457+0000 (oldest deadline 2019-11-29T21:08:55.616375+0000) 2019-11-29T21:09:20.273 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:09:20.267+0000 1694c700 -1 osd.7 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:15.847085+0000 front 2019-11-29T21:08:15.123564+0000 (oldest deadline 2019-11-29T21:08:58.796991+0000) 2019-11-29T21:09:20.301 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:09:20.294+0000 1694c700 -1 osd.1 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:10.927167+0000 front 2019-11-29T21:08:15.847163+0000 (oldest deadline 2019-11-29T21:08:55.724531+0000) 2019-11-29T21:09:20.427 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:09:20.415+0000 1694c700 -1 osd.6 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:11.750292+0000 front 2019-11-29T21:08:11.949697+0000 (oldest deadline 2019-11-29T21:08:56.089689+0000) 2019-11-29T21:09:20.697 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:09:20.692+0000 1694c700 -1 osd.2 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:12.928257+0000 front 2019-11-29T21:08:16.066366+0000 (oldest deadline 2019-11-29T21:08:55.743597+0000) 2019-11-29T21:09:20.967 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:09:20.960+0000 1694c700 -1 osd.4 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:15.846819+0000 front 2019-11-29T21:08:15.848973+0000 (oldest deadline 2019-11-29T21:08:57.555070+0000) 2019-11-29T21:09:21.065 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:09:21.060+0000 1694c700 -1 osd.0 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:11.025811+0000 front 2019-11-29T21:08:11.024457+0000 (oldest deadline 2019-11-29T21:08:55.616375+0000) 2019-11-29T21:09:21.302 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:09:21.296+0000 1694c700 -1 osd.1 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:10.927167+0000 front 2019-11-29T21:08:15.847163+0000 (oldest deadline 2019-11-29T21:08:55.724531+0000) 2019-11-29T21:09:21.321 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:09:21.314+0000 1694c700 -1 osd.7 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:15.847085+0000 front 2019-11-29T21:08:15.123564+0000 (oldest deadline 2019-11-29T21:08:58.796991+0000) 2019-11-29T21:09:21.395 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:09:21.388+0000 1694c700 -1 osd.6 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:11.750292+0000 front 2019-11-29T21:08:11.949697+0000 (oldest deadline 2019-11-29T21:08:56.089689+0000) 2019-11-29T21:09:21.708 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:09:21.702+0000 1694c700 -1 osd.2 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:12.928257+0000 front 2019-11-29T21:08:16.066366+0000 (oldest deadline 2019-11-29T21:08:55.743597+0000) 2019-11-29T21:09:21.993 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:09:21.987+0000 1694c700 -1 osd.4 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:15.846819+0000 front 2019-11-29T21:08:15.848973+0000 (oldest deadline 2019-11-29T21:08:57.555070+0000) 2019-11-29T21:09:22.115 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:09:22.109+0000 1694c700 -1 osd.0 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:11.025811+0000 front 2019-11-29T21:08:11.024457+0000 (oldest deadline 2019-11-29T21:08:55.616375+0000) 2019-11-29T21:09:22.312 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:09:22.305+0000 1694c700 -1 osd.7 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:15.847085+0000 front 2019-11-29T21:08:15.123564+0000 (oldest deadline 2019-11-29T21:08:58.796991+0000) 2019-11-29T21:09:22.353 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:09:22.348+0000 1694c700 -1 osd.1 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:10.927167+0000 front 2019-11-29T21:08:15.847163+0000 (oldest deadline 2019-11-29T21:08:55.724531+0000) 2019-11-29T21:09:22.354 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:09:22.348+0000 1694c700 -1 osd.6 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:11.750292+0000 front 2019-11-29T21:08:11.949697+0000 (oldest deadline 2019-11-29T21:08:56.089689+0000) 2019-11-29T21:09:22.701 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:09:22.695+0000 1694c700 -1 osd.2 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:12.928257+0000 front 2019-11-29T21:08:16.066366+0000 (oldest deadline 2019-11-29T21:08:55.743597+0000) 2019-11-29T21:09:22.967 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:09:22.961+0000 1694c700 -1 osd.4 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:15.846819+0000 front 2019-11-29T21:08:15.848973+0000 (oldest deadline 2019-11-29T21:08:57.555070+0000) 2019-11-29T21:09:23.106 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:09:23.100+0000 1694c700 -1 osd.0 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:11.025811+0000 front 2019-11-29T21:08:11.024457+0000 (oldest deadline 2019-11-29T21:08:55.616375+0000) 2019-11-29T21:09:23.323 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:09:23.318+0000 1694c700 -1 osd.1 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:10.927167+0000 front 2019-11-29T21:08:15.847163+0000 (oldest deadline 2019-11-29T21:08:55.724531+0000) 2019-11-29T21:09:23.335 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:09:23.329+0000 1694c700 -1 osd.7 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:15.847085+0000 front 2019-11-29T21:08:15.123564+0000 (oldest deadline 2019-11-29T21:08:58.796991+0000) 2019-11-29T21:09:23.400 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:09:23.394+0000 1694c700 -1 osd.6 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:11.750292+0000 front 2019-11-29T21:08:11.949697+0000 (oldest deadline 2019-11-29T21:08:56.089689+0000) 2019-11-29T21:09:23.712 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:09:23.707+0000 1694c700 -1 osd.2 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:12.928257+0000 front 2019-11-29T21:08:16.066366+0000 (oldest deadline 2019-11-29T21:08:55.743597+0000) 2019-11-29T21:09:24.017 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:09:24.011+0000 1694c700 -1 osd.4 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:15.846819+0000 front 2019-11-29T21:08:15.848973+0000 (oldest deadline 2019-11-29T21:08:57.555070+0000) 2019-11-29T21:09:24.108 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:09:24.102+0000 1694c700 -1 osd.0 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:11.025811+0000 front 2019-11-29T21:08:11.024457+0000 (oldest deadline 2019-11-29T21:08:55.616375+0000) 2019-11-29T21:09:24.373 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:09:24.368+0000 1694c700 -1 osd.7 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:15.847085+0000 front 2019-11-29T21:08:15.123564+0000 (oldest deadline 2019-11-29T21:08:58.796991+0000) 2019-11-29T21:09:24.375 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:09:24.370+0000 1694c700 -1 osd.1 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:10.927167+0000 front 2019-11-29T21:08:15.847163+0000 (oldest deadline 2019-11-29T21:08:55.724531+0000) 2019-11-29T21:09:24.387 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:09:24.380+0000 1694c700 -1 osd.6 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:11.750292+0000 front 2019-11-29T21:08:11.949697+0000 (oldest deadline 2019-11-29T21:08:56.089689+0000) 2019-11-29T21:09:24.703 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:09:24.698+0000 1694c700 -1 osd.2 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:12.928257+0000 front 2019-11-29T21:08:16.066366+0000 (oldest deadline 2019-11-29T21:08:55.743597+0000) 2019-11-29T21:09:24.978 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:09:24.972+0000 1694c700 -1 osd.4 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:15.846819+0000 front 2019-11-29T21:08:15.848973+0000 (oldest deadline 2019-11-29T21:08:57.555070+0000) 2019-11-29T21:09:25.124 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:09:25.119+0000 1694c700 -1 osd.0 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:11.025811+0000 front 2019-11-29T21:08:11.024457+0000 (oldest deadline 2019-11-29T21:08:55.616375+0000) 2019-11-29T21:09:25.349 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:09:25.343+0000 1694c700 -1 osd.6 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:11.750292+0000 front 2019-11-29T21:08:11.949697+0000 (oldest deadline 2019-11-29T21:08:56.089689+0000) 2019-11-29T21:09:25.368 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:09:25.363+0000 1694c700 -1 osd.7 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:15.847085+0000 front 2019-11-29T21:08:15.123564+0000 (oldest deadline 2019-11-29T21:08:58.796991+0000) 2019-11-29T21:09:25.368 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:09:25.364+0000 1694c700 -1 osd.1 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:10.927167+0000 front 2019-11-29T21:08:15.847163+0000 (oldest deadline 2019-11-29T21:08:55.724531+0000) 2019-11-29T21:09:25.689 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:09:25.683+0000 1694c700 -1 osd.2 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:12.928257+0000 front 2019-11-29T21:08:16.066366+0000 (oldest deadline 2019-11-29T21:08:55.743597+0000) 2019-11-29T21:09:25.961 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:09:25.955+0000 1694c700 -1 osd.4 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:15.846819+0000 front 2019-11-29T21:08:15.848973+0000 (oldest deadline 2019-11-29T21:08:57.555070+0000) 2019-11-29T21:09:26.172 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:09:26.166+0000 1694c700 -1 osd.0 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:11.025811+0000 front 2019-11-29T21:08:11.024457+0000 (oldest deadline 2019-11-29T21:08:55.616375+0000) 2019-11-29T21:09:26.329 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:09:26.323+0000 1694c700 -1 osd.6 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:11.750292+0000 front 2019-11-29T21:08:11.949697+0000 (oldest deadline 2019-11-29T21:08:56.089689+0000) 2019-11-29T21:09:26.337 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:09:26.332+0000 1694c700 -1 osd.7 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:15.847085+0000 front 2019-11-29T21:08:15.123564+0000 (oldest deadline 2019-11-29T21:08:58.796991+0000) 2019-11-29T21:09:26.393 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:09:26.388+0000 1694c700 -1 osd.1 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:10.927167+0000 front 2019-11-29T21:08:15.847163+0000 (oldest deadline 2019-11-29T21:08:55.724531+0000) 2019-11-29T21:09:26.702 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:09:26.697+0000 1694c700 -1 osd.2 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:12.928257+0000 front 2019-11-29T21:08:16.066366+0000 (oldest deadline 2019-11-29T21:08:55.743597+0000) 2019-11-29T21:09:26.972 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:09:26.965+0000 1694c700 -1 osd.4 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:15.846819+0000 front 2019-11-29T21:08:15.848973+0000 (oldest deadline 2019-11-29T21:08:57.555070+0000) 2019-11-29T21:09:27.159 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:09:27.151+0000 1694c700 -1 osd.0 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:11.025811+0000 front 2019-11-29T21:08:11.024457+0000 (oldest deadline 2019-11-29T21:08:55.616375+0000) 2019-11-29T21:09:27.339 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:09:27.333+0000 1694c700 -1 osd.6 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:11.750292+0000 front 2019-11-29T21:08:11.949697+0000 (oldest deadline 2019-11-29T21:08:56.089689+0000) 2019-11-29T21:09:27.380 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:09:27.374+0000 1694c700 -1 osd.7 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:15.847085+0000 front 2019-11-29T21:08:15.123564+0000 (oldest deadline 2019-11-29T21:08:58.796991+0000) 2019-11-29T21:09:27.444 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:09:27.437+0000 1694c700 -1 osd.1 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:10.927167+0000 front 2019-11-29T21:08:15.847163+0000 (oldest deadline 2019-11-29T21:08:55.724531+0000) 2019-11-29T21:09:27.724 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:09:27.718+0000 1694c700 -1 osd.2 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:12.928257+0000 front 2019-11-29T21:08:16.066366+0000 (oldest deadline 2019-11-29T21:08:55.743597+0000) 2019-11-29T21:09:28.002 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:09:27.994+0000 1694c700 -1 osd.4 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:15.846819+0000 front 2019-11-29T21:08:15.848973+0000 (oldest deadline 2019-11-29T21:08:57.555070+0000) 2019-11-29T21:09:28.186 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:09:28.181+0000 1694c700 -1 osd.0 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:11.025811+0000 front 2019-11-29T21:08:11.024457+0000 (oldest deadline 2019-11-29T21:08:55.616375+0000) 2019-11-29T21:09:28.372 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:09:28.366+0000 1694c700 -1 osd.6 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:11.750292+0000 front 2019-11-29T21:08:11.949697+0000 (oldest deadline 2019-11-29T21:08:56.089689+0000) 2019-11-29T21:09:28.401 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:09:28.395+0000 1694c700 -1 osd.7 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:15.847085+0000 front 2019-11-29T21:08:15.123564+0000 (oldest deadline 2019-11-29T21:08:58.796991+0000) 2019-11-29T21:09:28.490 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:09:28.483+0000 1694c700 -1 osd.1 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:10.927167+0000 front 2019-11-29T21:08:15.847163+0000 (oldest deadline 2019-11-29T21:08:55.724531+0000) 2019-11-29T21:09:28.706 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:09:28.700+0000 1694c700 -1 osd.2 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:12.928257+0000 front 2019-11-29T21:08:16.066366+0000 (oldest deadline 2019-11-29T21:08:55.743597+0000) 2019-11-29T21:09:29.022 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:09:29.015+0000 1694c700 -1 osd.4 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:15.846819+0000 front 2019-11-29T21:08:15.848973+0000 (oldest deadline 2019-11-29T21:08:57.555070+0000) 2019-11-29T21:09:29.180 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:09:29.174+0000 1694c700 -1 osd.0 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:11.025811+0000 front 2019-11-29T21:08:11.024457+0000 (oldest deadline 2019-11-29T21:08:55.616375+0000) 2019-11-29T21:09:29.331 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:09:29.325+0000 1694c700 -1 osd.6 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:11.750292+0000 front 2019-11-29T21:08:11.949697+0000 (oldest deadline 2019-11-29T21:08:56.089689+0000) 2019-11-29T21:09:29.450 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:09:29.444+0000 1694c700 -1 osd.7 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:15.847085+0000 front 2019-11-29T21:08:15.123564+0000 (oldest deadline 2019-11-29T21:08:58.796991+0000) 2019-11-29T21:09:29.525 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:09:29.519+0000 1694c700 -1 osd.1 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:10.927167+0000 front 2019-11-29T21:08:15.847163+0000 (oldest deadline 2019-11-29T21:08:55.724531+0000) 2019-11-29T21:09:29.755 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:09:29.750+0000 1694c700 -1 osd.2 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:12.928257+0000 front 2019-11-29T21:08:16.066366+0000 (oldest deadline 2019-11-29T21:08:55.743597+0000) 2019-11-29T21:09:30.032 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:09:30.026+0000 1694c700 -1 osd.4 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:15.846819+0000 front 2019-11-29T21:08:15.848973+0000 (oldest deadline 2019-11-29T21:08:57.555070+0000) 2019-11-29T21:09:30.149 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:09:30.144+0000 1694c700 -1 osd.0 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:11.025811+0000 front 2019-11-29T21:08:11.024457+0000 (oldest deadline 2019-11-29T21:08:55.616375+0000) 2019-11-29T21:09:30.374 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:09:30.368+0000 1694c700 -1 osd.6 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:11.750292+0000 front 2019-11-29T21:08:11.949697+0000 (oldest deadline 2019-11-29T21:08:56.089689+0000) 2019-11-29T21:09:30.441 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:09:30.435+0000 1694c700 -1 osd.7 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:15.847085+0000 front 2019-11-29T21:08:15.123564+0000 (oldest deadline 2019-11-29T21:08:58.796991+0000) 2019-11-29T21:09:30.542 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:09:30.534+0000 1694c700 -1 osd.1 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:10.927167+0000 front 2019-11-29T21:08:15.847163+0000 (oldest deadline 2019-11-29T21:08:55.724531+0000) 2019-11-29T21:09:30.752 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:09:30.746+0000 1694c700 -1 osd.2 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:12.928257+0000 front 2019-11-29T21:08:16.066366+0000 (oldest deadline 2019-11-29T21:08:55.743597+0000) 2019-11-29T21:09:31.142 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:09:31.136+0000 1694c700 -1 osd.0 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:11.025811+0000 front 2019-11-29T21:08:11.024457+0000 (oldest deadline 2019-11-29T21:08:55.616375+0000) 2019-11-29T21:09:31.381 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:09:31.370+0000 1694c700 -1 osd.6 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:11.750292+0000 front 2019-11-29T21:08:11.949697+0000 (oldest deadline 2019-11-29T21:08:56.089689+0000) 2019-11-29T21:09:31.453 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:09:31.446+0000 1694c700 -1 osd.7 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:15.847085+0000 front 2019-11-29T21:08:15.123564+0000 (oldest deadline 2019-11-29T21:08:58.796991+0000) 2019-11-29T21:09:31.578 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:09:31.572+0000 1694c700 -1 osd.1 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:10.927167+0000 front 2019-11-29T21:08:15.847163+0000 (oldest deadline 2019-11-29T21:08:55.724531+0000) 2019-11-29T21:09:31.786 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:09:31.776+0000 1694c700 -1 osd.5 254 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4331.0:130068 7.5 7:a7f90313:reshard::reshard.0000000012:head [call lock.lock in=70b] snapc 0=[] RETRY=28 ondisk+retry+write+known_if_redirected e254) 2019-11-29T21:09:32.180 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:09:32.175+0000 1694c700 -1 osd.0 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:11.025811+0000 front 2019-11-29T21:08:11.024457+0000 (oldest deadline 2019-11-29T21:08:55.616375+0000) 2019-11-29T21:09:32.348 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:09:32.340+0000 1694c700 -1 osd.6 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:11.750292+0000 front 2019-11-29T21:08:11.949697+0000 (oldest deadline 2019-11-29T21:08:56.089689+0000) 2019-11-29T21:09:32.449 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:09:32.442+0000 1694c700 -1 osd.7 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:15.847085+0000 front 2019-11-29T21:08:15.123564+0000 (oldest deadline 2019-11-29T21:08:58.796991+0000) 2019-11-29T21:09:32.757 INFO:tasks.ceph.mon.b.smithi022.stderr:2019-11-29T21:09:32.751+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 3 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.22:6818/9264,v1:172.21.15.22:6819/9264] for 46sec e254 v254) 2019-11-29T21:09:32.821 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:09:32.815+0000 1694c700 -1 osd.5 254 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4331.0:130068 7.5 7:a7f90313:reshard::reshard.0000000012:head [call lock.lock in=70b] snapc 0=[] RETRY=28 ondisk+retry+write+known_if_redirected e254) 2019-11-29T21:09:33.177 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:09:33.171+0000 1694c700 -1 osd.0 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:11.025811+0000 front 2019-11-29T21:08:11.024457+0000 (oldest deadline 2019-11-29T21:08:55.616375+0000) 2019-11-29T21:09:33.325 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:09:33.318+0000 1694c700 -1 osd.6 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:11.750292+0000 front 2019-11-29T21:08:11.949697+0000 (oldest deadline 2019-11-29T21:08:56.089689+0000) 2019-11-29T21:09:33.472 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:09:33.465+0000 1694c700 -1 osd.7 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:15.847085+0000 front 2019-11-29T21:08:15.123564+0000 (oldest deadline 2019-11-29T21:08:58.796991+0000) 2019-11-29T21:09:33.805 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:09:33.799+0000 1694c700 -1 osd.5 254 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4331.0:130068 7.5 7:a7f90313:reshard::reshard.0000000012:head [call lock.lock in=70b] snapc 0=[] RETRY=28 ondisk+retry+write+known_if_redirected e254) 2019-11-29T21:09:34.291 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:09:34.285+0000 1694c700 -1 osd.6 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:11.750292+0000 front 2019-11-29T21:08:11.949697+0000 (oldest deadline 2019-11-29T21:08:56.089689+0000) 2019-11-29T21:09:34.459 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:09:34.453+0000 1694c700 -1 osd.7 254 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:08:15.847085+0000 front 2019-11-29T21:08:15.123564+0000 (oldest deadline 2019-11-29T21:08:58.796991+0000) 2019-11-29T21:09:34.778 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:09:34.772+0000 1694c700 -1 osd.5 254 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4331.0:130068 7.5 7:a7f90313:reshard::reshard.0000000012:head [call lock.lock in=70b] snapc 0=[] RETRY=28 ondisk+retry+write+known_if_redirected e254) 2019-11-29T21:09:35.767 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:09:35.760+0000 1694c700 -1 osd.5 254 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4331.0:130068 7.5 7:a7f90313:reshard::reshard.0000000012:head [call lock.lock in=70b] snapc 0=[] RETRY=28 ondisk+retry+write+known_if_redirected e254) 2019-11-29T21:09:36.726 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:09:36.720+0000 1694c700 -1 osd.5 254 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4331.0:130068 7.5 7:a7f90313:reshard::reshard.0000000012:head [call lock.lock in=70b] snapc 0=[] RETRY=28 ondisk+retry+write+known_if_redirected e254) 2019-11-29T21:09:37.757 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:09:37.751+0000 1694c700 -1 osd.5 254 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4331.0:130068 7.5 7:a7f90313:reshard::reshard.0000000012:head [call lock.lock in=70b] snapc 0=[] RETRY=28 ondisk+retry+write+known_if_redirected e254) 2019-11-29T21:09:38.729 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:09:38.723+0000 1694c700 -1 osd.5 254 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4331.0:130068 7.5 7:a7f90313:reshard::reshard.0000000012:head [call lock.lock in=70b] snapc 0=[] RETRY=28 ondisk+retry+write+known_if_redirected e254) 2019-11-29T21:09:39.687 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:09:39.681+0000 1694c700 -1 osd.5 254 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4331.0:130068 7.5 7:a7f90313:reshard::reshard.0000000012:head [call lock.lock in=70b] snapc 0=[] RETRY=28 ondisk+retry+write+known_if_redirected e254) 2019-11-29T21:09:40.692 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:09:40.686+0000 1694c700 -1 osd.5 254 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4331.0:130068 7.5 7:a7f90313:reshard::reshard.0000000012:head [call lock.lock in=70b] snapc 0=[] RETRY=28 ondisk+retry+write+known_if_redirected e254) 2019-11-29T21:09:41.672 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:09:41.666+0000 1694c700 -1 osd.5 254 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4331.0:130068 7.5 7:a7f90313:reshard::reshard.0000000012:head [call lock.lock in=70b] snapc 0=[] RETRY=28 ondisk+retry+write+known_if_redirected e254) 2019-11-29T21:09:42.712 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:09:42.707+0000 1694c700 -1 osd.5 254 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4331.0:130068 7.5 7:a7f90313:reshard::reshard.0000000012:head [call lock.lock in=70b] snapc 0=[] RETRY=28 ondisk+retry+write+known_if_redirected e254) 2019-11-29T21:09:43.727 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:09:43.722+0000 1694c700 -1 osd.5 254 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4331.0:130068 7.5 7:a7f90313:reshard::reshard.0000000012:head [call lock.lock in=70b] snapc 0=[] RETRY=28 ondisk+retry+write+known_if_redirected e254) 2019-11-29T21:09:44.774 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:09:44.769+0000 1694c700 -1 osd.5 254 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4331.0:130068 7.5 7:a7f90313:reshard::reshard.0000000012:head [call lock.lock in=70b] snapc 0=[] RETRY=28 ondisk+retry+write+known_if_redirected e254) 2019-11-29T21:09:45.779 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:09:45.772+0000 1694c700 -1 osd.5 254 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4331.0:130068 7.5 7:a7f90313:reshard::reshard.0000000012:head [call lock.lock in=70b] snapc 0=[] RETRY=28 ondisk+retry+write+known_if_redirected e254) 2019-11-29T21:09:46.756 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:09:46.752+0000 1694c700 -1 osd.5 254 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4331.0:130068 7.5 7:a7f90313:reshard::reshard.0000000012:head [call lock.lock in=70b] snapc 0=[] RETRY=28 ondisk+retry+write+known_if_redirected e254) 2019-11-29T21:09:47.719 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:09:47.714+0000 1694c700 -1 osd.5 254 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4331.0:130068 7.5 7:a7f90313:reshard::reshard.0000000012:head [call lock.lock in=70b] snapc 0=[] RETRY=28 ondisk+retry+write+known_if_redirected e254) 2019-11-29T21:09:48.686 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:09:48.681+0000 1694c700 -1 osd.5 254 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4331.0:130068 7.5 7:a7f90313:reshard::reshard.0000000012:head [call lock.lock in=70b] snapc 0=[] RETRY=28 ondisk+retry+write+known_if_redirected e254) 2019-11-29T21:09:49.675 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:09:49.670+0000 1694c700 -1 osd.5 254 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4331.0:130068 7.5 7:a7f90313:reshard::reshard.0000000012:head [call lock.lock in=70b] snapc 0=[] RETRY=28 ondisk+retry+write+known_if_redirected e254) 2019-11-29T21:09:50.727 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:09:50.713+0000 1694c700 -1 osd.5 254 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4331.0:130068 7.5 7:a7f90313:reshard::reshard.0000000012:head [call lock.lock in=70b] snapc 0=[] RETRY=28 ondisk+retry+write+known_if_redirected e254) 2019-11-29T21:09:51.771 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:09:51.766+0000 1694c700 -1 osd.5 254 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4331.0:130068 7.5 7:a7f90313:reshard::reshard.0000000012:head [call lock.lock in=70b] snapc 0=[] RETRY=28 ondisk+retry+write+known_if_redirected e254) 2019-11-29T21:09:52.739 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:09:52.734+0000 1694c700 -1 osd.5 254 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4331.0:130068 7.5 7:a7f90313:reshard::reshard.0000000012:head [call lock.lock in=70b] snapc 0=[] RETRY=28 ondisk+retry+write+known_if_redirected e254) 2019-11-29T21:09:53.750 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:09:53.745+0000 1694c700 -1 osd.5 254 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4331.0:130068 7.5 7:a7f90313:reshard::reshard.0000000012:head [call lock.lock in=70b] snapc 0=[] RETRY=28 ondisk+retry+write+known_if_redirected e254) 2019-11-29T21:09:54.770 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:09:54.764+0000 1694c700 -1 osd.5 254 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4331.0:130068 7.5 7:a7f90313:reshard::reshard.0000000012:head [call lock.lock in=70b] snapc 0=[] RETRY=28 ondisk+retry+write+known_if_redirected e254) 2019-11-29T21:09:55.810 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:09:55.805+0000 1694c700 -1 osd.5 254 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4331.0:130068 7.5 7:a7f90313:reshard::reshard.0000000012:head [call lock.lock in=70b] snapc 0=[] RETRY=28 ondisk+retry+write+known_if_redirected e254) 2019-11-29T21:09:56.842 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:09:56.837+0000 1694c700 -1 osd.5 254 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4331.0:130068 7.5 7:a7f90313:reshard::reshard.0000000012:head [call lock.lock in=70b] snapc 0=[] RETRY=28 ondisk+retry+write+known_if_redirected e254) 2019-11-29T21:09:57.797 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:09:57.792+0000 1694c700 -1 osd.5 254 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4331.0:130068 7.5 7:a7f90313:reshard::reshard.0000000012:head [call lock.lock in=70b] snapc 0=[] RETRY=28 ondisk+retry+write+known_if_redirected e254) 2019-11-29T21:09:58.790 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:09:58.786+0000 1694c700 -1 osd.5 254 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4331.0:130068 7.5 7:a7f90313:reshard::reshard.0000000012:head [call lock.lock in=70b] snapc 0=[] RETRY=28 ondisk+retry+write+known_if_redirected e254) 2019-11-29T21:09:59.782 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:09:59.777+0000 1694c700 -1 osd.5 254 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4331.0:130068 7.5 7:a7f90313:reshard::reshard.0000000012:head [call lock.lock in=70b] snapc 0=[] RETRY=28 ondisk+retry+write+known_if_redirected e254) 2019-11-29T21:10:00.058 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:08:44:40.716 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T21:10:00.071 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:08:44:40.678 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T21:10:00.076 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:08:44:40.683 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T21:10:00.083 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:08:44:40.742 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T21:10:00.091 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:08:44:40.698 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T21:10:00.096 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:08:44:40.703 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T21:10:00.290 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:08:44:40.897 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T21:10:00.344 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:08:44:41.002 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T21:10:00.353 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:08:44:40.960 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T21:10:00.834 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:10:00.829+0000 1694c700 -1 osd.5 254 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4331.0:130068 7.5 7:a7f90313:reshard::reshard.0000000012:head [call lock.lock in=70b] snapc 0=[] RETRY=28 ondisk+retry+write+known_if_redirected e254) 2019-11-29T21:10:01.880 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:10:01.875+0000 1694c700 -1 osd.5 254 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:130068 7.5 7:a7f90313:reshard::reshard.0000000012:head [call lock.lock in=70b] snapc 0=[] RETRY=28 ondisk+retry+write+known_if_redirected e254) 2019-11-29T21:10:02.863 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:10:02.857+0000 1694c700 -1 osd.5 254 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:130068 7.5 7:a7f90313:reshard::reshard.0000000012:head [call lock.lock in=70b] snapc 0=[] RETRY=28 ondisk+retry+write+known_if_redirected e254) 2019-11-29T21:10:03.915 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:10:03.910+0000 1694c700 -1 osd.5 254 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:130068 7.5 7:a7f90313:reshard::reshard.0000000012:head [call lock.lock in=70b] snapc 0=[] RETRY=28 ondisk+retry+write+known_if_redirected e254) 2019-11-29T21:10:04.920 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:10:04.910+0000 1694c700 -1 osd.5 254 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:130068 7.5 7:a7f90313:reshard::reshard.0000000012:head [call lock.lock in=70b] snapc 0=[] RETRY=28 ondisk+retry+write+known_if_redirected e254) 2019-11-29T21:10:05.950 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:10:05.945+0000 1694c700 -1 osd.5 254 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:130068 7.5 7:a7f90313:reshard::reshard.0000000012:head [call lock.lock in=70b] snapc 0=[] RETRY=28 ondisk+retry+write+known_if_redirected e254) 2019-11-29T21:10:06.928 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:10:06.924+0000 1694c700 -1 osd.5 254 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:130068 7.5 7:a7f90313:reshard::reshard.0000000012:head [call lock.lock in=70b] snapc 0=[] RETRY=28 ondisk+retry+write+known_if_redirected e254) 2019-11-29T21:10:07.967 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:10:07.962+0000 1694c700 -1 osd.5 254 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:130068 7.5 7:a7f90313:reshard::reshard.0000000012:head [call lock.lock in=70b] snapc 0=[] RETRY=28 ondisk+retry+write+known_if_redirected e254) 2019-11-29T21:10:08.970 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:10:08.965+0000 1694c700 -1 osd.5 254 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:130068 7.5 7:a7f90313:reshard::reshard.0000000012:head [call lock.lock in=70b] snapc 0=[] RETRY=28 ondisk+retry+write+known_if_redirected e254) 2019-11-29T21:10:09.946 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:10:09.942+0000 1694c700 -1 osd.5 254 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:130068 7.5 7:a7f90313:reshard::reshard.0000000012:head [call lock.lock in=70b] snapc 0=[] RETRY=28 ondisk+retry+write+known_if_redirected e254) 2019-11-29T21:10:10.932 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:10:10.927+0000 1694c700 -1 osd.5 254 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:130068 7.5 7:a7f90313:reshard::reshard.0000000012:head [call lock.lock in=70b] snapc 0=[] RETRY=28 ondisk+retry+write+known_if_redirected e254) 2019-11-29T21:10:11.986 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:10:11.978+0000 1694c700 -1 osd.5 254 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:130068 7.5 7:a7f90313:reshard::reshard.0000000012:head [call lock.lock in=70b] snapc 0=[] RETRY=28 ondisk+retry+write+known_if_redirected e254) 2019-11-29T21:10:12.979 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:10:12.969+0000 1694c700 -1 osd.5 254 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:130068 7.5 7:a7f90313:reshard::reshard.0000000012:head [call lock.lock in=70b] snapc 0=[] RETRY=28 ondisk+retry+write+known_if_redirected e254) 2019-11-29T21:10:13.939 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:10:13.934+0000 1694c700 -1 osd.5 254 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:130068 7.5 7:a7f90313:reshard::reshard.0000000012:head [call lock.lock in=70b] snapc 0=[] RETRY=28 ondisk+retry+write+known_if_redirected e254) 2019-11-29T21:10:14.918 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:10:14.913+0000 1694c700 -1 osd.5 254 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:130068 7.5 7:a7f90313:reshard::reshard.0000000012:head [call lock.lock in=70b] snapc 0=[] RETRY=28 ondisk+retry+write+known_if_redirected e254) 2019-11-29T21:10:15.915 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:10:15.910+0000 1694c700 -1 osd.5 254 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:130068 7.5 7:a7f90313:reshard::reshard.0000000012:head [call lock.lock in=70b] snapc 0=[] RETRY=28 ondisk+retry+write+known_if_redirected e254) 2019-11-29T21:10:16.885 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:10:16.880+0000 1694c700 -1 osd.5 254 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:130068 7.5 7:a7f90313:reshard::reshard.0000000012:head [call lock.lock in=70b] snapc 0=[] RETRY=28 ondisk+retry+write+known_if_redirected e254) 2019-11-29T21:10:17.891 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:10:17.886+0000 1694c700 -1 osd.5 254 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:130068 7.5 7:a7f90313:reshard::reshard.0000000012:head [call lock.lock in=70b] snapc 0=[] RETRY=28 ondisk+retry+write+known_if_redirected e254) 2019-11-29T21:10:18.883 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:10:18.878+0000 1694c700 -1 osd.5 254 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:130068 7.5 7:a7f90313:reshard::reshard.0000000012:head [call lock.lock in=70b] snapc 0=[] RETRY=28 ondisk+retry+write+known_if_redirected e254) 2019-11-29T21:10:19.900 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:10:19.896+0000 1694c700 -1 osd.5 254 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:130068 7.5 7:a7f90313:reshard::reshard.0000000012:head [call lock.lock in=70b] snapc 0=[] RETRY=28 ondisk+retry+write+known_if_redirected e254) 2019-11-29T21:10:20.926 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:10:20.919+0000 1694c700 -1 osd.5 254 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:130068 7.5 7:a7f90313:reshard::reshard.0000000012:head [call lock.lock in=70b] snapc 0=[] RETRY=28 ondisk+retry+write+known_if_redirected e254) 2019-11-29T21:10:21.947 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:10:21.940+0000 1694c700 -1 osd.5 254 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:130068 7.5 7:a7f90313:reshard::reshard.0000000012:head [call lock.lock in=70b] snapc 0=[] RETRY=28 ondisk+retry+write+known_if_redirected e254) 2019-11-29T21:10:22.974 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:10:22.968+0000 1694c700 -1 osd.5 254 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:130068 7.5 7:a7f90313:reshard::reshard.0000000012:head [call lock.lock in=70b] snapc 0=[] RETRY=28 ondisk+retry+write+known_if_redirected e254) 2019-11-29T21:10:23.986 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:10:23.981+0000 1694c700 -1 osd.5 254 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:130068 7.5 7:a7f90313:reshard::reshard.0000000012:head [call lock.lock in=70b] snapc 0=[] RETRY=28 ondisk+retry+write+known_if_redirected e254) 2019-11-29T21:10:25.036 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:10:25.028+0000 1694c700 -1 osd.5 254 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:130068 7.5 7:a7f90313:reshard::reshard.0000000012:head [call lock.lock in=70b] snapc 0=[] RETRY=28 ondisk+retry+write+known_if_redirected e254) 2019-11-29T21:10:25.990 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:10:25.985+0000 1694c700 -1 osd.5 254 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:130068 7.5 7:a7f90313:reshard::reshard.0000000012:head [call lock.lock in=70b] snapc 0=[] RETRY=28 ondisk+retry+write+known_if_redirected e254) 2019-11-29T21:10:27.017 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:10:27.012+0000 1694c700 -1 osd.5 254 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:130068 7.5 7:a7f90313:reshard::reshard.0000000012:head [call lock.lock in=70b] snapc 0=[] RETRY=28 ondisk+retry+write+known_if_redirected e254) 2019-11-29T21:10:28.014 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:10:28.009+0000 1694c700 -1 osd.5 254 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:130068 7.5 7:a7f90313:reshard::reshard.0000000012:head [call lock.lock in=70b] snapc 0=[] RETRY=28 ondisk+retry+write+known_if_redirected e254) 2019-11-29T21:10:29.060 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:10:29.054+0000 1694c700 -1 osd.5 254 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:130068 7.5 7:a7f90313:reshard::reshard.0000000012:head [call lock.lock in=70b] snapc 0=[] RETRY=28 ondisk+retry+write+known_if_redirected e254) 2019-11-29T21:10:30.103 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:10:30.097+0000 1694c700 -1 osd.5 254 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:130068 7.5 7:a7f90313:reshard::reshard.0000000012:head [call lock.lock in=70b] snapc 0=[] RETRY=28 ondisk+retry+write+known_if_redirected e254) 2019-11-29T21:10:31.110 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:10:31.104+0000 1694c700 -1 osd.5 254 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:130068 7.5 7:a7f90313:reshard::reshard.0000000012:head [call lock.lock in=70b] snapc 0=[] RETRY=28 ondisk+retry+write+known_if_redirected e254) 2019-11-29T21:10:32.120 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:10:32.114+0000 1694c700 -1 osd.5 254 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:130068 7.5 7:a7f90313:reshard::reshard.0000000012:head [call lock.lock in=70b] snapc 0=[] RETRY=28 ondisk+retry+write+known_if_redirected e254) 2019-11-29T21:10:33.090 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:10:33.083+0000 1694c700 -1 osd.5 254 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:130068 7.5 7:a7f90313:reshard::reshard.0000000012:head [call lock.lock in=70b] snapc 0=[] RETRY=28 ondisk+retry+write+known_if_redirected e254) 2019-11-29T21:10:34.085 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:10:34.078+0000 1694c700 -1 osd.5 254 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:130068 7.5 7:a7f90313:reshard::reshard.0000000012:head [call lock.lock in=70b] snapc 0=[] RETRY=28 ondisk+retry+write+known_if_redirected e254) 2019-11-29T21:10:35.137 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:10:35.131+0000 1694c700 -1 osd.5 254 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:130068 7.5 7:a7f90313:reshard::reshard.0000000012:head [call lock.lock in=70b] snapc 0=[] RETRY=28 ondisk+retry+write+known_if_redirected e254) 2019-11-29T21:10:36.136 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:10:36.129+0000 1694c700 -1 osd.5 254 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:130068 7.5 7:a7f90313:reshard::reshard.0000000012:head [call lock.lock in=70b] snapc 0=[] RETRY=28 ondisk+retry+write+known_if_redirected e254) 2019-11-29T21:10:37.133 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:10:37.125+0000 1694c700 -1 osd.5 254 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:130068 7.5 7:a7f90313:reshard::reshard.0000000012:head [call lock.lock in=70b] snapc 0=[] RETRY=28 ondisk+retry+write+known_if_redirected e254) 2019-11-29T21:10:38.123 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:10:38.118+0000 1694c700 -1 osd.5 254 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:130068 7.5 7:a7f90313:reshard::reshard.0000000012:head [call lock.lock in=70b] snapc 0=[] RETRY=28 ondisk+retry+write+known_if_redirected e254) 2019-11-29T21:10:39.101 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:10:39.095+0000 1694c700 -1 osd.5 254 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:130068 7.5 7:a7f90313:reshard::reshard.0000000012:head [call lock.lock in=70b] snapc 0=[] RETRY=28 ondisk+retry+write+known_if_redirected e254) 2019-11-29T21:10:40.085 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:10:40.079+0000 1694c700 -1 osd.5 254 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:130068 7.5 7:a7f90313:reshard::reshard.0000000012:head [call lock.lock in=70b] snapc 0=[] RETRY=28 ondisk+retry+write+known_if_redirected e254) 2019-11-29T21:10:41.081 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:10:41.075+0000 1694c700 -1 osd.5 254 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:130068 7.5 7:a7f90313:reshard::reshard.0000000012:head [call lock.lock in=70b] snapc 0=[] RETRY=28 ondisk+retry+write+known_if_redirected e254) 2019-11-29T21:10:42.115 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:10:42.110+0000 1694c700 -1 osd.5 254 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:130068 7.5 7:a7f90313:reshard::reshard.0000000012:head [call lock.lock in=70b] snapc 0=[] RETRY=28 ondisk+retry+write+known_if_redirected e254) 2019-11-29T21:10:43.126 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:10:43.119+0000 1694c700 -1 osd.5 254 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:130068 7.5 7:a7f90313:reshard::reshard.0000000012:head [call lock.lock in=70b] snapc 0=[] RETRY=28 ondisk+retry+write+known_if_redirected e254) 2019-11-29T21:10:44.120 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:10:44.115+0000 1694c700 -1 osd.5 255 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:130068 7.5 7:a7f90313:reshard::reshard.0000000012:head [call lock.lock in=70b] snapc 0=[] RETRY=28 ondisk+retry+write+known_if_redirected e254) 2019-11-29T21:10:45.352 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:10:45.324+0000 1694c700 -1 osd.5 256 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:130068 7.5 7:a7f90313:reshard::reshard.0000000012:head [call lock.lock in=70b] snapc 0=[] RETRY=28 ondisk+retry+write+known_if_redirected e254) 2019-11-29T21:10:46.418 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:10:46.370+0000 1694c700 -1 osd.5 257 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:130068 7.5 7:a7f90313:reshard::reshard.0000000012:head [call lock.lock in=70b] snapc 0=[] RETRY=28 ondisk+retry+write+known_if_redirected e254) 2019-11-29T21:10:47.498 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:10:47.384+0000 1694c700 -1 osd.5 257 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:130068 7.5 7:a7f90313:reshard::reshard.0000000012:head [call lock.lock in=70b] snapc 0=[] RETRY=28 ondisk+retry+write+known_if_redirected e254) 2019-11-29T21:10:48.411 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:10:48.404+0000 1694c700 -1 osd.5 257 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4331.0:130068 7.5 7:a7f90313:reshard::reshard.0000000012:head [call lock.lock in=70b] snapc 0=[] RETRY=28 ondisk+retry+write+known_if_redirected e254) 2019-11-29T21:11:39.194 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:11:39.187+0000 1694c700 -1 osd.6 282 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:121744 6.8 6:1adc68c2:root::.bucket.meta.efa89e82fef944908f84171016951717%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.619:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e272) 2019-11-29T21:11:40.152 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:11:40.145+0000 1694c700 -1 osd.6 282 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:121744 6.8 6:1adc68c2:root::.bucket.meta.efa89e82fef944908f84171016951717%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.619:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e272) 2019-11-29T21:11:40.964 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:11:40.951+0000 1694c700 -1 osd.1 282 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130523 7.0 7:05588ce8:lc::lc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected e274) 2019-11-29T21:11:41.196 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:11:41.191+0000 1694c700 -1 osd.6 282 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:121744 6.8 6:1adc68c2:root::.bucket.meta.efa89e82fef944908f84171016951717%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.619:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e272) 2019-11-29T21:11:41.933 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:11:41.928+0000 1694c700 -1 osd.1 282 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130523 7.0 7:05588ce8:lc::lc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected e274) 2019-11-29T21:11:42.228 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:11:42.224+0000 1694c700 -1 osd.6 282 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:121744 6.8 6:1adc68c2:root::.bucket.meta.efa89e82fef944908f84171016951717%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.619:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e272) 2019-11-29T21:11:42.983 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:11:42.978+0000 1694c700 -1 osd.1 282 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130523 7.0 7:05588ce8:lc::lc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected e274) 2019-11-29T21:11:43.277 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:11:43.273+0000 1694c700 -1 osd.6 282 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:121744 6.8 6:1adc68c2:root::.bucket.meta.efa89e82fef944908f84171016951717%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.619:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e272) 2019-11-29T21:11:43.942 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:11:43.937+0000 1694c700 -1 osd.1 282 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130523 7.0 7:05588ce8:lc::lc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected e274) 2019-11-29T21:11:44.296 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:11:44.291+0000 1694c700 -1 osd.6 282 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:121744 6.8 6:1adc68c2:root::.bucket.meta.efa89e82fef944908f84171016951717%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.619:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e272) 2019-11-29T21:11:44.947 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:11:44.942+0000 1694c700 -1 osd.1 282 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130523 7.0 7:05588ce8:lc::lc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected e274) 2019-11-29T21:11:45.304 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:11:45.300+0000 1694c700 -1 osd.6 282 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:121744 6.8 6:1adc68c2:root::.bucket.meta.efa89e82fef944908f84171016951717%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.619:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e272) 2019-11-29T21:11:45.982 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:11:45.978+0000 1694c700 -1 osd.1 282 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130523 7.0 7:05588ce8:lc::lc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected e274) 2019-11-29T21:11:46.317 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:11:46.308+0000 1694c700 -1 osd.6 282 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:121744 6.8 6:1adc68c2:root::.bucket.meta.efa89e82fef944908f84171016951717%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.619:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e272) 2019-11-29T21:11:46.982 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:11:46.978+0000 1694c700 -1 osd.1 282 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130523 7.0 7:05588ce8:lc::lc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected e274) 2019-11-29T21:11:47.319 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:11:47.313+0000 1694c700 -1 osd.6 282 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:121744 6.8 6:1adc68c2:root::.bucket.meta.efa89e82fef944908f84171016951717%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.619:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e272) 2019-11-29T21:11:48.007 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:11:48.002+0000 1694c700 -1 osd.1 282 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130523 7.0 7:05588ce8:lc::lc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected e274) 2019-11-29T21:11:48.350 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:11:48.344+0000 1694c700 -1 osd.6 282 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:121744 6.8 6:1adc68c2:root::.bucket.meta.efa89e82fef944908f84171016951717%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.619:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e272) 2019-11-29T21:11:49.044 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:11:49.039+0000 1694c700 -1 osd.1 282 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130523 7.0 7:05588ce8:lc::lc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected e274) 2019-11-29T21:11:49.401 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:11:49.396+0000 1694c700 -1 osd.6 282 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:121744 6.8 6:1adc68c2:root::.bucket.meta.efa89e82fef944908f84171016951717%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.619:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e272) 2019-11-29T21:11:50.055 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:11:50.050+0000 1694c700 -1 osd.1 282 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130523 7.0 7:05588ce8:lc::lc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected e274) 2019-11-29T21:11:50.395 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:11:50.390+0000 1694c700 -1 osd.6 282 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:121744 6.8 6:1adc68c2:root::.bucket.meta.efa89e82fef944908f84171016951717%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.619:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e272) 2019-11-29T21:11:51.013 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:11:51.006+0000 1694c700 -1 osd.1 282 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130523 7.0 7:05588ce8:lc::lc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected e274) 2019-11-29T21:11:51.377 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:11:51.371+0000 1694c700 -1 osd.6 282 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:121744 6.8 6:1adc68c2:root::.bucket.meta.efa89e82fef944908f84171016951717%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.619:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e272) 2019-11-29T21:11:51.973 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:11:51.968+0000 1694c700 -1 osd.1 282 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130523 7.0 7:05588ce8:lc::lc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected e274) 2019-11-29T21:11:52.373 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:11:52.367+0000 1694c700 -1 osd.6 282 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:121744 6.8 6:1adc68c2:root::.bucket.meta.efa89e82fef944908f84171016951717%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.619:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e272) 2019-11-29T21:11:52.979 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:11:52.974+0000 1694c700 -1 osd.1 282 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130523 7.0 7:05588ce8:lc::lc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected e274) 2019-11-29T21:11:53.366 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:11:53.360+0000 1694c700 -1 osd.6 282 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:121744 6.8 6:1adc68c2:root::.bucket.meta.efa89e82fef944908f84171016951717%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.619:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e272) 2019-11-29T21:11:53.956 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:11:53.949+0000 1694c700 -1 osd.1 282 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130523 7.0 7:05588ce8:lc::lc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected e274) 2019-11-29T21:11:54.322 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:11:54.316+0000 1694c700 -1 osd.6 282 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:121744 6.8 6:1adc68c2:root::.bucket.meta.efa89e82fef944908f84171016951717%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.619:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e272) 2019-11-29T21:11:54.926 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:11:54.922+0000 1694c700 -1 osd.1 282 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130523 7.0 7:05588ce8:lc::lc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected e274) 2019-11-29T21:11:55.283 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:11:55.277+0000 1694c700 -1 osd.6 282 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:121744 6.8 6:1adc68c2:root::.bucket.meta.efa89e82fef944908f84171016951717%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.619:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e272) 2019-11-29T21:11:55.914 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:11:55.909+0000 1694c700 -1 osd.1 282 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130523 7.0 7:05588ce8:lc::lc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected e274) 2019-11-29T21:11:56.336 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:11:56.330+0000 1694c700 -1 osd.6 282 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:121744 6.8 6:1adc68c2:root::.bucket.meta.efa89e82fef944908f84171016951717%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.619:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e272) 2019-11-29T21:11:56.874 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:11:56.869+0000 1694c700 -1 osd.1 282 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130523 7.0 7:05588ce8:lc::lc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected e274) 2019-11-29T21:11:57.319 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:11:57.313+0000 1694c700 -1 osd.6 282 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:121744 6.8 6:1adc68c2:root::.bucket.meta.efa89e82fef944908f84171016951717%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.619:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e272) 2019-11-29T21:11:57.908 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:11:57.903+0000 1694c700 -1 osd.1 282 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130523 7.0 7:05588ce8:lc::lc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected e274) 2019-11-29T21:11:58.329 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:11:58.323+0000 1694c700 -1 osd.6 282 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:121744 6.8 6:1adc68c2:root::.bucket.meta.efa89e82fef944908f84171016951717%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.619:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e272) 2019-11-29T21:11:58.869 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:11:58.862+0000 1694c700 -1 osd.1 282 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130523 7.0 7:05588ce8:lc::lc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected e274) 2019-11-29T21:11:59.369 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:11:59.364+0000 1694c700 -1 osd.6 282 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:121744 6.8 6:1adc68c2:root::.bucket.meta.efa89e82fef944908f84171016951717%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.619:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e272) 2019-11-29T21:11:59.889 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:11:59.885+0000 1694c700 -1 osd.1 282 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130523 7.0 7:05588ce8:lc::lc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected e274) 2019-11-29T21:12:00.394 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:12:00.388+0000 1694c700 -1 osd.6 282 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:121744 6.8 6:1adc68c2:root::.bucket.meta.efa89e82fef944908f84171016951717%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.619:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e272) 2019-11-29T21:12:00.867 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:12:00.862+0000 1694c700 -1 osd.1 282 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130523 7.0 7:05588ce8:lc::lc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected e274) 2019-11-29T21:12:01.411 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:12:01.406+0000 1694c700 -1 osd.6 282 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:121744 6.8 6:1adc68c2:root::.bucket.meta.efa89e82fef944908f84171016951717%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.619:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e272) 2019-11-29T21:12:01.827 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:12:01.822+0000 1694c700 -1 osd.1 282 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130523 7.0 7:05588ce8:lc::lc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected e274) 2019-11-29T21:12:02.455 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:12:02.449+0000 1694c700 -1 osd.6 282 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:121744 6.8 6:1adc68c2:root::.bucket.meta.efa89e82fef944908f84171016951717%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.619:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e272) 2019-11-29T21:12:02.526 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:12:02.521+0000 1694c700 -1 osd.2 282 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:16.889090+0000 front 2019-11-29T21:11:16.369878+0000 (oldest deadline 2019-11-29T21:12:02.068366+0000) 2019-11-29T21:12:02.626 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:12:02.620+0000 1694c700 -1 osd.4 282 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:16.320933+0000 front 2019-11-29T21:11:16.372641+0000 (oldest deadline 2019-11-29T21:12:01.843111+0000) 2019-11-29T21:12:02.824 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:12:02.813+0000 1694c700 -1 osd.1 282 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130523 7.0 7:05588ce8:lc::lc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected e274) 2019-11-29T21:12:03.484 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:12:03.478+0000 1694c700 -1 osd.2 282 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:16.889090+0000 front 2019-11-29T21:11:16.369878+0000 (oldest deadline 2019-11-29T21:12:02.068366+0000) 2019-11-29T21:12:03.503 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:12:03.498+0000 1694c700 -1 osd.6 282 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:121744 6.8 6:1adc68c2:root::.bucket.meta.efa89e82fef944908f84171016951717%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.619:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e272) 2019-11-29T21:12:03.517 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:12:03.512+0000 1694c700 -1 osd.0 282 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:18.669553+0000 front 2019-11-29T21:11:19.271424+0000 (oldest deadline 2019-11-29T21:12:03.301175+0000) 2019-11-29T21:12:03.586 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:12:03.579+0000 1694c700 -1 osd.4 282 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:16.320933+0000 front 2019-11-29T21:11:16.372641+0000 (oldest deadline 2019-11-29T21:12:01.843111+0000) 2019-11-29T21:12:03.865 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:12:03.860+0000 1694c700 -1 osd.1 282 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130523 7.0 7:05588ce8:lc::lc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected e274) 2019-11-29T21:12:04.465 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:12:04.460+0000 1694c700 -1 osd.2 282 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:16.889090+0000 front 2019-11-29T21:11:16.369878+0000 (oldest deadline 2019-11-29T21:12:02.068366+0000) 2019-11-29T21:12:04.517 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:12:04.511+0000 1694c700 -1 osd.6 282 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:18.409835+0000 front 2019-11-29T21:11:18.823976+0000 (oldest deadline 2019-11-29T21:12:04.201710+0000) 2019-11-29T21:12:04.519 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:12:04.512+0000 1694c700 -1 osd.6 282 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:121744 6.8 6:1adc68c2:root::.bucket.meta.efa89e82fef944908f84171016951717%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.619:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e272) 2019-11-29T21:12:04.537 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:12:04.532+0000 1694c700 -1 osd.0 282 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:18.669553+0000 front 2019-11-29T21:11:19.271424+0000 (oldest deadline 2019-11-29T21:12:03.301175+0000) 2019-11-29T21:12:04.545 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:12:04.535+0000 1694c700 -1 osd.4 282 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:16.320933+0000 front 2019-11-29T21:11:16.372641+0000 (oldest deadline 2019-11-29T21:12:01.843111+0000) 2019-11-29T21:12:04.853 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:12:04.848+0000 1694c700 -1 osd.1 282 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130523 7.0 7:05588ce8:lc::lc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected e274) 2019-11-29T21:12:04.924 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:12:04.914+0000 1694c700 -1 osd.7 282 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:18.752655+0000 front 2019-11-29T21:11:18.632138+0000 (oldest deadline 2019-11-29T21:12:04.472776+0000) 2019-11-29T21:12:05.509 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:12:05.501+0000 1694c700 -1 osd.6 282 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:18.409835+0000 front 2019-11-29T21:11:18.823976+0000 (oldest deadline 2019-11-29T21:12:04.201710+0000) 2019-11-29T21:12:05.509 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:12:05.503+0000 1694c700 -1 osd.6 282 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:121744 6.8 6:1adc68c2:root::.bucket.meta.efa89e82fef944908f84171016951717%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.619:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e272) 2019-11-29T21:12:05.520 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:12:05.514+0000 1694c700 -1 osd.2 282 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:16.889090+0000 front 2019-11-29T21:11:16.369878+0000 (oldest deadline 2019-11-29T21:12:02.068366+0000) 2019-11-29T21:12:05.533 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:12:05.527+0000 1694c700 -1 osd.4 282 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:16.320933+0000 front 2019-11-29T21:11:16.372641+0000 (oldest deadline 2019-11-29T21:12:01.843111+0000) 2019-11-29T21:12:05.585 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:12:05.580+0000 1694c700 -1 osd.0 282 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:18.669553+0000 front 2019-11-29T21:11:19.271424+0000 (oldest deadline 2019-11-29T21:12:03.301175+0000) 2019-11-29T21:12:05.838 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:12:05.833+0000 1694c700 -1 osd.1 282 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130523 7.0 7:05588ce8:lc::lc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected e274) 2019-11-29T21:12:05.924 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:12:05.918+0000 1694c700 -1 osd.7 282 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:18.752655+0000 front 2019-11-29T21:11:18.632138+0000 (oldest deadline 2019-11-29T21:12:04.472776+0000) 2019-11-29T21:12:06.472 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:12:06.466+0000 1694c700 -1 osd.6 282 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:18.409835+0000 front 2019-11-29T21:11:18.823976+0000 (oldest deadline 2019-11-29T21:12:04.201710+0000) 2019-11-29T21:12:06.472 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:12:06.467+0000 1694c700 -1 osd.6 282 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:121744 6.8 6:1adc68c2:root::.bucket.meta.efa89e82fef944908f84171016951717%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.619:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e272) 2019-11-29T21:12:06.522 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:12:06.514+0000 1694c700 -1 osd.4 282 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:16.320933+0000 front 2019-11-29T21:11:16.372641+0000 (oldest deadline 2019-11-29T21:12:01.843111+0000) 2019-11-29T21:12:06.544 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:12:06.538+0000 1694c700 -1 osd.0 282 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:18.669553+0000 front 2019-11-29T21:11:19.271424+0000 (oldest deadline 2019-11-29T21:12:03.301175+0000) 2019-11-29T21:12:06.549 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:12:06.543+0000 1694c700 -1 osd.2 282 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:16.889090+0000 front 2019-11-29T21:11:16.369878+0000 (oldest deadline 2019-11-29T21:12:02.068366+0000) 2019-11-29T21:12:06.859 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:12:06.854+0000 1694c700 -1 osd.1 282 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:21.393313+0000 front 2019-11-29T21:11:21.431973+0000 (oldest deadline 2019-11-29T21:12:05.990591+0000) 2019-11-29T21:12:06.862 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:12:06.858+0000 1694c700 -1 osd.1 282 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130523 7.0 7:05588ce8:lc::lc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected e274) 2019-11-29T21:12:06.881 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:12:06.874+0000 1694c700 -1 osd.7 282 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:18.752655+0000 front 2019-11-29T21:11:18.632138+0000 (oldest deadline 2019-11-29T21:12:04.472776+0000) 2019-11-29T21:12:07.436 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:12:07.430+0000 1694c700 -1 osd.6 282 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:18.409835+0000 front 2019-11-29T21:11:18.823976+0000 (oldest deadline 2019-11-29T21:12:04.201710+0000) 2019-11-29T21:12:07.437 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:12:07.431+0000 1694c700 -1 osd.6 282 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:121744 6.8 6:1adc68c2:root::.bucket.meta.efa89e82fef944908f84171016951717%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.619:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e272) 2019-11-29T21:12:07.504 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:12:07.499+0000 1694c700 -1 osd.0 282 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:18.669553+0000 front 2019-11-29T21:11:19.271424+0000 (oldest deadline 2019-11-29T21:12:03.301175+0000) 2019-11-29T21:12:07.506 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:12:07.501+0000 1694c700 -1 osd.4 282 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:16.320933+0000 front 2019-11-29T21:11:16.372641+0000 (oldest deadline 2019-11-29T21:12:01.843111+0000) 2019-11-29T21:12:07.539 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:12:07.532+0000 1694c700 -1 osd.2 282 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:16.889090+0000 front 2019-11-29T21:11:16.369878+0000 (oldest deadline 2019-11-29T21:12:02.068366+0000) 2019-11-29T21:12:07.855 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:12:07.849+0000 1694c700 -1 osd.7 282 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:18.752655+0000 front 2019-11-29T21:11:18.632138+0000 (oldest deadline 2019-11-29T21:12:04.472776+0000) 2019-11-29T21:12:07.899 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:12:07.893+0000 1694c700 -1 osd.1 282 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:21.393313+0000 front 2019-11-29T21:11:21.431973+0000 (oldest deadline 2019-11-29T21:12:05.990591+0000) 2019-11-29T21:12:07.900 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:12:07.894+0000 1694c700 -1 osd.1 282 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130523 7.0 7:05588ce8:lc::lc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected e274) 2019-11-29T21:12:08.397 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:12:08.390+0000 1694c700 -1 osd.6 282 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:18.409835+0000 front 2019-11-29T21:11:18.823976+0000 (oldest deadline 2019-11-29T21:12:04.201710+0000) 2019-11-29T21:12:08.397 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:12:08.391+0000 1694c700 -1 osd.6 282 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:121744 6.8 6:1adc68c2:root::.bucket.meta.efa89e82fef944908f84171016951717%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.619:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e272) 2019-11-29T21:12:08.515 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:12:08.509+0000 1694c700 -1 osd.4 282 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:16.320933+0000 front 2019-11-29T21:11:16.372641+0000 (oldest deadline 2019-11-29T21:12:01.843111+0000) 2019-11-29T21:12:08.547 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:12:08.541+0000 1694c700 -1 osd.2 282 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:16.889090+0000 front 2019-11-29T21:11:16.369878+0000 (oldest deadline 2019-11-29T21:12:02.068366+0000) 2019-11-29T21:12:08.554 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:12:08.547+0000 1694c700 -1 osd.0 282 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:18.669553+0000 front 2019-11-29T21:11:19.271424+0000 (oldest deadline 2019-11-29T21:12:03.301175+0000) 2019-11-29T21:12:08.851 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:12:08.845+0000 1694c700 -1 osd.7 282 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:18.752655+0000 front 2019-11-29T21:11:18.632138+0000 (oldest deadline 2019-11-29T21:12:04.472776+0000) 2019-11-29T21:12:08.950 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:12:08.944+0000 1694c700 -1 osd.1 282 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:21.393313+0000 front 2019-11-29T21:11:21.431973+0000 (oldest deadline 2019-11-29T21:12:05.990591+0000) 2019-11-29T21:12:08.953 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:12:08.946+0000 1694c700 -1 osd.1 282 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130523 7.0 7:05588ce8:lc::lc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected e274) 2019-11-29T21:12:09.428 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:12:09.422+0000 1694c700 -1 osd.6 282 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:18.409835+0000 front 2019-11-29T21:11:18.823976+0000 (oldest deadline 2019-11-29T21:12:04.201710+0000) 2019-11-29T21:12:09.429 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:12:09.423+0000 1694c700 -1 osd.6 282 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:121744 6.8 6:1adc68c2:root::.bucket.meta.efa89e82fef944908f84171016951717%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.619:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e272) 2019-11-29T21:12:09.541 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:12:09.536+0000 1694c700 -1 osd.2 282 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:16.889090+0000 front 2019-11-29T21:11:16.369878+0000 (oldest deadline 2019-11-29T21:12:02.068366+0000) 2019-11-29T21:12:09.556 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:12:09.550+0000 1694c700 -1 osd.4 282 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:16.320933+0000 front 2019-11-29T21:11:16.372641+0000 (oldest deadline 2019-11-29T21:12:01.843111+0000) 2019-11-29T21:12:09.567 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:12:09.561+0000 1694c700 -1 osd.0 282 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:18.669553+0000 front 2019-11-29T21:11:19.271424+0000 (oldest deadline 2019-11-29T21:12:03.301175+0000) 2019-11-29T21:12:09.834 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:12:09.828+0000 1694c700 -1 osd.7 282 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:18.752655+0000 front 2019-11-29T21:11:18.632138+0000 (oldest deadline 2019-11-29T21:12:04.472776+0000) 2019-11-29T21:12:09.917 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:12:09.899+0000 1694c700 -1 osd.1 282 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:21.393313+0000 front 2019-11-29T21:11:21.431973+0000 (oldest deadline 2019-11-29T21:12:05.990591+0000) 2019-11-29T21:12:09.917 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:12:09.901+0000 1694c700 -1 osd.1 282 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130523 7.0 7:05588ce8:lc::lc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected e274) 2019-11-29T21:12:10.439 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:12:10.432+0000 1694c700 -1 osd.6 282 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:18.409835+0000 front 2019-11-29T21:11:18.823976+0000 (oldest deadline 2019-11-29T21:12:04.201710+0000) 2019-11-29T21:12:10.440 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:12:10.433+0000 1694c700 -1 osd.6 282 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:121744 6.8 6:1adc68c2:root::.bucket.meta.efa89e82fef944908f84171016951717%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.619:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e272) 2019-11-29T21:12:10.507 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:12:10.502+0000 1694c700 -1 osd.2 282 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:16.889090+0000 front 2019-11-29T21:11:16.369878+0000 (oldest deadline 2019-11-29T21:12:02.068366+0000) 2019-11-29T21:12:10.577 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:12:10.571+0000 1694c700 -1 osd.0 282 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:18.669553+0000 front 2019-11-29T21:11:19.271424+0000 (oldest deadline 2019-11-29T21:12:03.301175+0000) 2019-11-29T21:12:10.578 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:12:10.570+0000 1694c700 -1 osd.4 282 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:16.320933+0000 front 2019-11-29T21:11:16.372641+0000 (oldest deadline 2019-11-29T21:12:01.843111+0000) 2019-11-29T21:12:10.863 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:12:10.854+0000 1694c700 -1 osd.7 282 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:18.752655+0000 front 2019-11-29T21:11:18.632138+0000 (oldest deadline 2019-11-29T21:12:04.472776+0000) 2019-11-29T21:12:10.917 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:12:10.912+0000 1694c700 -1 osd.1 282 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:21.393313+0000 front 2019-11-29T21:11:21.431973+0000 (oldest deadline 2019-11-29T21:12:05.990591+0000) 2019-11-29T21:12:10.920 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:12:10.915+0000 1694c700 -1 osd.1 282 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130523 7.0 7:05588ce8:lc::lc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected e274) 2019-11-29T21:12:11.449 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:12:11.443+0000 1694c700 -1 osd.6 282 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:18.409835+0000 front 2019-11-29T21:11:18.823976+0000 (oldest deadline 2019-11-29T21:12:04.201710+0000) 2019-11-29T21:12:11.449 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:12:11.444+0000 1694c700 -1 osd.6 282 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:121744 6.8 6:1adc68c2:root::.bucket.meta.efa89e82fef944908f84171016951717%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.619:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e272) 2019-11-29T21:12:11.547 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:12:11.542+0000 1694c700 -1 osd.2 282 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:16.889090+0000 front 2019-11-29T21:11:16.369878+0000 (oldest deadline 2019-11-29T21:12:02.068366+0000) 2019-11-29T21:12:11.547 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:12:11.543+0000 1694c700 -1 osd.0 282 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:18.669553+0000 front 2019-11-29T21:11:19.271424+0000 (oldest deadline 2019-11-29T21:12:03.301175+0000) 2019-11-29T21:12:11.561 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:12:11.555+0000 1694c700 -1 osd.4 282 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:16.320933+0000 front 2019-11-29T21:11:16.372641+0000 (oldest deadline 2019-11-29T21:12:01.843111+0000) 2019-11-29T21:12:11.913 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:12:11.906+0000 1694c700 -1 osd.7 282 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:18.752655+0000 front 2019-11-29T21:11:18.632138+0000 (oldest deadline 2019-11-29T21:12:04.472776+0000) 2019-11-29T21:12:11.932 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:12:11.926+0000 1694c700 -1 osd.1 282 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:21.393313+0000 front 2019-11-29T21:11:21.431973+0000 (oldest deadline 2019-11-29T21:12:05.990591+0000) 2019-11-29T21:12:11.932 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:12:11.927+0000 1694c700 -1 osd.1 282 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130523 7.0 7:05588ce8:lc::lc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected e274) 2019-11-29T21:12:12.465 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:12:12.459+0000 1694c700 -1 osd.6 282 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:18.409835+0000 front 2019-11-29T21:11:18.823976+0000 (oldest deadline 2019-11-29T21:12:04.201710+0000) 2019-11-29T21:12:12.465 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:12:12.460+0000 1694c700 -1 osd.6 282 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:121744 6.8 6:1adc68c2:root::.bucket.meta.efa89e82fef944908f84171016951717%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.619:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e272) 2019-11-29T21:12:12.517 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:12:12.511+0000 1694c700 -1 osd.4 282 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:16.320933+0000 front 2019-11-29T21:11:16.372641+0000 (oldest deadline 2019-11-29T21:12:01.843111+0000) 2019-11-29T21:12:12.523 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:12:12.517+0000 1694c700 -1 osd.0 282 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:18.669553+0000 front 2019-11-29T21:11:19.271424+0000 (oldest deadline 2019-11-29T21:12:03.301175+0000) 2019-11-29T21:12:12.563 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:12:12.556+0000 1694c700 -1 osd.2 282 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:16.889090+0000 front 2019-11-29T21:11:16.369878+0000 (oldest deadline 2019-11-29T21:12:02.068366+0000) 2019-11-29T21:12:12.885 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:12:12.878+0000 1694c700 -1 osd.7 282 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:18.752655+0000 front 2019-11-29T21:11:18.632138+0000 (oldest deadline 2019-11-29T21:12:04.472776+0000) 2019-11-29T21:12:12.887 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:12:12.881+0000 1694c700 -1 osd.1 282 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:21.393313+0000 front 2019-11-29T21:11:21.431973+0000 (oldest deadline 2019-11-29T21:12:05.990591+0000) 2019-11-29T21:12:12.888 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:12:12.883+0000 1694c700 -1 osd.1 282 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130523 7.0 7:05588ce8:lc::lc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected e274) 2019-11-29T21:12:13.514 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:12:13.507+0000 1694c700 -1 osd.6 282 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:18.409835+0000 front 2019-11-29T21:11:18.823976+0000 (oldest deadline 2019-11-29T21:12:04.201710+0000) 2019-11-29T21:12:13.514 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:12:13.508+0000 1694c700 -1 osd.6 282 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:121744 6.8 6:1adc68c2:root::.bucket.meta.efa89e82fef944908f84171016951717%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.619:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e272) 2019-11-29T21:12:13.541 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:12:13.535+0000 1694c700 -1 osd.2 282 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:16.889090+0000 front 2019-11-29T21:11:16.369878+0000 (oldest deadline 2019-11-29T21:12:02.068366+0000) 2019-11-29T21:12:13.551 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:12:13.546+0000 1694c700 -1 osd.0 282 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:18.669553+0000 front 2019-11-29T21:11:19.271424+0000 (oldest deadline 2019-11-29T21:12:03.301175+0000) 2019-11-29T21:12:13.571 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:12:13.564+0000 1694c700 -1 osd.4 282 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:16.320933+0000 front 2019-11-29T21:11:16.372641+0000 (oldest deadline 2019-11-29T21:12:01.843111+0000) 2019-11-29T21:12:13.860 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:12:13.853+0000 1694c700 -1 osd.7 282 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:18.752655+0000 front 2019-11-29T21:11:18.632138+0000 (oldest deadline 2019-11-29T21:12:04.472776+0000) 2019-11-29T21:12:13.897 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:12:13.891+0000 1694c700 -1 osd.1 282 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:21.393313+0000 front 2019-11-29T21:11:21.431973+0000 (oldest deadline 2019-11-29T21:12:05.990591+0000) 2019-11-29T21:12:13.898 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:12:13.893+0000 1694c700 -1 osd.1 282 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130523 7.0 7:05588ce8:lc::lc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected e274) 2019-11-29T21:12:14.536 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:12:14.530+0000 1694c700 -1 osd.6 282 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:18.409835+0000 front 2019-11-29T21:11:18.823976+0000 (oldest deadline 2019-11-29T21:12:04.201710+0000) 2019-11-29T21:12:14.537 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:12:14.531+0000 1694c700 -1 osd.6 282 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:121744 6.8 6:1adc68c2:root::.bucket.meta.efa89e82fef944908f84171016951717%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.619:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e272) 2019-11-29T21:12:14.574 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:12:14.568+0000 1694c700 -1 osd.2 282 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:16.889090+0000 front 2019-11-29T21:11:16.369878+0000 (oldest deadline 2019-11-29T21:12:02.068366+0000) 2019-11-29T21:12:14.583 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:12:14.576+0000 1694c700 -1 osd.4 282 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:16.320933+0000 front 2019-11-29T21:11:16.372641+0000 (oldest deadline 2019-11-29T21:12:01.843111+0000) 2019-11-29T21:12:14.601 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:12:14.595+0000 1694c700 -1 osd.0 282 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:18.669553+0000 front 2019-11-29T21:11:19.271424+0000 (oldest deadline 2019-11-29T21:12:03.301175+0000) 2019-11-29T21:12:14.839 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:12:14.832+0000 1694c700 -1 osd.7 282 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:18.752655+0000 front 2019-11-29T21:11:18.632138+0000 (oldest deadline 2019-11-29T21:12:04.472776+0000) 2019-11-29T21:12:14.898 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:12:14.892+0000 1694c700 -1 osd.1 282 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:21.393313+0000 front 2019-11-29T21:11:21.431973+0000 (oldest deadline 2019-11-29T21:12:05.990591+0000) 2019-11-29T21:12:14.899 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:12:14.894+0000 1694c700 -1 osd.1 282 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130523 7.0 7:05588ce8:lc::lc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected e274) 2019-11-29T21:12:15.568 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:12:15.563+0000 1694c700 -1 osd.0 282 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:18.669553+0000 front 2019-11-29T21:11:19.271424+0000 (oldest deadline 2019-11-29T21:12:03.301175+0000) 2019-11-29T21:12:15.572 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:12:15.566+0000 1694c700 -1 osd.6 282 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:18.409835+0000 front 2019-11-29T21:11:18.823976+0000 (oldest deadline 2019-11-29T21:12:04.201710+0000) 2019-11-29T21:12:15.573 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:12:15.567+0000 1694c700 -1 osd.6 282 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:121744 6.8 6:1adc68c2:root::.bucket.meta.efa89e82fef944908f84171016951717%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.619:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e272) 2019-11-29T21:12:15.595 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:12:15.588+0000 1694c700 -1 osd.2 283 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:16.889090+0000 front 2019-11-29T21:11:16.369878+0000 (oldest deadline 2019-11-29T21:12:02.068366+0000) 2019-11-29T21:12:15.667 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:12:15.635+0000 1694c700 -1 osd.4 283 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:16.320933+0000 front 2019-11-29T21:11:16.372641+0000 (oldest deadline 2019-11-29T21:12:01.843111+0000) 2019-11-29T21:12:15.801 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:12:15.796+0000 1694c700 -1 osd.7 282 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:18.752655+0000 front 2019-11-29T21:11:18.632138+0000 (oldest deadline 2019-11-29T21:12:04.472776+0000) 2019-11-29T21:12:16.079 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:12:15.932+0000 1694c700 -1 osd.1 283 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:21.393313+0000 front 2019-11-29T21:11:21.431973+0000 (oldest deadline 2019-11-29T21:12:05.990591+0000) 2019-11-29T21:12:16.097 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:12:16.013+0000 1694c700 -1 osd.1 283 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130523 7.0 7:05588ce8:lc::lc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected e274) 2019-11-29T21:12:16.548 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:12:16.543+0000 1694c700 -1 osd.0 283 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:18.669553+0000 front 2019-11-29T21:11:19.271424+0000 (oldest deadline 2019-11-29T21:12:03.301175+0000) 2019-11-29T21:12:16.559 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:12:16.553+0000 1694c700 -1 osd.6 283 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:18.409835+0000 front 2019-11-29T21:11:18.823976+0000 (oldest deadline 2019-11-29T21:12:04.201710+0000) 2019-11-29T21:12:16.559 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:12:16.554+0000 1694c700 -1 osd.6 283 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:121744 6.8 6:1adc68c2:root::.bucket.meta.efa89e82fef944908f84171016951717%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.619:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e272) 2019-11-29T21:12:16.582 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:12:16.577+0000 1694c700 -1 osd.2 283 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:16.889090+0000 front 2019-11-29T21:11:16.369878+0000 (oldest deadline 2019-11-29T21:12:02.068366+0000) 2019-11-29T21:12:16.646 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:12:16.640+0000 1694c700 -1 osd.4 283 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:16.320933+0000 front 2019-11-29T21:11:16.372641+0000 (oldest deadline 2019-11-29T21:12:01.843111+0000) 2019-11-29T21:12:16.772 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:12:16.766+0000 1694c700 -1 osd.7 283 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:18.752655+0000 front 2019-11-29T21:11:18.632138+0000 (oldest deadline 2019-11-29T21:12:04.472776+0000) 2019-11-29T21:12:17.044 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:12:17.039+0000 1694c700 -1 osd.1 283 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:21.393313+0000 front 2019-11-29T21:11:21.431973+0000 (oldest deadline 2019-11-29T21:12:05.990591+0000) 2019-11-29T21:12:17.045 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:12:17.040+0000 1694c700 -1 osd.1 283 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130523 7.0 7:05588ce8:lc::lc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected e274) 2019-11-29T21:12:17.521 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:12:17.515+0000 1694c700 -1 osd.0 283 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:18.669553+0000 front 2019-11-29T21:11:19.271424+0000 (oldest deadline 2019-11-29T21:12:03.301175+0000) 2019-11-29T21:12:17.578 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:12:17.570+0000 1694c700 -1 osd.6 283 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:18.409835+0000 front 2019-11-29T21:11:18.823976+0000 (oldest deadline 2019-11-29T21:12:04.201710+0000) 2019-11-29T21:12:17.578 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:12:17.571+0000 1694c700 -1 osd.6 283 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:121744 6.8 6:1adc68c2:root::.bucket.meta.efa89e82fef944908f84171016951717%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.619:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e272) 2019-11-29T21:12:17.606 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:12:17.601+0000 1694c700 -1 osd.2 283 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:16.889090+0000 front 2019-11-29T21:11:16.369878+0000 (oldest deadline 2019-11-29T21:12:02.068366+0000) 2019-11-29T21:12:17.693 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:12:17.687+0000 1694c700 -1 osd.4 283 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:16.320933+0000 front 2019-11-29T21:11:16.372641+0000 (oldest deadline 2019-11-29T21:12:01.843111+0000) 2019-11-29T21:12:17.746 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:12:17.740+0000 1694c700 -1 osd.7 283 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:18.752655+0000 front 2019-11-29T21:11:18.632138+0000 (oldest deadline 2019-11-29T21:12:04.472776+0000) 2019-11-29T21:12:18.090 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:12:18.085+0000 1694c700 -1 osd.1 283 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:21.393313+0000 front 2019-11-29T21:11:21.431973+0000 (oldest deadline 2019-11-29T21:12:05.990591+0000) 2019-11-29T21:12:18.093 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:12:18.089+0000 1694c700 -1 osd.1 283 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130523 7.0 7:05588ce8:lc::lc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected e274) 2019-11-29T21:12:18.550 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:12:18.544+0000 1694c700 -1 osd.0 283 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:18.669553+0000 front 2019-11-29T21:11:19.271424+0000 (oldest deadline 2019-11-29T21:12:03.301175+0000) 2019-11-29T21:12:18.584 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:12:18.578+0000 1694c700 -1 osd.2 283 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:16.889090+0000 front 2019-11-29T21:11:16.369878+0000 (oldest deadline 2019-11-29T21:12:02.068366+0000) 2019-11-29T21:12:18.615 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:12:18.609+0000 1694c700 -1 osd.6 283 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:18.409835+0000 front 2019-11-29T21:11:18.823976+0000 (oldest deadline 2019-11-29T21:12:04.201710+0000) 2019-11-29T21:12:18.616 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:12:18.610+0000 1694c700 -1 osd.6 283 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:121744 6.8 6:1adc68c2:root::.bucket.meta.efa89e82fef944908f84171016951717%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.619:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e272) 2019-11-29T21:12:18.743 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:12:18.737+0000 1694c700 -1 osd.4 283 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:16.320933+0000 front 2019-11-29T21:11:16.372641+0000 (oldest deadline 2019-11-29T21:12:01.843111+0000) 2019-11-29T21:12:18.770 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:12:18.764+0000 1694c700 -1 osd.7 283 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:18.752655+0000 front 2019-11-29T21:11:18.632138+0000 (oldest deadline 2019-11-29T21:12:04.472776+0000) 2019-11-29T21:12:19.125 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:12:19.098+0000 1694c700 -1 osd.1 283 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:21.393313+0000 front 2019-11-29T21:11:21.431973+0000 (oldest deadline 2019-11-29T21:12:05.990591+0000) 2019-11-29T21:12:19.127 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:12:19.101+0000 1694c700 -1 osd.1 283 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130523 7.0 7:05588ce8:lc::lc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected e274) 2019-11-29T21:12:19.563 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:12:19.558+0000 1694c700 -1 osd.0 283 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:18.669553+0000 front 2019-11-29T21:11:19.271424+0000 (oldest deadline 2019-11-29T21:12:03.301175+0000) 2019-11-29T21:12:19.592 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:12:19.587+0000 1694c700 -1 osd.2 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:16.889090+0000 front 2019-11-29T21:11:16.369878+0000 (oldest deadline 2019-11-29T21:12:02.068366+0000) 2019-11-29T21:12:19.607 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:12:19.600+0000 1694c700 -1 osd.6 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:18.409835+0000 front 2019-11-29T21:11:18.823976+0000 (oldest deadline 2019-11-29T21:12:04.201710+0000) 2019-11-29T21:12:19.607 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:12:19.601+0000 1694c700 -1 osd.6 284 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:121744 6.8 6:1adc68c2:root::.bucket.meta.efa89e82fef944908f84171016951717%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.619:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e272) 2019-11-29T21:12:19.834 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:12:19.771+0000 1694c700 -1 osd.7 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:18.752655+0000 front 2019-11-29T21:11:18.632138+0000 (oldest deadline 2019-11-29T21:12:04.472776+0000) 2019-11-29T21:12:19.905 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:12:19.822+0000 1694c700 -1 osd.4 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:16.320933+0000 front 2019-11-29T21:11:16.372641+0000 (oldest deadline 2019-11-29T21:12:01.843111+0000) 2019-11-29T21:12:20.122 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:12:20.116+0000 1694c700 -1 osd.1 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:21.393313+0000 front 2019-11-29T21:11:21.431973+0000 (oldest deadline 2019-11-29T21:12:05.990591+0000) 2019-11-29T21:12:20.123 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:12:20.118+0000 1694c700 -1 osd.1 284 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130523 7.0 7:05588ce8:lc::lc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected e274) 2019-11-29T21:12:20.553 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:12:20.548+0000 1694c700 -1 osd.0 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:18.669553+0000 front 2019-11-29T21:11:19.271424+0000 (oldest deadline 2019-11-29T21:12:03.301175+0000) 2019-11-29T21:12:20.596 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:12:20.590+0000 1694c700 -1 osd.2 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:16.889090+0000 front 2019-11-29T21:11:16.369878+0000 (oldest deadline 2019-11-29T21:12:02.068366+0000) 2019-11-29T21:12:20.649 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:12:20.643+0000 1694c700 -1 osd.6 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:18.409835+0000 front 2019-11-29T21:11:18.823976+0000 (oldest deadline 2019-11-29T21:12:04.201710+0000) 2019-11-29T21:12:20.650 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:12:20.645+0000 1694c700 -1 osd.6 284 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:121744 6.8 6:1adc68c2:root::.bucket.meta.efa89e82fef944908f84171016951717%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.619:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e272) 2019-11-29T21:12:20.805 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:12:20.798+0000 1694c700 -1 osd.4 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:16.320933+0000 front 2019-11-29T21:11:16.372641+0000 (oldest deadline 2019-11-29T21:12:01.843111+0000) 2019-11-29T21:12:20.831 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:12:20.826+0000 1694c700 -1 osd.7 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:18.752655+0000 front 2019-11-29T21:11:18.632138+0000 (oldest deadline 2019-11-29T21:12:04.472776+0000) 2019-11-29T21:12:21.180 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:12:21.166+0000 1694c700 -1 osd.1 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:21.393313+0000 front 2019-11-29T21:11:21.431973+0000 (oldest deadline 2019-11-29T21:12:05.990591+0000) 2019-11-29T21:12:21.181 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:12:21.167+0000 1694c700 -1 osd.1 284 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130523 7.0 7:05588ce8:lc::lc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected e274) 2019-11-29T21:12:21.541 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:12:21.537+0000 1694c700 -1 osd.0 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:18.669553+0000 front 2019-11-29T21:11:19.271424+0000 (oldest deadline 2019-11-29T21:12:03.301175+0000) 2019-11-29T21:12:21.644 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:12:21.639+0000 1694c700 -1 osd.2 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:16.889090+0000 front 2019-11-29T21:11:16.369878+0000 (oldest deadline 2019-11-29T21:12:02.068366+0000) 2019-11-29T21:12:21.674 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:12:21.668+0000 1694c700 -1 osd.6 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:18.409835+0000 front 2019-11-29T21:11:18.823976+0000 (oldest deadline 2019-11-29T21:12:04.201710+0000) 2019-11-29T21:12:21.674 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:12:21.669+0000 1694c700 -1 osd.6 284 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:121744 6.8 6:1adc68c2:root::.bucket.meta.efa89e82fef944908f84171016951717%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.619:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e272) 2019-11-29T21:12:21.815 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:12:21.809+0000 1694c700 -1 osd.7 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:18.752655+0000 front 2019-11-29T21:11:18.632138+0000 (oldest deadline 2019-11-29T21:12:04.472776+0000) 2019-11-29T21:12:21.822 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:12:21.816+0000 1694c700 -1 osd.4 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:16.320933+0000 front 2019-11-29T21:11:16.372641+0000 (oldest deadline 2019-11-29T21:12:01.843111+0000) 2019-11-29T21:12:22.129 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:12:22.123+0000 1694c700 -1 osd.1 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:21.393313+0000 front 2019-11-29T21:11:21.431973+0000 (oldest deadline 2019-11-29T21:12:05.990591+0000) 2019-11-29T21:12:22.132 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:12:22.128+0000 1694c700 -1 osd.1 284 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130523 7.0 7:05588ce8:lc::lc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected e274) 2019-11-29T21:12:22.578 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:12:22.572+0000 1694c700 -1 osd.0 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:18.669553+0000 front 2019-11-29T21:11:19.271424+0000 (oldest deadline 2019-11-29T21:12:03.301175+0000) 2019-11-29T21:12:22.636 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:12:22.630+0000 1694c700 -1 osd.2 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:16.889090+0000 front 2019-11-29T21:11:16.369878+0000 (oldest deadline 2019-11-29T21:12:02.068366+0000) 2019-11-29T21:12:22.637 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:12:22.632+0000 1694c700 -1 osd.6 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:18.409835+0000 front 2019-11-29T21:11:18.823976+0000 (oldest deadline 2019-11-29T21:12:04.201710+0000) 2019-11-29T21:12:22.638 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:12:22.634+0000 1694c700 -1 osd.6 284 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:121744 6.8 6:1adc68c2:root::.bucket.meta.efa89e82fef944908f84171016951717%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.619:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e272) 2019-11-29T21:12:22.840 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:12:22.835+0000 1694c700 -1 osd.4 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:16.320933+0000 front 2019-11-29T21:11:16.372641+0000 (oldest deadline 2019-11-29T21:12:01.843111+0000) 2019-11-29T21:12:22.843 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:12:22.838+0000 1694c700 -1 osd.7 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:18.752655+0000 front 2019-11-29T21:11:18.632138+0000 (oldest deadline 2019-11-29T21:12:04.472776+0000) 2019-11-29T21:12:23.161 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:12:23.155+0000 1694c700 -1 osd.1 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:21.393313+0000 front 2019-11-29T21:11:21.431973+0000 (oldest deadline 2019-11-29T21:12:05.990591+0000) 2019-11-29T21:12:23.164 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:12:23.159+0000 1694c700 -1 osd.1 284 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130523 7.0 7:05588ce8:lc::lc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected e274) 2019-11-29T21:12:23.617 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:12:23.611+0000 1694c700 -1 osd.6 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:18.409835+0000 front 2019-11-29T21:11:18.823976+0000 (oldest deadline 2019-11-29T21:12:04.201710+0000) 2019-11-29T21:12:23.618 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:12:23.613+0000 1694c700 -1 osd.6 284 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:121744 6.8 6:1adc68c2:root::.bucket.meta.efa89e82fef944908f84171016951717%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.619:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e272) 2019-11-29T21:12:23.631 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:12:23.620+0000 1694c700 -1 osd.0 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:18.669553+0000 front 2019-11-29T21:11:19.271424+0000 (oldest deadline 2019-11-29T21:12:03.301175+0000) 2019-11-29T21:12:23.673 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:12:23.666+0000 1694c700 -1 osd.2 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:16.889090+0000 front 2019-11-29T21:11:16.369878+0000 (oldest deadline 2019-11-29T21:12:02.068366+0000) 2019-11-29T21:12:23.829 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:12:23.816+0000 1694c700 -1 osd.4 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:16.320933+0000 front 2019-11-29T21:11:16.372641+0000 (oldest deadline 2019-11-29T21:12:01.843111+0000) 2019-11-29T21:12:23.871 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:12:23.864+0000 1694c700 -1 osd.7 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:18.752655+0000 front 2019-11-29T21:11:18.632138+0000 (oldest deadline 2019-11-29T21:12:04.472776+0000) 2019-11-29T21:12:24.160 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:12:24.155+0000 1694c700 -1 osd.1 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:21.393313+0000 front 2019-11-29T21:11:21.431973+0000 (oldest deadline 2019-11-29T21:12:05.990591+0000) 2019-11-29T21:12:24.161 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:12:24.156+0000 1694c700 -1 osd.1 284 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130523 7.0 7:05588ce8:lc::lc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected e274) 2019-11-29T21:12:24.663 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:12:24.658+0000 1694c700 -1 osd.6 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:18.409835+0000 front 2019-11-29T21:11:18.823976+0000 (oldest deadline 2019-11-29T21:12:04.201710+0000) 2019-11-29T21:12:24.664 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:12:24.659+0000 1694c700 -1 osd.6 284 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:121744 6.8 6:1adc68c2:root::.bucket.meta.efa89e82fef944908f84171016951717%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.619:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e272) 2019-11-29T21:12:24.673 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:12:24.664+0000 1694c700 -1 osd.0 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:18.669553+0000 front 2019-11-29T21:11:19.271424+0000 (oldest deadline 2019-11-29T21:12:03.301175+0000) 2019-11-29T21:12:24.679 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:12:24.674+0000 1694c700 -1 osd.2 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:16.889090+0000 front 2019-11-29T21:11:16.369878+0000 (oldest deadline 2019-11-29T21:12:02.068366+0000) 2019-11-29T21:12:24.840 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:12:24.834+0000 1694c700 -1 osd.4 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:16.320933+0000 front 2019-11-29T21:11:16.372641+0000 (oldest deadline 2019-11-29T21:12:01.843111+0000) 2019-11-29T21:12:24.869 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:12:24.864+0000 1694c700 -1 osd.7 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:18.752655+0000 front 2019-11-29T21:11:18.632138+0000 (oldest deadline 2019-11-29T21:12:04.472776+0000) 2019-11-29T21:12:25.134 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:12:25.128+0000 1694c700 -1 osd.1 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:21.393313+0000 front 2019-11-29T21:11:21.431973+0000 (oldest deadline 2019-11-29T21:12:05.990591+0000) 2019-11-29T21:12:25.135 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:12:25.130+0000 1694c700 -1 osd.1 284 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130523 7.0 7:05588ce8:lc::lc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected e274) 2019-11-29T21:12:25.672 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:12:25.666+0000 1694c700 -1 osd.6 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:18.409835+0000 front 2019-11-29T21:11:18.823976+0000 (oldest deadline 2019-11-29T21:12:04.201710+0000) 2019-11-29T21:12:25.714 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:12:25.686+0000 1694c700 -1 osd.0 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:18.669553+0000 front 2019-11-29T21:11:19.271424+0000 (oldest deadline 2019-11-29T21:12:03.301175+0000) 2019-11-29T21:12:25.715 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:12:25.668+0000 1694c700 -1 osd.6 284 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:121744 6.8 6:1adc68c2:root::.bucket.meta.efa89e82fef944908f84171016951717%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.619:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e272) 2019-11-29T21:12:25.735 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:12:25.726+0000 1694c700 -1 osd.2 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:16.889090+0000 front 2019-11-29T21:11:16.369878+0000 (oldest deadline 2019-11-29T21:12:02.068366+0000) 2019-11-29T21:12:25.871 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:12:25.865+0000 1694c700 -1 osd.4 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:16.320933+0000 front 2019-11-29T21:11:16.372641+0000 (oldest deadline 2019-11-29T21:12:01.843111+0000) 2019-11-29T21:12:25.923 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:12:25.907+0000 1694c700 -1 osd.7 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:18.752655+0000 front 2019-11-29T21:11:18.632138+0000 (oldest deadline 2019-11-29T21:12:04.472776+0000) 2019-11-29T21:12:26.097 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:12:26.091+0000 1694c700 -1 osd.1 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:21.393313+0000 front 2019-11-29T21:11:21.431973+0000 (oldest deadline 2019-11-29T21:12:05.990591+0000) 2019-11-29T21:12:26.097 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:12:26.093+0000 1694c700 -1 osd.1 284 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130523 7.0 7:05588ce8:lc::lc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected e274) 2019-11-29T21:12:26.673 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:12:26.667+0000 1694c700 -1 osd.0 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:18.669553+0000 front 2019-11-29T21:11:19.271424+0000 (oldest deadline 2019-11-29T21:12:03.301175+0000) 2019-11-29T21:12:26.703 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:12:26.698+0000 1694c700 -1 osd.6 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:18.409835+0000 front 2019-11-29T21:11:18.823976+0000 (oldest deadline 2019-11-29T21:12:04.201710+0000) 2019-11-29T21:12:26.704 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:12:26.699+0000 1694c700 -1 osd.6 284 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:121744 6.8 6:1adc68c2:root::.bucket.meta.efa89e82fef944908f84171016951717%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.619:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e272) 2019-11-29T21:12:26.767 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:12:26.762+0000 1694c700 -1 osd.2 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:16.889090+0000 front 2019-11-29T21:11:16.369878+0000 (oldest deadline 2019-11-29T21:12:02.068366+0000) 2019-11-29T21:12:26.925 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:12:26.920+0000 1694c700 -1 osd.4 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:16.320933+0000 front 2019-11-29T21:11:16.372641+0000 (oldest deadline 2019-11-29T21:12:01.843111+0000) 2019-11-29T21:12:26.931 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:12:26.922+0000 1694c700 -1 osd.7 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:18.752655+0000 front 2019-11-29T21:11:18.632138+0000 (oldest deadline 2019-11-29T21:12:04.472776+0000) 2019-11-29T21:12:27.071 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:12:27.066+0000 1694c700 -1 osd.1 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:21.393313+0000 front 2019-11-29T21:11:21.431973+0000 (oldest deadline 2019-11-29T21:12:05.990591+0000) 2019-11-29T21:12:27.073 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:12:27.069+0000 1694c700 -1 osd.1 284 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130523 7.0 7:05588ce8:lc::lc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected e274) 2019-11-29T21:12:27.702 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:12:27.696+0000 1694c700 -1 osd.0 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:18.669553+0000 front 2019-11-29T21:11:19.271424+0000 (oldest deadline 2019-11-29T21:12:03.301175+0000) 2019-11-29T21:12:27.725 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:12:27.718+0000 1694c700 -1 osd.2 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:16.889090+0000 front 2019-11-29T21:11:16.369878+0000 (oldest deadline 2019-11-29T21:12:02.068366+0000) 2019-11-29T21:12:27.747 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:12:27.741+0000 1694c700 -1 osd.6 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:18.409835+0000 front 2019-11-29T21:11:18.823976+0000 (oldest deadline 2019-11-29T21:12:04.201710+0000) 2019-11-29T21:12:27.747 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:12:27.743+0000 1694c700 -1 osd.6 284 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:121744 6.8 6:1adc68c2:root::.bucket.meta.efa89e82fef944908f84171016951717%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.619:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e272) 2019-11-29T21:12:27.903 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:12:27.898+0000 1694c700 -1 osd.4 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:16.320933+0000 front 2019-11-29T21:11:16.372641+0000 (oldest deadline 2019-11-29T21:12:01.843111+0000) 2019-11-29T21:12:27.963 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:12:27.957+0000 1694c700 -1 osd.7 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:18.752655+0000 front 2019-11-29T21:11:18.632138+0000 (oldest deadline 2019-11-29T21:12:04.472776+0000) 2019-11-29T21:12:28.121 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:12:28.116+0000 1694c700 -1 osd.1 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:21.393313+0000 front 2019-11-29T21:11:21.431973+0000 (oldest deadline 2019-11-29T21:12:05.990591+0000) 2019-11-29T21:12:28.124 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:12:28.119+0000 1694c700 -1 osd.1 284 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130523 7.0 7:05588ce8:lc::lc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected e274) 2019-11-29T21:12:28.727 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:12:28.722+0000 1694c700 -1 osd.0 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:18.669553+0000 front 2019-11-29T21:11:19.271424+0000 (oldest deadline 2019-11-29T21:12:03.301175+0000) 2019-11-29T21:12:28.765 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:12:28.759+0000 1694c700 -1 osd.2 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:16.889090+0000 front 2019-11-29T21:11:16.369878+0000 (oldest deadline 2019-11-29T21:12:02.068366+0000) 2019-11-29T21:12:28.772 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:12:28.766+0000 1694c700 -1 osd.6 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:18.409835+0000 front 2019-11-29T21:11:18.823976+0000 (oldest deadline 2019-11-29T21:12:04.201710+0000) 2019-11-29T21:12:28.773 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:12:28.768+0000 1694c700 -1 osd.6 284 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:121744 6.8 6:1adc68c2:root::.bucket.meta.efa89e82fef944908f84171016951717%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.619:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e272) 2019-11-29T21:12:28.920 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:12:28.911+0000 1694c700 -1 osd.7 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:18.752655+0000 front 2019-11-29T21:11:18.632138+0000 (oldest deadline 2019-11-29T21:12:04.472776+0000) 2019-11-29T21:12:28.929 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:12:28.924+0000 1694c700 -1 osd.4 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:16.320933+0000 front 2019-11-29T21:11:16.372641+0000 (oldest deadline 2019-11-29T21:12:01.843111+0000) 2019-11-29T21:12:29.172 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:12:29.167+0000 1694c700 -1 osd.1 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:21.393313+0000 front 2019-11-29T21:11:21.431973+0000 (oldest deadline 2019-11-29T21:12:05.990591+0000) 2019-11-29T21:12:29.173 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:12:29.168+0000 1694c700 -1 osd.1 284 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130523 7.0 7:05588ce8:lc::lc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected e274) 2019-11-29T21:12:29.733 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:12:29.727+0000 1694c700 -1 osd.2 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:16.889090+0000 front 2019-11-29T21:11:16.369878+0000 (oldest deadline 2019-11-29T21:12:02.068366+0000) 2019-11-29T21:12:29.751 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:12:29.745+0000 1694c700 -1 osd.6 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:18.409835+0000 front 2019-11-29T21:11:18.823976+0000 (oldest deadline 2019-11-29T21:12:04.201710+0000) 2019-11-29T21:12:29.752 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:12:29.747+0000 1694c700 -1 osd.6 284 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:121744 6.8 6:1adc68c2:root::.bucket.meta.efa89e82fef944908f84171016951717%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.619:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e272) 2019-11-29T21:12:29.762 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:12:29.757+0000 1694c700 -1 osd.0 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:18.669553+0000 front 2019-11-29T21:11:19.271424+0000 (oldest deadline 2019-11-29T21:12:03.301175+0000) 2019-11-29T21:12:29.941 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:12:29.937+0000 1694c700 -1 osd.7 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:18.752655+0000 front 2019-11-29T21:11:18.632138+0000 (oldest deadline 2019-11-29T21:12:04.472776+0000) 2019-11-29T21:12:29.942 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:12:29.937+0000 1694c700 -1 osd.4 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:16.320933+0000 front 2019-11-29T21:11:16.372641+0000 (oldest deadline 2019-11-29T21:12:01.843111+0000) 2019-11-29T21:12:30.211 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:12:30.204+0000 1694c700 -1 osd.1 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:21.393313+0000 front 2019-11-29T21:11:21.431973+0000 (oldest deadline 2019-11-29T21:12:05.990591+0000) 2019-11-29T21:12:30.212 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:12:30.207+0000 1694c700 -1 osd.1 284 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130523 7.0 7:05588ce8:lc::lc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected e274) 2019-11-29T21:12:30.762 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:12:30.756+0000 1694c700 -1 osd.6 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:18.409835+0000 front 2019-11-29T21:11:18.823976+0000 (oldest deadline 2019-11-29T21:12:04.201710+0000) 2019-11-29T21:12:30.763 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:12:30.758+0000 1694c700 -1 osd.6 284 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:121744 6.8 6:1adc68c2:root::.bucket.meta.efa89e82fef944908f84171016951717%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.619:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e272) 2019-11-29T21:12:30.772 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:12:30.767+0000 1694c700 -1 osd.2 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:16.889090+0000 front 2019-11-29T21:11:16.369878+0000 (oldest deadline 2019-11-29T21:12:02.068366+0000) 2019-11-29T21:12:30.804 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:12:30.799+0000 1694c700 -1 osd.0 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:18.669553+0000 front 2019-11-29T21:11:19.271424+0000 (oldest deadline 2019-11-29T21:12:03.301175+0000) 2019-11-29T21:12:30.925 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:12:30.919+0000 1694c700 -1 osd.4 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:16.320933+0000 front 2019-11-29T21:11:16.372641+0000 (oldest deadline 2019-11-29T21:12:01.843111+0000) 2019-11-29T21:12:30.963 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:12:30.957+0000 1694c700 -1 osd.7 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:18.752655+0000 front 2019-11-29T21:11:18.632138+0000 (oldest deadline 2019-11-29T21:12:04.472776+0000) 2019-11-29T21:12:31.176 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:12:31.170+0000 1694c700 -1 osd.1 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:21.393313+0000 front 2019-11-29T21:11:21.431973+0000 (oldest deadline 2019-11-29T21:12:05.990591+0000) 2019-11-29T21:12:31.177 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:12:31.172+0000 1694c700 -1 osd.1 284 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130523 7.0 7:05588ce8:lc::lc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected e274) 2019-11-29T21:12:31.745 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:12:31.740+0000 1694c700 -1 osd.2 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:16.889090+0000 front 2019-11-29T21:11:16.369878+0000 (oldest deadline 2019-11-29T21:12:02.068366+0000) 2019-11-29T21:12:31.774 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:12:31.769+0000 1694c700 -1 osd.0 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:18.669553+0000 front 2019-11-29T21:11:19.271424+0000 (oldest deadline 2019-11-29T21:12:03.301175+0000) 2019-11-29T21:12:31.808 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:12:31.802+0000 1694c700 -1 osd.6 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:18.409835+0000 front 2019-11-29T21:11:18.823976+0000 (oldest deadline 2019-11-29T21:12:04.201710+0000) 2019-11-29T21:12:31.809 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:12:31.804+0000 1694c700 -1 osd.6 284 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:121744 6.8 6:1adc68c2:root::.bucket.meta.efa89e82fef944908f84171016951717%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.619:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e272) 2019-11-29T21:12:31.886 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:12:31.881+0000 1694c700 -1 osd.4 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:16.320933+0000 front 2019-11-29T21:11:16.372641+0000 (oldest deadline 2019-11-29T21:12:01.843111+0000) 2019-11-29T21:12:31.979 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:12:31.973+0000 1694c700 -1 osd.7 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:18.752655+0000 front 2019-11-29T21:11:18.632138+0000 (oldest deadline 2019-11-29T21:12:04.472776+0000) 2019-11-29T21:12:32.142 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:12:32.137+0000 1694c700 -1 osd.1 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:21.393313+0000 front 2019-11-29T21:11:21.431973+0000 (oldest deadline 2019-11-29T21:12:05.990591+0000) 2019-11-29T21:12:32.145 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:12:32.141+0000 1694c700 -1 osd.1 284 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130523 7.0 7:05588ce8:lc::lc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected e274) 2019-11-29T21:12:32.783 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:12:32.778+0000 1694c700 -1 osd.2 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:16.889090+0000 front 2019-11-29T21:11:16.369878+0000 (oldest deadline 2019-11-29T21:12:02.068366+0000) 2019-11-29T21:12:32.793 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:12:32.788+0000 1694c700 -1 osd.0 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:18.669553+0000 front 2019-11-29T21:11:19.271424+0000 (oldest deadline 2019-11-29T21:12:03.301175+0000) 2019-11-29T21:12:32.833 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:12:32.827+0000 1694c700 -1 osd.6 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:18.409835+0000 front 2019-11-29T21:11:18.823976+0000 (oldest deadline 2019-11-29T21:12:04.201710+0000) 2019-11-29T21:12:32.833 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:12:32.829+0000 1694c700 -1 osd.6 284 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:121744 6.8 6:1adc68c2:root::.bucket.meta.efa89e82fef944908f84171016951717%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.619:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e272) 2019-11-29T21:12:32.911 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:12:32.906+0000 1694c700 -1 osd.4 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:16.320933+0000 front 2019-11-29T21:11:16.372641+0000 (oldest deadline 2019-11-29T21:12:01.843111+0000) 2019-11-29T21:12:32.957 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:12:32.952+0000 1694c700 -1 osd.7 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:18.752655+0000 front 2019-11-29T21:11:18.632138+0000 (oldest deadline 2019-11-29T21:12:04.472776+0000) 2019-11-29T21:12:33.155 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:12:33.149+0000 1694c700 -1 osd.1 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:21.393313+0000 front 2019-11-29T21:11:21.431973+0000 (oldest deadline 2019-11-29T21:12:05.990591+0000) 2019-11-29T21:12:33.156 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:12:33.151+0000 1694c700 -1 osd.1 284 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130523 7.0 7:05588ce8:lc::lc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected e274) 2019-11-29T21:12:33.455 INFO:tasks.ceph.mon.b.smithi022.stderr:2019-11-29T21:12:33.446+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.22:6818/9264,v1:172.21.15.22:6819/9264] for 46sec e282 v282) 2019-11-29T21:12:33.757 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:12:33.751+0000 1694c700 -1 osd.0 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:18.669553+0000 front 2019-11-29T21:11:19.271424+0000 (oldest deadline 2019-11-29T21:12:03.301175+0000) 2019-11-29T21:12:33.807 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:12:33.802+0000 1694c700 -1 osd.2 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:16.889090+0000 front 2019-11-29T21:11:16.369878+0000 (oldest deadline 2019-11-29T21:12:02.068366+0000) 2019-11-29T21:12:33.817 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:12:33.811+0000 1694c700 -1 osd.6 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:18.409835+0000 front 2019-11-29T21:11:18.823976+0000 (oldest deadline 2019-11-29T21:12:04.201710+0000) 2019-11-29T21:12:33.818 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:12:33.813+0000 1694c700 -1 osd.6 284 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:121744 6.8 6:1adc68c2:root::.bucket.meta.efa89e82fef944908f84171016951717%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.619:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e272) 2019-11-29T21:12:33.912 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:12:33.906+0000 1694c700 -1 osd.4 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:16.320933+0000 front 2019-11-29T21:11:16.372641+0000 (oldest deadline 2019-11-29T21:12:01.843111+0000) 2019-11-29T21:12:33.979 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:12:33.973+0000 1694c700 -1 osd.7 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:18.752655+0000 front 2019-11-29T21:11:18.632138+0000 (oldest deadline 2019-11-29T21:12:04.472776+0000) 2019-11-29T21:12:34.202 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:12:34.197+0000 1694c700 -1 osd.1 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:21.393313+0000 front 2019-11-29T21:11:21.431973+0000 (oldest deadline 2019-11-29T21:12:05.990591+0000) 2019-11-29T21:12:34.205 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:12:34.201+0000 1694c700 -1 osd.1 284 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130523 7.0 7:05588ce8:lc::lc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected e274) 2019-11-29T21:12:34.753 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:12:34.747+0000 1694c700 -1 osd.0 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:18.669553+0000 front 2019-11-29T21:11:19.271424+0000 (oldest deadline 2019-11-29T21:12:03.301175+0000) 2019-11-29T21:12:34.779 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:12:34.774+0000 1694c700 -1 osd.2 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:16.889090+0000 front 2019-11-29T21:11:16.369878+0000 (oldest deadline 2019-11-29T21:12:02.068366+0000) 2019-11-29T21:12:34.851 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:12:34.844+0000 1694c700 -1 osd.6 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:18.409835+0000 front 2019-11-29T21:11:18.823976+0000 (oldest deadline 2019-11-29T21:12:04.201710+0000) 2019-11-29T21:12:34.851 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:12:34.845+0000 1694c700 -1 osd.6 284 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:121744 6.8 6:1adc68c2:root::.bucket.meta.efa89e82fef944908f84171016951717%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.619:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e272) 2019-11-29T21:12:34.900 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:12:34.895+0000 1694c700 -1 osd.4 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:16.320933+0000 front 2019-11-29T21:11:16.372641+0000 (oldest deadline 2019-11-29T21:12:01.843111+0000) 2019-11-29T21:12:35.025 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:12:35.019+0000 1694c700 -1 osd.7 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:18.752655+0000 front 2019-11-29T21:11:18.632138+0000 (oldest deadline 2019-11-29T21:12:04.472776+0000) 2019-11-29T21:12:35.237 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:12:35.232+0000 1694c700 -1 osd.1 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:21.393313+0000 front 2019-11-29T21:11:21.431973+0000 (oldest deadline 2019-11-29T21:12:05.990591+0000) 2019-11-29T21:12:35.240 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:12:35.236+0000 1694c700 -1 osd.1 284 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130523 7.0 7:05588ce8:lc::lc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected e274) 2019-11-29T21:12:35.765 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:12:35.759+0000 1694c700 -1 osd.0 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:18.669553+0000 front 2019-11-29T21:11:19.271424+0000 (oldest deadline 2019-11-29T21:12:03.301175+0000) 2019-11-29T21:12:35.831 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:12:35.826+0000 1694c700 -1 osd.2 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:16.889090+0000 front 2019-11-29T21:11:16.369878+0000 (oldest deadline 2019-11-29T21:12:02.068366+0000) 2019-11-29T21:12:35.883 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:12:35.878+0000 1694c700 -1 osd.6 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:18.409835+0000 front 2019-11-29T21:11:18.823976+0000 (oldest deadline 2019-11-29T21:12:04.201710+0000) 2019-11-29T21:12:35.884 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:12:35.879+0000 1694c700 -1 osd.6 284 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:121744 6.8 6:1adc68c2:root::.bucket.meta.efa89e82fef944908f84171016951717%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.619:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e272) 2019-11-29T21:12:35.932 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:12:35.926+0000 1694c700 -1 osd.4 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:16.320933+0000 front 2019-11-29T21:11:16.372641+0000 (oldest deadline 2019-11-29T21:12:01.843111+0000) 2019-11-29T21:12:36.017 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:12:36.012+0000 1694c700 -1 osd.7 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:18.752655+0000 front 2019-11-29T21:11:18.632138+0000 (oldest deadline 2019-11-29T21:12:04.472776+0000) 2019-11-29T21:12:36.259 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:12:36.253+0000 1694c700 -1 osd.1 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:21.393313+0000 front 2019-11-29T21:11:21.431973+0000 (oldest deadline 2019-11-29T21:12:05.990591+0000) 2019-11-29T21:12:36.260 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:12:36.255+0000 1694c700 -1 osd.1 284 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130523 7.0 7:05588ce8:lc::lc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected e274) 2019-11-29T21:12:36.729 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:12:36.723+0000 1694c700 -1 osd.0 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:18.669553+0000 front 2019-11-29T21:11:19.271424+0000 (oldest deadline 2019-11-29T21:12:03.301175+0000) 2019-11-29T21:12:36.836 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:12:36.832+0000 1694c700 -1 osd.2 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:16.889090+0000 front 2019-11-29T21:11:16.369878+0000 (oldest deadline 2019-11-29T21:12:02.068366+0000) 2019-11-29T21:12:36.889 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:12:36.883+0000 1694c700 -1 osd.6 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:18.409835+0000 front 2019-11-29T21:11:18.823976+0000 (oldest deadline 2019-11-29T21:12:04.201710+0000) 2019-11-29T21:12:36.890 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:12:36.885+0000 1694c700 -1 osd.6 284 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:121744 6.8 6:1adc68c2:root::.bucket.meta.efa89e82fef944908f84171016951717%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.619:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e272) 2019-11-29T21:12:36.915 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:12:36.909+0000 1694c700 -1 osd.4 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:16.320933+0000 front 2019-11-29T21:11:16.372641+0000 (oldest deadline 2019-11-29T21:12:01.843111+0000) 2019-11-29T21:12:37.036 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:12:37.031+0000 1694c700 -1 osd.7 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:18.752655+0000 front 2019-11-29T21:11:18.632138+0000 (oldest deadline 2019-11-29T21:12:04.472776+0000) 2019-11-29T21:12:37.259 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:12:37.254+0000 1694c700 -1 osd.1 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:21.393313+0000 front 2019-11-29T21:11:21.431973+0000 (oldest deadline 2019-11-29T21:12:05.990591+0000) 2019-11-29T21:12:37.259 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:12:37.255+0000 1694c700 -1 osd.1 284 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130523 7.0 7:05588ce8:lc::lc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected e274) 2019-11-29T21:12:37.702 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:12:37.698+0000 1694c700 -1 osd.0 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:18.669553+0000 front 2019-11-29T21:11:19.271424+0000 (oldest deadline 2019-11-29T21:12:03.301175+0000) 2019-11-29T21:12:37.851 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:12:37.846+0000 1694c700 -1 osd.2 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:16.889090+0000 front 2019-11-29T21:11:16.369878+0000 (oldest deadline 2019-11-29T21:12:02.068366+0000) 2019-11-29T21:12:37.929 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:12:37.922+0000 1694c700 -1 osd.4 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:16.320933+0000 front 2019-11-29T21:11:16.372641+0000 (oldest deadline 2019-11-29T21:12:01.843111+0000) 2019-11-29T21:12:37.929 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:12:37.923+0000 1694c700 -1 osd.6 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:18.409835+0000 front 2019-11-29T21:11:18.823976+0000 (oldest deadline 2019-11-29T21:12:04.201710+0000) 2019-11-29T21:12:37.929 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:12:37.924+0000 1694c700 -1 osd.6 284 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:121744 6.8 6:1adc68c2:root::.bucket.meta.efa89e82fef944908f84171016951717%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.619:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e272) 2019-11-29T21:12:38.066 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:12:38.060+0000 1694c700 -1 osd.7 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:18.752655+0000 front 2019-11-29T21:11:18.632138+0000 (oldest deadline 2019-11-29T21:12:04.472776+0000) 2019-11-29T21:12:38.300 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:12:38.293+0000 1694c700 -1 osd.1 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:21.393313+0000 front 2019-11-29T21:11:21.431973+0000 (oldest deadline 2019-11-29T21:12:05.990591+0000) 2019-11-29T21:12:38.304 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:12:38.300+0000 1694c700 -1 osd.1 284 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130523 7.0 7:05588ce8:lc::lc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected e274) 2019-11-29T21:12:38.459 INFO:tasks.ceph.mon.b.smithi022.stderr:2019-11-29T21:12:38.456+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.22:6818/9264,v1:172.21.15.22:6819/9264] for 46sec e282 v282) 2019-11-29T21:12:38.726 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:12:38.721+0000 1694c700 -1 osd.0 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:18.669553+0000 front 2019-11-29T21:11:19.271424+0000 (oldest deadline 2019-11-29T21:12:03.301175+0000) 2019-11-29T21:12:38.897 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:12:38.891+0000 1694c700 -1 osd.2 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:16.889090+0000 front 2019-11-29T21:11:16.369878+0000 (oldest deadline 2019-11-29T21:12:02.068366+0000) 2019-11-29T21:12:38.954 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:12:38.948+0000 1694c700 -1 osd.4 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:16.320933+0000 front 2019-11-29T21:11:16.372641+0000 (oldest deadline 2019-11-29T21:12:01.843111+0000) 2019-11-29T21:12:38.960 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:12:38.954+0000 1694c700 -1 osd.6 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:18.409835+0000 front 2019-11-29T21:11:18.823976+0000 (oldest deadline 2019-11-29T21:12:04.201710+0000) 2019-11-29T21:12:38.960 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:12:38.956+0000 1694c700 -1 osd.6 284 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:121744 6.8 6:1adc68c2:root::.bucket.meta.efa89e82fef944908f84171016951717%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.619:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e272) 2019-11-29T21:12:39.111 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:12:39.106+0000 1694c700 -1 osd.7 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:18.752655+0000 front 2019-11-29T21:11:18.632138+0000 (oldest deadline 2019-11-29T21:12:04.472776+0000) 2019-11-29T21:12:39.334 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:12:39.328+0000 1694c700 -1 osd.1 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:21.393313+0000 front 2019-11-29T21:11:21.431973+0000 (oldest deadline 2019-11-29T21:12:05.990591+0000) 2019-11-29T21:12:39.334 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:12:39.330+0000 1694c700 -1 osd.1 284 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130523 7.0 7:05588ce8:lc::lc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected e274) 2019-11-29T21:12:39.776 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:12:39.769+0000 1694c700 -1 osd.0 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:18.669553+0000 front 2019-11-29T21:11:19.271424+0000 (oldest deadline 2019-11-29T21:12:03.301175+0000) 2019-11-29T21:12:39.874 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:12:39.868+0000 1694c700 -1 osd.2 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:16.889090+0000 front 2019-11-29T21:11:16.369878+0000 (oldest deadline 2019-11-29T21:12:02.068366+0000) 2019-11-29T21:12:39.925 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:12:39.920+0000 1694c700 -1 osd.6 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:18.409835+0000 front 2019-11-29T21:11:18.823976+0000 (oldest deadline 2019-11-29T21:12:04.201710+0000) 2019-11-29T21:12:39.925 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:12:39.921+0000 1694c700 -1 osd.6 284 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:121744 6.8 6:1adc68c2:root::.bucket.meta.efa89e82fef944908f84171016951717%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.619:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e272) 2019-11-29T21:12:39.969 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:12:39.965+0000 1694c700 -1 osd.4 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:16.320933+0000 front 2019-11-29T21:11:16.372641+0000 (oldest deadline 2019-11-29T21:12:01.843111+0000) 2019-11-29T21:12:40.091 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:12:40.086+0000 1694c700 -1 osd.7 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:18.752655+0000 front 2019-11-29T21:11:18.632138+0000 (oldest deadline 2019-11-29T21:12:04.472776+0000) 2019-11-29T21:12:40.320 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:12:40.314+0000 1694c700 -1 osd.1 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:21.393313+0000 front 2019-11-29T21:11:21.431973+0000 (oldest deadline 2019-11-29T21:12:05.990591+0000) 2019-11-29T21:12:40.321 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:12:40.316+0000 1694c700 -1 osd.1 284 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130523 7.0 7:05588ce8:lc::lc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected e274) 2019-11-29T21:12:40.802 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:12:40.796+0000 1694c700 -1 osd.0 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:18.669553+0000 front 2019-11-29T21:11:19.271424+0000 (oldest deadline 2019-11-29T21:12:03.301175+0000) 2019-11-29T21:12:40.882 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:12:40.876+0000 1694c700 -1 osd.6 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:18.409835+0000 front 2019-11-29T21:11:18.823976+0000 (oldest deadline 2019-11-29T21:12:04.201710+0000) 2019-11-29T21:12:40.882 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:12:40.877+0000 1694c700 -1 osd.6 284 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:121744 6.8 6:1adc68c2:root::.bucket.meta.efa89e82fef944908f84171016951717%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.619:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e272) 2019-11-29T21:12:40.916 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:12:40.911+0000 1694c700 -1 osd.2 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:16.889090+0000 front 2019-11-29T21:11:16.369878+0000 (oldest deadline 2019-11-29T21:12:02.068366+0000) 2019-11-29T21:12:40.963 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:12:40.957+0000 1694c700 -1 osd.4 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:16.320933+0000 front 2019-11-29T21:11:16.372641+0000 (oldest deadline 2019-11-29T21:12:01.843111+0000) 2019-11-29T21:12:41.059 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:12:41.053+0000 1694c700 -1 osd.7 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:18.752655+0000 front 2019-11-29T21:11:18.632138+0000 (oldest deadline 2019-11-29T21:12:04.472776+0000) 2019-11-29T21:12:41.365 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:12:41.359+0000 1694c700 -1 osd.1 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:21.393313+0000 front 2019-11-29T21:11:21.431973+0000 (oldest deadline 2019-11-29T21:12:05.990591+0000) 2019-11-29T21:12:41.366 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:12:41.361+0000 1694c700 -1 osd.1 284 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130523 7.0 7:05588ce8:lc::lc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected e274) 2019-11-29T21:12:41.779 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:12:41.773+0000 1694c700 -1 osd.0 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:18.669553+0000 front 2019-11-29T21:11:19.271424+0000 (oldest deadline 2019-11-29T21:12:03.301175+0000) 2019-11-29T21:12:41.899 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:12:41.894+0000 1694c700 -1 osd.2 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:16.889090+0000 front 2019-11-29T21:11:16.369878+0000 (oldest deadline 2019-11-29T21:12:02.068366+0000) 2019-11-29T21:12:41.918 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:12:41.913+0000 1694c700 -1 osd.6 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:18.409835+0000 front 2019-11-29T21:11:18.823976+0000 (oldest deadline 2019-11-29T21:12:04.201710+0000) 2019-11-29T21:12:41.919 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:12:41.914+0000 1694c700 -1 osd.6 284 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:121744 6.8 6:1adc68c2:root::.bucket.meta.efa89e82fef944908f84171016951717%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.619:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e272) 2019-11-29T21:12:41.998 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:12:41.992+0000 1694c700 -1 osd.4 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:16.320933+0000 front 2019-11-29T21:11:16.372641+0000 (oldest deadline 2019-11-29T21:12:01.843111+0000) 2019-11-29T21:12:42.066 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:12:42.062+0000 1694c700 -1 osd.7 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:18.752655+0000 front 2019-11-29T21:11:18.632138+0000 (oldest deadline 2019-11-29T21:12:04.472776+0000) 2019-11-29T21:12:42.335 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:12:42.330+0000 1694c700 -1 osd.1 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:21.393313+0000 front 2019-11-29T21:11:21.431973+0000 (oldest deadline 2019-11-29T21:12:05.990591+0000) 2019-11-29T21:12:42.336 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:12:42.332+0000 1694c700 -1 osd.1 284 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130523 7.0 7:05588ce8:lc::lc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected e274) 2019-11-29T21:12:42.771 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:12:42.765+0000 1694c700 -1 osd.0 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:18.669553+0000 front 2019-11-29T21:11:19.271424+0000 (oldest deadline 2019-11-29T21:12:03.301175+0000) 2019-11-29T21:12:42.885 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:12:42.879+0000 1694c700 -1 osd.6 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:18.409835+0000 front 2019-11-29T21:11:18.823976+0000 (oldest deadline 2019-11-29T21:12:04.201710+0000) 2019-11-29T21:12:42.886 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:12:42.881+0000 1694c700 -1 osd.6 284 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:121744 6.8 6:1adc68c2:root::.bucket.meta.efa89e82fef944908f84171016951717%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.619:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e272) 2019-11-29T21:12:42.909 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:12:42.904+0000 1694c700 -1 osd.2 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:16.889090+0000 front 2019-11-29T21:11:16.369878+0000 (oldest deadline 2019-11-29T21:12:02.068366+0000) 2019-11-29T21:12:42.965 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:12:42.959+0000 1694c700 -1 osd.4 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:16.320933+0000 front 2019-11-29T21:11:16.372641+0000 (oldest deadline 2019-11-29T21:12:01.843111+0000) 2019-11-29T21:12:43.102 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:12:43.097+0000 1694c700 -1 osd.7 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:18.752655+0000 front 2019-11-29T21:11:18.632138+0000 (oldest deadline 2019-11-29T21:12:04.472776+0000) 2019-11-29T21:12:43.306 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:12:43.301+0000 1694c700 -1 osd.1 284 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:11:21.393313+0000 front 2019-11-29T21:11:21.431973+0000 (oldest deadline 2019-11-29T21:12:05.990591+0000) 2019-11-29T21:12:43.309 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:12:43.305+0000 1694c700 -1 osd.1 284 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130523 7.0 7:05588ce8:lc::lc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected e274) 2019-11-29T21:12:43.534 INFO:tasks.ceph.mon.b.smithi022.stderr:2019-11-29T21:12:43.522+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.22:6818/9264,v1:172.21.15.22:6819/9264] for 46sec e282 v282) 2019-11-29T21:12:43.975 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:12:43.969+0000 1694c700 -1 osd.6 285 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:121744 6.8 6:1adc68c2:root::.bucket.meta.efa89e82fef944908f84171016951717%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.619:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e272) 2019-11-29T21:12:44.383 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:12:44.366+0000 1694c700 -1 osd.1 285 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130523 7.0 7:05588ce8:lc::lc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected e274) 2019-11-29T21:12:45.287 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:12:45.283+0000 1694c700 -1 osd.6 286 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:121744 6.8 6:1adc68c2:root::.bucket.meta.efa89e82fef944908f84171016951717%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.619:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e272) 2019-11-29T21:12:46.318 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:12:46.307+0000 1694c700 -1 osd.6 286 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:121744 6.8 6:1adc68c2:root::.bucket.meta.efa89e82fef944908f84171016951717%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.619:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e272) 2019-11-29T21:12:47.301 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:12:47.296+0000 1694c700 -1 osd.6 286 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:121744 6.8 6:1adc68c2:root::.bucket.meta.efa89e82fef944908f84171016951717%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.619:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e272) 2019-11-29T21:12:48.300 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:12:48.297+0000 1694c700 -1 osd.6 286 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:121744 6.8 6:1adc68c2:root::.bucket.meta.efa89e82fef944908f84171016951717%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.619:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e272) 2019-11-29T21:12:49.347 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:12:49.343+0000 1694c700 -1 osd.6 286 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:121744 6.8 6:1adc68c2:root::.bucket.meta.efa89e82fef944908f84171016951717%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.619:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e272) 2019-11-29T21:12:50.330 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:12:50.323+0000 1694c700 -1 osd.6 286 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:121744 6.8 6:1adc68c2:root::.bucket.meta.efa89e82fef944908f84171016951717%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.619:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e272) 2019-11-29T21:12:51.387 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:12:51.383+0000 1694c700 -1 osd.6 286 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:121744 6.8 6:1adc68c2:root::.bucket.meta.efa89e82fef944908f84171016951717%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.619:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e272) 2019-11-29T21:12:52.452 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:12:52.447+0000 1694c700 -1 osd.6 286 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:121744 6.8 6:1adc68c2:root::.bucket.meta.efa89e82fef944908f84171016951717%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.619:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e272) 2019-11-29T21:12:53.515 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:12:53.466+0000 1694c700 -1 osd.6 287 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:121744 6.8 6:1adc68c2:root::.bucket.meta.efa89e82fef944908f84171016951717%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.619:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e272) 2019-11-29T21:12:54.480 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:12:54.476+0000 1694c700 -1 osd.6 287 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:121744 6.8 6:1adc68c2:root::.bucket.meta.efa89e82fef944908f84171016951717%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.619:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e272) 2019-11-29T21:12:55.448 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:12:55.444+0000 1694c700 -1 osd.6 288 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:121744 6.8 6:1adc68c2:root::.bucket.meta.efa89e82fef944908f84171016951717%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.619:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e272) 2019-11-29T21:12:56.433 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:12:56.427+0000 1694c700 -1 osd.6 288 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:121744 6.8 6:1adc68c2:root::.bucket.meta.efa89e82fef944908f84171016951717%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.619:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e272) 2019-11-29T21:12:57.421 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:12:57.417+0000 1694c700 -1 osd.6 288 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:121744 6.8 6:1adc68c2:root::.bucket.meta.efa89e82fef944908f84171016951717%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.619:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e272) 2019-11-29T21:12:58.446 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:12:58.442+0000 1694c700 -1 osd.6 288 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:121744 6.8 6:1adc68c2:root::.bucket.meta.efa89e82fef944908f84171016951717%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.619:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e272) 2019-11-29T21:12:59.487 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:12:59.482+0000 1694c700 -1 osd.6 288 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:121744 6.8 6:1adc68c2:root::.bucket.meta.efa89e82fef944908f84171016951717%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.619:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e272) 2019-11-29T21:13:00.518 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:13:00.513+0000 1694c700 -1 osd.6 288 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:121744 6.8 6:1adc68c2:root::.bucket.meta.efa89e82fef944908f84171016951717%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.619:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e272) 2019-11-29T21:13:01.529 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:13:01.525+0000 1694c700 -1 osd.6 288 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:121744 6.8 6:1adc68c2:root::.bucket.meta.efa89e82fef944908f84171016951717%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.619:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e272) 2019-11-29T21:13:02.482 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:13:02.477+0000 1694c700 -1 osd.6 288 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:121744 6.8 6:1adc68c2:root::.bucket.meta.efa89e82fef944908f84171016951717%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.619:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e272) 2019-11-29T21:13:03.451 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:13:03.446+0000 1694c700 -1 osd.6 288 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:121744 6.8 6:1adc68c2:root::.bucket.meta.efa89e82fef944908f84171016951717%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.619:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e272) 2019-11-29T21:13:04.442 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:13:04.437+0000 1694c700 -1 osd.6 288 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:121744 6.8 6:1adc68c2:root::.bucket.meta.efa89e82fef944908f84171016951717%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.619:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e272) 2019-11-29T21:13:05.488 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:13:05.483+0000 1694c700 -1 osd.6 288 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:121744 6.8 6:1adc68c2:root::.bucket.meta.efa89e82fef944908f84171016951717%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.619:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e272) 2019-11-29T21:13:06.488 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:13:06.482+0000 1694c700 -1 osd.6 288 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:121744 6.8 6:1adc68c2:root::.bucket.meta.efa89e82fef944908f84171016951717%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.619:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e272) 2019-11-29T21:13:07.474 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:13:07.469+0000 1694c700 -1 osd.6 288 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:121744 6.8 6:1adc68c2:root::.bucket.meta.efa89e82fef944908f84171016951717%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.619:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e272) 2019-11-29T21:13:08.502 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:13:08.496+0000 1694c700 -1 osd.6 288 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:121744 6.8 6:1adc68c2:root::.bucket.meta.efa89e82fef944908f84171016951717%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.619:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e272) 2019-11-29T21:13:09.544 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:13:09.538+0000 1694c700 -1 osd.6 288 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:121744 6.8 6:1adc68c2:root::.bucket.meta.efa89e82fef944908f84171016951717%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.619:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e272) 2019-11-29T21:13:15.749 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:08:47:56.408 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T21:13:15.757 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:08:47:56.416 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T21:13:15.781 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:08:47:56.387 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T21:13:15.784 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:08:47:56.390 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T21:13:15.788 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:08:47:56.395 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T21:13:15.789 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:08:47:56.396 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T21:13:16.212 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:08:47:56.813 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T21:13:16.218 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:08:47:56.870 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T21:13:16.224 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:08:47:56.826 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T21:13:37.652 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:13:37.628+0000 31f84700 -1 osd.1 290 build_incremental_map_msg missing incremental map 290 2019-11-29T21:13:38.053 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:13:38.021+0000 11cac700 -1 osd.5 291 build_incremental_map_msg missing incremental map 291 2019-11-29T21:13:38.097 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:13:38.059+0000 31783700 -1 osd.5 291 build_incremental_map_msg missing incremental map 291 2019-11-29T21:13:38.129 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:13:38.122+0000 3578b700 -1 osd.5 291 build_incremental_map_msg missing incremental map 291 2019-11-29T21:13:38.237 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:13:38.142+0000 31783700 -1 osd.5 291 build_incremental_map_msg missing incremental map 291 2019-11-29T21:13:39.971 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:13:39.964+0000 31783700 -1 osd.5 292 build_incremental_map_msg missing incremental map 292 2019-11-29T21:13:40.042 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:13:39.998+0000 31783700 -1 osd.5 292 build_incremental_map_msg missing incremental map 292 2019-11-29T21:13:42.589 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:13:42.584+0000 1694c700 -1 osd.2 294 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:12:57.331816+0000 front 2019-11-29T21:12:57.609891+0000 (oldest deadline 2019-11-29T21:13:42.371018+0000) 2019-11-29T21:13:42.688 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:13:42.675+0000 1694c700 -1 osd.6 294 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:12:58.456616+0000 front 2019-11-29T21:12:58.890252+0000 (oldest deadline 2019-11-29T21:13:41.916277+0000) 2019-11-29T21:13:43.515 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:13:43.491+0000 1694c700 -1 osd.4 295 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:12:57.934998+0000 front 2019-11-29T21:12:57.895812+0000 (oldest deadline 2019-11-29T21:13:43.091702+0000) 2019-11-29T21:13:43.609 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:13:43.604+0000 1694c700 -1 osd.2 294 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:12:57.331816+0000 front 2019-11-29T21:12:57.609891+0000 (oldest deadline 2019-11-29T21:13:42.371018+0000) 2019-11-29T21:13:43.784 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:13:43.762+0000 1694c700 -1 osd.6 295 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:12:58.456616+0000 front 2019-11-29T21:12:58.890252+0000 (oldest deadline 2019-11-29T21:13:41.916277+0000) 2019-11-29T21:13:43.845 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:08:48:24.504 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T21:13:43.848 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:08:48:24.506 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T21:13:43.860 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:08:48:24.467 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T21:13:43.880 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:08:48:24.487 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T21:13:43.899 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:08:48:24.506 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T21:13:43.902 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:08:48:24.560 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T21:13:43.908 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:08:48:24.515 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T21:13:43.965 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:08:48:24.571 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T21:13:43.986 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:08:48:24.592 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T21:13:44.524 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:13:44.519+0000 1694c700 -1 osd.4 295 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:12:57.934998+0000 front 2019-11-29T21:12:57.895812+0000 (oldest deadline 2019-11-29T21:13:43.091702+0000) 2019-11-29T21:13:44.569 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:13:44.564+0000 1694c700 -1 osd.7 295 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:13:00.167532+0000 front 2019-11-29T21:13:00.165419+0000 (oldest deadline 2019-11-29T21:13:43.652133+0000) 2019-11-29T21:13:44.580 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:13:44.574+0000 1694c700 -1 osd.2 295 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:12:57.331816+0000 front 2019-11-29T21:12:57.609891+0000 (oldest deadline 2019-11-29T21:13:42.371018+0000) 2019-11-29T21:13:44.808 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:13:44.803+0000 1694c700 -1 osd.6 295 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:12:58.456616+0000 front 2019-11-29T21:12:58.890252+0000 (oldest deadline 2019-11-29T21:13:41.916277+0000) 2019-11-29T21:13:45.581 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:13:45.576+0000 1694c700 -1 osd.2 295 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:12:57.331816+0000 front 2019-11-29T21:12:57.609891+0000 (oldest deadline 2019-11-29T21:13:42.371018+0000) 2019-11-29T21:13:46.059 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:13:46.039+0000 1694c700 -1 osd.0 295 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:13:00.422418+0000 front 2019-11-29T21:13:00.731173+0000 (oldest deadline 2019-11-29T21:13:45.670857+0000) 2019-11-29T21:13:46.060 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:13:46.051+0000 1694c700 -1 osd.0 295 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:121949 2.30 2:0df1e99d:::7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.619_da27b1c94c0a4e1dbfa5ee45fa7ce3fd:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~134 in=134b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (56) in=76b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e288) 2019-11-29T21:13:46.333 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:13:46.314+0000 3578b700 -1 osd.5 296 build_incremental_map_msg missing incremental map 291 2019-11-29T21:13:46.387 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:13:46.329+0000 3578b700 -1 osd.5 296 build_incremental_map_msg missing incremental map 292 2019-11-29T21:13:47.083 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:13:47.079+0000 1694c700 -1 osd.0 296 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:121949 2.30 2:0df1e99d:::7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.619_da27b1c94c0a4e1dbfa5ee45fa7ce3fd:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~134 in=134b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (56) in=76b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e288) 2019-11-29T21:13:48.106 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:13:48.077+0000 1694c700 -1 osd.0 298 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:121949 2.30 2:0df1e99d:::7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.619_da27b1c94c0a4e1dbfa5ee45fa7ce3fd:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~134 in=134b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (56) in=76b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e288) 2019-11-29T21:13:49.817 INFO:tasks.ceph.mon.b.smithi022.stderr:2019-11-29T21:13:49.811+0000 1a899700 -1 log_channel(cluster) log [ERR] : Health check failed: Possible data damage: 1 pg recovery_unfound (PG_DAMAGED) 2019-11-29T21:15:13.066 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:15:13.011+0000 3578b700 -1 osd.1 303 build_incremental_map_msg missing incremental map 303 2019-11-29T21:15:14.934 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:15:14.919+0000 35f8c700 -1 osd.1 304 build_incremental_map_msg missing incremental map 303 2019-11-29T21:15:16.018 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:15:15.976+0000 31783700 -1 osd.1 304 build_incremental_map_msg missing incremental map 303 2019-11-29T21:16:14.289 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:16:14.284+0000 1694c700 -1 osd.2 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:28.173248+0000 front 2019-11-29T21:15:28.170175+0000 (oldest deadline 2019-11-29T21:16:13.905517+0000) 2019-11-29T21:16:14.489 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:16:14.484+0000 1694c700 -1 osd.1 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:32.171663+0000 front 2019-11-29T21:15:32.174029+0000 (oldest deadline 2019-11-29T21:16:14.249421+0000) 2019-11-29T21:16:14.561 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:16:14.555+0000 1694c700 -1 osd.7 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:30.982239+0000 front 2019-11-29T21:15:31.001645+0000 (oldest deadline 2019-11-29T21:16:13.774774+0000) 2019-11-29T21:16:15.268 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:16:15.262+0000 1694c700 -1 osd.2 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:28.173248+0000 front 2019-11-29T21:15:28.170175+0000 (oldest deadline 2019-11-29T21:16:13.905517+0000) 2019-11-29T21:16:15.492 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:16:15.487+0000 1694c700 -1 osd.1 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:32.171663+0000 front 2019-11-29T21:15:32.174029+0000 (oldest deadline 2019-11-29T21:16:14.249421+0000) 2019-11-29T21:16:15.584 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:16:15.578+0000 1694c700 -1 osd.7 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:30.982239+0000 front 2019-11-29T21:15:31.001645+0000 (oldest deadline 2019-11-29T21:16:13.774774+0000) 2019-11-29T21:16:15.725 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:16:15.721+0000 1694c700 -1 osd.0 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:30.018449+0000 front 2019-11-29T21:15:30.286187+0000 (oldest deadline 2019-11-29T21:16:15.566696+0000) 2019-11-29T21:16:16.307 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:16:16.302+0000 1694c700 -1 osd.2 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:28.173248+0000 front 2019-11-29T21:15:28.170175+0000 (oldest deadline 2019-11-29T21:16:13.905517+0000) 2019-11-29T21:16:16.524 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:16:16.519+0000 1694c700 -1 osd.4 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:31.251737+0000 front 2019-11-29T21:15:31.252737+0000 (oldest deadline 2019-11-29T21:16:16.424909+0000) 2019-11-29T21:16:16.528 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:16:16.524+0000 1694c700 -1 osd.1 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:32.171663+0000 front 2019-11-29T21:15:32.174029+0000 (oldest deadline 2019-11-29T21:16:14.249421+0000) 2019-11-29T21:16:16.633 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:16:16.628+0000 1694c700 -1 osd.7 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:30.982239+0000 front 2019-11-29T21:15:31.001645+0000 (oldest deadline 2019-11-29T21:16:13.774774+0000) 2019-11-29T21:16:16.721 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:16:16.717+0000 1694c700 -1 osd.0 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:30.018449+0000 front 2019-11-29T21:15:30.286187+0000 (oldest deadline 2019-11-29T21:16:15.566696+0000) 2019-11-29T21:16:16.933 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:16:16.928+0000 1694c700 -1 osd.6 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:32.559736+0000 front 2019-11-29T21:15:32.556097+0000 (oldest deadline 2019-11-29T21:16:15.999660+0000) 2019-11-29T21:16:17.288 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:16:17.282+0000 1694c700 -1 osd.2 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:28.173248+0000 front 2019-11-29T21:15:28.170175+0000 (oldest deadline 2019-11-29T21:16:13.905517+0000) 2019-11-29T21:16:17.538 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:16:17.533+0000 1694c700 -1 osd.4 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:31.251737+0000 front 2019-11-29T21:15:31.252737+0000 (oldest deadline 2019-11-29T21:16:16.424909+0000) 2019-11-29T21:16:17.547 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:16:17.541+0000 1694c700 -1 osd.1 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:32.171663+0000 front 2019-11-29T21:15:32.174029+0000 (oldest deadline 2019-11-29T21:16:14.249421+0000) 2019-11-29T21:16:17.638 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:16:17.633+0000 1694c700 -1 osd.7 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:30.982239+0000 front 2019-11-29T21:15:31.001645+0000 (oldest deadline 2019-11-29T21:16:13.774774+0000) 2019-11-29T21:16:17.684 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:16:17.679+0000 1694c700 -1 osd.0 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:30.018449+0000 front 2019-11-29T21:15:30.286187+0000 (oldest deadline 2019-11-29T21:16:15.566696+0000) 2019-11-29T21:16:17.979 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:16:17.974+0000 1694c700 -1 osd.6 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:32.559736+0000 front 2019-11-29T21:15:32.556097+0000 (oldest deadline 2019-11-29T21:16:15.999660+0000) 2019-11-29T21:16:18.249 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:16:18.243+0000 1694c700 -1 osd.2 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:28.173248+0000 front 2019-11-29T21:15:28.170175+0000 (oldest deadline 2019-11-29T21:16:13.905517+0000) 2019-11-29T21:16:18.514 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:16:18.507+0000 1694c700 -1 osd.4 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:31.251737+0000 front 2019-11-29T21:15:31.252737+0000 (oldest deadline 2019-11-29T21:16:16.424909+0000) 2019-11-29T21:16:18.571 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:16:18.565+0000 1694c700 -1 osd.1 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:32.171663+0000 front 2019-11-29T21:15:32.174029+0000 (oldest deadline 2019-11-29T21:16:14.249421+0000) 2019-11-29T21:16:18.651 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:16:18.646+0000 1694c700 -1 osd.7 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:30.982239+0000 front 2019-11-29T21:15:31.001645+0000 (oldest deadline 2019-11-29T21:16:13.774774+0000) 2019-11-29T21:16:18.681 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:16:18.672+0000 1694c700 -1 osd.0 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:30.018449+0000 front 2019-11-29T21:15:30.286187+0000 (oldest deadline 2019-11-29T21:16:15.566696+0000) 2019-11-29T21:16:19.016 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:16:19.010+0000 1694c700 -1 osd.6 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:32.559736+0000 front 2019-11-29T21:15:32.556097+0000 (oldest deadline 2019-11-29T21:16:15.999660+0000) 2019-11-29T21:16:19.208 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:16:19.202+0000 1694c700 -1 osd.2 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:28.173248+0000 front 2019-11-29T21:15:28.170175+0000 (oldest deadline 2019-11-29T21:16:13.905517+0000) 2019-11-29T21:16:19.502 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:16:19.497+0000 1694c700 -1 osd.4 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:31.251737+0000 front 2019-11-29T21:15:31.252737+0000 (oldest deadline 2019-11-29T21:16:16.424909+0000) 2019-11-29T21:16:19.568 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:16:19.562+0000 1694c700 -1 osd.1 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:32.171663+0000 front 2019-11-29T21:15:32.174029+0000 (oldest deadline 2019-11-29T21:16:14.249421+0000) 2019-11-29T21:16:19.683 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:16:19.678+0000 1694c700 -1 osd.0 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:30.018449+0000 front 2019-11-29T21:15:30.286187+0000 (oldest deadline 2019-11-29T21:16:15.566696+0000) 2019-11-29T21:16:19.692 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:16:19.688+0000 1694c700 -1 osd.7 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:30.982239+0000 front 2019-11-29T21:15:31.001645+0000 (oldest deadline 2019-11-29T21:16:13.774774+0000) 2019-11-29T21:16:20.062 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:16:20.056+0000 1694c700 -1 osd.6 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:32.559736+0000 front 2019-11-29T21:15:32.556097+0000 (oldest deadline 2019-11-29T21:16:15.999660+0000) 2019-11-29T21:16:20.240 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:16:20.235+0000 1694c700 -1 osd.2 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:28.173248+0000 front 2019-11-29T21:15:28.170175+0000 (oldest deadline 2019-11-29T21:16:13.905517+0000) 2019-11-29T21:16:20.494 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:16:20.489+0000 1694c700 -1 osd.4 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:31.251737+0000 front 2019-11-29T21:15:31.252737+0000 (oldest deadline 2019-11-29T21:16:16.424909+0000) 2019-11-29T21:16:20.587 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:16:20.582+0000 1694c700 -1 osd.1 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:32.171663+0000 front 2019-11-29T21:15:32.174029+0000 (oldest deadline 2019-11-29T21:16:14.249421+0000) 2019-11-29T21:16:20.676 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:16:20.670+0000 1694c700 -1 osd.0 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:30.018449+0000 front 2019-11-29T21:15:30.286187+0000 (oldest deadline 2019-11-29T21:16:15.566696+0000) 2019-11-29T21:16:20.724 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:16:20.719+0000 1694c700 -1 osd.7 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:30.982239+0000 front 2019-11-29T21:15:31.001645+0000 (oldest deadline 2019-11-29T21:16:13.774774+0000) 2019-11-29T21:16:21.064 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:16:21.060+0000 1694c700 -1 osd.6 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:32.559736+0000 front 2019-11-29T21:15:32.556097+0000 (oldest deadline 2019-11-29T21:16:15.999660+0000) 2019-11-29T21:16:21.267 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:16:21.262+0000 1694c700 -1 osd.2 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:28.173248+0000 front 2019-11-29T21:15:28.170175+0000 (oldest deadline 2019-11-29T21:16:13.905517+0000) 2019-11-29T21:16:21.535 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:16:21.530+0000 1694c700 -1 osd.4 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:31.251737+0000 front 2019-11-29T21:15:31.252737+0000 (oldest deadline 2019-11-29T21:16:16.424909+0000) 2019-11-29T21:16:21.571 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:16:21.566+0000 1694c700 -1 osd.1 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:32.171663+0000 front 2019-11-29T21:15:32.174029+0000 (oldest deadline 2019-11-29T21:16:14.249421+0000) 2019-11-29T21:16:21.697 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:16:21.692+0000 1694c700 -1 osd.7 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:30.982239+0000 front 2019-11-29T21:15:31.001645+0000 (oldest deadline 2019-11-29T21:16:13.774774+0000) 2019-11-29T21:16:21.719 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:16:21.714+0000 1694c700 -1 osd.0 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:30.018449+0000 front 2019-11-29T21:15:30.286187+0000 (oldest deadline 2019-11-29T21:16:15.566696+0000) 2019-11-29T21:16:22.065 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:16:22.060+0000 1694c700 -1 osd.6 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:32.559736+0000 front 2019-11-29T21:15:32.556097+0000 (oldest deadline 2019-11-29T21:16:15.999660+0000) 2019-11-29T21:16:22.275 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:16:22.268+0000 1694c700 -1 osd.2 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:28.173248+0000 front 2019-11-29T21:15:28.170175+0000 (oldest deadline 2019-11-29T21:16:13.905517+0000) 2019-11-29T21:16:22.558 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:16:22.552+0000 1694c700 -1 osd.4 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:31.251737+0000 front 2019-11-29T21:15:31.252737+0000 (oldest deadline 2019-11-29T21:16:16.424909+0000) 2019-11-29T21:16:22.572 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:16:22.567+0000 1694c700 -1 osd.1 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:32.171663+0000 front 2019-11-29T21:15:32.174029+0000 (oldest deadline 2019-11-29T21:16:14.249421+0000) 2019-11-29T21:16:22.714 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:16:22.708+0000 1694c700 -1 osd.7 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:30.982239+0000 front 2019-11-29T21:15:31.001645+0000 (oldest deadline 2019-11-29T21:16:13.774774+0000) 2019-11-29T21:16:22.718 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:16:22.711+0000 1694c700 -1 osd.0 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:30.018449+0000 front 2019-11-29T21:15:30.286187+0000 (oldest deadline 2019-11-29T21:16:15.566696+0000) 2019-11-29T21:16:23.065 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:16:23.060+0000 1694c700 -1 osd.6 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:32.559736+0000 front 2019-11-29T21:15:32.556097+0000 (oldest deadline 2019-11-29T21:16:15.999660+0000) 2019-11-29T21:16:23.307 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:16:23.302+0000 1694c700 -1 osd.2 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:28.173248+0000 front 2019-11-29T21:15:28.170175+0000 (oldest deadline 2019-11-29T21:16:13.905517+0000) 2019-11-29T21:16:23.589 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:16:23.585+0000 1694c700 -1 osd.4 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:31.251737+0000 front 2019-11-29T21:15:31.252737+0000 (oldest deadline 2019-11-29T21:16:16.424909+0000) 2019-11-29T21:16:23.595 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:16:23.590+0000 1694c700 -1 osd.1 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:32.171663+0000 front 2019-11-29T21:15:32.174029+0000 (oldest deadline 2019-11-29T21:16:14.249421+0000) 2019-11-29T21:16:23.722 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:16:23.716+0000 1694c700 -1 osd.0 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:30.018449+0000 front 2019-11-29T21:15:30.286187+0000 (oldest deadline 2019-11-29T21:16:15.566696+0000) 2019-11-29T21:16:23.736 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:16:23.731+0000 1694c700 -1 osd.7 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:30.982239+0000 front 2019-11-29T21:15:31.001645+0000 (oldest deadline 2019-11-29T21:16:13.774774+0000) 2019-11-29T21:16:24.059 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:16:24.054+0000 1694c700 -1 osd.6 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:32.559736+0000 front 2019-11-29T21:15:32.556097+0000 (oldest deadline 2019-11-29T21:16:15.999660+0000) 2019-11-29T21:16:24.355 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:16:24.349+0000 1694c700 -1 osd.2 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:28.173248+0000 front 2019-11-29T21:15:28.170175+0000 (oldest deadline 2019-11-29T21:16:13.905517+0000) 2019-11-29T21:16:24.611 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:16:24.604+0000 1694c700 -1 osd.1 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:32.171663+0000 front 2019-11-29T21:15:32.174029+0000 (oldest deadline 2019-11-29T21:16:14.249421+0000) 2019-11-29T21:16:24.620 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:16:24.614+0000 1694c700 -1 osd.4 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:31.251737+0000 front 2019-11-29T21:15:31.252737+0000 (oldest deadline 2019-11-29T21:16:16.424909+0000) 2019-11-29T21:16:24.705 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:16:24.700+0000 1694c700 -1 osd.7 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:30.982239+0000 front 2019-11-29T21:15:31.001645+0000 (oldest deadline 2019-11-29T21:16:13.774774+0000) 2019-11-29T21:16:24.757 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:16:24.751+0000 1694c700 -1 osd.0 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:30.018449+0000 front 2019-11-29T21:15:30.286187+0000 (oldest deadline 2019-11-29T21:16:15.566696+0000) 2019-11-29T21:16:25.113 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:16:25.108+0000 1694c700 -1 osd.6 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:32.559736+0000 front 2019-11-29T21:15:32.556097+0000 (oldest deadline 2019-11-29T21:16:15.999660+0000) 2019-11-29T21:16:25.352 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:16:25.347+0000 1694c700 -1 osd.2 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:28.173248+0000 front 2019-11-29T21:15:28.170175+0000 (oldest deadline 2019-11-29T21:16:13.905517+0000) 2019-11-29T21:16:25.592 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:16:25.587+0000 1694c700 -1 osd.4 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:31.251737+0000 front 2019-11-29T21:15:31.252737+0000 (oldest deadline 2019-11-29T21:16:16.424909+0000) 2019-11-29T21:16:25.655 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:16:25.649+0000 1694c700 -1 osd.1 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:32.171663+0000 front 2019-11-29T21:15:32.174029+0000 (oldest deadline 2019-11-29T21:16:14.249421+0000) 2019-11-29T21:16:25.731 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:16:25.726+0000 1694c700 -1 osd.7 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:30.982239+0000 front 2019-11-29T21:15:31.001645+0000 (oldest deadline 2019-11-29T21:16:13.774774+0000) 2019-11-29T21:16:25.744 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:16:25.738+0000 1694c700 -1 osd.0 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:30.018449+0000 front 2019-11-29T21:15:30.286187+0000 (oldest deadline 2019-11-29T21:16:15.566696+0000) 2019-11-29T21:16:26.137 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:16:26.132+0000 1694c700 -1 osd.6 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:32.559736+0000 front 2019-11-29T21:15:32.556097+0000 (oldest deadline 2019-11-29T21:16:15.999660+0000) 2019-11-29T21:16:26.139 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:16:26.134+0000 1694c700 -1 osd.6 304 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:122258 6.8 6:1fd8e474:root::16bdcfa80a424029b43ee60169a747c5:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e304) 2019-11-29T21:16:26.385 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:16:26.379+0000 1694c700 -1 osd.2 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:28.173248+0000 front 2019-11-29T21:15:28.170175+0000 (oldest deadline 2019-11-29T21:16:13.905517+0000) 2019-11-29T21:16:26.632 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:16:26.627+0000 1694c700 -1 osd.1 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:32.171663+0000 front 2019-11-29T21:15:32.174029+0000 (oldest deadline 2019-11-29T21:16:14.249421+0000) 2019-11-29T21:16:26.643 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:16:26.638+0000 1694c700 -1 osd.4 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:31.251737+0000 front 2019-11-29T21:15:31.252737+0000 (oldest deadline 2019-11-29T21:16:16.424909+0000) 2019-11-29T21:16:26.712 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:16:26.708+0000 1694c700 -1 osd.7 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:30.982239+0000 front 2019-11-29T21:15:31.001645+0000 (oldest deadline 2019-11-29T21:16:13.774774+0000) 2019-11-29T21:16:26.755 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:16:26.750+0000 1694c700 -1 osd.0 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:30.018449+0000 front 2019-11-29T21:15:30.286187+0000 (oldest deadline 2019-11-29T21:16:15.566696+0000) 2019-11-29T21:16:27.131 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:16:27.125+0000 1694c700 -1 osd.6 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:32.559736+0000 front 2019-11-29T21:15:32.556097+0000 (oldest deadline 2019-11-29T21:16:15.999660+0000) 2019-11-29T21:16:27.131 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:16:27.127+0000 1694c700 -1 osd.6 304 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:122258 6.8 6:1fd8e474:root::16bdcfa80a424029b43ee60169a747c5:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e304) 2019-11-29T21:16:27.396 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:16:27.390+0000 1694c700 -1 osd.2 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:28.173248+0000 front 2019-11-29T21:15:28.170175+0000 (oldest deadline 2019-11-29T21:16:13.905517+0000) 2019-11-29T21:16:27.626 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:16:27.620+0000 1694c700 -1 osd.4 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:31.251737+0000 front 2019-11-29T21:15:31.252737+0000 (oldest deadline 2019-11-29T21:16:16.424909+0000) 2019-11-29T21:16:27.668 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:16:27.663+0000 1694c700 -1 osd.7 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:30.982239+0000 front 2019-11-29T21:15:31.001645+0000 (oldest deadline 2019-11-29T21:16:13.774774+0000) 2019-11-29T21:16:27.672 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:16:27.667+0000 1694c700 -1 osd.1 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:32.171663+0000 front 2019-11-29T21:15:32.174029+0000 (oldest deadline 2019-11-29T21:16:14.249421+0000) 2019-11-29T21:16:27.760 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:16:27.754+0000 1694c700 -1 osd.0 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:30.018449+0000 front 2019-11-29T21:15:30.286187+0000 (oldest deadline 2019-11-29T21:16:15.566696+0000) 2019-11-29T21:16:28.102 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:16:28.097+0000 1694c700 -1 osd.6 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:32.559736+0000 front 2019-11-29T21:15:32.556097+0000 (oldest deadline 2019-11-29T21:16:15.999660+0000) 2019-11-29T21:16:28.102 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:16:28.097+0000 1694c700 -1 osd.6 304 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:122258 6.8 6:1fd8e474:root::16bdcfa80a424029b43ee60169a747c5:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e304) 2019-11-29T21:16:28.390 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:16:28.384+0000 1694c700 -1 osd.2 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:28.173248+0000 front 2019-11-29T21:15:28.170175+0000 (oldest deadline 2019-11-29T21:16:13.905517+0000) 2019-11-29T21:16:28.609 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:16:28.603+0000 1694c700 -1 osd.4 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:31.251737+0000 front 2019-11-29T21:15:31.252737+0000 (oldest deadline 2019-11-29T21:16:16.424909+0000) 2019-11-29T21:16:28.625 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:16:28.620+0000 1694c700 -1 osd.7 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:30.982239+0000 front 2019-11-29T21:15:31.001645+0000 (oldest deadline 2019-11-29T21:16:13.774774+0000) 2019-11-29T21:16:28.702 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:16:28.696+0000 1694c700 -1 osd.1 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:32.171663+0000 front 2019-11-29T21:15:32.174029+0000 (oldest deadline 2019-11-29T21:16:14.249421+0000) 2019-11-29T21:16:28.741 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:16:28.727+0000 1694c700 -1 osd.0 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:30.018449+0000 front 2019-11-29T21:15:30.286187+0000 (oldest deadline 2019-11-29T21:16:15.566696+0000) 2019-11-29T21:16:29.114 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:16:29.108+0000 1694c700 -1 osd.6 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:32.559736+0000 front 2019-11-29T21:15:32.556097+0000 (oldest deadline 2019-11-29T21:16:15.999660+0000) 2019-11-29T21:16:29.115 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:16:29.110+0000 1694c700 -1 osd.6 304 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:122258 6.8 6:1fd8e474:root::16bdcfa80a424029b43ee60169a747c5:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e304) 2019-11-29T21:16:29.440 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:16:29.436+0000 1694c700 -1 osd.2 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:28.173248+0000 front 2019-11-29T21:15:28.170175+0000 (oldest deadline 2019-11-29T21:16:13.905517+0000) 2019-11-29T21:16:29.581 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:16:29.575+0000 1694c700 -1 osd.7 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:30.982239+0000 front 2019-11-29T21:15:31.001645+0000 (oldest deadline 2019-11-29T21:16:13.774774+0000) 2019-11-29T21:16:29.621 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:16:29.615+0000 1694c700 -1 osd.4 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:31.251737+0000 front 2019-11-29T21:15:31.252737+0000 (oldest deadline 2019-11-29T21:16:16.424909+0000) 2019-11-29T21:16:29.685 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:16:29.680+0000 1694c700 -1 osd.0 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:30.018449+0000 front 2019-11-29T21:15:30.286187+0000 (oldest deadline 2019-11-29T21:16:15.566696+0000) 2019-11-29T21:16:29.697 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:16:29.691+0000 1694c700 -1 osd.1 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:32.171663+0000 front 2019-11-29T21:15:32.174029+0000 (oldest deadline 2019-11-29T21:16:14.249421+0000) 2019-11-29T21:16:30.157 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:16:30.152+0000 1694c700 -1 osd.6 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:32.559736+0000 front 2019-11-29T21:15:32.556097+0000 (oldest deadline 2019-11-29T21:16:15.999660+0000) 2019-11-29T21:16:30.158 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:16:30.153+0000 1694c700 -1 osd.6 304 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:122258 6.8 6:1fd8e474:root::16bdcfa80a424029b43ee60169a747c5:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e304) 2019-11-29T21:16:30.395 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:16:30.390+0000 1694c700 -1 osd.2 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:28.173248+0000 front 2019-11-29T21:15:28.170175+0000 (oldest deadline 2019-11-29T21:16:13.905517+0000) 2019-11-29T21:16:30.603 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:16:30.598+0000 1694c700 -1 osd.7 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:30.982239+0000 front 2019-11-29T21:15:31.001645+0000 (oldest deadline 2019-11-29T21:16:13.774774+0000) 2019-11-29T21:16:30.657 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:16:30.651+0000 1694c700 -1 osd.4 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:31.251737+0000 front 2019-11-29T21:15:31.252737+0000 (oldest deadline 2019-11-29T21:16:16.424909+0000) 2019-11-29T21:16:30.669 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:16:30.664+0000 1694c700 -1 osd.0 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:30.018449+0000 front 2019-11-29T21:15:30.286187+0000 (oldest deadline 2019-11-29T21:16:15.566696+0000) 2019-11-29T21:16:30.723 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:16:30.717+0000 1694c700 -1 osd.1 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:32.171663+0000 front 2019-11-29T21:15:32.174029+0000 (oldest deadline 2019-11-29T21:16:14.249421+0000) 2019-11-29T21:16:31.199 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:16:31.193+0000 1694c700 -1 osd.6 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:32.559736+0000 front 2019-11-29T21:15:32.556097+0000 (oldest deadline 2019-11-29T21:16:15.999660+0000) 2019-11-29T21:16:31.199 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:16:31.195+0000 1694c700 -1 osd.6 304 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:122258 6.8 6:1fd8e474:root::16bdcfa80a424029b43ee60169a747c5:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e304) 2019-11-29T21:16:31.428 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:16:31.422+0000 1694c700 -1 osd.2 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:28.173248+0000 front 2019-11-29T21:15:28.170175+0000 (oldest deadline 2019-11-29T21:16:13.905517+0000) 2019-11-29T21:16:31.563 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:16:31.557+0000 1694c700 -1 osd.7 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:30.982239+0000 front 2019-11-29T21:15:31.001645+0000 (oldest deadline 2019-11-29T21:16:13.774774+0000) 2019-11-29T21:16:31.633 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:16:31.627+0000 1694c700 -1 osd.0 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:30.018449+0000 front 2019-11-29T21:15:30.286187+0000 (oldest deadline 2019-11-29T21:16:15.566696+0000) 2019-11-29T21:16:31.645 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:16:31.639+0000 1694c700 -1 osd.4 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:31.251737+0000 front 2019-11-29T21:15:31.252737+0000 (oldest deadline 2019-11-29T21:16:16.424909+0000) 2019-11-29T21:16:31.719 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:16:31.714+0000 1694c700 -1 osd.1 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:32.171663+0000 front 2019-11-29T21:15:32.174029+0000 (oldest deadline 2019-11-29T21:16:14.249421+0000) 2019-11-29T21:16:32.209 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:16:32.203+0000 1694c700 -1 osd.6 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:32.559736+0000 front 2019-11-29T21:15:32.556097+0000 (oldest deadline 2019-11-29T21:16:15.999660+0000) 2019-11-29T21:16:32.211 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:16:32.208+0000 1694c700 -1 osd.6 304 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:122258 6.8 6:1fd8e474:root::16bdcfa80a424029b43ee60169a747c5:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e304) 2019-11-29T21:16:32.477 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:16:32.473+0000 1694c700 -1 osd.2 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:28.173248+0000 front 2019-11-29T21:15:28.170175+0000 (oldest deadline 2019-11-29T21:16:13.905517+0000) 2019-11-29T21:16:32.593 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:16:32.587+0000 1694c700 -1 osd.7 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:30.982239+0000 front 2019-11-29T21:15:31.001645+0000 (oldest deadline 2019-11-29T21:16:13.774774+0000) 2019-11-29T21:16:32.672 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:16:32.667+0000 1694c700 -1 osd.0 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:30.018449+0000 front 2019-11-29T21:15:30.286187+0000 (oldest deadline 2019-11-29T21:16:15.566696+0000) 2019-11-29T21:16:32.673 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:16:32.668+0000 1694c700 -1 osd.1 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:32.171663+0000 front 2019-11-29T21:15:32.174029+0000 (oldest deadline 2019-11-29T21:16:14.249421+0000) 2019-11-29T21:16:32.681 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:16:32.675+0000 1694c700 -1 osd.4 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:31.251737+0000 front 2019-11-29T21:15:31.252737+0000 (oldest deadline 2019-11-29T21:16:16.424909+0000) 2019-11-29T21:16:33.262 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:16:33.257+0000 1694c700 -1 osd.6 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:32.559736+0000 front 2019-11-29T21:15:32.556097+0000 (oldest deadline 2019-11-29T21:16:15.999660+0000) 2019-11-29T21:16:33.262 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:16:33.258+0000 1694c700 -1 osd.6 304 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:122258 6.8 6:1fd8e474:root::16bdcfa80a424029b43ee60169a747c5:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e304) 2019-11-29T21:16:33.513 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:16:33.508+0000 1694c700 -1 osd.2 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:28.173248+0000 front 2019-11-29T21:15:28.170175+0000 (oldest deadline 2019-11-29T21:16:13.905517+0000) 2019-11-29T21:16:33.578 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:16:33.573+0000 1694c700 -1 osd.7 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:30.982239+0000 front 2019-11-29T21:15:31.001645+0000 (oldest deadline 2019-11-29T21:16:13.774774+0000) 2019-11-29T21:16:33.674 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:16:33.663+0000 1694c700 -1 osd.1 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:32.171663+0000 front 2019-11-29T21:15:32.174029+0000 (oldest deadline 2019-11-29T21:16:14.249421+0000) 2019-11-29T21:16:33.721 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:16:33.716+0000 1694c700 -1 osd.0 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:30.018449+0000 front 2019-11-29T21:15:30.286187+0000 (oldest deadline 2019-11-29T21:16:15.566696+0000) 2019-11-29T21:16:33.728 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:16:33.723+0000 1694c700 -1 osd.4 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:31.251737+0000 front 2019-11-29T21:15:31.252737+0000 (oldest deadline 2019-11-29T21:16:16.424909+0000) 2019-11-29T21:16:34.241 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:16:34.235+0000 1694c700 -1 osd.6 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:32.559736+0000 front 2019-11-29T21:15:32.556097+0000 (oldest deadline 2019-11-29T21:16:15.999660+0000) 2019-11-29T21:16:34.243 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:16:34.237+0000 1694c700 -1 osd.6 304 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:122258 6.8 6:1fd8e474:root::16bdcfa80a424029b43ee60169a747c5:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e304) 2019-11-29T21:16:34.514 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:16:34.509+0000 1694c700 -1 osd.2 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:28.173248+0000 front 2019-11-29T21:15:28.170175+0000 (oldest deadline 2019-11-29T21:16:13.905517+0000) 2019-11-29T21:16:34.599 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:16:34.593+0000 1694c700 -1 osd.7 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:30.982239+0000 front 2019-11-29T21:15:31.001645+0000 (oldest deadline 2019-11-29T21:16:13.774774+0000) 2019-11-29T21:16:34.680 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:16:34.675+0000 1694c700 -1 osd.1 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:32.171663+0000 front 2019-11-29T21:15:32.174029+0000 (oldest deadline 2019-11-29T21:16:14.249421+0000) 2019-11-29T21:16:34.722 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:16:34.717+0000 1694c700 -1 osd.4 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:31.251737+0000 front 2019-11-29T21:15:31.252737+0000 (oldest deadline 2019-11-29T21:16:16.424909+0000) 2019-11-29T21:16:34.744 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:16:34.739+0000 1694c700 -1 osd.0 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:30.018449+0000 front 2019-11-29T21:15:30.286187+0000 (oldest deadline 2019-11-29T21:16:15.566696+0000) 2019-11-29T21:16:35.294 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:16:35.287+0000 1694c700 -1 osd.6 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:32.559736+0000 front 2019-11-29T21:15:32.556097+0000 (oldest deadline 2019-11-29T21:16:15.999660+0000) 2019-11-29T21:16:35.295 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:16:35.290+0000 1694c700 -1 osd.6 304 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:122258 6.8 6:1fd8e474:root::16bdcfa80a424029b43ee60169a747c5:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e304) 2019-11-29T21:16:35.518 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:16:35.513+0000 1694c700 -1 osd.2 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:28.173248+0000 front 2019-11-29T21:15:28.170175+0000 (oldest deadline 2019-11-29T21:16:13.905517+0000) 2019-11-29T21:16:35.572 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:16:35.567+0000 1694c700 -1 osd.7 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:30.982239+0000 front 2019-11-29T21:15:31.001645+0000 (oldest deadline 2019-11-29T21:16:13.774774+0000) 2019-11-29T21:16:35.698 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:16:35.692+0000 1694c700 -1 osd.4 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:31.251737+0000 front 2019-11-29T21:15:31.252737+0000 (oldest deadline 2019-11-29T21:16:16.424909+0000) 2019-11-29T21:16:35.723 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:16:35.715+0000 1694c700 -1 osd.1 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:32.171663+0000 front 2019-11-29T21:15:32.174029+0000 (oldest deadline 2019-11-29T21:16:14.249421+0000) 2019-11-29T21:16:35.729 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:16:35.724+0000 1694c700 -1 osd.0 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:30.018449+0000 front 2019-11-29T21:15:30.286187+0000 (oldest deadline 2019-11-29T21:16:15.566696+0000) 2019-11-29T21:16:36.317 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:16:36.312+0000 1694c700 -1 osd.6 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:32.559736+0000 front 2019-11-29T21:15:32.556097+0000 (oldest deadline 2019-11-29T21:16:15.999660+0000) 2019-11-29T21:16:36.319 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:16:36.315+0000 1694c700 -1 osd.6 304 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:122258 6.8 6:1fd8e474:root::16bdcfa80a424029b43ee60169a747c5:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e304) 2019-11-29T21:16:36.550 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:16:36.544+0000 1694c700 -1 osd.2 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:28.173248+0000 front 2019-11-29T21:15:28.170175+0000 (oldest deadline 2019-11-29T21:16:13.905517+0000) 2019-11-29T21:16:36.577 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:16:36.566+0000 1694c700 -1 osd.7 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:30.982239+0000 front 2019-11-29T21:15:31.001645+0000 (oldest deadline 2019-11-29T21:16:13.774774+0000) 2019-11-29T21:16:36.683 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:16:36.679+0000 1694c700 -1 osd.0 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:30.018449+0000 front 2019-11-29T21:15:30.286187+0000 (oldest deadline 2019-11-29T21:16:15.566696+0000) 2019-11-29T21:16:36.722 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:16:36.717+0000 1694c700 -1 osd.1 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:32.171663+0000 front 2019-11-29T21:15:32.174029+0000 (oldest deadline 2019-11-29T21:16:14.249421+0000) 2019-11-29T21:16:36.727 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:16:36.722+0000 1694c700 -1 osd.4 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:31.251737+0000 front 2019-11-29T21:15:31.252737+0000 (oldest deadline 2019-11-29T21:16:16.424909+0000) 2019-11-29T21:16:37.279 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:16:37.274+0000 1694c700 -1 osd.6 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:32.559736+0000 front 2019-11-29T21:15:32.556097+0000 (oldest deadline 2019-11-29T21:16:15.999660+0000) 2019-11-29T21:16:37.280 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:16:37.275+0000 1694c700 -1 osd.6 304 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:122258 6.8 6:1fd8e474:root::16bdcfa80a424029b43ee60169a747c5:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e304) 2019-11-29T21:16:37.505 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:16:37.499+0000 1694c700 -1 osd.2 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:28.173248+0000 front 2019-11-29T21:15:28.170175+0000 (oldest deadline 2019-11-29T21:16:13.905517+0000) 2019-11-29T21:16:37.539 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:16:37.533+0000 1694c700 -1 osd.7 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:30.982239+0000 front 2019-11-29T21:15:31.001645+0000 (oldest deadline 2019-11-29T21:16:13.774774+0000) 2019-11-29T21:16:37.693 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:16:37.688+0000 1694c700 -1 osd.4 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:31.251737+0000 front 2019-11-29T21:15:31.252737+0000 (oldest deadline 2019-11-29T21:16:16.424909+0000) 2019-11-29T21:16:37.715 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:16:37.710+0000 1694c700 -1 osd.0 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:30.018449+0000 front 2019-11-29T21:15:30.286187+0000 (oldest deadline 2019-11-29T21:16:15.566696+0000) 2019-11-29T21:16:37.726 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:16:37.722+0000 1694c700 -1 osd.1 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:32.171663+0000 front 2019-11-29T21:15:32.174029+0000 (oldest deadline 2019-11-29T21:16:14.249421+0000) 2019-11-29T21:16:38.233 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:16:38.227+0000 1694c700 -1 osd.6 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:32.559736+0000 front 2019-11-29T21:15:32.556097+0000 (oldest deadline 2019-11-29T21:16:15.999660+0000) 2019-11-29T21:16:38.234 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:16:38.229+0000 1694c700 -1 osd.6 304 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:122258 6.8 6:1fd8e474:root::16bdcfa80a424029b43ee60169a747c5:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e304) 2019-11-29T21:16:38.504 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:16:38.498+0000 1694c700 -1 osd.7 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:30.982239+0000 front 2019-11-29T21:15:31.001645+0000 (oldest deadline 2019-11-29T21:16:13.774774+0000) 2019-11-29T21:16:38.522 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:16:38.516+0000 1694c700 -1 osd.2 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:28.173248+0000 front 2019-11-29T21:15:28.170175+0000 (oldest deadline 2019-11-29T21:16:13.905517+0000) 2019-11-29T21:16:38.716 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:16:38.711+0000 1694c700 -1 osd.0 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:30.018449+0000 front 2019-11-29T21:15:30.286187+0000 (oldest deadline 2019-11-29T21:16:15.566696+0000) 2019-11-29T21:16:38.730 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:16:38.724+0000 1694c700 -1 osd.4 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:31.251737+0000 front 2019-11-29T21:15:31.252737+0000 (oldest deadline 2019-11-29T21:16:16.424909+0000) 2019-11-29T21:16:38.749 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:16:38.742+0000 1694c700 -1 osd.1 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:32.171663+0000 front 2019-11-29T21:15:32.174029+0000 (oldest deadline 2019-11-29T21:16:14.249421+0000) 2019-11-29T21:16:39.285 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:16:39.280+0000 1694c700 -1 osd.6 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:32.559736+0000 front 2019-11-29T21:15:32.556097+0000 (oldest deadline 2019-11-29T21:16:15.999660+0000) 2019-11-29T21:16:39.288 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:16:39.283+0000 1694c700 -1 osd.6 304 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:122258 6.8 6:1fd8e474:root::16bdcfa80a424029b43ee60169a747c5:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e304) 2019-11-29T21:16:39.498 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:16:39.488+0000 1694c700 -1 osd.7 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:30.982239+0000 front 2019-11-29T21:15:31.001645+0000 (oldest deadline 2019-11-29T21:16:13.774774+0000) 2019-11-29T21:16:39.551 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:16:39.547+0000 1694c700 -1 osd.2 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:28.173248+0000 front 2019-11-29T21:15:28.170175+0000 (oldest deadline 2019-11-29T21:16:13.905517+0000) 2019-11-29T21:16:39.687 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:16:39.683+0000 1694c700 -1 osd.4 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:31.251737+0000 front 2019-11-29T21:15:31.252737+0000 (oldest deadline 2019-11-29T21:16:16.424909+0000) 2019-11-29T21:16:39.710 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:16:39.705+0000 1694c700 -1 osd.0 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:30.018449+0000 front 2019-11-29T21:15:30.286187+0000 (oldest deadline 2019-11-29T21:16:15.566696+0000) 2019-11-29T21:16:39.722 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:16:39.718+0000 1694c700 -1 osd.1 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:32.171663+0000 front 2019-11-29T21:15:32.174029+0000 (oldest deadline 2019-11-29T21:16:14.249421+0000) 2019-11-29T21:16:40.332 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:16:40.327+0000 1694c700 -1 osd.6 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:32.559736+0000 front 2019-11-29T21:15:32.556097+0000 (oldest deadline 2019-11-29T21:16:15.999660+0000) 2019-11-29T21:16:40.335 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:16:40.331+0000 1694c700 -1 osd.6 304 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:122258 6.8 6:1fd8e474:root::16bdcfa80a424029b43ee60169a747c5:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e304) 2019-11-29T21:16:40.501 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:16:40.495+0000 1694c700 -1 osd.7 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:30.982239+0000 front 2019-11-29T21:15:31.001645+0000 (oldest deadline 2019-11-29T21:16:13.774774+0000) 2019-11-29T21:16:40.550 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:16:40.542+0000 1694c700 -1 osd.2 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:28.173248+0000 front 2019-11-29T21:15:28.170175+0000 (oldest deadline 2019-11-29T21:16:13.905517+0000) 2019-11-29T21:16:40.677 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:16:40.672+0000 1694c700 -1 osd.4 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:31.251737+0000 front 2019-11-29T21:15:31.252737+0000 (oldest deadline 2019-11-29T21:16:16.424909+0000) 2019-11-29T21:16:40.742 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:16:40.737+0000 1694c700 -1 osd.0 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:30.018449+0000 front 2019-11-29T21:15:30.286187+0000 (oldest deadline 2019-11-29T21:16:15.566696+0000) 2019-11-29T21:16:40.766 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:16:40.761+0000 1694c700 -1 osd.1 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:32.171663+0000 front 2019-11-29T21:15:32.174029+0000 (oldest deadline 2019-11-29T21:16:14.249421+0000) 2019-11-29T21:16:41.314 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:16:41.308+0000 1694c700 -1 osd.6 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:32.559736+0000 front 2019-11-29T21:15:32.556097+0000 (oldest deadline 2019-11-29T21:16:15.999660+0000) 2019-11-29T21:16:41.315 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:16:41.310+0000 1694c700 -1 osd.6 304 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:122258 6.8 6:1fd8e474:root::16bdcfa80a424029b43ee60169a747c5:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e304) 2019-11-29T21:16:41.508 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:16:41.502+0000 1694c700 -1 osd.7 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:30.982239+0000 front 2019-11-29T21:15:31.001645+0000 (oldest deadline 2019-11-29T21:16:13.774774+0000) 2019-11-29T21:16:41.599 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:16:41.593+0000 1694c700 -1 osd.2 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:28.173248+0000 front 2019-11-29T21:15:28.170175+0000 (oldest deadline 2019-11-29T21:16:13.905517+0000) 2019-11-29T21:16:41.649 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:16:41.643+0000 1694c700 -1 osd.4 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:31.251737+0000 front 2019-11-29T21:15:31.252737+0000 (oldest deadline 2019-11-29T21:16:16.424909+0000) 2019-11-29T21:16:41.726 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:16:41.721+0000 1694c700 -1 osd.0 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:30.018449+0000 front 2019-11-29T21:15:30.286187+0000 (oldest deadline 2019-11-29T21:16:15.566696+0000) 2019-11-29T21:16:41.750 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:16:41.744+0000 1694c700 -1 osd.1 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:32.171663+0000 front 2019-11-29T21:15:32.174029+0000 (oldest deadline 2019-11-29T21:16:14.249421+0000) 2019-11-29T21:16:42.283 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:16:42.278+0000 1694c700 -1 osd.6 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:32.559736+0000 front 2019-11-29T21:15:32.556097+0000 (oldest deadline 2019-11-29T21:16:15.999660+0000) 2019-11-29T21:16:42.286 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:16:42.282+0000 1694c700 -1 osd.6 304 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:122258 6.8 6:1fd8e474:root::16bdcfa80a424029b43ee60169a747c5:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e304) 2019-11-29T21:16:42.522 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:16:42.516+0000 1694c700 -1 osd.7 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:30.982239+0000 front 2019-11-29T21:15:31.001645+0000 (oldest deadline 2019-11-29T21:16:13.774774+0000) 2019-11-29T21:16:42.580 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:16:42.574+0000 1694c700 -1 osd.2 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:28.173248+0000 front 2019-11-29T21:15:28.170175+0000 (oldest deadline 2019-11-29T21:16:13.905517+0000) 2019-11-29T21:16:42.623 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:16:42.617+0000 1694c700 -1 osd.4 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:31.251737+0000 front 2019-11-29T21:15:31.252737+0000 (oldest deadline 2019-11-29T21:16:16.424909+0000) 2019-11-29T21:16:42.731 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:16:42.725+0000 1694c700 -1 osd.1 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:32.171663+0000 front 2019-11-29T21:15:32.174029+0000 (oldest deadline 2019-11-29T21:16:14.249421+0000) 2019-11-29T21:16:42.760 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:16:42.754+0000 1694c700 -1 osd.0 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:30.018449+0000 front 2019-11-29T21:15:30.286187+0000 (oldest deadline 2019-11-29T21:16:15.566696+0000) 2019-11-29T21:16:43.271 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:16:43.265+0000 1694c700 -1 osd.6 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:32.559736+0000 front 2019-11-29T21:15:32.556097+0000 (oldest deadline 2019-11-29T21:16:15.999660+0000) 2019-11-29T21:16:43.272 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:16:43.267+0000 1694c700 -1 osd.6 304 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:122258 6.8 6:1fd8e474:root::16bdcfa80a424029b43ee60169a747c5:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e304) 2019-11-29T21:16:43.517 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:16:43.511+0000 1694c700 -1 osd.7 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:30.982239+0000 front 2019-11-29T21:15:31.001645+0000 (oldest deadline 2019-11-29T21:16:13.774774+0000) 2019-11-29T21:16:43.575 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:16:43.570+0000 1694c700 -1 osd.2 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:28.173248+0000 front 2019-11-29T21:15:28.170175+0000 (oldest deadline 2019-11-29T21:16:13.905517+0000) 2019-11-29T21:16:43.671 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:16:43.666+0000 1694c700 -1 osd.4 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:31.251737+0000 front 2019-11-29T21:15:31.252737+0000 (oldest deadline 2019-11-29T21:16:16.424909+0000) 2019-11-29T21:16:43.767 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:16:43.761+0000 1694c700 -1 osd.0 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:30.018449+0000 front 2019-11-29T21:15:30.286187+0000 (oldest deadline 2019-11-29T21:16:15.566696+0000) 2019-11-29T21:16:43.779 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:16:43.773+0000 1694c700 -1 osd.1 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:32.171663+0000 front 2019-11-29T21:15:32.174029+0000 (oldest deadline 2019-11-29T21:16:14.249421+0000) 2019-11-29T21:16:44.275 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:16:44.257+0000 1694c700 -1 osd.6 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:32.559736+0000 front 2019-11-29T21:15:32.556097+0000 (oldest deadline 2019-11-29T21:16:15.999660+0000) 2019-11-29T21:16:44.281 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:16:44.258+0000 1694c700 -1 osd.6 304 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:122258 6.8 6:1fd8e474:root::16bdcfa80a424029b43ee60169a747c5:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e304) 2019-11-29T21:16:44.538 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:16:44.533+0000 1694c700 -1 osd.7 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:30.982239+0000 front 2019-11-29T21:15:31.001645+0000 (oldest deadline 2019-11-29T21:16:13.774774+0000) 2019-11-29T21:16:44.602 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:16:44.596+0000 1694c700 -1 osd.2 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:28.173248+0000 front 2019-11-29T21:15:28.170175+0000 (oldest deadline 2019-11-29T21:16:13.905517+0000) 2019-11-29T21:16:44.631 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:16:44.626+0000 1694c700 -1 osd.4 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:31.251737+0000 front 2019-11-29T21:15:31.252737+0000 (oldest deadline 2019-11-29T21:16:16.424909+0000) 2019-11-29T21:16:44.765 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:16:44.760+0000 1694c700 -1 osd.1 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:32.171663+0000 front 2019-11-29T21:15:32.174029+0000 (oldest deadline 2019-11-29T21:16:14.249421+0000) 2019-11-29T21:16:44.785 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:16:44.780+0000 1694c700 -1 osd.0 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:30.018449+0000 front 2019-11-29T21:15:30.286187+0000 (oldest deadline 2019-11-29T21:16:15.566696+0000) 2019-11-29T21:16:45.259 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:16:45.253+0000 1694c700 -1 osd.6 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:32.559736+0000 front 2019-11-29T21:15:32.556097+0000 (oldest deadline 2019-11-29T21:16:15.999660+0000) 2019-11-29T21:16:45.260 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:16:45.255+0000 1694c700 -1 osd.6 304 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:122258 6.8 6:1fd8e474:root::16bdcfa80a424029b43ee60169a747c5:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e304) 2019-11-29T21:16:45.590 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:16:45.585+0000 1694c700 -1 osd.2 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:28.173248+0000 front 2019-11-29T21:15:28.170175+0000 (oldest deadline 2019-11-29T21:16:13.905517+0000) 2019-11-29T21:16:45.591 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:16:45.586+0000 1694c700 -1 osd.7 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:30.982239+0000 front 2019-11-29T21:15:31.001645+0000 (oldest deadline 2019-11-29T21:16:13.774774+0000) 2019-11-29T21:16:45.671 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:16:45.667+0000 1694c700 -1 osd.4 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:31.251737+0000 front 2019-11-29T21:15:31.252737+0000 (oldest deadline 2019-11-29T21:16:16.424909+0000) 2019-11-29T21:16:45.750 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:16:45.745+0000 1694c700 -1 osd.1 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:32.171663+0000 front 2019-11-29T21:15:32.174029+0000 (oldest deadline 2019-11-29T21:16:14.249421+0000) 2019-11-29T21:16:45.818 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:16:45.812+0000 1694c700 -1 osd.0 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:30.018449+0000 front 2019-11-29T21:15:30.286187+0000 (oldest deadline 2019-11-29T21:16:15.566696+0000) 2019-11-29T21:16:46.229 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:16:46.224+0000 1694c700 -1 osd.6 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:32.559736+0000 front 2019-11-29T21:15:32.556097+0000 (oldest deadline 2019-11-29T21:16:15.999660+0000) 2019-11-29T21:16:46.230 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:16:46.225+0000 1694c700 -1 osd.6 304 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:122258 6.8 6:1fd8e474:root::16bdcfa80a424029b43ee60169a747c5:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e304) 2019-11-29T21:16:46.561 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:16:46.556+0000 1694c700 -1 osd.7 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:30.982239+0000 front 2019-11-29T21:15:31.001645+0000 (oldest deadline 2019-11-29T21:16:13.774774+0000) 2019-11-29T21:16:46.568 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:16:46.564+0000 1694c700 -1 osd.2 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:28.173248+0000 front 2019-11-29T21:15:28.170175+0000 (oldest deadline 2019-11-29T21:16:13.905517+0000) 2019-11-29T21:16:46.676 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:16:46.671+0000 1694c700 -1 osd.4 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:31.251737+0000 front 2019-11-29T21:15:31.252737+0000 (oldest deadline 2019-11-29T21:16:16.424909+0000) 2019-11-29T21:16:46.798 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:16:46.793+0000 1694c700 -1 osd.1 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:32.171663+0000 front 2019-11-29T21:15:32.174029+0000 (oldest deadline 2019-11-29T21:16:14.249421+0000) 2019-11-29T21:16:46.831 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:16:46.827+0000 1694c700 -1 osd.0 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:30.018449+0000 front 2019-11-29T21:15:30.286187+0000 (oldest deadline 2019-11-29T21:16:15.566696+0000) 2019-11-29T21:16:47.264 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:16:47.258+0000 1694c700 -1 osd.6 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:32.559736+0000 front 2019-11-29T21:15:32.556097+0000 (oldest deadline 2019-11-29T21:16:15.999660+0000) 2019-11-29T21:16:47.264 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:16:47.260+0000 1694c700 -1 osd.6 304 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:122258 6.8 6:1fd8e474:root::16bdcfa80a424029b43ee60169a747c5:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e304) 2019-11-29T21:16:47.556 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:16:47.551+0000 1694c700 -1 osd.2 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:28.173248+0000 front 2019-11-29T21:15:28.170175+0000 (oldest deadline 2019-11-29T21:16:13.905517+0000) 2019-11-29T21:16:47.612 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:16:47.607+0000 1694c700 -1 osd.7 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:30.982239+0000 front 2019-11-29T21:15:31.001645+0000 (oldest deadline 2019-11-29T21:16:13.774774+0000) 2019-11-29T21:16:47.634 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:16:47.629+0000 1694c700 -1 osd.4 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:31.251737+0000 front 2019-11-29T21:15:31.252737+0000 (oldest deadline 2019-11-29T21:16:16.424909+0000) 2019-11-29T21:16:47.835 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:16:47.829+0000 1694c700 -1 osd.1 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:32.171663+0000 front 2019-11-29T21:15:32.174029+0000 (oldest deadline 2019-11-29T21:16:14.249421+0000) 2019-11-29T21:16:47.848 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:16:47.842+0000 1694c700 -1 osd.0 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:30.018449+0000 front 2019-11-29T21:15:30.286187+0000 (oldest deadline 2019-11-29T21:16:15.566696+0000) 2019-11-29T21:16:48.266 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:16:48.260+0000 1694c700 -1 osd.6 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:32.559736+0000 front 2019-11-29T21:15:32.556097+0000 (oldest deadline 2019-11-29T21:16:15.999660+0000) 2019-11-29T21:16:48.266 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:16:48.262+0000 1694c700 -1 osd.6 304 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:122258 6.8 6:1fd8e474:root::16bdcfa80a424029b43ee60169a747c5:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e304) 2019-11-29T21:16:48.539 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:16:48.533+0000 1694c700 -1 osd.2 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:28.173248+0000 front 2019-11-29T21:15:28.170175+0000 (oldest deadline 2019-11-29T21:16:13.905517+0000) 2019-11-29T21:16:48.618 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:16:48.613+0000 1694c700 -1 osd.4 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:31.251737+0000 front 2019-11-29T21:15:31.252737+0000 (oldest deadline 2019-11-29T21:16:16.424909+0000) 2019-11-29T21:16:48.634 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:16:48.629+0000 1694c700 -1 osd.7 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:30.982239+0000 front 2019-11-29T21:15:31.001645+0000 (oldest deadline 2019-11-29T21:16:13.774774+0000) 2019-11-29T21:16:48.853 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:16:48.848+0000 1694c700 -1 osd.1 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:32.171663+0000 front 2019-11-29T21:15:32.174029+0000 (oldest deadline 2019-11-29T21:16:14.249421+0000) 2019-11-29T21:16:48.876 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:16:48.872+0000 1694c700 -1 osd.0 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:30.018449+0000 front 2019-11-29T21:15:30.286187+0000 (oldest deadline 2019-11-29T21:16:15.566696+0000) 2019-11-29T21:16:49.226 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:16:49.221+0000 1694c700 -1 osd.6 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:32.559736+0000 front 2019-11-29T21:15:32.556097+0000 (oldest deadline 2019-11-29T21:16:15.999660+0000) 2019-11-29T21:16:49.228 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:16:49.224+0000 1694c700 -1 osd.6 304 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:122258 6.8 6:1fd8e474:root::16bdcfa80a424029b43ee60169a747c5:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e304) 2019-11-29T21:16:49.444 INFO:tasks.ceph.mon.b.smithi022.stderr:2019-11-29T21:16:49.439+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.22:6818/9264,v1:172.21.15.22:6819/9264] for 42sec e304 v304) 2019-11-29T21:16:49.563 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:16:49.558+0000 1694c700 -1 osd.2 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:28.173248+0000 front 2019-11-29T21:15:28.170175+0000 (oldest deadline 2019-11-29T21:16:13.905517+0000) 2019-11-29T21:16:49.630 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:16:49.626+0000 1694c700 -1 osd.7 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:30.982239+0000 front 2019-11-29T21:15:31.001645+0000 (oldest deadline 2019-11-29T21:16:13.774774+0000) 2019-11-29T21:16:49.634 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:16:49.629+0000 1694c700 -1 osd.4 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:31.251737+0000 front 2019-11-29T21:15:31.252737+0000 (oldest deadline 2019-11-29T21:16:16.424909+0000) 2019-11-29T21:16:49.849 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:16:49.844+0000 1694c700 -1 osd.1 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:32.171663+0000 front 2019-11-29T21:15:32.174029+0000 (oldest deadline 2019-11-29T21:16:14.249421+0000) 2019-11-29T21:16:49.909 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:16:49.904+0000 1694c700 -1 osd.0 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:30.018449+0000 front 2019-11-29T21:15:30.286187+0000 (oldest deadline 2019-11-29T21:16:15.566696+0000) 2019-11-29T21:16:50.258 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:16:50.253+0000 1694c700 -1 osd.6 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:32.559736+0000 front 2019-11-29T21:15:32.556097+0000 (oldest deadline 2019-11-29T21:16:15.999660+0000) 2019-11-29T21:16:50.261 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:16:50.257+0000 1694c700 -1 osd.6 304 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:122258 6.8 6:1fd8e474:root::16bdcfa80a424029b43ee60169a747c5:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e304) 2019-11-29T21:16:50.548 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:16:50.543+0000 1694c700 -1 osd.2 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:28.173248+0000 front 2019-11-29T21:15:28.170175+0000 (oldest deadline 2019-11-29T21:16:13.905517+0000) 2019-11-29T21:16:50.607 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:16:50.601+0000 1694c700 -1 osd.7 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:30.982239+0000 front 2019-11-29T21:15:31.001645+0000 (oldest deadline 2019-11-29T21:16:13.774774+0000) 2019-11-29T21:16:50.633 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:16:50.627+0000 1694c700 -1 osd.4 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:31.251737+0000 front 2019-11-29T21:15:31.252737+0000 (oldest deadline 2019-11-29T21:16:16.424909+0000) 2019-11-29T21:16:50.828 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:16:50.823+0000 1694c700 -1 osd.1 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:32.171663+0000 front 2019-11-29T21:15:32.174029+0000 (oldest deadline 2019-11-29T21:16:14.249421+0000) 2019-11-29T21:16:50.945 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:16:50.939+0000 1694c700 -1 osd.0 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:30.018449+0000 front 2019-11-29T21:15:30.286187+0000 (oldest deadline 2019-11-29T21:16:15.566696+0000) 2019-11-29T21:16:51.287 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:16:51.281+0000 1694c700 -1 osd.6 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:32.559736+0000 front 2019-11-29T21:15:32.556097+0000 (oldest deadline 2019-11-29T21:16:15.999660+0000) 2019-11-29T21:16:51.288 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:16:51.283+0000 1694c700 -1 osd.6 304 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:122258 6.8 6:1fd8e474:root::16bdcfa80a424029b43ee60169a747c5:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e304) 2019-11-29T21:16:51.536 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:16:51.530+0000 1694c700 -1 osd.2 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:28.173248+0000 front 2019-11-29T21:15:28.170175+0000 (oldest deadline 2019-11-29T21:16:13.905517+0000) 2019-11-29T21:16:51.580 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:16:51.573+0000 1694c700 -1 osd.7 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:30.982239+0000 front 2019-11-29T21:15:31.001645+0000 (oldest deadline 2019-11-29T21:16:13.774774+0000) 2019-11-29T21:16:51.592 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:16:51.587+0000 1694c700 -1 osd.4 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:31.251737+0000 front 2019-11-29T21:15:31.252737+0000 (oldest deadline 2019-11-29T21:16:16.424909+0000) 2019-11-29T21:16:51.860 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:16:51.855+0000 1694c700 -1 osd.1 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:32.171663+0000 front 2019-11-29T21:15:32.174029+0000 (oldest deadline 2019-11-29T21:16:14.249421+0000) 2019-11-29T21:16:51.958 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:16:51.953+0000 1694c700 -1 osd.0 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:30.018449+0000 front 2019-11-29T21:15:30.286187+0000 (oldest deadline 2019-11-29T21:16:15.566696+0000) 2019-11-29T21:16:52.281 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:16:52.275+0000 1694c700 -1 osd.6 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:32.559736+0000 front 2019-11-29T21:15:32.556097+0000 (oldest deadline 2019-11-29T21:16:15.999660+0000) 2019-11-29T21:16:52.281 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:16:52.276+0000 1694c700 -1 osd.6 304 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:122258 6.8 6:1fd8e474:root::16bdcfa80a424029b43ee60169a747c5:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e304) 2019-11-29T21:16:52.561 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:16:52.556+0000 1694c700 -1 osd.7 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:30.982239+0000 front 2019-11-29T21:15:31.001645+0000 (oldest deadline 2019-11-29T21:16:13.774774+0000) 2019-11-29T21:16:52.581 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:16:52.575+0000 1694c700 -1 osd.2 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:28.173248+0000 front 2019-11-29T21:15:28.170175+0000 (oldest deadline 2019-11-29T21:16:13.905517+0000) 2019-11-29T21:16:52.616 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:16:52.611+0000 1694c700 -1 osd.4 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:31.251737+0000 front 2019-11-29T21:15:31.252737+0000 (oldest deadline 2019-11-29T21:16:16.424909+0000) 2019-11-29T21:16:52.901 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:16:52.896+0000 1694c700 -1 osd.1 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:32.171663+0000 front 2019-11-29T21:15:32.174029+0000 (oldest deadline 2019-11-29T21:16:14.249421+0000) 2019-11-29T21:16:52.938 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:16:52.933+0000 1694c700 -1 osd.0 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:30.018449+0000 front 2019-11-29T21:15:30.286187+0000 (oldest deadline 2019-11-29T21:16:15.566696+0000) 2019-11-29T21:16:53.267 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:16:53.263+0000 1694c700 -1 osd.6 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:32.559736+0000 front 2019-11-29T21:15:32.556097+0000 (oldest deadline 2019-11-29T21:16:15.999660+0000) 2019-11-29T21:16:53.269 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:16:53.265+0000 1694c700 -1 osd.6 304 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:122258 6.8 6:1fd8e474:root::16bdcfa80a424029b43ee60169a747c5:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e304) 2019-11-29T21:16:53.555 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:16:53.551+0000 1694c700 -1 osd.7 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:30.982239+0000 front 2019-11-29T21:15:31.001645+0000 (oldest deadline 2019-11-29T21:16:13.774774+0000) 2019-11-29T21:16:53.564 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:16:53.559+0000 1694c700 -1 osd.2 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:28.173248+0000 front 2019-11-29T21:15:28.170175+0000 (oldest deadline 2019-11-29T21:16:13.905517+0000) 2019-11-29T21:16:53.583 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:16:53.578+0000 1694c700 -1 osd.4 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:31.251737+0000 front 2019-11-29T21:15:31.252737+0000 (oldest deadline 2019-11-29T21:16:16.424909+0000) 2019-11-29T21:16:53.864 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:16:53.859+0000 1694c700 -1 osd.1 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:32.171663+0000 front 2019-11-29T21:15:32.174029+0000 (oldest deadline 2019-11-29T21:16:14.249421+0000) 2019-11-29T21:16:53.978 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:16:53.972+0000 1694c700 -1 osd.0 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:30.018449+0000 front 2019-11-29T21:15:30.286187+0000 (oldest deadline 2019-11-29T21:16:15.566696+0000) 2019-11-29T21:16:54.244 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:16:54.239+0000 1694c700 -1 osd.6 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:32.559736+0000 front 2019-11-29T21:15:32.556097+0000 (oldest deadline 2019-11-29T21:16:15.999660+0000) 2019-11-29T21:16:54.246 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:16:54.242+0000 1694c700 -1 osd.6 304 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:122258 6.8 6:1fd8e474:root::16bdcfa80a424029b43ee60169a747c5:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e304) 2019-11-29T21:16:54.462 INFO:tasks.ceph.mon.b.smithi022.stderr:2019-11-29T21:16:54.457+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.22:6818/9264,v1:172.21.15.22:6819/9264] for 42sec e304 v304) 2019-11-29T21:16:54.551 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:16:54.546+0000 1694c700 -1 osd.2 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:28.173248+0000 front 2019-11-29T21:15:28.170175+0000 (oldest deadline 2019-11-29T21:16:13.905517+0000) 2019-11-29T21:16:54.586 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:16:54.581+0000 1694c700 -1 osd.7 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:30.982239+0000 front 2019-11-29T21:15:31.001645+0000 (oldest deadline 2019-11-29T21:16:13.774774+0000) 2019-11-29T21:16:54.600 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:16:54.595+0000 1694c700 -1 osd.4 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:31.251737+0000 front 2019-11-29T21:15:31.252737+0000 (oldest deadline 2019-11-29T21:16:16.424909+0000) 2019-11-29T21:16:54.894 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:16:54.889+0000 1694c700 -1 osd.1 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:32.171663+0000 front 2019-11-29T21:15:32.174029+0000 (oldest deadline 2019-11-29T21:16:14.249421+0000) 2019-11-29T21:16:55.016 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:16:55.011+0000 1694c700 -1 osd.0 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:30.018449+0000 front 2019-11-29T21:15:30.286187+0000 (oldest deadline 2019-11-29T21:16:15.566696+0000) 2019-11-29T21:16:55.232 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:16:55.225+0000 1694c700 -1 osd.6 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:32.559736+0000 front 2019-11-29T21:15:32.556097+0000 (oldest deadline 2019-11-29T21:16:15.999660+0000) 2019-11-29T21:16:55.233 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:16:55.227+0000 1694c700 -1 osd.6 304 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:122258 6.8 6:1fd8e474:root::16bdcfa80a424029b43ee60169a747c5:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e304) 2019-11-29T21:16:55.577 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:16:55.572+0000 1694c700 -1 osd.4 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:31.251737+0000 front 2019-11-29T21:15:31.252737+0000 (oldest deadline 2019-11-29T21:16:16.424909+0000) 2019-11-29T21:16:55.600 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:16:55.595+0000 1694c700 -1 osd.2 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:28.173248+0000 front 2019-11-29T21:15:28.170175+0000 (oldest deadline 2019-11-29T21:16:13.905517+0000) 2019-11-29T21:16:55.612 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:16:55.608+0000 1694c700 -1 osd.7 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:30.982239+0000 front 2019-11-29T21:15:31.001645+0000 (oldest deadline 2019-11-29T21:16:13.774774+0000) 2019-11-29T21:16:55.902 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:16:55.897+0000 1694c700 -1 osd.1 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:32.171663+0000 front 2019-11-29T21:15:32.174029+0000 (oldest deadline 2019-11-29T21:16:14.249421+0000) 2019-11-29T21:16:56.032 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:16:56.026+0000 1694c700 -1 osd.0 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:30.018449+0000 front 2019-11-29T21:15:30.286187+0000 (oldest deadline 2019-11-29T21:16:15.566696+0000) 2019-11-29T21:16:56.242 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:16:56.236+0000 1694c700 -1 osd.6 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:32.559736+0000 front 2019-11-29T21:15:32.556097+0000 (oldest deadline 2019-11-29T21:16:15.999660+0000) 2019-11-29T21:16:56.242 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:16:56.237+0000 1694c700 -1 osd.6 304 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:122258 6.8 6:1fd8e474:root::16bdcfa80a424029b43ee60169a747c5:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e304) 2019-11-29T21:16:56.604 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:16:56.599+0000 1694c700 -1 osd.7 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:30.982239+0000 front 2019-11-29T21:15:31.001645+0000 (oldest deadline 2019-11-29T21:16:13.774774+0000) 2019-11-29T21:16:56.611 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:16:56.606+0000 1694c700 -1 osd.2 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:28.173248+0000 front 2019-11-29T21:15:28.170175+0000 (oldest deadline 2019-11-29T21:16:13.905517+0000) 2019-11-29T21:16:56.623 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:16:56.617+0000 1694c700 -1 osd.4 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:31.251737+0000 front 2019-11-29T21:15:31.252737+0000 (oldest deadline 2019-11-29T21:16:16.424909+0000) 2019-11-29T21:16:56.916 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:16:56.911+0000 1694c700 -1 osd.1 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:32.171663+0000 front 2019-11-29T21:15:32.174029+0000 (oldest deadline 2019-11-29T21:16:14.249421+0000) 2019-11-29T21:16:57.051 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:16:57.046+0000 1694c700 -1 osd.0 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:30.018449+0000 front 2019-11-29T21:15:30.286187+0000 (oldest deadline 2019-11-29T21:16:15.566696+0000) 2019-11-29T21:16:57.291 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:16:57.285+0000 1694c700 -1 osd.6 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:32.559736+0000 front 2019-11-29T21:15:32.556097+0000 (oldest deadline 2019-11-29T21:16:15.999660+0000) 2019-11-29T21:16:57.291 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:16:57.286+0000 1694c700 -1 osd.6 304 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:122258 6.8 6:1fd8e474:root::16bdcfa80a424029b43ee60169a747c5:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e304) 2019-11-29T21:16:57.593 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:16:57.586+0000 1694c700 -1 osd.4 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:31.251737+0000 front 2019-11-29T21:15:31.252737+0000 (oldest deadline 2019-11-29T21:16:16.424909+0000) 2019-11-29T21:16:57.605 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:16:57.600+0000 1694c700 -1 osd.2 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:28.173248+0000 front 2019-11-29T21:15:28.170175+0000 (oldest deadline 2019-11-29T21:16:13.905517+0000) 2019-11-29T21:16:57.606 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:16:57.602+0000 1694c700 -1 osd.7 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:30.982239+0000 front 2019-11-29T21:15:31.001645+0000 (oldest deadline 2019-11-29T21:16:13.774774+0000) 2019-11-29T21:16:57.872 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:16:57.866+0000 1694c700 -1 osd.1 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:32.171663+0000 front 2019-11-29T21:15:32.174029+0000 (oldest deadline 2019-11-29T21:16:14.249421+0000) 2019-11-29T21:16:58.065 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:16:58.057+0000 1694c700 -1 osd.0 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:30.018449+0000 front 2019-11-29T21:15:30.286187+0000 (oldest deadline 2019-11-29T21:16:15.566696+0000) 2019-11-29T21:16:58.281 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:16:58.275+0000 1694c700 -1 osd.6 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:32.559736+0000 front 2019-11-29T21:15:32.556097+0000 (oldest deadline 2019-11-29T21:16:15.999660+0000) 2019-11-29T21:16:58.281 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:16:58.276+0000 1694c700 -1 osd.6 304 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:122258 6.8 6:1fd8e474:root::16bdcfa80a424029b43ee60169a747c5:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e304) 2019-11-29T21:16:58.633 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:16:58.627+0000 1694c700 -1 osd.4 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:31.251737+0000 front 2019-11-29T21:15:31.252737+0000 (oldest deadline 2019-11-29T21:16:16.424909+0000) 2019-11-29T21:16:58.649 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:16:58.643+0000 1694c700 -1 osd.2 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:28.173248+0000 front 2019-11-29T21:15:28.170175+0000 (oldest deadline 2019-11-29T21:16:13.905517+0000) 2019-11-29T21:16:58.658 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:16:58.652+0000 1694c700 -1 osd.7 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:30.982239+0000 front 2019-11-29T21:15:31.001645+0000 (oldest deadline 2019-11-29T21:16:13.774774+0000) 2019-11-29T21:16:58.913 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:16:58.904+0000 1694c700 -1 osd.1 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:32.171663+0000 front 2019-11-29T21:15:32.174029+0000 (oldest deadline 2019-11-29T21:16:14.249421+0000) 2019-11-29T21:16:59.042 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:16:59.036+0000 1694c700 -1 osd.0 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:30.018449+0000 front 2019-11-29T21:15:30.286187+0000 (oldest deadline 2019-11-29T21:16:15.566696+0000) 2019-11-29T21:16:59.262 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:16:59.257+0000 1694c700 -1 osd.6 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:32.559736+0000 front 2019-11-29T21:15:32.556097+0000 (oldest deadline 2019-11-29T21:16:15.999660+0000) 2019-11-29T21:16:59.265 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:16:59.261+0000 1694c700 -1 osd.6 304 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:122258 6.8 6:1fd8e474:root::16bdcfa80a424029b43ee60169a747c5:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e304) 2019-11-29T21:16:59.522 INFO:tasks.ceph.mon.b.smithi022.stderr:2019-11-29T21:16:59.516+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.22:6818/9264,v1:172.21.15.22:6819/9264] for 42sec e304 v304) 2019-11-29T21:16:59.632 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:16:59.625+0000 1694c700 -1 osd.2 304 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:15:28.173248+0000 front 2019-11-29T21:15:28.170175+0000 (oldest deadline 2019-11-29T21:16:13.905517+0000) 2019-11-29T21:17:00.303 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:17:00.298+0000 1694c700 -1 osd.6 305 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:122258 6.8 6:1fd8e474:root::16bdcfa80a424029b43ee60169a747c5:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e304) 2019-11-29T21:17:01.398 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:17:01.338+0000 1694c700 -1 osd.6 306 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:122258 6.8 6:1fd8e474:root::16bdcfa80a424029b43ee60169a747c5:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e304) 2019-11-29T21:17:06.908 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:08:51:47.566 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T21:17:06.916 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:08:51:47.574 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T21:17:06.926 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:08:51:47.533 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T21:17:06.931 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:08:51:47.538 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T21:17:06.932 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:08:51:47.539 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T21:17:06.936 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:08:51:47.543 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T21:17:07.181 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:08:51:47.788 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T21:17:07.247 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:08:51:47.854 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T21:17:07.258 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:08:51:47.916 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T21:17:34.646 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:17:34.570+0000 31f84700 -1 osd.5 310 build_incremental_map_msg missing incremental map 310 2019-11-29T21:17:34.732 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:17:34.656+0000 35f8c700 -1 osd.5 310 build_incremental_map_msg missing incremental map 310 2019-11-29T21:17:34.984 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:17:34.882+0000 3578b700 -1 osd.5 310 build_incremental_map_msg missing incremental map 310 2019-11-29T21:17:35.366 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:17:35.213+0000 35f8c700 -1 osd.5 310 build_incremental_map_msg missing incremental map 310 2019-11-29T21:17:36.082 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:17:36.074+0000 124ad700 -1 osd.5 311 build_incremental_map_msg missing incremental map 310 2019-11-29T21:17:36.257 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:17:36.216+0000 38f92700 -1 osd.1 310 build_incremental_map_msg missing incremental map 310 2019-11-29T21:17:36.338 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:17:36.235+0000 34789700 -1 osd.1 310 build_incremental_map_msg missing incremental map 310 2019-11-29T21:17:57.596 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:17:57.590+0000 1694c700 -1 osd.6 311 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:17:15.956756+0000 front 2019-11-29T21:17:16.234423+0000 (oldest deadline 2019-11-29T21:17:57.561470+0000) 2019-11-29T21:17:58.168 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:17:58.161+0000 1694c700 -1 osd.2 311 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:17:12.014042+0000 front 2019-11-29T21:17:12.108989+0000 (oldest deadline 2019-11-29T21:17:57.285099+0000) 2019-11-29T21:17:58.221 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:17:58.215+0000 1694c700 -1 osd.4 311 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:17:14.805640+0000 front 2019-11-29T21:17:14.630528+0000 (oldest deadline 2019-11-29T21:17:58.087592+0000) 2019-11-29T21:17:58.639 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:17:58.632+0000 1694c700 -1 osd.6 311 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:17:15.956756+0000 front 2019-11-29T21:17:16.234423+0000 (oldest deadline 2019-11-29T21:17:57.561470+0000) 2019-11-29T21:17:58.951 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:17:58.945+0000 1694c700 -1 osd.7 311 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:17:16.039891+0000 front 2019-11-29T21:17:16.539349+0000 (oldest deadline 2019-11-29T21:17:58.319270+0000) 2019-11-29T21:17:59.067 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:17:59.063+0000 1694c700 -1 osd.0 311 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:17:16.548538+0000 front 2019-11-29T21:17:16.503378+0000 (oldest deadline 2019-11-29T21:17:58.571463+0000) 2019-11-29T21:17:59.227 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:17:59.219+0000 1694c700 -1 osd.2 311 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:17:12.014042+0000 front 2019-11-29T21:17:12.108989+0000 (oldest deadline 2019-11-29T21:17:57.285099+0000) 2019-11-29T21:17:59.250 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:17:59.244+0000 1694c700 -1 osd.4 311 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:17:14.805640+0000 front 2019-11-29T21:17:14.630528+0000 (oldest deadline 2019-11-29T21:17:58.087592+0000) 2019-11-29T21:17:59.632 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:17:59.625+0000 1694c700 -1 osd.6 311 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:17:15.956756+0000 front 2019-11-29T21:17:16.234423+0000 (oldest deadline 2019-11-29T21:17:57.561470+0000) 2019-11-29T21:17:59.961 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:17:59.955+0000 1694c700 -1 osd.7 311 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:17:16.039891+0000 front 2019-11-29T21:17:16.539349+0000 (oldest deadline 2019-11-29T21:17:58.319270+0000) 2019-11-29T21:18:00.113 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:18:00.106+0000 1694c700 -1 osd.0 311 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:17:16.548538+0000 front 2019-11-29T21:17:16.503378+0000 (oldest deadline 2019-11-29T21:17:58.571463+0000) 2019-11-29T21:18:00.190 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:18:00.184+0000 1694c700 -1 osd.2 311 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:17:12.014042+0000 front 2019-11-29T21:17:12.108989+0000 (oldest deadline 2019-11-29T21:17:57.285099+0000) 2019-11-29T21:18:00.213 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:18:00.206+0000 1694c700 -1 osd.4 311 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:17:14.805640+0000 front 2019-11-29T21:17:14.630528+0000 (oldest deadline 2019-11-29T21:17:58.087592+0000) 2019-11-29T21:18:00.599 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:18:00.592+0000 1694c700 -1 osd.6 311 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:17:15.956756+0000 front 2019-11-29T21:17:16.234423+0000 (oldest deadline 2019-11-29T21:17:57.561470+0000) 2019-11-29T21:18:00.941 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:18:00.931+0000 1694c700 -1 osd.7 311 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:17:16.039891+0000 front 2019-11-29T21:17:16.539349+0000 (oldest deadline 2019-11-29T21:17:58.319270+0000) 2019-11-29T21:18:01.113 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:18:01.105+0000 1694c700 -1 osd.0 311 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:17:16.548538+0000 front 2019-11-29T21:17:16.503378+0000 (oldest deadline 2019-11-29T21:17:58.571463+0000) 2019-11-29T21:18:01.173 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:18:01.167+0000 1694c700 -1 osd.4 311 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:17:14.805640+0000 front 2019-11-29T21:17:14.630528+0000 (oldest deadline 2019-11-29T21:17:58.087592+0000) 2019-11-29T21:18:01.187 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:18:01.182+0000 1694c700 -1 osd.2 311 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:17:12.014042+0000 front 2019-11-29T21:17:12.108989+0000 (oldest deadline 2019-11-29T21:17:57.285099+0000) 2019-11-29T21:18:01.560 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:18:01.555+0000 1694c700 -1 osd.6 311 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:17:15.956756+0000 front 2019-11-29T21:17:16.234423+0000 (oldest deadline 2019-11-29T21:17:57.561470+0000) 2019-11-29T21:18:01.979 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:18:01.971+0000 1694c700 -1 osd.7 311 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:17:16.039891+0000 front 2019-11-29T21:17:16.539349+0000 (oldest deadline 2019-11-29T21:17:58.319270+0000) 2019-11-29T21:18:02.111 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:18:02.104+0000 1694c700 -1 osd.0 311 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:17:16.548538+0000 front 2019-11-29T21:17:16.503378+0000 (oldest deadline 2019-11-29T21:17:58.571463+0000) 2019-11-29T21:18:02.171 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:18:02.165+0000 1694c700 -1 osd.4 311 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:17:14.805640+0000 front 2019-11-29T21:17:14.630528+0000 (oldest deadline 2019-11-29T21:17:58.087592+0000) 2019-11-29T21:18:02.237 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:18:02.231+0000 1694c700 -1 osd.2 311 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:17:12.014042+0000 front 2019-11-29T21:17:12.108989+0000 (oldest deadline 2019-11-29T21:17:57.285099+0000) 2019-11-29T21:18:02.589 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:18:02.581+0000 1694c700 -1 osd.6 311 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:17:15.956756+0000 front 2019-11-29T21:17:16.234423+0000 (oldest deadline 2019-11-29T21:17:57.561470+0000) 2019-11-29T21:18:03.005 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:18:02.999+0000 1694c700 -1 osd.7 311 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:17:16.039891+0000 front 2019-11-29T21:17:16.539349+0000 (oldest deadline 2019-11-29T21:17:58.319270+0000) 2019-11-29T21:18:03.152 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:18:03.146+0000 1694c700 -1 osd.0 311 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:17:16.548538+0000 front 2019-11-29T21:17:16.503378+0000 (oldest deadline 2019-11-29T21:17:58.571463+0000) 2019-11-29T21:18:03.196 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:18:03.189+0000 1694c700 -1 osd.4 311 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:17:14.805640+0000 front 2019-11-29T21:17:14.630528+0000 (oldest deadline 2019-11-29T21:17:58.087592+0000) 2019-11-29T21:18:03.199 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:18:03.195+0000 1694c700 -1 osd.5 311 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e308) 2019-11-29T21:18:03.228 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:18:03.222+0000 1694c700 -1 osd.2 311 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:17:12.014042+0000 front 2019-11-29T21:17:12.108989+0000 (oldest deadline 2019-11-29T21:17:57.285099+0000) 2019-11-29T21:18:03.630 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:18:03.624+0000 1694c700 -1 osd.6 311 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:17:15.956756+0000 front 2019-11-29T21:17:16.234423+0000 (oldest deadline 2019-11-29T21:17:57.561470+0000) 2019-11-29T21:18:04.027 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:18:04.021+0000 1694c700 -1 osd.7 311 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:17:16.039891+0000 front 2019-11-29T21:17:16.539349+0000 (oldest deadline 2019-11-29T21:17:58.319270+0000) 2019-11-29T21:18:04.159 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:18:04.152+0000 1694c700 -1 osd.4 311 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:17:14.805640+0000 front 2019-11-29T21:17:14.630528+0000 (oldest deadline 2019-11-29T21:17:58.087592+0000) 2019-11-29T21:18:04.166 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:18:04.160+0000 1694c700 -1 osd.0 311 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:17:16.548538+0000 front 2019-11-29T21:17:16.503378+0000 (oldest deadline 2019-11-29T21:17:58.571463+0000) 2019-11-29T21:18:04.224 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:18:04.219+0000 1694c700 -1 osd.5 311 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e308) 2019-11-29T21:18:04.230 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:18:04.224+0000 1694c700 -1 osd.2 311 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:17:12.014042+0000 front 2019-11-29T21:17:12.108989+0000 (oldest deadline 2019-11-29T21:17:57.285099+0000) 2019-11-29T21:18:04.670 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:18:04.664+0000 1694c700 -1 osd.6 311 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:17:15.956756+0000 front 2019-11-29T21:17:16.234423+0000 (oldest deadline 2019-11-29T21:17:57.561470+0000) 2019-11-29T21:18:04.993 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:18:04.986+0000 1694c700 -1 osd.7 311 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:17:16.039891+0000 front 2019-11-29T21:17:16.539349+0000 (oldest deadline 2019-11-29T21:17:58.319270+0000) 2019-11-29T21:18:05.238 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:18:05.234+0000 1694c700 -1 osd.2 311 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:17:12.014042+0000 front 2019-11-29T21:17:12.108989+0000 (oldest deadline 2019-11-29T21:17:57.285099+0000) 2019-11-29T21:18:05.557 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:18:05.340+0000 1694c700 -1 osd.5 312 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e308) 2019-11-29T21:18:05.639 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:18:05.557+0000 3578b700 -1 osd.5 312 build_incremental_map_msg missing incremental map 310 2019-11-29T21:19:29.570 INFO:teuthology.orchestra.run.smithi062.stderr:testContainerExistenceCachingProblem (test.functional.tests.TestContainer) ... ok 2019-11-29T21:19:40.175 INFO:teuthology.orchestra.run.smithi062.stderr:testContainerFileList (test.functional.tests.TestContainer) ... ok 2019-11-29T21:19:44.033 INFO:teuthology.orchestra.run.smithi062.stderr:testContainerFileListOnContainerThatDoesNotExist (test.functional.tests.TestContainer) ... ok 2019-11-29T21:19:57.637 INFO:teuthology.orchestra.run.smithi062.stderr:testContainerFileListWithLimit (test.functional.tests.TestContainer) ... ok 2019-11-29T21:19:58.908 INFO:teuthology.orchestra.run.smithi062.stderr:testContainerInfo (test.functional.tests.TestContainer) ... ok 2019-11-29T21:20:00.022 INFO:teuthology.orchestra.run.smithi062.stderr:testContainerInfoOnContainerThatDoesNotExist (test.functional.tests.TestContainer) ... ok 2019-11-29T21:20:20.754 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:08:55:01.412 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T21:20:20.796 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:08:55:01.454 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T21:20:20.803 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:08:55:01.410 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T21:20:20.822 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:08:55:01.429 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T21:20:20.824 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:08:55:01.431 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T21:20:20.857 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:08:55:01.464 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T21:20:21.024 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:08:55:01.631 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T21:20:21.075 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:08:55:01.682 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T21:20:21.145 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:08:55:01.803 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T21:20:25.310 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:20:25.304+0000 1694c700 -1 osd.6 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:42.449685+0000 front 2019-11-29T21:19:45.036882+0000 (oldest deadline 2019-11-29T21:20:24.969312+0000) 2019-11-29T21:20:25.450 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:20:25.443+0000 1694c700 -1 osd.0 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:44.992971+0000 front 2019-11-29T21:19:44.955979+0000 (oldest deadline 2019-11-29T21:20:24.876002+0000) 2019-11-29T21:20:26.228 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:20:26.223+0000 1694c700 -1 osd.4 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:41.674767+0000 front 2019-11-29T21:19:42.252818+0000 (oldest deadline 2019-11-29T21:20:25.479901+0000) 2019-11-29T21:20:26.241 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:20:26.236+0000 1694c700 -1 osd.1 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:44.768506+0000 front 2019-11-29T21:19:46.629509+0000 (oldest deadline 2019-11-29T21:20:25.495458+0000) 2019-11-29T21:20:26.268 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:20:26.262+0000 1694c700 -1 osd.6 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:42.449685+0000 front 2019-11-29T21:19:45.036882+0000 (oldest deadline 2019-11-29T21:20:24.969312+0000) 2019-11-29T21:20:26.439 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:20:26.434+0000 1694c700 -1 osd.0 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:44.992971+0000 front 2019-11-29T21:19:44.955979+0000 (oldest deadline 2019-11-29T21:20:24.876002+0000) 2019-11-29T21:20:27.093 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:20:27.088+0000 1694c700 -1 osd.2 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:46.605817+0000 front 2019-11-29T21:19:44.260084+0000 (oldest deadline 2019-11-29T21:20:26.398110+0000) 2019-11-29T21:20:27.281 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:20:27.276+0000 1694c700 -1 osd.4 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:41.674767+0000 front 2019-11-29T21:19:42.252818+0000 (oldest deadline 2019-11-29T21:20:25.479901+0000) 2019-11-29T21:20:27.288 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:20:27.282+0000 1694c700 -1 osd.1 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:44.768506+0000 front 2019-11-29T21:19:46.629509+0000 (oldest deadline 2019-11-29T21:20:25.495458+0000) 2019-11-29T21:20:27.300 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:20:27.295+0000 1694c700 -1 osd.6 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:42.449685+0000 front 2019-11-29T21:19:45.036882+0000 (oldest deadline 2019-11-29T21:20:24.969312+0000) 2019-11-29T21:20:27.476 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:20:27.470+0000 1694c700 -1 osd.0 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:44.992971+0000 front 2019-11-29T21:19:44.955979+0000 (oldest deadline 2019-11-29T21:20:24.876002+0000) 2019-11-29T21:20:28.074 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:20:28.069+0000 1694c700 -1 osd.2 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:46.605817+0000 front 2019-11-29T21:19:44.260084+0000 (oldest deadline 2019-11-29T21:20:26.398110+0000) 2019-11-29T21:20:28.273 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:20:28.267+0000 1694c700 -1 osd.6 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:42.449685+0000 front 2019-11-29T21:19:45.036882+0000 (oldest deadline 2019-11-29T21:20:24.969312+0000) 2019-11-29T21:20:28.309 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:20:28.304+0000 1694c700 -1 osd.1 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:44.768506+0000 front 2019-11-29T21:19:46.629509+0000 (oldest deadline 2019-11-29T21:20:25.495458+0000) 2019-11-29T21:20:28.335 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:20:28.329+0000 1694c700 -1 osd.4 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:41.674767+0000 front 2019-11-29T21:19:42.252818+0000 (oldest deadline 2019-11-29T21:20:25.479901+0000) 2019-11-29T21:20:28.484 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:20:28.478+0000 1694c700 -1 osd.0 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:44.992971+0000 front 2019-11-29T21:19:44.955979+0000 (oldest deadline 2019-11-29T21:20:24.876002+0000) 2019-11-29T21:20:29.048 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:20:29.039+0000 1694c700 -1 osd.2 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:46.605817+0000 front 2019-11-29T21:19:44.260084+0000 (oldest deadline 2019-11-29T21:20:26.398110+0000) 2019-11-29T21:20:29.314 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:20:29.308+0000 1694c700 -1 osd.1 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:44.768506+0000 front 2019-11-29T21:19:46.629509+0000 (oldest deadline 2019-11-29T21:20:25.495458+0000) 2019-11-29T21:20:29.328 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:20:29.322+0000 1694c700 -1 osd.6 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:42.449685+0000 front 2019-11-29T21:19:45.036882+0000 (oldest deadline 2019-11-29T21:20:24.969312+0000) 2019-11-29T21:20:29.354 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:20:29.348+0000 1694c700 -1 osd.4 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:41.674767+0000 front 2019-11-29T21:19:42.252818+0000 (oldest deadline 2019-11-29T21:20:25.479901+0000) 2019-11-29T21:20:29.502 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:20:29.495+0000 1694c700 -1 osd.0 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:44.992971+0000 front 2019-11-29T21:19:44.955979+0000 (oldest deadline 2019-11-29T21:20:24.876002+0000) 2019-11-29T21:20:30.041 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:20:30.037+0000 1694c700 -1 osd.2 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:46.605817+0000 front 2019-11-29T21:19:44.260084+0000 (oldest deadline 2019-11-29T21:20:26.398110+0000) 2019-11-29T21:20:30.176 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:20:30.171+0000 1694c700 -1 osd.7 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:45.286901+0000 front 2019-11-29T21:19:45.271818+0000 (oldest deadline 2019-11-29T21:20:30.098128+0000) 2019-11-29T21:20:30.310 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:20:30.306+0000 1694c700 -1 osd.1 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:44.768506+0000 front 2019-11-29T21:19:46.629509+0000 (oldest deadline 2019-11-29T21:20:25.495458+0000) 2019-11-29T21:20:30.352 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:20:30.345+0000 1694c700 -1 osd.6 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:42.449685+0000 front 2019-11-29T21:19:45.036882+0000 (oldest deadline 2019-11-29T21:20:24.969312+0000) 2019-11-29T21:20:30.402 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:20:30.397+0000 1694c700 -1 osd.4 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:41.674767+0000 front 2019-11-29T21:19:42.252818+0000 (oldest deadline 2019-11-29T21:20:25.479901+0000) 2019-11-29T21:20:30.495 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:20:30.490+0000 1694c700 -1 osd.0 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:44.992971+0000 front 2019-11-29T21:19:44.955979+0000 (oldest deadline 2019-11-29T21:20:24.876002+0000) 2019-11-29T21:20:31.070 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:20:31.064+0000 1694c700 -1 osd.2 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:46.605817+0000 front 2019-11-29T21:19:44.260084+0000 (oldest deadline 2019-11-29T21:20:26.398110+0000) 2019-11-29T21:20:31.182 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:20:31.177+0000 1694c700 -1 osd.7 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:45.286901+0000 front 2019-11-29T21:19:45.271818+0000 (oldest deadline 2019-11-29T21:20:30.098128+0000) 2019-11-29T21:20:31.322 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:20:31.317+0000 1694c700 -1 osd.6 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:42.449685+0000 front 2019-11-29T21:19:45.036882+0000 (oldest deadline 2019-11-29T21:20:24.969312+0000) 2019-11-29T21:20:31.335 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:20:31.329+0000 1694c700 -1 osd.1 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:44.768506+0000 front 2019-11-29T21:19:46.629509+0000 (oldest deadline 2019-11-29T21:20:25.495458+0000) 2019-11-29T21:20:31.400 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:20:31.393+0000 1694c700 -1 osd.4 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:41.674767+0000 front 2019-11-29T21:19:42.252818+0000 (oldest deadline 2019-11-29T21:20:25.479901+0000) 2019-11-29T21:20:31.455 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:20:31.449+0000 1694c700 -1 osd.0 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:44.992971+0000 front 2019-11-29T21:19:44.955979+0000 (oldest deadline 2019-11-29T21:20:24.876002+0000) 2019-11-29T21:20:32.054 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:20:32.050+0000 1694c700 -1 osd.2 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:46.605817+0000 front 2019-11-29T21:19:44.260084+0000 (oldest deadline 2019-11-29T21:20:26.398110+0000) 2019-11-29T21:20:32.179 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:20:32.174+0000 1694c700 -1 osd.7 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:45.286901+0000 front 2019-11-29T21:19:45.271818+0000 (oldest deadline 2019-11-29T21:20:30.098128+0000) 2019-11-29T21:20:32.302 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:20:32.297+0000 1694c700 -1 osd.1 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:44.768506+0000 front 2019-11-29T21:19:46.629509+0000 (oldest deadline 2019-11-29T21:20:25.495458+0000) 2019-11-29T21:20:32.307 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:20:32.302+0000 1694c700 -1 osd.6 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:42.449685+0000 front 2019-11-29T21:19:45.036882+0000 (oldest deadline 2019-11-29T21:20:24.969312+0000) 2019-11-29T21:20:32.412 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:20:32.408+0000 1694c700 -1 osd.4 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:41.674767+0000 front 2019-11-29T21:19:42.252818+0000 (oldest deadline 2019-11-29T21:20:25.479901+0000) 2019-11-29T21:20:32.470 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:20:32.465+0000 1694c700 -1 osd.0 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:44.992971+0000 front 2019-11-29T21:19:44.955979+0000 (oldest deadline 2019-11-29T21:20:24.876002+0000) 2019-11-29T21:20:33.075 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:20:33.069+0000 1694c700 -1 osd.2 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:46.605817+0000 front 2019-11-29T21:19:44.260084+0000 (oldest deadline 2019-11-29T21:20:26.398110+0000) 2019-11-29T21:20:33.168 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:20:33.163+0000 1694c700 -1 osd.7 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:45.286901+0000 front 2019-11-29T21:19:45.271818+0000 (oldest deadline 2019-11-29T21:20:30.098128+0000) 2019-11-29T21:20:33.323 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:20:33.318+0000 1694c700 -1 osd.6 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:42.449685+0000 front 2019-11-29T21:19:45.036882+0000 (oldest deadline 2019-11-29T21:20:24.969312+0000) 2019-11-29T21:20:33.324 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:20:33.319+0000 1694c700 -1 osd.1 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:44.768506+0000 front 2019-11-29T21:19:46.629509+0000 (oldest deadline 2019-11-29T21:20:25.495458+0000) 2019-11-29T21:20:33.460 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:20:33.455+0000 1694c700 -1 osd.0 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:44.992971+0000 front 2019-11-29T21:19:44.955979+0000 (oldest deadline 2019-11-29T21:20:24.876002+0000) 2019-11-29T21:20:33.461 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:20:33.456+0000 1694c700 -1 osd.4 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:41.674767+0000 front 2019-11-29T21:19:42.252818+0000 (oldest deadline 2019-11-29T21:20:25.479901+0000) 2019-11-29T21:20:34.060 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:20:34.054+0000 1694c700 -1 osd.2 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:46.605817+0000 front 2019-11-29T21:19:44.260084+0000 (oldest deadline 2019-11-29T21:20:26.398110+0000) 2019-11-29T21:20:34.156 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:20:34.151+0000 1694c700 -1 osd.7 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:45.286901+0000 front 2019-11-29T21:19:45.271818+0000 (oldest deadline 2019-11-29T21:20:30.098128+0000) 2019-11-29T21:20:34.295 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:20:34.290+0000 1694c700 -1 osd.1 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:44.768506+0000 front 2019-11-29T21:19:46.629509+0000 (oldest deadline 2019-11-29T21:20:25.495458+0000) 2019-11-29T21:20:34.320 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:20:34.315+0000 1694c700 -1 osd.6 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:42.449685+0000 front 2019-11-29T21:19:45.036882+0000 (oldest deadline 2019-11-29T21:20:24.969312+0000) 2019-11-29T21:20:34.455 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:20:34.449+0000 1694c700 -1 osd.0 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:44.992971+0000 front 2019-11-29T21:19:44.955979+0000 (oldest deadline 2019-11-29T21:20:24.876002+0000) 2019-11-29T21:20:34.463 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:20:34.457+0000 1694c700 -1 osd.4 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:41.674767+0000 front 2019-11-29T21:19:42.252818+0000 (oldest deadline 2019-11-29T21:20:25.479901+0000) 2019-11-29T21:20:35.091 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:20:35.086+0000 1694c700 -1 osd.2 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:46.605817+0000 front 2019-11-29T21:19:44.260084+0000 (oldest deadline 2019-11-29T21:20:26.398110+0000) 2019-11-29T21:20:35.204 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:20:35.199+0000 1694c700 -1 osd.7 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:45.286901+0000 front 2019-11-29T21:19:45.271818+0000 (oldest deadline 2019-11-29T21:20:30.098128+0000) 2019-11-29T21:20:35.336 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:20:35.331+0000 1694c700 -1 osd.6 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:42.449685+0000 front 2019-11-29T21:19:45.036882+0000 (oldest deadline 2019-11-29T21:20:24.969312+0000) 2019-11-29T21:20:35.339 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:20:35.333+0000 1694c700 -1 osd.1 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:44.768506+0000 front 2019-11-29T21:19:46.629509+0000 (oldest deadline 2019-11-29T21:20:25.495458+0000) 2019-11-29T21:20:35.456 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:20:35.450+0000 1694c700 -1 osd.4 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:41.674767+0000 front 2019-11-29T21:19:42.252818+0000 (oldest deadline 2019-11-29T21:20:25.479901+0000) 2019-11-29T21:20:35.457 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:20:35.452+0000 1694c700 -1 osd.0 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:44.992971+0000 front 2019-11-29T21:19:44.955979+0000 (oldest deadline 2019-11-29T21:20:24.876002+0000) 2019-11-29T21:20:36.059 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:20:36.054+0000 1694c700 -1 osd.2 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:46.605817+0000 front 2019-11-29T21:19:44.260084+0000 (oldest deadline 2019-11-29T21:20:26.398110+0000) 2019-11-29T21:20:36.208 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:20:36.203+0000 1694c700 -1 osd.7 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:45.286901+0000 front 2019-11-29T21:19:45.271818+0000 (oldest deadline 2019-11-29T21:20:30.098128+0000) 2019-11-29T21:20:36.325 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:20:36.320+0000 1694c700 -1 osd.1 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:44.768506+0000 front 2019-11-29T21:19:46.629509+0000 (oldest deadline 2019-11-29T21:20:25.495458+0000) 2019-11-29T21:20:36.331 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:20:36.326+0000 1694c700 -1 osd.6 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:42.449685+0000 front 2019-11-29T21:19:45.036882+0000 (oldest deadline 2019-11-29T21:20:24.969312+0000) 2019-11-29T21:20:36.416 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:20:36.410+0000 1694c700 -1 osd.4 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:41.674767+0000 front 2019-11-29T21:19:42.252818+0000 (oldest deadline 2019-11-29T21:20:25.479901+0000) 2019-11-29T21:20:36.468 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:20:36.463+0000 1694c700 -1 osd.0 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:44.992971+0000 front 2019-11-29T21:19:44.955979+0000 (oldest deadline 2019-11-29T21:20:24.876002+0000) 2019-11-29T21:20:37.075 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:20:37.071+0000 1694c700 -1 osd.2 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:46.605817+0000 front 2019-11-29T21:19:44.260084+0000 (oldest deadline 2019-11-29T21:20:26.398110+0000) 2019-11-29T21:20:37.219 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:20:37.210+0000 1694c700 -1 osd.7 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:45.286901+0000 front 2019-11-29T21:19:45.271818+0000 (oldest deadline 2019-11-29T21:20:30.098128+0000) 2019-11-29T21:20:37.345 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:20:37.340+0000 1694c700 -1 osd.1 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:44.768506+0000 front 2019-11-29T21:19:46.629509+0000 (oldest deadline 2019-11-29T21:20:25.495458+0000) 2019-11-29T21:20:37.386 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:20:37.381+0000 1694c700 -1 osd.6 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:42.449685+0000 front 2019-11-29T21:19:45.036882+0000 (oldest deadline 2019-11-29T21:20:24.969312+0000) 2019-11-29T21:20:37.437 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:20:37.432+0000 1694c700 -1 osd.4 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:41.674767+0000 front 2019-11-29T21:19:42.252818+0000 (oldest deadline 2019-11-29T21:20:25.479901+0000) 2019-11-29T21:20:37.453 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:20:37.448+0000 1694c700 -1 osd.0 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:44.992971+0000 front 2019-11-29T21:19:44.955979+0000 (oldest deadline 2019-11-29T21:20:24.876002+0000) 2019-11-29T21:20:38.076 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:20:38.071+0000 1694c700 -1 osd.2 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:46.605817+0000 front 2019-11-29T21:19:44.260084+0000 (oldest deadline 2019-11-29T21:20:26.398110+0000) 2019-11-29T21:20:38.195 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:20:38.189+0000 1694c700 -1 osd.7 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:45.286901+0000 front 2019-11-29T21:19:45.271818+0000 (oldest deadline 2019-11-29T21:20:30.098128+0000) 2019-11-29T21:20:38.392 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:20:38.387+0000 1694c700 -1 osd.1 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:44.768506+0000 front 2019-11-29T21:19:46.629509+0000 (oldest deadline 2019-11-29T21:20:25.495458+0000) 2019-11-29T21:20:38.401 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:20:38.396+0000 1694c700 -1 osd.6 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:42.449685+0000 front 2019-11-29T21:19:45.036882+0000 (oldest deadline 2019-11-29T21:20:24.969312+0000) 2019-11-29T21:20:38.441 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:20:38.436+0000 1694c700 -1 osd.4 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:41.674767+0000 front 2019-11-29T21:19:42.252818+0000 (oldest deadline 2019-11-29T21:20:25.479901+0000) 2019-11-29T21:20:38.456 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:20:38.450+0000 1694c700 -1 osd.0 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:44.992971+0000 front 2019-11-29T21:19:44.955979+0000 (oldest deadline 2019-11-29T21:20:24.876002+0000) 2019-11-29T21:20:39.071 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:20:39.065+0000 1694c700 -1 osd.2 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:46.605817+0000 front 2019-11-29T21:19:44.260084+0000 (oldest deadline 2019-11-29T21:20:26.398110+0000) 2019-11-29T21:20:39.171 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:20:39.166+0000 1694c700 -1 osd.7 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:45.286901+0000 front 2019-11-29T21:19:45.271818+0000 (oldest deadline 2019-11-29T21:20:30.098128+0000) 2019-11-29T21:20:39.359 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:20:39.353+0000 1694c700 -1 osd.1 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:44.768506+0000 front 2019-11-29T21:19:46.629509+0000 (oldest deadline 2019-11-29T21:20:25.495458+0000) 2019-11-29T21:20:39.409 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:20:39.403+0000 1694c700 -1 osd.6 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:42.449685+0000 front 2019-11-29T21:19:45.036882+0000 (oldest deadline 2019-11-29T21:20:24.969312+0000) 2019-11-29T21:20:39.442 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:20:39.437+0000 1694c700 -1 osd.0 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:44.992971+0000 front 2019-11-29T21:19:44.955979+0000 (oldest deadline 2019-11-29T21:20:24.876002+0000) 2019-11-29T21:20:39.486 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:20:39.481+0000 1694c700 -1 osd.4 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:41.674767+0000 front 2019-11-29T21:19:42.252818+0000 (oldest deadline 2019-11-29T21:20:25.479901+0000) 2019-11-29T21:20:40.072 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:20:40.067+0000 1694c700 -1 osd.2 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:46.605817+0000 front 2019-11-29T21:19:44.260084+0000 (oldest deadline 2019-11-29T21:20:26.398110+0000) 2019-11-29T21:20:40.173 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:20:40.168+0000 1694c700 -1 osd.7 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:45.286901+0000 front 2019-11-29T21:19:45.271818+0000 (oldest deadline 2019-11-29T21:20:30.098128+0000) 2019-11-29T21:20:40.319 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:20:40.314+0000 1694c700 -1 osd.1 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:44.768506+0000 front 2019-11-29T21:19:46.629509+0000 (oldest deadline 2019-11-29T21:20:25.495458+0000) 2019-11-29T21:20:40.420 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:20:40.414+0000 1694c700 -1 osd.6 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:42.449685+0000 front 2019-11-29T21:19:45.036882+0000 (oldest deadline 2019-11-29T21:20:24.969312+0000) 2019-11-29T21:20:40.421 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:20:40.416+0000 1694c700 -1 osd.0 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:44.992971+0000 front 2019-11-29T21:19:44.955979+0000 (oldest deadline 2019-11-29T21:20:24.876002+0000) 2019-11-29T21:20:40.471 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:20:40.466+0000 1694c700 -1 osd.4 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:41.674767+0000 front 2019-11-29T21:19:42.252818+0000 (oldest deadline 2019-11-29T21:20:25.479901+0000) 2019-11-29T21:20:41.083 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:20:41.078+0000 1694c700 -1 osd.2 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:46.605817+0000 front 2019-11-29T21:19:44.260084+0000 (oldest deadline 2019-11-29T21:20:26.398110+0000) 2019-11-29T21:20:41.174 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:20:41.167+0000 1694c700 -1 osd.7 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:45.286901+0000 front 2019-11-29T21:19:45.271818+0000 (oldest deadline 2019-11-29T21:20:30.098128+0000) 2019-11-29T21:20:41.345 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:20:41.340+0000 1694c700 -1 osd.1 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:44.768506+0000 front 2019-11-29T21:19:46.629509+0000 (oldest deadline 2019-11-29T21:20:25.495458+0000) 2019-11-29T21:20:41.409 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:20:41.404+0000 1694c700 -1 osd.0 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:44.992971+0000 front 2019-11-29T21:19:44.955979+0000 (oldest deadline 2019-11-29T21:20:24.876002+0000) 2019-11-29T21:20:41.456 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:20:41.450+0000 1694c700 -1 osd.4 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:41.674767+0000 front 2019-11-29T21:19:42.252818+0000 (oldest deadline 2019-11-29T21:20:25.479901+0000) 2019-11-29T21:20:41.470 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:20:41.465+0000 1694c700 -1 osd.6 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:42.449685+0000 front 2019-11-29T21:19:45.036882+0000 (oldest deadline 2019-11-29T21:20:24.969312+0000) 2019-11-29T21:20:42.060 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:20:42.055+0000 1694c700 -1 osd.2 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:46.605817+0000 front 2019-11-29T21:19:44.260084+0000 (oldest deadline 2019-11-29T21:20:26.398110+0000) 2019-11-29T21:20:42.188 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:20:42.182+0000 1694c700 -1 osd.7 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:45.286901+0000 front 2019-11-29T21:19:45.271818+0000 (oldest deadline 2019-11-29T21:20:30.098128+0000) 2019-11-29T21:20:42.345 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:20:42.338+0000 1694c700 -1 osd.1 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:44.768506+0000 front 2019-11-29T21:19:46.629509+0000 (oldest deadline 2019-11-29T21:20:25.495458+0000) 2019-11-29T21:20:42.346 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:20:42.340+0000 1694c700 -1 osd.1 318 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:122739 7.0 7:0943defa:::2019-11-29-21-7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.624-aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa:head [append 0~838 in=838b] snapc 0=[] ondisk+write+known_if_redirected e318) 2019-11-29T21:20:42.400 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:20:42.395+0000 1694c700 -1 osd.0 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:44.992971+0000 front 2019-11-29T21:19:44.955979+0000 (oldest deadline 2019-11-29T21:20:24.876002+0000) 2019-11-29T21:20:42.417 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:20:42.411+0000 1694c700 -1 osd.4 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:41.674767+0000 front 2019-11-29T21:19:42.252818+0000 (oldest deadline 2019-11-29T21:20:25.479901+0000) 2019-11-29T21:20:42.489 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:20:42.484+0000 1694c700 -1 osd.6 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:42.449685+0000 front 2019-11-29T21:19:45.036882+0000 (oldest deadline 2019-11-29T21:20:24.969312+0000) 2019-11-29T21:20:43.042 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:20:43.037+0000 1694c700 -1 osd.2 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:46.605817+0000 front 2019-11-29T21:19:44.260084+0000 (oldest deadline 2019-11-29T21:20:26.398110+0000) 2019-11-29T21:20:43.190 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:20:43.186+0000 1694c700 -1 osd.7 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:45.286901+0000 front 2019-11-29T21:19:45.271818+0000 (oldest deadline 2019-11-29T21:20:30.098128+0000) 2019-11-29T21:20:43.346 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:20:43.339+0000 1694c700 -1 osd.1 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:44.768506+0000 front 2019-11-29T21:19:46.629509+0000 (oldest deadline 2019-11-29T21:20:25.495458+0000) 2019-11-29T21:20:43.347 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:20:43.341+0000 1694c700 -1 osd.1 318 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:122739 7.0 7:0943defa:::2019-11-29-21-7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.624-aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa:head [append 0~838 in=838b] snapc 0=[] ondisk+write+known_if_redirected e318) 2019-11-29T21:20:43.423 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:20:43.417+0000 1694c700 -1 osd.4 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:41.674767+0000 front 2019-11-29T21:19:42.252818+0000 (oldest deadline 2019-11-29T21:20:25.479901+0000) 2019-11-29T21:20:43.446 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:20:43.441+0000 1694c700 -1 osd.0 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:44.992971+0000 front 2019-11-29T21:19:44.955979+0000 (oldest deadline 2019-11-29T21:20:24.876002+0000) 2019-11-29T21:20:43.502 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:20:43.497+0000 1694c700 -1 osd.6 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:42.449685+0000 front 2019-11-29T21:19:45.036882+0000 (oldest deadline 2019-11-29T21:20:24.969312+0000) 2019-11-29T21:20:44.041 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:20:44.036+0000 1694c700 -1 osd.2 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:46.605817+0000 front 2019-11-29T21:19:44.260084+0000 (oldest deadline 2019-11-29T21:20:26.398110+0000) 2019-11-29T21:20:44.177 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:20:44.171+0000 1694c700 -1 osd.7 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:45.286901+0000 front 2019-11-29T21:19:45.271818+0000 (oldest deadline 2019-11-29T21:20:30.098128+0000) 2019-11-29T21:20:44.369 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:20:44.363+0000 1694c700 -1 osd.1 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:44.768506+0000 front 2019-11-29T21:19:46.629509+0000 (oldest deadline 2019-11-29T21:20:25.495458+0000) 2019-11-29T21:20:44.373 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:20:44.369+0000 1694c700 -1 osd.1 318 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:122739 7.0 7:0943defa:::2019-11-29-21-7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.624-aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa:head [append 0~838 in=838b] snapc 0=[] ondisk+write+known_if_redirected e318) 2019-11-29T21:20:44.419 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:20:44.413+0000 1694c700 -1 osd.0 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:44.992971+0000 front 2019-11-29T21:19:44.955979+0000 (oldest deadline 2019-11-29T21:20:24.876002+0000) 2019-11-29T21:20:44.466 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:20:44.460+0000 1694c700 -1 osd.4 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:41.674767+0000 front 2019-11-29T21:19:42.252818+0000 (oldest deadline 2019-11-29T21:20:25.479901+0000) 2019-11-29T21:20:44.528 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:20:44.523+0000 1694c700 -1 osd.6 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:42.449685+0000 front 2019-11-29T21:19:45.036882+0000 (oldest deadline 2019-11-29T21:20:24.969312+0000) 2019-11-29T21:20:45.087 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:20:45.082+0000 1694c700 -1 osd.2 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:46.605817+0000 front 2019-11-29T21:19:44.260084+0000 (oldest deadline 2019-11-29T21:20:26.398110+0000) 2019-11-29T21:20:45.134 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:20:45.129+0000 1694c700 -1 osd.7 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:45.286901+0000 front 2019-11-29T21:19:45.271818+0000 (oldest deadline 2019-11-29T21:20:30.098128+0000) 2019-11-29T21:20:45.390 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:20:45.386+0000 1694c700 -1 osd.0 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:44.992971+0000 front 2019-11-29T21:19:44.955979+0000 (oldest deadline 2019-11-29T21:20:24.876002+0000) 2019-11-29T21:20:45.398 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:20:45.393+0000 1694c700 -1 osd.1 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:44.768506+0000 front 2019-11-29T21:19:46.629509+0000 (oldest deadline 2019-11-29T21:20:25.495458+0000) 2019-11-29T21:20:45.399 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:20:45.395+0000 1694c700 -1 osd.1 318 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:122739 7.0 7:0943defa:::2019-11-29-21-7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.624-aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa:head [append 0~838 in=838b] snapc 0=[] ondisk+write+known_if_redirected e318) 2019-11-29T21:20:45.459 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:20:45.453+0000 1694c700 -1 osd.4 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:41.674767+0000 front 2019-11-29T21:19:42.252818+0000 (oldest deadline 2019-11-29T21:20:25.479901+0000) 2019-11-29T21:20:45.567 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:20:45.562+0000 1694c700 -1 osd.6 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:42.449685+0000 front 2019-11-29T21:19:45.036882+0000 (oldest deadline 2019-11-29T21:20:24.969312+0000) 2019-11-29T21:20:46.094 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:20:46.089+0000 1694c700 -1 osd.2 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:46.605817+0000 front 2019-11-29T21:19:44.260084+0000 (oldest deadline 2019-11-29T21:20:26.398110+0000) 2019-11-29T21:20:46.176 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:20:46.172+0000 1694c700 -1 osd.7 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:45.286901+0000 front 2019-11-29T21:19:45.271818+0000 (oldest deadline 2019-11-29T21:20:30.098128+0000) 2019-11-29T21:20:46.422 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:20:46.418+0000 1694c700 -1 osd.1 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:44.768506+0000 front 2019-11-29T21:19:46.629509+0000 (oldest deadline 2019-11-29T21:20:25.495458+0000) 2019-11-29T21:20:46.423 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:20:46.420+0000 1694c700 -1 osd.1 318 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:122739 7.0 7:0943defa:::2019-11-29-21-7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.624-aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa:head [append 0~838 in=838b] snapc 0=[] ondisk+write+known_if_redirected e318) 2019-11-29T21:20:46.432 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:20:46.427+0000 1694c700 -1 osd.0 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:44.992971+0000 front 2019-11-29T21:19:44.955979+0000 (oldest deadline 2019-11-29T21:20:24.876002+0000) 2019-11-29T21:20:46.479 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:20:46.473+0000 1694c700 -1 osd.4 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:41.674767+0000 front 2019-11-29T21:19:42.252818+0000 (oldest deadline 2019-11-29T21:20:25.479901+0000) 2019-11-29T21:20:46.576 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:20:46.571+0000 1694c700 -1 osd.6 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:42.449685+0000 front 2019-11-29T21:19:45.036882+0000 (oldest deadline 2019-11-29T21:20:24.969312+0000) 2019-11-29T21:20:47.121 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:20:47.116+0000 1694c700 -1 osd.2 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:46.605817+0000 front 2019-11-29T21:19:44.260084+0000 (oldest deadline 2019-11-29T21:20:26.398110+0000) 2019-11-29T21:20:47.214 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:20:47.208+0000 1694c700 -1 osd.7 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:45.286901+0000 front 2019-11-29T21:19:45.271818+0000 (oldest deadline 2019-11-29T21:20:30.098128+0000) 2019-11-29T21:20:47.377 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:20:47.372+0000 1694c700 -1 osd.1 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:44.768506+0000 front 2019-11-29T21:19:46.629509+0000 (oldest deadline 2019-11-29T21:20:25.495458+0000) 2019-11-29T21:20:47.380 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:20:47.376+0000 1694c700 -1 osd.1 318 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:122739 7.0 7:0943defa:::2019-11-29-21-7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.624-aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa:head [append 0~838 in=838b] snapc 0=[] ondisk+write+known_if_redirected e318) 2019-11-29T21:20:47.422 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:20:47.416+0000 1694c700 -1 osd.0 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:44.992971+0000 front 2019-11-29T21:19:44.955979+0000 (oldest deadline 2019-11-29T21:20:24.876002+0000) 2019-11-29T21:20:47.496 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:20:47.490+0000 1694c700 -1 osd.4 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:41.674767+0000 front 2019-11-29T21:19:42.252818+0000 (oldest deadline 2019-11-29T21:20:25.479901+0000) 2019-11-29T21:20:47.537 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:20:47.532+0000 1694c700 -1 osd.6 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:42.449685+0000 front 2019-11-29T21:19:45.036882+0000 (oldest deadline 2019-11-29T21:20:24.969312+0000) 2019-11-29T21:20:48.156 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:20:48.150+0000 1694c700 -1 osd.2 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:46.605817+0000 front 2019-11-29T21:19:44.260084+0000 (oldest deadline 2019-11-29T21:20:26.398110+0000) 2019-11-29T21:20:48.244 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:20:48.239+0000 1694c700 -1 osd.7 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:45.286901+0000 front 2019-11-29T21:19:45.271818+0000 (oldest deadline 2019-11-29T21:20:30.098128+0000) 2019-11-29T21:20:48.362 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:20:48.356+0000 1694c700 -1 osd.1 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:44.768506+0000 front 2019-11-29T21:19:46.629509+0000 (oldest deadline 2019-11-29T21:20:25.495458+0000) 2019-11-29T21:20:48.362 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:20:48.358+0000 1694c700 -1 osd.1 318 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:122739 7.0 7:0943defa:::2019-11-29-21-7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.624-aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa:head [append 0~838 in=838b] snapc 0=[] ondisk+write+known_if_redirected e318) 2019-11-29T21:20:48.450 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:20:48.445+0000 1694c700 -1 osd.4 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:41.674767+0000 front 2019-11-29T21:19:42.252818+0000 (oldest deadline 2019-11-29T21:20:25.479901+0000) 2019-11-29T21:20:48.455 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:20:48.449+0000 1694c700 -1 osd.0 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:44.992971+0000 front 2019-11-29T21:19:44.955979+0000 (oldest deadline 2019-11-29T21:20:24.876002+0000) 2019-11-29T21:20:48.573 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:20:48.568+0000 1694c700 -1 osd.6 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:42.449685+0000 front 2019-11-29T21:19:45.036882+0000 (oldest deadline 2019-11-29T21:20:24.969312+0000) 2019-11-29T21:20:49.167 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:20:49.162+0000 1694c700 -1 osd.2 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:46.605817+0000 front 2019-11-29T21:19:44.260084+0000 (oldest deadline 2019-11-29T21:20:26.398110+0000) 2019-11-29T21:20:49.295 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:20:49.290+0000 1694c700 -1 osd.7 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:45.286901+0000 front 2019-11-29T21:19:45.271818+0000 (oldest deadline 2019-11-29T21:20:30.098128+0000) 2019-11-29T21:20:49.334 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:20:49.329+0000 1694c700 -1 osd.1 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:44.768506+0000 front 2019-11-29T21:19:46.629509+0000 (oldest deadline 2019-11-29T21:20:25.495458+0000) 2019-11-29T21:20:49.337 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:20:49.333+0000 1694c700 -1 osd.1 318 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:122739 7.0 7:0943defa:::2019-11-29-21-7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.624-aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa:head [append 0~838 in=838b] snapc 0=[] ondisk+write+known_if_redirected e318) 2019-11-29T21:20:49.454 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:20:49.448+0000 1694c700 -1 osd.4 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:41.674767+0000 front 2019-11-29T21:19:42.252818+0000 (oldest deadline 2019-11-29T21:20:25.479901+0000) 2019-11-29T21:20:49.486 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:20:49.480+0000 1694c700 -1 osd.0 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:44.992971+0000 front 2019-11-29T21:19:44.955979+0000 (oldest deadline 2019-11-29T21:20:24.876002+0000) 2019-11-29T21:20:49.546 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:20:49.541+0000 1694c700 -1 osd.6 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:42.449685+0000 front 2019-11-29T21:19:45.036882+0000 (oldest deadline 2019-11-29T21:20:24.969312+0000) 2019-11-29T21:20:50.138 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:20:50.132+0000 1694c700 -1 osd.2 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:46.605817+0000 front 2019-11-29T21:19:44.260084+0000 (oldest deadline 2019-11-29T21:20:26.398110+0000) 2019-11-29T21:20:50.320 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:20:50.315+0000 1694c700 -1 osd.7 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:45.286901+0000 front 2019-11-29T21:19:45.271818+0000 (oldest deadline 2019-11-29T21:20:30.098128+0000) 2019-11-29T21:20:50.370 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:20:50.365+0000 1694c700 -1 osd.1 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:44.768506+0000 front 2019-11-29T21:19:46.629509+0000 (oldest deadline 2019-11-29T21:20:25.495458+0000) 2019-11-29T21:20:50.371 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:20:50.366+0000 1694c700 -1 osd.1 318 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:122739 7.0 7:0943defa:::2019-11-29-21-7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.624-aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa:head [append 0~838 in=838b] snapc 0=[] ondisk+write+known_if_redirected e318) 2019-11-29T21:20:50.471 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:20:50.467+0000 1694c700 -1 osd.4 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:41.674767+0000 front 2019-11-29T21:19:42.252818+0000 (oldest deadline 2019-11-29T21:20:25.479901+0000) 2019-11-29T21:20:50.511 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:20:50.506+0000 1694c700 -1 osd.0 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:44.992971+0000 front 2019-11-29T21:19:44.955979+0000 (oldest deadline 2019-11-29T21:20:24.876002+0000) 2019-11-29T21:20:50.545 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:20:50.541+0000 1694c700 -1 osd.6 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:42.449685+0000 front 2019-11-29T21:19:45.036882+0000 (oldest deadline 2019-11-29T21:20:24.969312+0000) 2019-11-29T21:20:51.098 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:20:51.094+0000 1694c700 -1 osd.2 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:46.605817+0000 front 2019-11-29T21:19:44.260084+0000 (oldest deadline 2019-11-29T21:20:26.398110+0000) 2019-11-29T21:20:51.365 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:20:51.359+0000 1694c700 -1 osd.7 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:45.286901+0000 front 2019-11-29T21:19:45.271818+0000 (oldest deadline 2019-11-29T21:20:30.098128+0000) 2019-11-29T21:20:51.404 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:20:51.398+0000 1694c700 -1 osd.1 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:44.768506+0000 front 2019-11-29T21:19:46.629509+0000 (oldest deadline 2019-11-29T21:20:25.495458+0000) 2019-11-29T21:20:51.407 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:20:51.403+0000 1694c700 -1 osd.1 318 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:122739 7.0 7:0943defa:::2019-11-29-21-7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.624-aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa:head [append 0~838 in=838b] snapc 0=[] ondisk+write+known_if_redirected e318) 2019-11-29T21:20:51.480 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:20:51.474+0000 1694c700 -1 osd.4 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:41.674767+0000 front 2019-11-29T21:19:42.252818+0000 (oldest deadline 2019-11-29T21:20:25.479901+0000) 2019-11-29T21:20:51.546 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:20:51.540+0000 1694c700 -1 osd.0 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:44.992971+0000 front 2019-11-29T21:19:44.955979+0000 (oldest deadline 2019-11-29T21:20:24.876002+0000) 2019-11-29T21:20:51.599 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:20:51.594+0000 1694c700 -1 osd.6 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:42.449685+0000 front 2019-11-29T21:19:45.036882+0000 (oldest deadline 2019-11-29T21:20:24.969312+0000) 2019-11-29T21:20:52.104 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:20:52.098+0000 1694c700 -1 osd.2 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:46.605817+0000 front 2019-11-29T21:19:44.260084+0000 (oldest deadline 2019-11-29T21:20:26.398110+0000) 2019-11-29T21:20:52.357 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:20:52.352+0000 1694c700 -1 osd.7 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:45.286901+0000 front 2019-11-29T21:19:45.271818+0000 (oldest deadline 2019-11-29T21:20:30.098128+0000) 2019-11-29T21:20:52.394 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:20:52.387+0000 1694c700 -1 osd.1 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:44.768506+0000 front 2019-11-29T21:19:46.629509+0000 (oldest deadline 2019-11-29T21:20:25.495458+0000) 2019-11-29T21:20:52.394 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:20:52.389+0000 1694c700 -1 osd.1 318 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:122739 7.0 7:0943defa:::2019-11-29-21-7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.624-aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa:head [append 0~838 in=838b] snapc 0=[] ondisk+write+known_if_redirected e318) 2019-11-29T21:20:52.481 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:20:52.476+0000 1694c700 -1 osd.4 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:41.674767+0000 front 2019-11-29T21:19:42.252818+0000 (oldest deadline 2019-11-29T21:20:25.479901+0000) 2019-11-29T21:20:52.551 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:20:52.545+0000 1694c700 -1 osd.0 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:44.992971+0000 front 2019-11-29T21:19:44.955979+0000 (oldest deadline 2019-11-29T21:20:24.876002+0000) 2019-11-29T21:20:52.619 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:20:52.613+0000 1694c700 -1 osd.6 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:42.449685+0000 front 2019-11-29T21:19:45.036882+0000 (oldest deadline 2019-11-29T21:20:24.969312+0000) 2019-11-29T21:20:53.076 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:20:53.070+0000 1694c700 -1 osd.2 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:46.605817+0000 front 2019-11-29T21:19:44.260084+0000 (oldest deadline 2019-11-29T21:20:26.398110+0000) 2019-11-29T21:20:53.347 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:20:53.342+0000 1694c700 -1 osd.7 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:45.286901+0000 front 2019-11-29T21:19:45.271818+0000 (oldest deadline 2019-11-29T21:20:30.098128+0000) 2019-11-29T21:20:53.395 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:20:53.389+0000 1694c700 -1 osd.1 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:44.768506+0000 front 2019-11-29T21:19:46.629509+0000 (oldest deadline 2019-11-29T21:20:25.495458+0000) 2019-11-29T21:20:53.396 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:20:53.390+0000 1694c700 -1 osd.1 318 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:122739 7.0 7:0943defa:::2019-11-29-21-7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.624-aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa:head [append 0~838 in=838b] snapc 0=[] ondisk+write+known_if_redirected e318) 2019-11-29T21:20:53.505 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:20:53.500+0000 1694c700 -1 osd.4 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:41.674767+0000 front 2019-11-29T21:19:42.252818+0000 (oldest deadline 2019-11-29T21:20:25.479901+0000) 2019-11-29T21:20:53.519 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:20:53.515+0000 1694c700 -1 osd.0 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:44.992971+0000 front 2019-11-29T21:19:44.955979+0000 (oldest deadline 2019-11-29T21:20:24.876002+0000) 2019-11-29T21:20:53.619 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:20:53.614+0000 1694c700 -1 osd.6 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:42.449685+0000 front 2019-11-29T21:19:45.036882+0000 (oldest deadline 2019-11-29T21:20:24.969312+0000) 2019-11-29T21:20:54.115 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:20:54.110+0000 1694c700 -1 osd.2 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:46.605817+0000 front 2019-11-29T21:19:44.260084+0000 (oldest deadline 2019-11-29T21:20:26.398110+0000) 2019-11-29T21:20:54.385 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:20:54.380+0000 1694c700 -1 osd.7 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:45.286901+0000 front 2019-11-29T21:19:45.271818+0000 (oldest deadline 2019-11-29T21:20:30.098128+0000) 2019-11-29T21:20:54.400 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:20:54.394+0000 1694c700 -1 osd.1 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:44.768506+0000 front 2019-11-29T21:19:46.629509+0000 (oldest deadline 2019-11-29T21:20:25.495458+0000) 2019-11-29T21:20:54.401 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:20:54.396+0000 1694c700 -1 osd.1 318 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:122739 7.0 7:0943defa:::2019-11-29-21-7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.624-aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa:head [append 0~838 in=838b] snapc 0=[] ondisk+write+known_if_redirected e318) 2019-11-29T21:20:54.505 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:20:54.499+0000 1694c700 -1 osd.0 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:44.992971+0000 front 2019-11-29T21:19:44.955979+0000 (oldest deadline 2019-11-29T21:20:24.876002+0000) 2019-11-29T21:20:54.512 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:20:54.507+0000 1694c700 -1 osd.4 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:41.674767+0000 front 2019-11-29T21:19:42.252818+0000 (oldest deadline 2019-11-29T21:20:25.479901+0000) 2019-11-29T21:20:54.586 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:20:54.581+0000 1694c700 -1 osd.6 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:42.449685+0000 front 2019-11-29T21:19:45.036882+0000 (oldest deadline 2019-11-29T21:20:24.969312+0000) 2019-11-29T21:20:55.130 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:20:55.125+0000 1694c700 -1 osd.2 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:46.605817+0000 front 2019-11-29T21:19:44.260084+0000 (oldest deadline 2019-11-29T21:20:26.398110+0000) 2019-11-29T21:20:55.381 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:20:55.376+0000 1694c700 -1 osd.7 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:45.286901+0000 front 2019-11-29T21:19:45.271818+0000 (oldest deadline 2019-11-29T21:20:30.098128+0000) 2019-11-29T21:20:55.384 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:20:55.378+0000 1694c700 -1 osd.1 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:44.768506+0000 front 2019-11-29T21:19:46.629509+0000 (oldest deadline 2019-11-29T21:20:25.495458+0000) 2019-11-29T21:20:55.384 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:20:55.379+0000 1694c700 -1 osd.1 318 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:122739 7.0 7:0943defa:::2019-11-29-21-7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.624-aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa:head [append 0~838 in=838b] snapc 0=[] ondisk+write+known_if_redirected e318) 2019-11-29T21:20:55.543 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:20:55.538+0000 1694c700 -1 osd.0 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:44.992971+0000 front 2019-11-29T21:19:44.955979+0000 (oldest deadline 2019-11-29T21:20:24.876002+0000) 2019-11-29T21:20:55.549 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:20:55.544+0000 1694c700 -1 osd.4 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:41.674767+0000 front 2019-11-29T21:19:42.252818+0000 (oldest deadline 2019-11-29T21:20:25.479901+0000) 2019-11-29T21:20:55.613 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:20:55.608+0000 1694c700 -1 osd.6 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:42.449685+0000 front 2019-11-29T21:19:45.036882+0000 (oldest deadline 2019-11-29T21:20:24.969312+0000) 2019-11-29T21:20:55.803 INFO:tasks.ceph.mon.b.smithi022.stderr:2019-11-29T21:20:55.798+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.22:6818/9264,v1:172.21.15.22:6819/9264] for 40sec e318 v318) 2019-11-29T21:20:56.156 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:20:56.151+0000 1694c700 -1 osd.2 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:46.605817+0000 front 2019-11-29T21:19:44.260084+0000 (oldest deadline 2019-11-29T21:20:26.398110+0000) 2019-11-29T21:20:56.358 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:20:56.353+0000 1694c700 -1 osd.1 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:44.768506+0000 front 2019-11-29T21:19:46.629509+0000 (oldest deadline 2019-11-29T21:20:25.495458+0000) 2019-11-29T21:20:56.360 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:20:56.357+0000 1694c700 -1 osd.1 318 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:122739 7.0 7:0943defa:::2019-11-29-21-7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.624-aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa:head [append 0~838 in=838b] snapc 0=[] ondisk+write+known_if_redirected e318) 2019-11-29T21:20:56.406 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:20:56.400+0000 1694c700 -1 osd.7 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:45.286901+0000 front 2019-11-29T21:19:45.271818+0000 (oldest deadline 2019-11-29T21:20:30.098128+0000) 2019-11-29T21:20:56.577 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:20:56.571+0000 1694c700 -1 osd.0 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:44.992971+0000 front 2019-11-29T21:19:44.955979+0000 (oldest deadline 2019-11-29T21:20:24.876002+0000) 2019-11-29T21:20:56.582 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:20:56.575+0000 1694c700 -1 osd.4 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:41.674767+0000 front 2019-11-29T21:19:42.252818+0000 (oldest deadline 2019-11-29T21:20:25.479901+0000) 2019-11-29T21:20:56.594 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:20:56.588+0000 1694c700 -1 osd.6 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:42.449685+0000 front 2019-11-29T21:19:45.036882+0000 (oldest deadline 2019-11-29T21:20:24.969312+0000) 2019-11-29T21:20:57.203 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:20:57.197+0000 1694c700 -1 osd.2 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:46.605817+0000 front 2019-11-29T21:19:44.260084+0000 (oldest deadline 2019-11-29T21:20:26.398110+0000) 2019-11-29T21:20:57.411 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:20:57.395+0000 1694c700 -1 osd.1 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:44.768506+0000 front 2019-11-29T21:19:46.629509+0000 (oldest deadline 2019-11-29T21:20:25.495458+0000) 2019-11-29T21:20:57.416 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:20:57.399+0000 1694c700 -1 osd.1 318 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:122739 7.0 7:0943defa:::2019-11-29-21-7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.624-aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa:head [append 0~838 in=838b] snapc 0=[] ondisk+write+known_if_redirected e318) 2019-11-29T21:20:57.439 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:20:57.433+0000 1694c700 -1 osd.7 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:45.286901+0000 front 2019-11-29T21:19:45.271818+0000 (oldest deadline 2019-11-29T21:20:30.098128+0000) 2019-11-29T21:20:57.549 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:20:57.542+0000 1694c700 -1 osd.4 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:41.674767+0000 front 2019-11-29T21:19:42.252818+0000 (oldest deadline 2019-11-29T21:20:25.479901+0000) 2019-11-29T21:20:57.577 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:20:57.572+0000 1694c700 -1 osd.0 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:44.992971+0000 front 2019-11-29T21:19:44.955979+0000 (oldest deadline 2019-11-29T21:20:24.876002+0000) 2019-11-29T21:20:57.640 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:20:57.634+0000 1694c700 -1 osd.6 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:42.449685+0000 front 2019-11-29T21:19:45.036882+0000 (oldest deadline 2019-11-29T21:20:24.969312+0000) 2019-11-29T21:20:58.223 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:20:58.217+0000 1694c700 -1 osd.2 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:46.605817+0000 front 2019-11-29T21:19:44.260084+0000 (oldest deadline 2019-11-29T21:20:26.398110+0000) 2019-11-29T21:20:58.417 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:20:58.412+0000 1694c700 -1 osd.1 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:44.768506+0000 front 2019-11-29T21:19:46.629509+0000 (oldest deadline 2019-11-29T21:20:25.495458+0000) 2019-11-29T21:20:58.418 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:20:58.413+0000 1694c700 -1 osd.1 318 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:122739 7.0 7:0943defa:::2019-11-29-21-7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.624-aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa:head [append 0~838 in=838b] snapc 0=[] ondisk+write+known_if_redirected e318) 2019-11-29T21:20:58.422 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:20:58.415+0000 1694c700 -1 osd.7 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:45.286901+0000 front 2019-11-29T21:19:45.271818+0000 (oldest deadline 2019-11-29T21:20:30.098128+0000) 2019-11-29T21:20:58.519 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:20:58.513+0000 1694c700 -1 osd.4 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:41.674767+0000 front 2019-11-29T21:19:42.252818+0000 (oldest deadline 2019-11-29T21:20:25.479901+0000) 2019-11-29T21:20:58.557 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:20:58.552+0000 1694c700 -1 osd.0 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:44.992971+0000 front 2019-11-29T21:19:44.955979+0000 (oldest deadline 2019-11-29T21:20:24.876002+0000) 2019-11-29T21:20:58.653 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:20:58.647+0000 1694c700 -1 osd.6 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:42.449685+0000 front 2019-11-29T21:19:45.036882+0000 (oldest deadline 2019-11-29T21:20:24.969312+0000) 2019-11-29T21:20:59.192 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:20:59.186+0000 1694c700 -1 osd.2 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:46.605817+0000 front 2019-11-29T21:19:44.260084+0000 (oldest deadline 2019-11-29T21:20:26.398110+0000) 2019-11-29T21:20:59.446 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:20:59.440+0000 1694c700 -1 osd.7 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:45.286901+0000 front 2019-11-29T21:19:45.271818+0000 (oldest deadline 2019-11-29T21:20:30.098128+0000) 2019-11-29T21:20:59.454 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:20:59.449+0000 1694c700 -1 osd.1 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:44.768506+0000 front 2019-11-29T21:19:46.629509+0000 (oldest deadline 2019-11-29T21:20:25.495458+0000) 2019-11-29T21:20:59.456 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:20:59.451+0000 1694c700 -1 osd.1 318 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:122739 7.0 7:0943defa:::2019-11-29-21-7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.624-aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa:head [append 0~838 in=838b] snapc 0=[] ondisk+write+known_if_redirected e318) 2019-11-29T21:20:59.486 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:20:59.480+0000 1694c700 -1 osd.4 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:41.674767+0000 front 2019-11-29T21:19:42.252818+0000 (oldest deadline 2019-11-29T21:20:25.479901+0000) 2019-11-29T21:20:59.576 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:20:59.570+0000 1694c700 -1 osd.0 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:44.992971+0000 front 2019-11-29T21:19:44.955979+0000 (oldest deadline 2019-11-29T21:20:24.876002+0000) 2019-11-29T21:20:59.624 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:20:59.618+0000 1694c700 -1 osd.6 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:42.449685+0000 front 2019-11-29T21:19:45.036882+0000 (oldest deadline 2019-11-29T21:20:24.969312+0000) 2019-11-29T21:21:00.162 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:21:00.156+0000 1694c700 -1 osd.2 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:46.605817+0000 front 2019-11-29T21:19:44.260084+0000 (oldest deadline 2019-11-29T21:20:26.398110+0000) 2019-11-29T21:21:00.441 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:21:00.435+0000 1694c700 -1 osd.1 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:44.768506+0000 front 2019-11-29T21:19:46.629509+0000 (oldest deadline 2019-11-29T21:20:25.495458+0000) 2019-11-29T21:21:00.442 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:21:00.437+0000 1694c700 -1 osd.1 318 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:122739 7.0 7:0943defa:::2019-11-29-21-7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.624-aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa:head [append 0~838 in=838b] snapc 0=[] ondisk+write+known_if_redirected e318) 2019-11-29T21:21:00.457 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:21:00.451+0000 1694c700 -1 osd.4 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:41.674767+0000 front 2019-11-29T21:19:42.252818+0000 (oldest deadline 2019-11-29T21:20:25.479901+0000) 2019-11-29T21:21:00.474 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:21:00.467+0000 1694c700 -1 osd.7 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:45.286901+0000 front 2019-11-29T21:19:45.271818+0000 (oldest deadline 2019-11-29T21:20:30.098128+0000) 2019-11-29T21:21:00.557 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:21:00.552+0000 1694c700 -1 osd.0 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:44.992971+0000 front 2019-11-29T21:19:44.955979+0000 (oldest deadline 2019-11-29T21:20:24.876002+0000) 2019-11-29T21:21:00.591 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:21:00.585+0000 1694c700 -1 osd.6 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:42.449685+0000 front 2019-11-29T21:19:45.036882+0000 (oldest deadline 2019-11-29T21:20:24.969312+0000) 2019-11-29T21:21:00.819 INFO:tasks.ceph.mon.b.smithi022.stderr:2019-11-29T21:21:00.812+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.22:6818/9264,v1:172.21.15.22:6819/9264] for 40sec e318 v318) 2019-11-29T21:21:01.167 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:21:01.161+0000 1694c700 -1 osd.2 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:46.605817+0000 front 2019-11-29T21:19:44.260084+0000 (oldest deadline 2019-11-29T21:20:26.398110+0000) 2019-11-29T21:21:01.409 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:21:01.404+0000 1694c700 -1 osd.1 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:44.768506+0000 front 2019-11-29T21:19:46.629509+0000 (oldest deadline 2019-11-29T21:20:25.495458+0000) 2019-11-29T21:21:01.410 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:21:01.405+0000 1694c700 -1 osd.1 318 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:122739 7.0 7:0943defa:::2019-11-29-21-7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.624-aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa:head [append 0~838 in=838b] snapc 0=[] ondisk+write+known_if_redirected e318) 2019-11-29T21:21:01.438 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:21:01.432+0000 1694c700 -1 osd.7 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:45.286901+0000 front 2019-11-29T21:19:45.271818+0000 (oldest deadline 2019-11-29T21:20:30.098128+0000) 2019-11-29T21:21:01.454 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:21:01.448+0000 1694c700 -1 osd.4 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:41.674767+0000 front 2019-11-29T21:19:42.252818+0000 (oldest deadline 2019-11-29T21:20:25.479901+0000) 2019-11-29T21:21:01.533 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:21:01.527+0000 1694c700 -1 osd.0 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:44.992971+0000 front 2019-11-29T21:19:44.955979+0000 (oldest deadline 2019-11-29T21:20:24.876002+0000) 2019-11-29T21:21:01.638 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:21:01.633+0000 1694c700 -1 osd.6 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:42.449685+0000 front 2019-11-29T21:19:45.036882+0000 (oldest deadline 2019-11-29T21:20:24.969312+0000) 2019-11-29T21:21:02.146 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:21:02.142+0000 1694c700 -1 osd.2 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:46.605817+0000 front 2019-11-29T21:19:44.260084+0000 (oldest deadline 2019-11-29T21:20:26.398110+0000) 2019-11-29T21:21:02.400 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:21:02.394+0000 1694c700 -1 osd.7 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:45.286901+0000 front 2019-11-29T21:19:45.271818+0000 (oldest deadline 2019-11-29T21:20:30.098128+0000) 2019-11-29T21:21:02.420 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:21:02.416+0000 1694c700 -1 osd.1 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:44.768506+0000 front 2019-11-29T21:19:46.629509+0000 (oldest deadline 2019-11-29T21:20:25.495458+0000) 2019-11-29T21:21:02.423 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:21:02.419+0000 1694c700 -1 osd.1 318 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:122739 7.0 7:0943defa:::2019-11-29-21-7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.624-aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa:head [append 0~838 in=838b] snapc 0=[] ondisk+write+known_if_redirected e318) 2019-11-29T21:21:02.504 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:21:02.498+0000 1694c700 -1 osd.4 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:41.674767+0000 front 2019-11-29T21:19:42.252818+0000 (oldest deadline 2019-11-29T21:20:25.479901+0000) 2019-11-29T21:21:02.574 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:21:02.569+0000 1694c700 -1 osd.0 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:44.992971+0000 front 2019-11-29T21:19:44.955979+0000 (oldest deadline 2019-11-29T21:20:24.876002+0000) 2019-11-29T21:21:02.678 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:21:02.672+0000 1694c700 -1 osd.6 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:42.449685+0000 front 2019-11-29T21:19:45.036882+0000 (oldest deadline 2019-11-29T21:20:24.969312+0000) 2019-11-29T21:21:03.118 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:21:03.113+0000 1694c700 -1 osd.2 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:46.605817+0000 front 2019-11-29T21:19:44.260084+0000 (oldest deadline 2019-11-29T21:20:26.398110+0000) 2019-11-29T21:21:03.392 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:21:03.385+0000 1694c700 -1 osd.7 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:45.286901+0000 front 2019-11-29T21:19:45.271818+0000 (oldest deadline 2019-11-29T21:20:30.098128+0000) 2019-11-29T21:21:03.430 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:21:03.425+0000 1694c700 -1 osd.1 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:44.768506+0000 front 2019-11-29T21:19:46.629509+0000 (oldest deadline 2019-11-29T21:20:25.495458+0000) 2019-11-29T21:21:03.433 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:21:03.429+0000 1694c700 -1 osd.1 318 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:122739 7.0 7:0943defa:::2019-11-29-21-7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.624-aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa:head [append 0~838 in=838b] snapc 0=[] ondisk+write+known_if_redirected e318) 2019-11-29T21:21:03.471 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:21:03.465+0000 1694c700 -1 osd.4 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:41.674767+0000 front 2019-11-29T21:19:42.252818+0000 (oldest deadline 2019-11-29T21:20:25.479901+0000) 2019-11-29T21:21:03.532 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:21:03.526+0000 1694c700 -1 osd.0 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:44.992971+0000 front 2019-11-29T21:19:44.955979+0000 (oldest deadline 2019-11-29T21:20:24.876002+0000) 2019-11-29T21:21:03.650 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:21:03.644+0000 1694c700 -1 osd.6 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:42.449685+0000 front 2019-11-29T21:19:45.036882+0000 (oldest deadline 2019-11-29T21:20:24.969312+0000) 2019-11-29T21:21:04.168 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:21:04.163+0000 1694c700 -1 osd.2 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:46.605817+0000 front 2019-11-29T21:19:44.260084+0000 (oldest deadline 2019-11-29T21:20:26.398110+0000) 2019-11-29T21:21:04.372 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:21:04.367+0000 1694c700 -1 osd.7 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:45.286901+0000 front 2019-11-29T21:19:45.271818+0000 (oldest deadline 2019-11-29T21:20:30.098128+0000) 2019-11-29T21:21:04.406 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:21:04.400+0000 1694c700 -1 osd.1 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:44.768506+0000 front 2019-11-29T21:19:46.629509+0000 (oldest deadline 2019-11-29T21:20:25.495458+0000) 2019-11-29T21:21:04.406 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:21:04.401+0000 1694c700 -1 osd.1 318 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:122739 7.0 7:0943defa:::2019-11-29-21-7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.624-aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa:head [append 0~838 in=838b] snapc 0=[] ondisk+write+known_if_redirected e318) 2019-11-29T21:21:04.478 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:21:04.472+0000 1694c700 -1 osd.4 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:41.674767+0000 front 2019-11-29T21:19:42.252818+0000 (oldest deadline 2019-11-29T21:20:25.479901+0000) 2019-11-29T21:21:04.506 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:21:04.501+0000 1694c700 -1 osd.0 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:44.992971+0000 front 2019-11-29T21:19:44.955979+0000 (oldest deadline 2019-11-29T21:20:24.876002+0000) 2019-11-29T21:21:04.629 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:21:04.623+0000 1694c700 -1 osd.6 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:42.449685+0000 front 2019-11-29T21:19:45.036882+0000 (oldest deadline 2019-11-29T21:20:24.969312+0000) 2019-11-29T21:21:05.155 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:21:05.151+0000 1694c700 -1 osd.2 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:46.605817+0000 front 2019-11-29T21:19:44.260084+0000 (oldest deadline 2019-11-29T21:20:26.398110+0000) 2019-11-29T21:21:05.357 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:21:05.350+0000 1694c700 -1 osd.7 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:45.286901+0000 front 2019-11-29T21:19:45.271818+0000 (oldest deadline 2019-11-29T21:20:30.098128+0000) 2019-11-29T21:21:05.410 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:21:05.403+0000 1694c700 -1 osd.1 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:44.768506+0000 front 2019-11-29T21:19:46.629509+0000 (oldest deadline 2019-11-29T21:20:25.495458+0000) 2019-11-29T21:21:05.411 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:21:05.406+0000 1694c700 -1 osd.1 318 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:122739 7.0 7:0943defa:::2019-11-29-21-7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.624-aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa:head [append 0~838 in=838b] snapc 0=[] ondisk+write+known_if_redirected e318) 2019-11-29T21:21:05.438 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:21:05.431+0000 1694c700 -1 osd.4 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:41.674767+0000 front 2019-11-29T21:19:42.252818+0000 (oldest deadline 2019-11-29T21:20:25.479901+0000) 2019-11-29T21:21:05.512 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:21:05.506+0000 1694c700 -1 osd.0 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:44.992971+0000 front 2019-11-29T21:19:44.955979+0000 (oldest deadline 2019-11-29T21:20:24.876002+0000) 2019-11-29T21:21:05.642 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:21:05.635+0000 1694c700 -1 osd.6 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:42.449685+0000 front 2019-11-29T21:19:45.036882+0000 (oldest deadline 2019-11-29T21:20:24.969312+0000) 2019-11-29T21:21:05.829 INFO:tasks.ceph.mon.b.smithi022.stderr:2019-11-29T21:21:05.823+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.22:6818/9264,v1:172.21.15.22:6819/9264] for 40sec e318 v318) 2019-11-29T21:21:06.115 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:21:06.110+0000 1694c700 -1 osd.2 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:46.605817+0000 front 2019-11-29T21:19:44.260084+0000 (oldest deadline 2019-11-29T21:20:26.398110+0000) 2019-11-29T21:21:06.362 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:21:06.346+0000 1694c700 -1 osd.7 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:45.286901+0000 front 2019-11-29T21:19:45.271818+0000 (oldest deadline 2019-11-29T21:20:30.098128+0000) 2019-11-29T21:21:06.414 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:21:06.408+0000 1694c700 -1 osd.4 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:41.674767+0000 front 2019-11-29T21:19:42.252818+0000 (oldest deadline 2019-11-29T21:20:25.479901+0000) 2019-11-29T21:21:06.416 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:21:06.409+0000 1694c700 -1 osd.1 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:44.768506+0000 front 2019-11-29T21:19:46.629509+0000 (oldest deadline 2019-11-29T21:20:25.495458+0000) 2019-11-29T21:21:06.419 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:21:06.416+0000 1694c700 -1 osd.1 318 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:122739 7.0 7:0943defa:::2019-11-29-21-7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.624-aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa:head [append 0~838 in=838b] snapc 0=[] ondisk+write+known_if_redirected e318) 2019-11-29T21:21:06.549 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:21:06.544+0000 1694c700 -1 osd.0 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:44.992971+0000 front 2019-11-29T21:19:44.955979+0000 (oldest deadline 2019-11-29T21:20:24.876002+0000) 2019-11-29T21:21:06.675 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:21:06.669+0000 1694c700 -1 osd.6 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:42.449685+0000 front 2019-11-29T21:19:45.036882+0000 (oldest deadline 2019-11-29T21:20:24.969312+0000) 2019-11-29T21:21:07.142 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:21:07.136+0000 1694c700 -1 osd.2 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:46.605817+0000 front 2019-11-29T21:19:44.260084+0000 (oldest deadline 2019-11-29T21:20:26.398110+0000) 2019-11-29T21:21:07.346 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:21:07.340+0000 1694c700 -1 osd.7 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:45.286901+0000 front 2019-11-29T21:19:45.271818+0000 (oldest deadline 2019-11-29T21:20:30.098128+0000) 2019-11-29T21:21:07.461 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:21:07.454+0000 1694c700 -1 osd.4 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:41.674767+0000 front 2019-11-29T21:19:42.252818+0000 (oldest deadline 2019-11-29T21:20:25.479901+0000) 2019-11-29T21:21:07.463 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:21:07.458+0000 1694c700 -1 osd.1 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:44.768506+0000 front 2019-11-29T21:19:46.629509+0000 (oldest deadline 2019-11-29T21:20:25.495458+0000) 2019-11-29T21:21:07.466 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:21:07.462+0000 1694c700 -1 osd.1 318 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:122739 7.0 7:0943defa:::2019-11-29-21-7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.624-aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa:head [append 0~838 in=838b] snapc 0=[] ondisk+write+known_if_redirected e318) 2019-11-29T21:21:07.594 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:21:07.588+0000 1694c700 -1 osd.0 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:44.992971+0000 front 2019-11-29T21:19:44.955979+0000 (oldest deadline 2019-11-29T21:20:24.876002+0000) 2019-11-29T21:21:07.650 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:21:07.644+0000 1694c700 -1 osd.6 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:42.449685+0000 front 2019-11-29T21:19:45.036882+0000 (oldest deadline 2019-11-29T21:20:24.969312+0000) 2019-11-29T21:21:08.097 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:21:08.091+0000 1694c700 -1 osd.2 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:46.605817+0000 front 2019-11-29T21:19:44.260084+0000 (oldest deadline 2019-11-29T21:20:26.398110+0000) 2019-11-29T21:21:08.373 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:21:08.367+0000 1694c700 -1 osd.7 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:45.286901+0000 front 2019-11-29T21:19:45.271818+0000 (oldest deadline 2019-11-29T21:20:30.098128+0000) 2019-11-29T21:21:08.442 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:21:08.436+0000 1694c700 -1 osd.4 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:41.674767+0000 front 2019-11-29T21:19:42.252818+0000 (oldest deadline 2019-11-29T21:20:25.479901+0000) 2019-11-29T21:21:08.473 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:21:08.466+0000 1694c700 -1 osd.1 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:44.768506+0000 front 2019-11-29T21:19:46.629509+0000 (oldest deadline 2019-11-29T21:20:25.495458+0000) 2019-11-29T21:21:08.474 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:21:08.470+0000 1694c700 -1 osd.1 318 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:122739 7.0 7:0943defa:::2019-11-29-21-7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.624-aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa:head [append 0~838 in=838b] snapc 0=[] ondisk+write+known_if_redirected e318) 2019-11-29T21:21:08.629 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:21:08.623+0000 1694c700 -1 osd.0 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:44.992971+0000 front 2019-11-29T21:19:44.955979+0000 (oldest deadline 2019-11-29T21:20:24.876002+0000) 2019-11-29T21:21:08.641 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:21:08.635+0000 1694c700 -1 osd.6 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:42.449685+0000 front 2019-11-29T21:19:45.036882+0000 (oldest deadline 2019-11-29T21:20:24.969312+0000) 2019-11-29T21:21:09.134 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:21:09.129+0000 1694c700 -1 osd.2 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:46.605817+0000 front 2019-11-29T21:19:44.260084+0000 (oldest deadline 2019-11-29T21:20:26.398110+0000) 2019-11-29T21:21:09.402 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:21:09.396+0000 1694c700 -1 osd.7 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:45.286901+0000 front 2019-11-29T21:19:45.271818+0000 (oldest deadline 2019-11-29T21:20:30.098128+0000) 2019-11-29T21:21:09.423 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:21:09.417+0000 1694c700 -1 osd.4 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:41.674767+0000 front 2019-11-29T21:19:42.252818+0000 (oldest deadline 2019-11-29T21:20:25.479901+0000) 2019-11-29T21:21:09.521 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:21:09.516+0000 1694c700 -1 osd.1 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:44.768506+0000 front 2019-11-29T21:19:46.629509+0000 (oldest deadline 2019-11-29T21:20:25.495458+0000) 2019-11-29T21:21:09.523 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:21:09.519+0000 1694c700 -1 osd.1 318 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:122739 7.0 7:0943defa:::2019-11-29-21-7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.624-aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa:head [append 0~838 in=838b] snapc 0=[] ondisk+write+known_if_redirected e318) 2019-11-29T21:21:09.634 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:21:09.626+0000 1694c700 -1 osd.0 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:44.992971+0000 front 2019-11-29T21:19:44.955979+0000 (oldest deadline 2019-11-29T21:20:24.876002+0000) 2019-11-29T21:21:09.675 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:21:09.669+0000 1694c700 -1 osd.6 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:42.449685+0000 front 2019-11-29T21:19:45.036882+0000 (oldest deadline 2019-11-29T21:20:24.969312+0000) 2019-11-29T21:21:10.145 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:21:10.139+0000 1694c700 -1 osd.2 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:46.605817+0000 front 2019-11-29T21:19:44.260084+0000 (oldest deadline 2019-11-29T21:20:26.398110+0000) 2019-11-29T21:21:10.404 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:21:10.398+0000 1694c700 -1 osd.7 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:45.286901+0000 front 2019-11-29T21:19:45.271818+0000 (oldest deadline 2019-11-29T21:20:30.098128+0000) 2019-11-29T21:21:10.459 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:21:10.453+0000 1694c700 -1 osd.4 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:41.674767+0000 front 2019-11-29T21:19:42.252818+0000 (oldest deadline 2019-11-29T21:20:25.479901+0000) 2019-11-29T21:21:10.506 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:21:10.499+0000 1694c700 -1 osd.1 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:44.768506+0000 front 2019-11-29T21:19:46.629509+0000 (oldest deadline 2019-11-29T21:20:25.495458+0000) 2019-11-29T21:21:10.507 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:21:10.501+0000 1694c700 -1 osd.1 318 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:122739 7.0 7:0943defa:::2019-11-29-21-7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.624-aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa:head [append 0~838 in=838b] snapc 0=[] ondisk+write+known_if_redirected e318) 2019-11-29T21:21:10.661 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:21:10.655+0000 1694c700 -1 osd.0 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:44.992971+0000 front 2019-11-29T21:19:44.955979+0000 (oldest deadline 2019-11-29T21:20:24.876002+0000) 2019-11-29T21:21:10.698 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:21:10.692+0000 1694c700 -1 osd.6 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:42.449685+0000 front 2019-11-29T21:19:45.036882+0000 (oldest deadline 2019-11-29T21:20:24.969312+0000) 2019-11-29T21:21:10.916 INFO:tasks.ceph.mon.b.smithi022.stderr:2019-11-29T21:21:10.895+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.22:6818/9264,v1:172.21.15.22:6819/9264] for 40sec e318 v318) 2019-11-29T21:21:11.190 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:21:11.185+0000 1694c700 -1 osd.2 318 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:19:46.605817+0000 front 2019-11-29T21:19:44.260084+0000 (oldest deadline 2019-11-29T21:20:26.398110+0000) 2019-11-29T21:21:11.768 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:21:11.749+0000 1694c700 -1 osd.1 319 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:122739 7.0 7:0943defa:::2019-11-29-21-7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.624-aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa:head [append 0~838 in=838b] snapc 0=[] ondisk+write+known_if_redirected e318) 2019-11-29T21:21:12.901 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:21:12.880+0000 1694c700 -1 osd.1 320 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:122739 7.0 7:0943defa:::2019-11-29-21-7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.624-aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa:head [append 0~838 in=838b] snapc 0=[] ondisk+write+known_if_redirected e318) 2019-11-29T21:21:14.019 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:21:13.923+0000 1694c700 -1 osd.1 320 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:122739 7.0 7:0943defa:::2019-11-29-21-7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.624-aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa:head [append 0~838 in=838b] snapc 0=[] ondisk+write+known_if_redirected e318) 2019-11-29T21:21:14.616 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:08:55:55.275 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T21:21:14.621 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:08:55:55.279 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T21:21:14.627 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:08:55:55.233 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T21:21:14.627 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:08:55:55.233 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T21:21:14.632 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:08:55:55.239 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T21:21:14.633 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:08:55:55.240 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T21:21:14.705 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:08:55:55.363 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T21:21:14.713 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:08:55:55.320 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T21:21:14.718 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:08:55:55.325 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T21:21:16.769 INFO:teuthology.orchestra.run.smithi062.stderr:testContainerNameLimit (test.functional.tests.TestContainer) ... ok 2019-11-29T21:21:36.082 INFO:teuthology.orchestra.run.smithi062.stderr:testCreate (test.functional.tests.TestContainer) ... ok 2019-11-29T21:22:06.280 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:08:56:46.938 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T21:22:06.285 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:08:56:46.944 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T21:22:06.294 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:08:56:46.901 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T21:22:06.306 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:08:56:46.913 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T21:22:06.317 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:08:56:46.924 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T21:22:06.340 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:08:56:46.947 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T21:22:06.397 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:08:56:47.000 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T21:22:06.397 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:08:56:47.055 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T21:22:06.416 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:08:56:47.023 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T21:22:08.885 INFO:teuthology.orchestra.run.smithi062.stderr:testDelete (test.functional.tests.TestContainer) ... ok 2019-11-29T21:22:09.320 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:22:09.314+0000 1694c700 -1 osd.0 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:25.462895+0000 front 2019-11-29T21:21:25.494956+0000 (oldest deadline 2019-11-29T21:22:08.916174+0000) 2019-11-29T21:22:10.293 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:22:10.287+0000 1694c700 -1 osd.0 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:25.462895+0000 front 2019-11-29T21:21:25.494956+0000 (oldest deadline 2019-11-29T21:22:08.916174+0000) 2019-11-29T21:22:10.300 INFO:teuthology.orchestra.run.smithi062.stderr:testDeleteOnContainerThatDoesNotExist (test.functional.tests.TestContainer) ... ok 2019-11-29T21:22:10.346 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:22:10.338+0000 1694c700 -1 osd.7 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:26.017730+0000 front 2019-11-29T21:21:26.035729+0000 (oldest deadline 2019-11-29T21:22:10.090349+0000) 2019-11-29T21:22:10.413 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:22:10.402+0000 1694c700 -1 osd.2 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:24.865157+0000 front 2019-11-29T21:21:25.043612+0000 (oldest deadline 2019-11-29T21:22:10.152928+0000) 2019-11-29T21:22:10.861 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:22:10.855+0000 1694c700 -1 osd.4 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:24.879532+0000 front 2019-11-29T21:21:25.486498+0000 (oldest deadline 2019-11-29T21:22:10.136539+0000) 2019-11-29T21:22:11.301 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:22:11.297+0000 1694c700 -1 osd.0 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:25.462895+0000 front 2019-11-29T21:21:25.494956+0000 (oldest deadline 2019-11-29T21:22:08.916174+0000) 2019-11-29T21:22:11.370 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:22:11.363+0000 1694c700 -1 osd.7 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:26.017730+0000 front 2019-11-29T21:21:26.035729+0000 (oldest deadline 2019-11-29T21:22:10.090349+0000) 2019-11-29T21:22:11.431 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:22:11.425+0000 1694c700 -1 osd.2 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:24.865157+0000 front 2019-11-29T21:21:25.043612+0000 (oldest deadline 2019-11-29T21:22:10.152928+0000) 2019-11-29T21:22:11.899 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:22:11.893+0000 1694c700 -1 osd.4 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:24.879532+0000 front 2019-11-29T21:21:25.486498+0000 (oldest deadline 2019-11-29T21:22:10.136539+0000) 2019-11-29T21:22:11.946 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:22:11.941+0000 1694c700 -1 osd.5 324 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e322) 2019-11-29T21:22:12.341 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:22:12.336+0000 1694c700 -1 osd.0 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:25.462895+0000 front 2019-11-29T21:21:25.494956+0000 (oldest deadline 2019-11-29T21:22:08.916174+0000) 2019-11-29T21:22:12.373 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:22:12.366+0000 1694c700 -1 osd.7 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:26.017730+0000 front 2019-11-29T21:21:26.035729+0000 (oldest deadline 2019-11-29T21:22:10.090349+0000) 2019-11-29T21:22:12.471 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:22:12.467+0000 1694c700 -1 osd.2 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:24.865157+0000 front 2019-11-29T21:21:25.043612+0000 (oldest deadline 2019-11-29T21:22:10.152928+0000) 2019-11-29T21:22:12.936 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:22:12.928+0000 1694c700 -1 osd.4 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:24.879532+0000 front 2019-11-29T21:21:25.486498+0000 (oldest deadline 2019-11-29T21:22:10.136539+0000) 2019-11-29T21:22:12.983 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:22:12.979+0000 1694c700 -1 osd.5 324 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e322) 2019-11-29T21:22:13.346 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:22:13.340+0000 1694c700 -1 osd.0 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:25.462895+0000 front 2019-11-29T21:21:25.494956+0000 (oldest deadline 2019-11-29T21:22:08.916174+0000) 2019-11-29T21:22:13.352 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:22:13.346+0000 1694c700 -1 osd.7 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:26.017730+0000 front 2019-11-29T21:21:26.035729+0000 (oldest deadline 2019-11-29T21:22:10.090349+0000) 2019-11-29T21:22:13.448 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:22:13.441+0000 1694c700 -1 osd.2 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:24.865157+0000 front 2019-11-29T21:21:25.043612+0000 (oldest deadline 2019-11-29T21:22:10.152928+0000) 2019-11-29T21:22:13.906 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:22:13.900+0000 1694c700 -1 osd.4 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:24.879532+0000 front 2019-11-29T21:21:25.486498+0000 (oldest deadline 2019-11-29T21:22:10.136539+0000) 2019-11-29T21:22:14.019 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:22:14.015+0000 1694c700 -1 osd.5 324 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e322) 2019-11-29T21:22:14.349 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:22:14.343+0000 1694c700 -1 osd.7 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:26.017730+0000 front 2019-11-29T21:21:26.035729+0000 (oldest deadline 2019-11-29T21:22:10.090349+0000) 2019-11-29T21:22:14.373 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:22:14.366+0000 1694c700 -1 osd.0 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:25.462895+0000 front 2019-11-29T21:21:25.494956+0000 (oldest deadline 2019-11-29T21:22:08.916174+0000) 2019-11-29T21:22:14.455 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:22:14.450+0000 1694c700 -1 osd.2 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:24.865157+0000 front 2019-11-29T21:21:25.043612+0000 (oldest deadline 2019-11-29T21:22:10.152928+0000) 2019-11-29T21:22:14.946 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:22:14.938+0000 1694c700 -1 osd.4 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:24.879532+0000 front 2019-11-29T21:21:25.486498+0000 (oldest deadline 2019-11-29T21:22:10.136539+0000) 2019-11-29T21:22:15.072 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:22:15.066+0000 1694c700 -1 osd.5 324 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e322) 2019-11-29T21:22:15.361 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:22:15.354+0000 1694c700 -1 osd.7 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:26.017730+0000 front 2019-11-29T21:21:26.035729+0000 (oldest deadline 2019-11-29T21:22:10.090349+0000) 2019-11-29T21:22:15.412 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:22:15.406+0000 1694c700 -1 osd.0 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:25.462895+0000 front 2019-11-29T21:21:25.494956+0000 (oldest deadline 2019-11-29T21:22:08.916174+0000) 2019-11-29T21:22:15.458 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:22:15.454+0000 1694c700 -1 osd.2 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:24.865157+0000 front 2019-11-29T21:21:25.043612+0000 (oldest deadline 2019-11-29T21:22:10.152928+0000) 2019-11-29T21:22:15.938 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:22:15.932+0000 1694c700 -1 osd.4 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:24.879532+0000 front 2019-11-29T21:21:25.486498+0000 (oldest deadline 2019-11-29T21:22:10.136539+0000) 2019-11-29T21:22:16.032 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:22:16.027+0000 1694c700 -1 osd.5 324 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e322) 2019-11-29T21:22:16.352 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:22:16.345+0000 1694c700 -1 osd.7 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:26.017730+0000 front 2019-11-29T21:21:26.035729+0000 (oldest deadline 2019-11-29T21:22:10.090349+0000) 2019-11-29T21:22:16.431 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:22:16.427+0000 1694c700 -1 osd.0 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:25.462895+0000 front 2019-11-29T21:21:25.494956+0000 (oldest deadline 2019-11-29T21:22:08.916174+0000) 2019-11-29T21:22:16.515 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:22:16.508+0000 1694c700 -1 osd.2 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:24.865157+0000 front 2019-11-29T21:21:25.043612+0000 (oldest deadline 2019-11-29T21:22:10.152928+0000) 2019-11-29T21:22:16.936 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:22:16.928+0000 1694c700 -1 osd.4 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:24.879532+0000 front 2019-11-29T21:21:25.486498+0000 (oldest deadline 2019-11-29T21:22:10.136539+0000) 2019-11-29T21:22:17.023 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:22:17.018+0000 1694c700 -1 osd.5 324 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e322) 2019-11-29T21:22:17.337 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:22:17.330+0000 1694c700 -1 osd.7 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:26.017730+0000 front 2019-11-29T21:21:26.035729+0000 (oldest deadline 2019-11-29T21:22:10.090349+0000) 2019-11-29T21:22:17.407 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:22:17.403+0000 1694c700 -1 osd.0 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:25.462895+0000 front 2019-11-29T21:21:25.494956+0000 (oldest deadline 2019-11-29T21:22:08.916174+0000) 2019-11-29T21:22:17.508 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:22:17.501+0000 1694c700 -1 osd.2 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:24.865157+0000 front 2019-11-29T21:21:25.043612+0000 (oldest deadline 2019-11-29T21:22:10.152928+0000) 2019-11-29T21:22:17.946 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:22:17.939+0000 1694c700 -1 osd.4 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:24.879532+0000 front 2019-11-29T21:21:25.486498+0000 (oldest deadline 2019-11-29T21:22:10.136539+0000) 2019-11-29T21:22:18.000 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:22:17.987+0000 1694c700 -1 osd.5 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:21:37.113676+0000 (oldest deadline 2019-11-29T21:22:17.113676+0000) 2019-11-29T21:22:18.000 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:22:17.995+0000 1694c700 -1 osd.5 324 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e322) 2019-11-29T21:22:18.304 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:22:18.296+0000 1694c700 -1 osd.7 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:26.017730+0000 front 2019-11-29T21:21:26.035729+0000 (oldest deadline 2019-11-29T21:22:10.090349+0000) 2019-11-29T21:22:18.412 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:22:18.407+0000 1694c700 -1 osd.0 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:25.462895+0000 front 2019-11-29T21:21:25.494956+0000 (oldest deadline 2019-11-29T21:22:08.916174+0000) 2019-11-29T21:22:18.552 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:22:18.547+0000 1694c700 -1 osd.2 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:24.865157+0000 front 2019-11-29T21:21:25.043612+0000 (oldest deadline 2019-11-29T21:22:10.152928+0000) 2019-11-29T21:22:19.015 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:22:19.008+0000 1694c700 -1 osd.5 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:21:37.113676+0000 (oldest deadline 2019-11-29T21:22:17.113676+0000) 2019-11-29T21:22:19.016 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:22:19.010+0000 1694c700 -1 osd.5 324 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e322) 2019-11-29T21:22:19.023 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:22:19.007+0000 1694c700 -1 osd.4 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:24.879532+0000 front 2019-11-29T21:21:25.486498+0000 (oldest deadline 2019-11-29T21:22:10.136539+0000) 2019-11-29T21:22:19.287 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:22:19.280+0000 1694c700 -1 osd.7 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:26.017730+0000 front 2019-11-29T21:21:26.035729+0000 (oldest deadline 2019-11-29T21:22:10.090349+0000) 2019-11-29T21:22:19.383 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:22:19.376+0000 1694c700 -1 osd.0 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:25.462895+0000 front 2019-11-29T21:21:25.494956+0000 (oldest deadline 2019-11-29T21:22:08.916174+0000) 2019-11-29T21:22:19.598 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:22:19.592+0000 1694c700 -1 osd.2 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:24.865157+0000 front 2019-11-29T21:21:25.043612+0000 (oldest deadline 2019-11-29T21:22:10.152928+0000) 2019-11-29T21:22:19.976 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:22:19.969+0000 1694c700 -1 osd.5 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:21:37.113676+0000 (oldest deadline 2019-11-29T21:22:17.113676+0000) 2019-11-29T21:22:19.979 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:22:19.973+0000 1694c700 -1 osd.5 324 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e322) 2019-11-29T21:22:20.013 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:22:20.006+0000 1694c700 -1 osd.4 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:24.879532+0000 front 2019-11-29T21:21:25.486498+0000 (oldest deadline 2019-11-29T21:22:10.136539+0000) 2019-11-29T21:22:20.337 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:22:20.330+0000 1694c700 -1 osd.7 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:26.017730+0000 front 2019-11-29T21:21:26.035729+0000 (oldest deadline 2019-11-29T21:22:10.090349+0000) 2019-11-29T21:22:20.405 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:22:20.401+0000 1694c700 -1 osd.0 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:25.462895+0000 front 2019-11-29T21:21:25.494956+0000 (oldest deadline 2019-11-29T21:22:08.916174+0000) 2019-11-29T21:22:20.601 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:22:20.596+0000 1694c700 -1 osd.2 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:24.865157+0000 front 2019-11-29T21:21:25.043612+0000 (oldest deadline 2019-11-29T21:22:10.152928+0000) 2019-11-29T21:22:20.971 INFO:teuthology.orchestra.run.smithi062.stderr:testDeleteOnContainerWithFiles (test.functional.tests.TestContainer) ... ok 2019-11-29T21:22:21.000 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:22:20.993+0000 1694c700 -1 osd.4 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:24.879532+0000 front 2019-11-29T21:21:25.486498+0000 (oldest deadline 2019-11-29T21:22:10.136539+0000) 2019-11-29T21:22:21.029 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:22:21.018+0000 1694c700 -1 osd.5 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:21:37.113676+0000 (oldest deadline 2019-11-29T21:22:17.113676+0000) 2019-11-29T21:22:21.030 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:22:21.023+0000 1694c700 -1 osd.5 324 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e322) 2019-11-29T21:22:21.374 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:22:21.368+0000 1694c700 -1 osd.7 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:26.017730+0000 front 2019-11-29T21:21:26.035729+0000 (oldest deadline 2019-11-29T21:22:10.090349+0000) 2019-11-29T21:22:21.420 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:22:21.414+0000 1694c700 -1 osd.0 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:25.462895+0000 front 2019-11-29T21:21:25.494956+0000 (oldest deadline 2019-11-29T21:22:08.916174+0000) 2019-11-29T21:22:21.569 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:22:21.564+0000 1694c700 -1 osd.2 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:24.865157+0000 front 2019-11-29T21:21:25.043612+0000 (oldest deadline 2019-11-29T21:22:10.152928+0000) 2019-11-29T21:22:22.012 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:22:22.004+0000 1694c700 -1 osd.5 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:21:37.113676+0000 (oldest deadline 2019-11-29T21:22:17.113676+0000) 2019-11-29T21:22:22.013 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:22:22.007+0000 1694c700 -1 osd.5 324 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e322) 2019-11-29T21:22:22.015 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:22:22.009+0000 1694c700 -1 osd.4 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:24.879532+0000 front 2019-11-29T21:21:25.486498+0000 (oldest deadline 2019-11-29T21:22:10.136539+0000) 2019-11-29T21:22:22.187 INFO:teuthology.orchestra.run.smithi062.stderr:testFileCreateInContainerThatDoesNotExist (test.functional.tests.TestContainer) ... ok 2019-11-29T21:22:22.353 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:22:22.340+0000 1694c700 -1 osd.7 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:26.017730+0000 front 2019-11-29T21:21:26.035729+0000 (oldest deadline 2019-11-29T21:22:10.090349+0000) 2019-11-29T21:22:22.461 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:22:22.456+0000 1694c700 -1 osd.0 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:25.462895+0000 front 2019-11-29T21:21:25.494956+0000 (oldest deadline 2019-11-29T21:22:08.916174+0000) 2019-11-29T21:22:22.613 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:22:22.608+0000 1694c700 -1 osd.2 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:24.865157+0000 front 2019-11-29T21:21:25.043612+0000 (oldest deadline 2019-11-29T21:22:10.152928+0000) 2019-11-29T21:22:22.981 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:22:22.973+0000 1694c700 -1 osd.5 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:21:37.113676+0000 (oldest deadline 2019-11-29T21:22:17.113676+0000) 2019-11-29T21:22:22.981 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:22:22.976+0000 1694c700 -1 osd.5 324 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e322) 2019-11-29T21:22:23.073 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:22:23.058+0000 1694c700 -1 osd.4 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:24.879532+0000 front 2019-11-29T21:21:25.486498+0000 (oldest deadline 2019-11-29T21:22:10.136539+0000) 2019-11-29T21:22:23.309 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:22:23.302+0000 1694c700 -1 osd.7 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:26.017730+0000 front 2019-11-29T21:21:26.035729+0000 (oldest deadline 2019-11-29T21:22:10.090349+0000) 2019-11-29T21:22:23.497 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:22:23.492+0000 1694c700 -1 osd.0 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:25.462895+0000 front 2019-11-29T21:21:25.494956+0000 (oldest deadline 2019-11-29T21:22:08.916174+0000) 2019-11-29T21:22:23.644 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:22:23.637+0000 1694c700 -1 osd.2 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:24.865157+0000 front 2019-11-29T21:21:25.043612+0000 (oldest deadline 2019-11-29T21:22:10.152928+0000) 2019-11-29T21:22:24.029 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:22:24.021+0000 1694c700 -1 osd.4 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:24.879532+0000 front 2019-11-29T21:21:25.486498+0000 (oldest deadline 2019-11-29T21:22:10.136539+0000) 2019-11-29T21:22:24.029 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:22:24.015+0000 1694c700 -1 osd.5 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:21:37.113676+0000 (oldest deadline 2019-11-29T21:22:17.113676+0000) 2019-11-29T21:22:24.043 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:22:24.018+0000 1694c700 -1 osd.5 324 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e322) 2019-11-29T21:22:24.304 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:22:24.297+0000 1694c700 -1 osd.7 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:26.017730+0000 front 2019-11-29T21:21:26.035729+0000 (oldest deadline 2019-11-29T21:22:10.090349+0000) 2019-11-29T21:22:24.464 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:22:24.458+0000 1694c700 -1 osd.0 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:25.462895+0000 front 2019-11-29T21:21:25.494956+0000 (oldest deadline 2019-11-29T21:22:08.916174+0000) 2019-11-29T21:22:24.622 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:22:24.617+0000 1694c700 -1 osd.2 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:24.865157+0000 front 2019-11-29T21:21:25.043612+0000 (oldest deadline 2019-11-29T21:22:10.152928+0000) 2019-11-29T21:22:24.988 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:22:24.980+0000 1694c700 -1 osd.4 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:24.879532+0000 front 2019-11-29T21:21:25.486498+0000 (oldest deadline 2019-11-29T21:22:10.136539+0000) 2019-11-29T21:22:25.071 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:22:25.063+0000 1694c700 -1 osd.5 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:21:37.113676+0000 (oldest deadline 2019-11-29T21:22:17.113676+0000) 2019-11-29T21:22:25.072 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:22:25.066+0000 1694c700 -1 osd.5 324 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e322) 2019-11-29T21:22:25.284 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:22:25.278+0000 1694c700 -1 osd.7 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:26.017730+0000 front 2019-11-29T21:21:26.035729+0000 (oldest deadline 2019-11-29T21:22:10.090349+0000) 2019-11-29T21:22:25.453 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:22:25.448+0000 1694c700 -1 osd.0 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:25.462895+0000 front 2019-11-29T21:21:25.494956+0000 (oldest deadline 2019-11-29T21:22:08.916174+0000) 2019-11-29T21:22:25.622 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:22:25.616+0000 1694c700 -1 osd.2 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:24.865157+0000 front 2019-11-29T21:21:25.043612+0000 (oldest deadline 2019-11-29T21:22:10.152928+0000) 2019-11-29T21:22:26.035 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:22:26.029+0000 1694c700 -1 osd.4 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:24.879532+0000 front 2019-11-29T21:21:25.486498+0000 (oldest deadline 2019-11-29T21:22:10.136539+0000) 2019-11-29T21:22:26.062 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:22:26.056+0000 1694c700 -1 osd.5 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:21:37.113676+0000 (oldest deadline 2019-11-29T21:22:17.113676+0000) 2019-11-29T21:22:26.066 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:22:26.060+0000 1694c700 -1 osd.5 324 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e322) 2019-11-29T21:22:26.294 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:22:26.279+0000 1694c700 -1 osd.7 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:26.017730+0000 front 2019-11-29T21:21:26.035729+0000 (oldest deadline 2019-11-29T21:22:10.090349+0000) 2019-11-29T21:22:26.501 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:22:26.496+0000 1694c700 -1 osd.0 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:25.462895+0000 front 2019-11-29T21:21:25.494956+0000 (oldest deadline 2019-11-29T21:22:08.916174+0000) 2019-11-29T21:22:26.582 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:22:26.577+0000 1694c700 -1 osd.2 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:24.865157+0000 front 2019-11-29T21:21:25.043612+0000 (oldest deadline 2019-11-29T21:22:10.152928+0000) 2019-11-29T21:22:27.018 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:22:27.011+0000 1694c700 -1 osd.4 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:24.879532+0000 front 2019-11-29T21:21:25.486498+0000 (oldest deadline 2019-11-29T21:22:10.136539+0000) 2019-11-29T21:22:27.065 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:22:27.058+0000 1694c700 -1 osd.5 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:21:37.113676+0000 (oldest deadline 2019-11-29T21:22:17.113676+0000) 2019-11-29T21:22:27.068 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:22:27.063+0000 1694c700 -1 osd.5 324 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e322) 2019-11-29T21:22:27.283 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:22:27.276+0000 1694c700 -1 osd.7 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:26.017730+0000 front 2019-11-29T21:21:26.035729+0000 (oldest deadline 2019-11-29T21:22:10.090349+0000) 2019-11-29T21:22:27.468 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:22:27.463+0000 1694c700 -1 osd.0 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:25.462895+0000 front 2019-11-29T21:21:25.494956+0000 (oldest deadline 2019-11-29T21:22:08.916174+0000) 2019-11-29T21:22:27.550 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:22:27.545+0000 1694c700 -1 osd.2 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:24.865157+0000 front 2019-11-29T21:21:25.043612+0000 (oldest deadline 2019-11-29T21:22:10.152928+0000) 2019-11-29T21:22:27.999 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:22:27.991+0000 1694c700 -1 osd.4 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:24.879532+0000 front 2019-11-29T21:21:25.486498+0000 (oldest deadline 2019-11-29T21:22:10.136539+0000) 2019-11-29T21:22:28.106 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:22:28.099+0000 1694c700 -1 osd.5 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:21:37.113676+0000 (oldest deadline 2019-11-29T21:22:17.113676+0000) 2019-11-29T21:22:28.110 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:22:28.105+0000 1694c700 -1 osd.5 324 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e322) 2019-11-29T21:22:28.306 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:22:28.298+0000 1694c700 -1 osd.7 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:26.017730+0000 front 2019-11-29T21:21:26.035729+0000 (oldest deadline 2019-11-29T21:22:10.090349+0000) 2019-11-29T21:22:28.479 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:22:28.475+0000 1694c700 -1 osd.0 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:25.462895+0000 front 2019-11-29T21:21:25.494956+0000 (oldest deadline 2019-11-29T21:22:08.916174+0000) 2019-11-29T21:22:28.572 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:22:28.566+0000 1694c700 -1 osd.2 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:24.865157+0000 front 2019-11-29T21:21:25.043612+0000 (oldest deadline 2019-11-29T21:22:10.152928+0000) 2019-11-29T21:22:29.029 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:22:29.019+0000 1694c700 -1 osd.4 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:24.879532+0000 front 2019-11-29T21:21:25.486498+0000 (oldest deadline 2019-11-29T21:22:10.136539+0000) 2019-11-29T21:22:29.142 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:22:29.135+0000 1694c700 -1 osd.5 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:21:37.113676+0000 (oldest deadline 2019-11-29T21:22:17.113676+0000) 2019-11-29T21:22:29.143 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:22:29.137+0000 1694c700 -1 osd.5 324 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e322) 2019-11-29T21:22:29.327 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:22:29.316+0000 1694c700 -1 osd.7 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:26.017730+0000 front 2019-11-29T21:21:26.035729+0000 (oldest deadline 2019-11-29T21:22:10.090349+0000) 2019-11-29T21:22:29.456 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:22:29.451+0000 1694c700 -1 osd.0 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:25.462895+0000 front 2019-11-29T21:21:25.494956+0000 (oldest deadline 2019-11-29T21:22:08.916174+0000) 2019-11-29T21:22:29.543 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:22:29.538+0000 1694c700 -1 osd.2 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:24.865157+0000 front 2019-11-29T21:21:25.043612+0000 (oldest deadline 2019-11-29T21:22:10.152928+0000) 2019-11-29T21:22:30.013 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:22:30.006+0000 1694c700 -1 osd.4 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:24.879532+0000 front 2019-11-29T21:21:25.486498+0000 (oldest deadline 2019-11-29T21:22:10.136539+0000) 2019-11-29T21:22:30.110 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:22:30.102+0000 1694c700 -1 osd.5 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:21:37.113676+0000 (oldest deadline 2019-11-29T21:22:17.113676+0000) 2019-11-29T21:22:30.111 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:22:30.104+0000 1694c700 -1 osd.5 324 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e322) 2019-11-29T21:22:30.368 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:22:30.361+0000 1694c700 -1 osd.7 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:26.017730+0000 front 2019-11-29T21:21:26.035729+0000 (oldest deadline 2019-11-29T21:22:10.090349+0000) 2019-11-29T21:22:30.483 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:22:30.477+0000 1694c700 -1 osd.0 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:25.462895+0000 front 2019-11-29T21:21:25.494956+0000 (oldest deadline 2019-11-29T21:22:08.916174+0000) 2019-11-29T21:22:30.511 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:22:30.506+0000 1694c700 -1 osd.2 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:24.865157+0000 front 2019-11-29T21:21:25.043612+0000 (oldest deadline 2019-11-29T21:22:10.152928+0000) 2019-11-29T21:22:31.024 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:22:31.017+0000 1694c700 -1 osd.4 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:24.879532+0000 front 2019-11-29T21:21:25.486498+0000 (oldest deadline 2019-11-29T21:22:10.136539+0000) 2019-11-29T21:22:31.159 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:22:31.152+0000 1694c700 -1 osd.5 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:21:37.113676+0000 (oldest deadline 2019-11-29T21:22:17.113676+0000) 2019-11-29T21:22:31.160 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:22:31.154+0000 1694c700 -1 osd.5 324 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e322) 2019-11-29T21:22:31.394 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:22:31.388+0000 1694c700 -1 osd.7 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:26.017730+0000 front 2019-11-29T21:21:26.035729+0000 (oldest deadline 2019-11-29T21:22:10.090349+0000) 2019-11-29T21:22:31.448 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:22:31.441+0000 1694c700 -1 osd.0 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:25.462895+0000 front 2019-11-29T21:21:25.494956+0000 (oldest deadline 2019-11-29T21:22:08.916174+0000) 2019-11-29T21:22:31.511 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:22:31.502+0000 1694c700 -1 osd.2 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:24.865157+0000 front 2019-11-29T21:21:25.043612+0000 (oldest deadline 2019-11-29T21:22:10.152928+0000) 2019-11-29T21:22:32.040 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:22:32.034+0000 1694c700 -1 osd.4 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:24.879532+0000 front 2019-11-29T21:21:25.486498+0000 (oldest deadline 2019-11-29T21:22:10.136539+0000) 2019-11-29T21:22:32.160 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:22:32.152+0000 1694c700 -1 osd.5 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:21:37.113676+0000 (oldest deadline 2019-11-29T21:22:17.113676+0000) 2019-11-29T21:22:32.160 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:22:32.155+0000 1694c700 -1 osd.5 324 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e322) 2019-11-29T21:22:32.408 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:22:32.400+0000 1694c700 -1 osd.7 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:26.017730+0000 front 2019-11-29T21:21:26.035729+0000 (oldest deadline 2019-11-29T21:22:10.090349+0000) 2019-11-29T21:22:32.453 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:22:32.448+0000 1694c700 -1 osd.0 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:25.462895+0000 front 2019-11-29T21:21:25.494956+0000 (oldest deadline 2019-11-29T21:22:08.916174+0000) 2019-11-29T21:22:32.534 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:22:32.529+0000 1694c700 -1 osd.2 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:24.865157+0000 front 2019-11-29T21:21:25.043612+0000 (oldest deadline 2019-11-29T21:22:10.152928+0000) 2019-11-29T21:22:33.000 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:22:32.989+0000 1694c700 -1 osd.4 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:24.879532+0000 front 2019-11-29T21:21:25.486498+0000 (oldest deadline 2019-11-29T21:22:10.136539+0000) 2019-11-29T21:22:33.129 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:22:33.122+0000 1694c700 -1 osd.5 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:21:37.113676+0000 (oldest deadline 2019-11-29T21:22:17.113676+0000) 2019-11-29T21:22:33.130 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:22:33.124+0000 1694c700 -1 osd.5 324 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e322) 2019-11-29T21:22:33.368 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:22:33.361+0000 1694c700 -1 osd.7 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:26.017730+0000 front 2019-11-29T21:21:26.035729+0000 (oldest deadline 2019-11-29T21:22:10.090349+0000) 2019-11-29T21:22:33.443 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:22:33.438+0000 1694c700 -1 osd.0 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:25.462895+0000 front 2019-11-29T21:21:25.494956+0000 (oldest deadline 2019-11-29T21:22:08.916174+0000) 2019-11-29T21:22:33.512 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:22:33.507+0000 1694c700 -1 osd.2 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:24.865157+0000 front 2019-11-29T21:21:25.043612+0000 (oldest deadline 2019-11-29T21:22:10.152928+0000) 2019-11-29T21:22:34.000 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:22:33.993+0000 1694c700 -1 osd.4 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:24.879532+0000 front 2019-11-29T21:21:25.486498+0000 (oldest deadline 2019-11-29T21:22:10.136539+0000) 2019-11-29T21:22:34.139 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:22:34.132+0000 1694c700 -1 osd.5 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:21:37.113676+0000 (oldest deadline 2019-11-29T21:22:17.113676+0000) 2019-11-29T21:22:34.140 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:22:34.134+0000 1694c700 -1 osd.5 324 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e322) 2019-11-29T21:22:34.400 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:22:34.394+0000 1694c700 -1 osd.0 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:25.462895+0000 front 2019-11-29T21:21:25.494956+0000 (oldest deadline 2019-11-29T21:22:08.916174+0000) 2019-11-29T21:22:34.418 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:22:34.411+0000 1694c700 -1 osd.7 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:26.017730+0000 front 2019-11-29T21:21:26.035729+0000 (oldest deadline 2019-11-29T21:22:10.090349+0000) 2019-11-29T21:22:34.477 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:22:34.471+0000 1694c700 -1 osd.2 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:24.865157+0000 front 2019-11-29T21:21:25.043612+0000 (oldest deadline 2019-11-29T21:22:10.152928+0000) 2019-11-29T21:22:35.001 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:22:34.980+0000 1694c700 -1 osd.4 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:24.879532+0000 front 2019-11-29T21:21:25.486498+0000 (oldest deadline 2019-11-29T21:22:10.136539+0000) 2019-11-29T21:22:35.097 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:22:35.089+0000 1694c700 -1 osd.5 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:21:37.113676+0000 (oldest deadline 2019-11-29T21:22:17.113676+0000) 2019-11-29T21:22:35.099 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:22:35.092+0000 1694c700 -1 osd.5 324 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e322) 2019-11-29T21:22:35.414 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:22:35.407+0000 1694c700 -1 osd.7 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:26.017730+0000 front 2019-11-29T21:21:26.035729+0000 (oldest deadline 2019-11-29T21:22:10.090349+0000) 2019-11-29T21:22:35.439 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:22:35.434+0000 1694c700 -1 osd.0 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:25.462895+0000 front 2019-11-29T21:21:25.494956+0000 (oldest deadline 2019-11-29T21:22:08.916174+0000) 2019-11-29T21:22:35.492 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:22:35.486+0000 1694c700 -1 osd.2 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:24.865157+0000 front 2019-11-29T21:21:25.043612+0000 (oldest deadline 2019-11-29T21:22:10.152928+0000) 2019-11-29T21:22:36.021 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:22:36.013+0000 1694c700 -1 osd.4 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:24.879532+0000 front 2019-11-29T21:21:25.486498+0000 (oldest deadline 2019-11-29T21:22:10.136539+0000) 2019-11-29T21:22:36.080 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:22:36.071+0000 1694c700 -1 osd.5 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:21:37.113676+0000 (oldest deadline 2019-11-29T21:22:17.113676+0000) 2019-11-29T21:22:36.081 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:22:36.075+0000 1694c700 -1 osd.5 324 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e322) 2019-11-29T21:22:36.420 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:22:36.413+0000 1694c700 -1 osd.7 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:26.017730+0000 front 2019-11-29T21:21:26.035729+0000 (oldest deadline 2019-11-29T21:22:10.090349+0000) 2019-11-29T21:22:36.470 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:22:36.465+0000 1694c700 -1 osd.0 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:25.462895+0000 front 2019-11-29T21:21:25.494956+0000 (oldest deadline 2019-11-29T21:22:08.916174+0000) 2019-11-29T21:22:36.498 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:22:36.493+0000 1694c700 -1 osd.2 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:24.865157+0000 front 2019-11-29T21:21:25.043612+0000 (oldest deadline 2019-11-29T21:22:10.152928+0000) 2019-11-29T21:22:37.021 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:22:37.015+0000 1694c700 -1 osd.4 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:24.879532+0000 front 2019-11-29T21:21:25.486498+0000 (oldest deadline 2019-11-29T21:22:10.136539+0000) 2019-11-29T21:22:37.192 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:22:37.114+0000 1694c700 -1 osd.5 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:21:37.113676+0000 (oldest deadline 2019-11-29T21:22:17.113676+0000) 2019-11-29T21:22:37.199 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:22:37.117+0000 1694c700 -1 osd.5 324 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e322) 2019-11-29T21:22:37.441 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:22:37.434+0000 1694c700 -1 osd.7 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:26.017730+0000 front 2019-11-29T21:21:26.035729+0000 (oldest deadline 2019-11-29T21:22:10.090349+0000) 2019-11-29T21:22:37.490 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:22:37.485+0000 1694c700 -1 osd.0 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:25.462895+0000 front 2019-11-29T21:21:25.494956+0000 (oldest deadline 2019-11-29T21:22:08.916174+0000) 2019-11-29T21:22:37.496 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:22:37.492+0000 1694c700 -1 osd.2 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:24.865157+0000 front 2019-11-29T21:21:25.043612+0000 (oldest deadline 2019-11-29T21:22:10.152928+0000) 2019-11-29T21:22:38.037 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:22:38.030+0000 1694c700 -1 osd.4 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:24.879532+0000 front 2019-11-29T21:21:25.486498+0000 (oldest deadline 2019-11-29T21:22:10.136539+0000) 2019-11-29T21:22:38.173 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:22:38.160+0000 1694c700 -1 osd.5 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:21:37.113676+0000 (oldest deadline 2019-11-29T21:22:17.113676+0000) 2019-11-29T21:22:38.175 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:22:38.162+0000 1694c700 -1 osd.5 324 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e322) 2019-11-29T21:22:38.463 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:22:38.457+0000 1694c700 -1 osd.0 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:25.462895+0000 front 2019-11-29T21:21:25.494956+0000 (oldest deadline 2019-11-29T21:22:08.916174+0000) 2019-11-29T21:22:38.494 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:22:38.486+0000 1694c700 -1 osd.7 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:26.017730+0000 front 2019-11-29T21:21:26.035729+0000 (oldest deadline 2019-11-29T21:22:10.090349+0000) 2019-11-29T21:22:38.501 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:22:38.496+0000 1694c700 -1 osd.2 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:24.865157+0000 front 2019-11-29T21:21:25.043612+0000 (oldest deadline 2019-11-29T21:22:10.152928+0000) 2019-11-29T21:22:39.028 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:22:39.019+0000 1694c700 -1 osd.4 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:24.879532+0000 front 2019-11-29T21:21:25.486498+0000 (oldest deadline 2019-11-29T21:22:10.136539+0000) 2019-11-29T21:22:39.178 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:22:39.171+0000 1694c700 -1 osd.5 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:21:37.113676+0000 (oldest deadline 2019-11-29T21:22:17.113676+0000) 2019-11-29T21:22:39.179 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:22:39.173+0000 1694c700 -1 osd.5 324 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e322) 2019-11-29T21:22:39.456 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:22:39.449+0000 1694c700 -1 osd.7 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:26.017730+0000 front 2019-11-29T21:21:26.035729+0000 (oldest deadline 2019-11-29T21:22:10.090349+0000) 2019-11-29T21:22:39.468 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:22:39.462+0000 1694c700 -1 osd.0 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:25.462895+0000 front 2019-11-29T21:21:25.494956+0000 (oldest deadline 2019-11-29T21:22:08.916174+0000) 2019-11-29T21:22:39.533 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:22:39.527+0000 1694c700 -1 osd.2 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:24.865157+0000 front 2019-11-29T21:21:25.043612+0000 (oldest deadline 2019-11-29T21:22:10.152928+0000) 2019-11-29T21:22:40.024 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:22:40.016+0000 1694c700 -1 osd.4 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:24.879532+0000 front 2019-11-29T21:21:25.486498+0000 (oldest deadline 2019-11-29T21:22:10.136539+0000) 2019-11-29T21:22:40.219 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:22:40.205+0000 1694c700 -1 osd.5 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:21:37.113676+0000 (oldest deadline 2019-11-29T21:22:17.113676+0000) 2019-11-29T21:22:40.219 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:22:40.208+0000 1694c700 -1 osd.5 324 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e322) 2019-11-29T21:22:40.444 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:22:40.439+0000 1694c700 -1 osd.0 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:25.462895+0000 front 2019-11-29T21:21:25.494956+0000 (oldest deadline 2019-11-29T21:22:08.916174+0000) 2019-11-29T21:22:40.455 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:22:40.447+0000 1694c700 -1 osd.7 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:26.017730+0000 front 2019-11-29T21:21:26.035729+0000 (oldest deadline 2019-11-29T21:22:10.090349+0000) 2019-11-29T21:22:40.564 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:22:40.558+0000 1694c700 -1 osd.2 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:24.865157+0000 front 2019-11-29T21:21:25.043612+0000 (oldest deadline 2019-11-29T21:22:10.152928+0000) 2019-11-29T21:22:41.010 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:22:41.002+0000 1694c700 -1 osd.4 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:24.879532+0000 front 2019-11-29T21:21:25.486498+0000 (oldest deadline 2019-11-29T21:22:10.136539+0000) 2019-11-29T21:22:41.226 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:22:41.219+0000 1694c700 -1 osd.5 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:21:37.113676+0000 (oldest deadline 2019-11-29T21:22:17.113676+0000) 2019-11-29T21:22:41.229 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:22:41.224+0000 1694c700 -1 osd.5 324 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e322) 2019-11-29T21:22:41.347 INFO:tasks.ceph.mon.b.smithi022.stderr:2019-11-29T21:22:41.338+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.1 [v2:172.21.15.62:6800/10370,v1:172.21.15.62:6801/10370] for 44sec e324 v324) 2019-11-29T21:22:41.402 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:22:41.395+0000 1694c700 -1 osd.0 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:25.462895+0000 front 2019-11-29T21:21:25.494956+0000 (oldest deadline 2019-11-29T21:22:08.916174+0000) 2019-11-29T21:22:41.449 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:22:41.443+0000 1694c700 -1 osd.7 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:26.017730+0000 front 2019-11-29T21:21:26.035729+0000 (oldest deadline 2019-11-29T21:22:10.090349+0000) 2019-11-29T21:22:41.535 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:22:41.530+0000 1694c700 -1 osd.2 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:24.865157+0000 front 2019-11-29T21:21:25.043612+0000 (oldest deadline 2019-11-29T21:22:10.152928+0000) 2019-11-29T21:22:41.980 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:22:41.974+0000 1694c700 -1 osd.4 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:24.879532+0000 front 2019-11-29T21:21:25.486498+0000 (oldest deadline 2019-11-29T21:22:10.136539+0000) 2019-11-29T21:22:42.206 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:22:42.198+0000 1694c700 -1 osd.5 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:21:37.113676+0000 (oldest deadline 2019-11-29T21:22:17.113676+0000) 2019-11-29T21:22:42.206 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:22:42.201+0000 1694c700 -1 osd.5 324 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e322) 2019-11-29T21:22:42.388 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:22:42.382+0000 1694c700 -1 osd.0 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:25.462895+0000 front 2019-11-29T21:21:25.494956+0000 (oldest deadline 2019-11-29T21:22:08.916174+0000) 2019-11-29T21:22:42.502 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:22:42.495+0000 1694c700 -1 osd.7 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:26.017730+0000 front 2019-11-29T21:21:26.035729+0000 (oldest deadline 2019-11-29T21:22:10.090349+0000) 2019-11-29T21:22:42.516 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:22:42.511+0000 1694c700 -1 osd.2 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:24.865157+0000 front 2019-11-29T21:21:25.043612+0000 (oldest deadline 2019-11-29T21:22:10.152928+0000) 2019-11-29T21:22:42.991 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:22:42.983+0000 1694c700 -1 osd.4 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:24.879532+0000 front 2019-11-29T21:21:25.486498+0000 (oldest deadline 2019-11-29T21:22:10.136539+0000) 2019-11-29T21:22:43.173 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:22:43.166+0000 1694c700 -1 osd.5 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:21:37.113676+0000 (oldest deadline 2019-11-29T21:22:17.113676+0000) 2019-11-29T21:22:43.177 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:22:43.171+0000 1694c700 -1 osd.5 324 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e322) 2019-11-29T21:22:43.388 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:22:43.383+0000 1694c700 -1 osd.0 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:25.462895+0000 front 2019-11-29T21:21:25.494956+0000 (oldest deadline 2019-11-29T21:22:08.916174+0000) 2019-11-29T21:22:43.465 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:22:43.457+0000 1694c700 -1 osd.7 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:26.017730+0000 front 2019-11-29T21:21:26.035729+0000 (oldest deadline 2019-11-29T21:22:10.090349+0000) 2019-11-29T21:22:43.481 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:22:43.476+0000 1694c700 -1 osd.2 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:24.865157+0000 front 2019-11-29T21:21:25.043612+0000 (oldest deadline 2019-11-29T21:22:10.152928+0000) 2019-11-29T21:22:43.946 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:22:43.939+0000 1694c700 -1 osd.4 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:24.879532+0000 front 2019-11-29T21:21:25.486498+0000 (oldest deadline 2019-11-29T21:22:10.136539+0000) 2019-11-29T21:22:44.202 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:22:44.193+0000 1694c700 -1 osd.5 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:21:37.113676+0000 (oldest deadline 2019-11-29T21:22:17.113676+0000) 2019-11-29T21:22:44.203 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:22:44.197+0000 1694c700 -1 osd.5 324 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e322) 2019-11-29T21:22:44.376 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:22:44.370+0000 1694c700 -1 osd.0 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:25.462895+0000 front 2019-11-29T21:21:25.494956+0000 (oldest deadline 2019-11-29T21:22:08.916174+0000) 2019-11-29T21:22:44.425 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:22:44.420+0000 1694c700 -1 osd.7 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:26.017730+0000 front 2019-11-29T21:21:26.035729+0000 (oldest deadline 2019-11-29T21:22:10.090349+0000) 2019-11-29T21:22:44.510 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:22:44.506+0000 1694c700 -1 osd.2 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:24.865157+0000 front 2019-11-29T21:21:25.043612+0000 (oldest deadline 2019-11-29T21:22:10.152928+0000) 2019-11-29T21:22:44.909 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:22:44.902+0000 1694c700 -1 osd.4 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:24.879532+0000 front 2019-11-29T21:21:25.486498+0000 (oldest deadline 2019-11-29T21:22:10.136539+0000) 2019-11-29T21:22:45.222 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:22:45.215+0000 1694c700 -1 osd.5 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:21:37.113676+0000 (oldest deadline 2019-11-29T21:22:17.113676+0000) 2019-11-29T21:22:45.223 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:22:45.217+0000 1694c700 -1 osd.5 324 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e322) 2019-11-29T21:22:45.389 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:22:45.384+0000 1694c700 -1 osd.0 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:25.462895+0000 front 2019-11-29T21:21:25.494956+0000 (oldest deadline 2019-11-29T21:22:08.916174+0000) 2019-11-29T21:22:45.456 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:22:45.450+0000 1694c700 -1 osd.7 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:26.017730+0000 front 2019-11-29T21:21:26.035729+0000 (oldest deadline 2019-11-29T21:22:10.090349+0000) 2019-11-29T21:22:45.519 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:22:45.510+0000 1694c700 -1 osd.2 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:24.865157+0000 front 2019-11-29T21:21:25.043612+0000 (oldest deadline 2019-11-29T21:22:10.152928+0000) 2019-11-29T21:22:45.907 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:22:45.900+0000 1694c700 -1 osd.4 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:24.879532+0000 front 2019-11-29T21:21:25.486498+0000 (oldest deadline 2019-11-29T21:22:10.136539+0000) 2019-11-29T21:22:46.184 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:22:46.176+0000 1694c700 -1 osd.5 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:21:37.113676+0000 (oldest deadline 2019-11-29T21:22:17.113676+0000) 2019-11-29T21:22:46.185 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:22:46.179+0000 1694c700 -1 osd.5 324 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e322) 2019-11-29T21:22:46.397 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:22:46.392+0000 1694c700 -1 osd.0 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:25.462895+0000 front 2019-11-29T21:21:25.494956+0000 (oldest deadline 2019-11-29T21:22:08.916174+0000) 2019-11-29T21:22:46.421 INFO:tasks.ceph.mon.b.smithi022.stderr:2019-11-29T21:22:46.414+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 4 slow ops, oldest is osd_failure(failed timeout osd.1 [v2:172.21.15.62:6800/10370,v1:172.21.15.62:6801/10370] for 44sec e324 v324) 2019-11-29T21:22:46.496 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:22:46.491+0000 1694c700 -1 osd.2 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:24.865157+0000 front 2019-11-29T21:21:25.043612+0000 (oldest deadline 2019-11-29T21:22:10.152928+0000) 2019-11-29T21:22:46.526 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:22:46.500+0000 1694c700 -1 osd.7 324 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:21:26.017730+0000 front 2019-11-29T21:21:26.035729+0000 (oldest deadline 2019-11-29T21:22:10.090349+0000) 2019-11-29T21:24:12.025 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:24:12.019+0000 1694c700 -1 osd.1 329 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:122739 7.0 7:0943defa:::2019-11-29-21-7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.624-aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa:head [append 0~838 in=838b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e328) 2019-11-29T21:24:13.059 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:24:13.055+0000 1694c700 -1 osd.1 329 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:122739 7.0 7:0943defa:::2019-11-29-21-7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.624-aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa:head [append 0~838 in=838b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e328) 2019-11-29T21:24:14.059 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:24:14.054+0000 1694c700 -1 osd.1 329 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:122739 7.0 7:0943defa:::2019-11-29-21-7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.624-aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa:head [append 0~838 in=838b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e328) 2019-11-29T21:24:15.042 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:24:15.037+0000 1694c700 -1 osd.1 329 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:122739 7.0 7:0943defa:::2019-11-29-21-7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.624-aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa:head [append 0~838 in=838b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e328) 2019-11-29T21:24:16.045 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:24:16.040+0000 1694c700 -1 osd.1 329 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:122739 7.0 7:0943defa:::2019-11-29-21-7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.624-aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa:head [append 0~838 in=838b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e328) 2019-11-29T21:24:17.000 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:24:16.995+0000 1694c700 -1 osd.1 329 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4325.0:122739 7.0 7:0943defa:::2019-11-29-21-7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.624-aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa:head [append 0~838 in=838b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e328) 2019-11-29T21:24:18.009 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:24:18.004+0000 1694c700 -1 osd.1 329 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4325.0:122739 7.0 7:0943defa:::2019-11-29-21-7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.624-aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa:head [append 0~838 in=838b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e328) 2019-11-29T21:24:19.028 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:24:19.023+0000 1694c700 -1 osd.1 329 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4325.0:122739 7.0 7:0943defa:::2019-11-29-21-7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.624-aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa:head [append 0~838 in=838b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e328) 2019-11-29T21:24:20.016 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:24:20.011+0000 1694c700 -1 osd.1 329 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4325.0:122739 7.0 7:0943defa:::2019-11-29-21-7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.624-aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa:head [append 0~838 in=838b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e328) 2019-11-29T21:24:21.069 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:24:21.058+0000 1694c700 -1 osd.1 329 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4325.0:122739 7.0 7:0943defa:::2019-11-29-21-7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.624-aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa:head [append 0~838 in=838b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e328) 2019-11-29T21:24:22.025 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:24:22.020+0000 1694c700 -1 osd.1 329 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4325.0:122739 7.0 7:0943defa:::2019-11-29-21-7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.624-aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa:head [append 0~838 in=838b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e328) 2019-11-29T21:24:22.996 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:24:22.991+0000 1694c700 -1 osd.1 329 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4325.0:122739 7.0 7:0943defa:::2019-11-29-21-7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.624-aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa:head [append 0~838 in=838b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e328) 2019-11-29T21:24:24.018 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:24:24.014+0000 1694c700 -1 osd.1 329 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4325.0:122739 7.0 7:0943defa:::2019-11-29-21-7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.624-aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa:head [append 0~838 in=838b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e328) 2019-11-29T21:24:24.992 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:24:24.987+0000 1694c700 -1 osd.1 329 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4325.0:122739 7.0 7:0943defa:::2019-11-29-21-7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.624-aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa:head [append 0~838 in=838b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e328) 2019-11-29T21:24:26.000 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:24:25.995+0000 1694c700 -1 osd.1 329 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4325.0:122739 7.0 7:0943defa:::2019-11-29-21-7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.624-aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa:head [append 0~838 in=838b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e328) 2019-11-29T21:24:26.998 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:24:26.989+0000 1694c700 -1 osd.1 329 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4325.0:122739 7.0 7:0943defa:::2019-11-29-21-7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.624-aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa:head [append 0~838 in=838b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e328) 2019-11-29T21:24:27.958 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:24:27.953+0000 1694c700 -1 osd.1 329 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4325.0:122739 7.0 7:0943defa:::2019-11-29-21-7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.624-aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa:head [append 0~838 in=838b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e328) 2019-11-29T21:24:28.918 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:24:28.912+0000 1694c700 -1 osd.1 329 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4325.0:122739 7.0 7:0943defa:::2019-11-29-21-7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.624-aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa:head [append 0~838 in=838b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e328) 2019-11-29T21:24:29.888 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:24:29.883+0000 1694c700 -1 osd.1 329 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4325.0:122739 7.0 7:0943defa:::2019-11-29-21-7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.624-aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa:head [append 0~838 in=838b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e328) 2019-11-29T21:24:30.925 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:24:30.920+0000 1694c700 -1 osd.1 329 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4325.0:122739 7.0 7:0943defa:::2019-11-29-21-7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.624-aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa:head [append 0~838 in=838b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e328) 2019-11-29T21:24:31.885 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:24:31.880+0000 1694c700 -1 osd.1 329 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4325.0:122739 7.0 7:0943defa:::2019-11-29-21-7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.624-aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa:head [append 0~838 in=838b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e328) 2019-11-29T21:24:32.919 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:24:32.915+0000 1694c700 -1 osd.1 329 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4325.0:122739 7.0 7:0943defa:::2019-11-29-21-7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.624-aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa:head [append 0~838 in=838b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e328) 2019-11-29T21:24:33.926 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:24:33.922+0000 1694c700 -1 osd.1 329 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4325.0:122739 7.0 7:0943defa:::2019-11-29-21-7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.624-aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa:head [append 0~838 in=838b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e328) 2019-11-29T21:24:34.964 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:24:34.960+0000 1694c700 -1 osd.1 329 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4325.0:122739 7.0 7:0943defa:::2019-11-29-21-7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.624-aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa:head [append 0~838 in=838b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e328) 2019-11-29T21:24:35.925 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:24:35.920+0000 1694c700 -1 osd.1 329 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4325.0:122739 7.0 7:0943defa:::2019-11-29-21-7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.624-aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa:head [append 0~838 in=838b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e328) 2019-11-29T21:24:36.938 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:24:36.932+0000 1694c700 -1 osd.1 329 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4325.0:122739 7.0 7:0943defa:::2019-11-29-21-7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.624-aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa:head [append 0~838 in=838b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e328) 2019-11-29T21:24:37.968 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:24:37.963+0000 1694c700 -1 osd.1 329 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4325.0:122739 7.0 7:0943defa:::2019-11-29-21-7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.624-aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa:head [append 0~838 in=838b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e328) 2019-11-29T21:24:38.928 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:24:38.923+0000 1694c700 -1 osd.1 329 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4325.0:122739 7.0 7:0943defa:::2019-11-29-21-7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.624-aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa:head [append 0~838 in=838b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e328) 2019-11-29T21:24:39.907 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:24:39.903+0000 1694c700 -1 osd.1 329 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4325.0:122739 7.0 7:0943defa:::2019-11-29-21-7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.624-aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa:head [append 0~838 in=838b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e328) 2019-11-29T21:24:40.956 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:24:40.951+0000 1694c700 -1 osd.1 329 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4325.0:122739 7.0 7:0943defa:::2019-11-29-21-7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.624-aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa:head [append 0~838 in=838b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e328) 2019-11-29T21:24:41.952 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:24:41.937+0000 1694c700 -1 osd.1 329 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4325.0:122739 7.0 7:0943defa:::2019-11-29-21-7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.624-aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa:head [append 0~838 in=838b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e328) 2019-11-29T21:24:41.990 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:24:41.986+0000 1694c700 -1 osd.2 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:23:59.107832+0000 front 2019-11-29T21:24:01.326414+0000 (oldest deadline 2019-11-29T21:24:41.295268+0000) 2019-11-29T21:24:42.424 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:24:42.418+0000 1694c700 -1 osd.7 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:23:57.018464+0000 front 2019-11-29T21:23:57.019230+0000 (oldest deadline 2019-11-29T21:24:41.644497+0000) 2019-11-29T21:24:42.931 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:24:42.926+0000 1694c700 -1 osd.1 329 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4325.0:122739 7.0 7:0943defa:::2019-11-29-21-7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.624-aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa:head [append 0~838 in=838b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e328) 2019-11-29T21:24:43.030 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:24:43.025+0000 1694c700 -1 osd.2 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:23:59.107832+0000 front 2019-11-29T21:24:01.326414+0000 (oldest deadline 2019-11-29T21:24:41.295268+0000) 2019-11-29T21:24:43.400 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:24:43.396+0000 1694c700 -1 osd.7 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:23:57.018464+0000 front 2019-11-29T21:23:57.019230+0000 (oldest deadline 2019-11-29T21:24:41.644497+0000) 2019-11-29T21:24:43.942 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:24:43.937+0000 1694c700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:01.249417+0000 front 2019-11-29T21:24:00.824567+0000 (oldest deadline 2019-11-29T21:24:43.890883+0000) 2019-11-29T21:24:43.943 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:24:43.938+0000 1694c700 -1 osd.1 329 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4325.0:122739 7.0 7:0943defa:::2019-11-29-21-7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.624-aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa:head [append 0~838 in=838b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e328) 2019-11-29T21:24:43.994 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:24:43.989+0000 1694c700 -1 osd.0 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:01.388668+0000 front 2019-11-29T21:24:00.967233+0000 (oldest deadline 2019-11-29T21:24:43.137996+0000) 2019-11-29T21:24:44.077 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:24:44.072+0000 1694c700 -1 osd.2 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:23:59.107832+0000 front 2019-11-29T21:24:01.326414+0000 (oldest deadline 2019-11-29T21:24:41.295268+0000) 2019-11-29T21:24:44.397 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:24:44.392+0000 1694c700 -1 osd.7 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:23:57.018464+0000 front 2019-11-29T21:23:57.019230+0000 (oldest deadline 2019-11-29T21:24:41.644497+0000) 2019-11-29T21:24:44.645 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:24:44.639+0000 1694c700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:00.820010+0000 front 2019-11-29T21:24:00.966468+0000 (oldest deadline 2019-11-29T21:24:44.301697+0000) 2019-11-29T21:24:44.932 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:24:44.927+0000 1694c700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:01.249417+0000 front 2019-11-29T21:24:00.824567+0000 (oldest deadline 2019-11-29T21:24:43.890883+0000) 2019-11-29T21:24:44.933 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:24:44.928+0000 1694c700 -1 osd.1 329 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4325.0:122739 7.0 7:0943defa:::2019-11-29-21-7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.624-aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa:head [append 0~838 in=838b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e328) 2019-11-29T21:24:44.984 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:24:44.978+0000 1694c700 -1 osd.0 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:01.388668+0000 front 2019-11-29T21:24:00.967233+0000 (oldest deadline 2019-11-29T21:24:43.137996+0000) 2019-11-29T21:24:45.086 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:24:45.081+0000 1694c700 -1 osd.2 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:23:59.107832+0000 front 2019-11-29T21:24:01.326414+0000 (oldest deadline 2019-11-29T21:24:41.295268+0000) 2019-11-29T21:24:45.367 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:24:45.362+0000 1694c700 -1 osd.7 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:23:57.018464+0000 front 2019-11-29T21:23:57.019230+0000 (oldest deadline 2019-11-29T21:24:41.644497+0000) 2019-11-29T21:24:45.369 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:24:45.365+0000 1694c700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:00.744358+0000 front 2019-11-29T21:24:01.158637+0000 (oldest deadline 2019-11-29T21:24:44.754406+0000) 2019-11-29T21:24:45.647 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:24:45.641+0000 1694c700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:00.820010+0000 front 2019-11-29T21:24:00.966468+0000 (oldest deadline 2019-11-29T21:24:44.301697+0000) 2019-11-29T21:24:45.978 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:24:45.973+0000 1694c700 -1 osd.0 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:01.388668+0000 front 2019-11-29T21:24:00.967233+0000 (oldest deadline 2019-11-29T21:24:43.137996+0000) 2019-11-29T21:24:45.984 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:24:45.978+0000 1694c700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:01.249417+0000 front 2019-11-29T21:24:00.824567+0000 (oldest deadline 2019-11-29T21:24:43.890883+0000) 2019-11-29T21:24:45.985 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:24:45.980+0000 1694c700 -1 osd.1 329 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4325.0:122739 7.0 7:0943defa:::2019-11-29-21-7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.624-aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa:head [append 0~838 in=838b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e328) 2019-11-29T21:24:46.054 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:24:46.049+0000 1694c700 -1 osd.2 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:23:59.107832+0000 front 2019-11-29T21:24:01.326414+0000 (oldest deadline 2019-11-29T21:24:41.295268+0000) 2019-11-29T21:24:46.362 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:24:46.357+0000 1694c700 -1 osd.7 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:23:57.018464+0000 front 2019-11-29T21:23:57.019230+0000 (oldest deadline 2019-11-29T21:24:41.644497+0000) 2019-11-29T21:24:46.405 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:24:46.401+0000 1694c700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:00.744358+0000 front 2019-11-29T21:24:01.158637+0000 (oldest deadline 2019-11-29T21:24:44.754406+0000) 2019-11-29T21:24:46.633 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:24:46.628+0000 1694c700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:00.820010+0000 front 2019-11-29T21:24:00.966468+0000 (oldest deadline 2019-11-29T21:24:44.301697+0000) 2019-11-29T21:24:46.960 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:24:46.955+0000 1694c700 -1 osd.0 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:01.388668+0000 front 2019-11-29T21:24:00.967233+0000 (oldest deadline 2019-11-29T21:24:43.137996+0000) 2019-11-29T21:24:46.997 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:24:46.991+0000 1694c700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:01.249417+0000 front 2019-11-29T21:24:00.824567+0000 (oldest deadline 2019-11-29T21:24:43.890883+0000) 2019-11-29T21:24:46.998 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:24:46.993+0000 1694c700 -1 osd.1 329 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4325.0:122739 7.0 7:0943defa:::2019-11-29-21-7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.624-aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa:head [append 0~838 in=838b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e328) 2019-11-29T21:24:47.049 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:24:47.045+0000 1694c700 -1 osd.2 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:23:59.107832+0000 front 2019-11-29T21:24:01.326414+0000 (oldest deadline 2019-11-29T21:24:41.295268+0000) 2019-11-29T21:24:47.326 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:24:47.321+0000 1694c700 -1 osd.7 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:23:57.018464+0000 front 2019-11-29T21:23:57.019230+0000 (oldest deadline 2019-11-29T21:24:41.644497+0000) 2019-11-29T21:24:47.362 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:24:47.358+0000 1694c700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:00.744358+0000 front 2019-11-29T21:24:01.158637+0000 (oldest deadline 2019-11-29T21:24:44.754406+0000) 2019-11-29T21:24:47.651 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:24:47.646+0000 1694c700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:00.820010+0000 front 2019-11-29T21:24:00.966468+0000 (oldest deadline 2019-11-29T21:24:44.301697+0000) 2019-11-29T21:24:47.977 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:24:47.972+0000 1694c700 -1 osd.0 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:01.388668+0000 front 2019-11-29T21:24:00.967233+0000 (oldest deadline 2019-11-29T21:24:43.137996+0000) 2019-11-29T21:24:48.017 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:24:48.011+0000 1694c700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:01.249417+0000 front 2019-11-29T21:24:00.824567+0000 (oldest deadline 2019-11-29T21:24:43.890883+0000) 2019-11-29T21:24:48.018 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:24:48.013+0000 1694c700 -1 osd.1 329 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4325.0:122739 7.0 7:0943defa:::2019-11-29-21-7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.624-aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa:head [append 0~838 in=838b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e328) 2019-11-29T21:24:48.048 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:24:48.043+0000 1694c700 -1 osd.2 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:23:59.107832+0000 front 2019-11-29T21:24:01.326414+0000 (oldest deadline 2019-11-29T21:24:41.295268+0000) 2019-11-29T21:24:48.320 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:24:48.315+0000 1694c700 -1 osd.7 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:23:57.018464+0000 front 2019-11-29T21:23:57.019230+0000 (oldest deadline 2019-11-29T21:24:41.644497+0000) 2019-11-29T21:24:48.412 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:24:48.407+0000 1694c700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:00.744358+0000 front 2019-11-29T21:24:01.158637+0000 (oldest deadline 2019-11-29T21:24:44.754406+0000) 2019-11-29T21:24:48.670 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:24:48.664+0000 1694c700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:00.820010+0000 front 2019-11-29T21:24:00.966468+0000 (oldest deadline 2019-11-29T21:24:44.301697+0000) 2019-11-29T21:24:48.979 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:24:48.973+0000 1694c700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:01.249417+0000 front 2019-11-29T21:24:00.824567+0000 (oldest deadline 2019-11-29T21:24:43.890883+0000) 2019-11-29T21:24:48.980 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:24:48.975+0000 1694c700 -1 osd.1 329 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4325.0:122739 7.0 7:0943defa:::2019-11-29-21-7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.624-aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa:head [append 0~838 in=838b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e328) 2019-11-29T21:24:48.995 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:24:48.990+0000 1694c700 -1 osd.0 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:01.388668+0000 front 2019-11-29T21:24:00.967233+0000 (oldest deadline 2019-11-29T21:24:43.137996+0000) 2019-11-29T21:24:49.073 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:24:49.067+0000 1694c700 -1 osd.2 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:23:59.107832+0000 front 2019-11-29T21:24:01.326414+0000 (oldest deadline 2019-11-29T21:24:41.295268+0000) 2019-11-29T21:24:49.366 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:24:49.361+0000 1694c700 -1 osd.7 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:23:57.018464+0000 front 2019-11-29T21:23:57.019230+0000 (oldest deadline 2019-11-29T21:24:41.644497+0000) 2019-11-29T21:24:49.378 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:24:49.373+0000 1694c700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:00.744358+0000 front 2019-11-29T21:24:01.158637+0000 (oldest deadline 2019-11-29T21:24:44.754406+0000) 2019-11-29T21:24:49.688 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:24:49.683+0000 1694c700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:00.820010+0000 front 2019-11-29T21:24:00.966468+0000 (oldest deadline 2019-11-29T21:24:44.301697+0000) 2019-11-29T21:24:49.942 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:24:49.936+0000 1694c700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:01.249417+0000 front 2019-11-29T21:24:00.824567+0000 (oldest deadline 2019-11-29T21:24:43.890883+0000) 2019-11-29T21:24:49.942 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:24:49.938+0000 1694c700 -1 osd.1 329 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4325.0:122739 7.0 7:0943defa:::2019-11-29-21-7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.624-aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa:head [append 0~838 in=838b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e328) 2019-11-29T21:24:49.987 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:24:49.982+0000 1694c700 -1 osd.0 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:01.388668+0000 front 2019-11-29T21:24:00.967233+0000 (oldest deadline 2019-11-29T21:24:43.137996+0000) 2019-11-29T21:24:50.076 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:24:50.071+0000 1694c700 -1 osd.2 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:23:59.107832+0000 front 2019-11-29T21:24:01.326414+0000 (oldest deadline 2019-11-29T21:24:41.295268+0000) 2019-11-29T21:24:50.346 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:24:50.341+0000 1694c700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:00.744358+0000 front 2019-11-29T21:24:01.158637+0000 (oldest deadline 2019-11-29T21:24:44.754406+0000) 2019-11-29T21:24:50.452 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:24:50.401+0000 1694c700 -1 osd.7 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:23:57.018464+0000 front 2019-11-29T21:23:57.019230+0000 (oldest deadline 2019-11-29T21:24:41.644497+0000) 2019-11-29T21:24:50.695 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:24:50.685+0000 1694c700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:00.820010+0000 front 2019-11-29T21:24:00.966468+0000 (oldest deadline 2019-11-29T21:24:44.301697+0000) 2019-11-29T21:24:50.941 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:24:50.935+0000 1694c700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:01.249417+0000 front 2019-11-29T21:24:00.824567+0000 (oldest deadline 2019-11-29T21:24:43.890883+0000) 2019-11-29T21:24:50.941 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:24:50.936+0000 1694c700 -1 osd.1 329 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4325.0:122739 7.0 7:0943defa:::2019-11-29-21-7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.624-aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa:head [append 0~838 in=838b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e328) 2019-11-29T21:24:51.021 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:24:51.015+0000 1694c700 -1 osd.0 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:01.388668+0000 front 2019-11-29T21:24:00.967233+0000 (oldest deadline 2019-11-29T21:24:43.137996+0000) 2019-11-29T21:24:51.085 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:24:51.080+0000 1694c700 -1 osd.2 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:23:59.107832+0000 front 2019-11-29T21:24:01.326414+0000 (oldest deadline 2019-11-29T21:24:41.295268+0000) 2019-11-29T21:24:51.319 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:24:51.314+0000 1694c700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:00.744358+0000 front 2019-11-29T21:24:01.158637+0000 (oldest deadline 2019-11-29T21:24:44.754406+0000) 2019-11-29T21:24:51.404 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:24:51.399+0000 1694c700 -1 osd.7 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:23:57.018464+0000 front 2019-11-29T21:23:57.019230+0000 (oldest deadline 2019-11-29T21:24:41.644497+0000) 2019-11-29T21:24:51.703 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:24:51.698+0000 1694c700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:00.820010+0000 front 2019-11-29T21:24:00.966468+0000 (oldest deadline 2019-11-29T21:24:44.301697+0000) 2019-11-29T21:24:51.958 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:24:51.953+0000 1694c700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:01.249417+0000 front 2019-11-29T21:24:00.824567+0000 (oldest deadline 2019-11-29T21:24:43.890883+0000) 2019-11-29T21:24:51.959 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:24:51.954+0000 1694c700 -1 osd.1 329 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4325.0:122739 7.0 7:0943defa:::2019-11-29-21-7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.624-aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa:head [append 0~838 in=838b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e328) 2019-11-29T21:24:52.046 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:24:52.038+0000 1694c700 -1 osd.0 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:01.388668+0000 front 2019-11-29T21:24:00.967233+0000 (oldest deadline 2019-11-29T21:24:43.137996+0000) 2019-11-29T21:24:52.134 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:24:52.129+0000 1694c700 -1 osd.2 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:23:59.107832+0000 front 2019-11-29T21:24:01.326414+0000 (oldest deadline 2019-11-29T21:24:41.295268+0000) 2019-11-29T21:24:52.299 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:24:52.293+0000 1694c700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:00.744358+0000 front 2019-11-29T21:24:01.158637+0000 (oldest deadline 2019-11-29T21:24:44.754406+0000) 2019-11-29T21:24:52.363 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:24:52.358+0000 1694c700 -1 osd.7 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:23:57.018464+0000 front 2019-11-29T21:23:57.019230+0000 (oldest deadline 2019-11-29T21:24:41.644497+0000) 2019-11-29T21:24:52.715 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:24:52.708+0000 1694c700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:00.820010+0000 front 2019-11-29T21:24:00.966468+0000 (oldest deadline 2019-11-29T21:24:44.301697+0000) 2019-11-29T21:24:52.998 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:24:52.993+0000 1694c700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:01.249417+0000 front 2019-11-29T21:24:00.824567+0000 (oldest deadline 2019-11-29T21:24:43.890883+0000) 2019-11-29T21:24:52.998 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:24:52.994+0000 1694c700 -1 osd.1 329 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4325.0:122739 7.0 7:0943defa:::2019-11-29-21-7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.624-aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa:head [append 0~838 in=838b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e328) 2019-11-29T21:24:53.081 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:24:53.076+0000 1694c700 -1 osd.0 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:01.388668+0000 front 2019-11-29T21:24:00.967233+0000 (oldest deadline 2019-11-29T21:24:43.137996+0000) 2019-11-29T21:24:53.186 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:24:53.180+0000 1694c700 -1 osd.2 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:23:59.107832+0000 front 2019-11-29T21:24:01.326414+0000 (oldest deadline 2019-11-29T21:24:41.295268+0000) 2019-11-29T21:24:53.258 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:24:53.251+0000 1694c700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:00.744358+0000 front 2019-11-29T21:24:01.158637+0000 (oldest deadline 2019-11-29T21:24:44.754406+0000) 2019-11-29T21:24:53.405 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:24:53.400+0000 1694c700 -1 osd.7 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:23:57.018464+0000 front 2019-11-29T21:23:57.019230+0000 (oldest deadline 2019-11-29T21:24:41.644497+0000) 2019-11-29T21:24:53.765 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:24:53.754+0000 1694c700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:00.820010+0000 front 2019-11-29T21:24:00.966468+0000 (oldest deadline 2019-11-29T21:24:44.301697+0000) 2019-11-29T21:24:54.012 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:24:54.007+0000 1694c700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:01.249417+0000 front 2019-11-29T21:24:00.824567+0000 (oldest deadline 2019-11-29T21:24:43.890883+0000) 2019-11-29T21:24:54.013 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:24:54.008+0000 1694c700 -1 osd.1 329 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4325.0:122739 7.0 7:0943defa:::2019-11-29-21-7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.624-aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa:head [append 0~838 in=838b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e328) 2019-11-29T21:24:54.101 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:24:54.095+0000 1694c700 -1 osd.0 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:01.388668+0000 front 2019-11-29T21:24:00.967233+0000 (oldest deadline 2019-11-29T21:24:43.137996+0000) 2019-11-29T21:24:54.184 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:24:54.178+0000 1694c700 -1 osd.2 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:23:59.107832+0000 front 2019-11-29T21:24:01.326414+0000 (oldest deadline 2019-11-29T21:24:41.295268+0000) 2019-11-29T21:24:54.229 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:24:54.223+0000 1694c700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:00.744358+0000 front 2019-11-29T21:24:01.158637+0000 (oldest deadline 2019-11-29T21:24:44.754406+0000) 2019-11-29T21:24:54.365 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:24:54.358+0000 1694c700 -1 osd.7 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:23:57.018464+0000 front 2019-11-29T21:23:57.019230+0000 (oldest deadline 2019-11-29T21:24:41.644497+0000) 2019-11-29T21:24:54.799 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:24:54.792+0000 1694c700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:00.820010+0000 front 2019-11-29T21:24:00.966468+0000 (oldest deadline 2019-11-29T21:24:44.301697+0000) 2019-11-29T21:24:55.008 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:24:55.001+0000 1694c700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:01.249417+0000 front 2019-11-29T21:24:00.824567+0000 (oldest deadline 2019-11-29T21:24:43.890883+0000) 2019-11-29T21:24:55.008 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:24:55.003+0000 1694c700 -1 osd.1 329 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4325.0:122739 7.0 7:0943defa:::2019-11-29-21-7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.624-aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa:head [append 0~838 in=838b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e328) 2019-11-29T21:24:55.113 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:24:55.107+0000 1694c700 -1 osd.0 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:01.388668+0000 front 2019-11-29T21:24:00.967233+0000 (oldest deadline 2019-11-29T21:24:43.137996+0000) 2019-11-29T21:24:55.177 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:24:55.172+0000 1694c700 -1 osd.2 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:23:59.107832+0000 front 2019-11-29T21:24:01.326414+0000 (oldest deadline 2019-11-29T21:24:41.295268+0000) 2019-11-29T21:24:55.230 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:24:55.224+0000 1694c700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:00.744358+0000 front 2019-11-29T21:24:01.158637+0000 (oldest deadline 2019-11-29T21:24:44.754406+0000) 2019-11-29T21:24:55.327 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:24:55.321+0000 1694c700 -1 osd.7 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:23:57.018464+0000 front 2019-11-29T21:23:57.019230+0000 (oldest deadline 2019-11-29T21:24:41.644497+0000) 2019-11-29T21:24:55.772 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:24:55.763+0000 1694c700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:00.820010+0000 front 2019-11-29T21:24:00.966468+0000 (oldest deadline 2019-11-29T21:24:44.301697+0000) 2019-11-29T21:24:56.008 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:24:56.003+0000 1694c700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:01.249417+0000 front 2019-11-29T21:24:00.824567+0000 (oldest deadline 2019-11-29T21:24:43.890883+0000) 2019-11-29T21:24:56.009 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:24:56.004+0000 1694c700 -1 osd.1 329 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4325.0:122739 7.0 7:0943defa:::2019-11-29-21-7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.624-aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa:head [append 0~838 in=838b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e328) 2019-11-29T21:24:56.076 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:24:56.071+0000 1694c700 -1 osd.0 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:01.388668+0000 front 2019-11-29T21:24:00.967233+0000 (oldest deadline 2019-11-29T21:24:43.137996+0000) 2019-11-29T21:24:56.224 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:24:56.219+0000 1694c700 -1 osd.2 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:23:59.107832+0000 front 2019-11-29T21:24:01.326414+0000 (oldest deadline 2019-11-29T21:24:41.295268+0000) 2019-11-29T21:24:56.246 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:24:56.240+0000 1694c700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:00.744358+0000 front 2019-11-29T21:24:01.158637+0000 (oldest deadline 2019-11-29T21:24:44.754406+0000) 2019-11-29T21:24:56.288 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:24:56.281+0000 1694c700 -1 osd.7 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:23:57.018464+0000 front 2019-11-29T21:23:57.019230+0000 (oldest deadline 2019-11-29T21:24:41.644497+0000) 2019-11-29T21:24:56.795 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:24:56.787+0000 1694c700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:00.820010+0000 front 2019-11-29T21:24:00.966468+0000 (oldest deadline 2019-11-29T21:24:44.301697+0000) 2019-11-29T21:24:57.039 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:24:57.033+0000 1694c700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:01.249417+0000 front 2019-11-29T21:24:00.824567+0000 (oldest deadline 2019-11-29T21:24:43.890883+0000) 2019-11-29T21:24:57.039 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:24:57.035+0000 1694c700 -1 osd.1 329 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4325.0:122739 7.0 7:0943defa:::2019-11-29-21-7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.624-aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa:head [append 0~838 in=838b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e328) 2019-11-29T21:24:57.068 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:24:57.064+0000 1694c700 -1 osd.0 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:01.388668+0000 front 2019-11-29T21:24:00.967233+0000 (oldest deadline 2019-11-29T21:24:43.137996+0000) 2019-11-29T21:24:57.230 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:24:57.224+0000 1694c700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:00.744358+0000 front 2019-11-29T21:24:01.158637+0000 (oldest deadline 2019-11-29T21:24:44.754406+0000) 2019-11-29T21:24:57.279 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:24:57.273+0000 1694c700 -1 osd.2 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:23:59.107832+0000 front 2019-11-29T21:24:01.326414+0000 (oldest deadline 2019-11-29T21:24:41.295268+0000) 2019-11-29T21:24:57.336 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:24:57.330+0000 1694c700 -1 osd.7 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:23:57.018464+0000 front 2019-11-29T21:23:57.019230+0000 (oldest deadline 2019-11-29T21:24:41.644497+0000) 2019-11-29T21:24:57.811 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:24:57.805+0000 1694c700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:00.820010+0000 front 2019-11-29T21:24:00.966468+0000 (oldest deadline 2019-11-29T21:24:44.301697+0000) 2019-11-29T21:24:58.043 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:24:58.039+0000 1694c700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:01.249417+0000 front 2019-11-29T21:24:00.824567+0000 (oldest deadline 2019-11-29T21:24:43.890883+0000) 2019-11-29T21:24:58.043 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:24:58.040+0000 1694c700 -1 osd.1 329 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4325.0:122739 7.0 7:0943defa:::2019-11-29-21-7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.624-aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa:head [append 0~838 in=838b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e328) 2019-11-29T21:24:58.079 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:24:58.075+0000 1694c700 -1 osd.0 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:01.388668+0000 front 2019-11-29T21:24:00.967233+0000 (oldest deadline 2019-11-29T21:24:43.137996+0000) 2019-11-29T21:24:58.239 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:24:58.235+0000 1694c700 -1 osd.2 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:23:59.107832+0000 front 2019-11-29T21:24:01.326414+0000 (oldest deadline 2019-11-29T21:24:41.295268+0000) 2019-11-29T21:24:58.282 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:24:58.276+0000 1694c700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:00.744358+0000 front 2019-11-29T21:24:01.158637+0000 (oldest deadline 2019-11-29T21:24:44.754406+0000) 2019-11-29T21:24:58.360 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:24:58.353+0000 1694c700 -1 osd.7 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:23:57.018464+0000 front 2019-11-29T21:23:57.019230+0000 (oldest deadline 2019-11-29T21:24:41.644497+0000) 2019-11-29T21:24:58.782 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:24:58.775+0000 1694c700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:00.820010+0000 front 2019-11-29T21:24:00.966468+0000 (oldest deadline 2019-11-29T21:24:44.301697+0000) 2019-11-29T21:24:59.075 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:24:59.070+0000 1694c700 -1 osd.0 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:01.388668+0000 front 2019-11-29T21:24:00.967233+0000 (oldest deadline 2019-11-29T21:24:43.137996+0000) 2019-11-29T21:24:59.084 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:24:59.079+0000 1694c700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:01.249417+0000 front 2019-11-29T21:24:00.824567+0000 (oldest deadline 2019-11-29T21:24:43.890883+0000) 2019-11-29T21:24:59.084 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:24:59.080+0000 1694c700 -1 osd.1 329 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4325.0:122739 7.0 7:0943defa:::2019-11-29-21-7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.624-aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa:head [append 0~838 in=838b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e328) 2019-11-29T21:24:59.216 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:24:59.210+0000 1694c700 -1 osd.2 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:23:59.107832+0000 front 2019-11-29T21:24:01.326414+0000 (oldest deadline 2019-11-29T21:24:41.295268+0000) 2019-11-29T21:24:59.278 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:24:59.272+0000 1694c700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:00.744358+0000 front 2019-11-29T21:24:01.158637+0000 (oldest deadline 2019-11-29T21:24:44.754406+0000) 2019-11-29T21:24:59.357 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:24:59.350+0000 1694c700 -1 osd.7 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:23:57.018464+0000 front 2019-11-29T21:23:57.019230+0000 (oldest deadline 2019-11-29T21:24:41.644497+0000) 2019-11-29T21:24:59.820 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:24:59.814+0000 1694c700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:00.820010+0000 front 2019-11-29T21:24:00.966468+0000 (oldest deadline 2019-11-29T21:24:44.301697+0000) 2019-11-29T21:25:00.057 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:25:00.050+0000 1694c700 -1 osd.0 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:01.388668+0000 front 2019-11-29T21:24:00.967233+0000 (oldest deadline 2019-11-29T21:24:43.137996+0000) 2019-11-29T21:25:00.063 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:25:00.058+0000 1694c700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:01.249417+0000 front 2019-11-29T21:24:00.824567+0000 (oldest deadline 2019-11-29T21:24:43.890883+0000) 2019-11-29T21:25:00.064 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:25:00.059+0000 1694c700 -1 osd.1 329 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4325.0:122739 7.0 7:0943defa:::2019-11-29-21-7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.624-aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa:head [append 0~838 in=838b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e328) 2019-11-29T21:25:00.212 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:25:00.207+0000 1694c700 -1 osd.2 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:23:59.107832+0000 front 2019-11-29T21:24:01.326414+0000 (oldest deadline 2019-11-29T21:24:41.295268+0000) 2019-11-29T21:25:00.253 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:25:00.246+0000 1694c700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:00.744358+0000 front 2019-11-29T21:24:01.158637+0000 (oldest deadline 2019-11-29T21:24:44.754406+0000) 2019-11-29T21:25:00.310 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:25:00.304+0000 1694c700 -1 osd.7 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:23:57.018464+0000 front 2019-11-29T21:23:57.019230+0000 (oldest deadline 2019-11-29T21:24:41.644497+0000) 2019-11-29T21:25:00.863 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:25:00.857+0000 1694c700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:00.820010+0000 front 2019-11-29T21:24:00.966468+0000 (oldest deadline 2019-11-29T21:24:44.301697+0000) 2019-11-29T21:25:01.031 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:25:01.024+0000 1694c700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:01.249417+0000 front 2019-11-29T21:24:00.824567+0000 (oldest deadline 2019-11-29T21:24:43.890883+0000) 2019-11-29T21:25:01.032 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:25:01.026+0000 1694c700 -1 osd.1 329 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4325.0:122739 7.0 7:0943defa:::2019-11-29-21-7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.624-aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa:head [append 0~838 in=838b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e328) 2019-11-29T21:25:01.064 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:25:01.056+0000 1694c700 -1 osd.0 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:01.388668+0000 front 2019-11-29T21:24:00.967233+0000 (oldest deadline 2019-11-29T21:24:43.137996+0000) 2019-11-29T21:25:01.167 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:25:01.162+0000 1694c700 -1 osd.2 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:23:59.107832+0000 front 2019-11-29T21:24:01.326414+0000 (oldest deadline 2019-11-29T21:24:41.295268+0000) 2019-11-29T21:25:01.295 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:25:01.288+0000 1694c700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:00.744358+0000 front 2019-11-29T21:24:01.158637+0000 (oldest deadline 2019-11-29T21:24:44.754406+0000) 2019-11-29T21:25:01.334 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:25:01.327+0000 1694c700 -1 osd.7 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:23:57.018464+0000 front 2019-11-29T21:23:57.019230+0000 (oldest deadline 2019-11-29T21:24:41.644497+0000) 2019-11-29T21:25:01.822 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:25:01.816+0000 1694c700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:00.820010+0000 front 2019-11-29T21:24:00.966468+0000 (oldest deadline 2019-11-29T21:24:44.301697+0000) 2019-11-29T21:25:02.044 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:25:02.039+0000 1694c700 -1 osd.0 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:01.388668+0000 front 2019-11-29T21:24:00.967233+0000 (oldest deadline 2019-11-29T21:24:43.137996+0000) 2019-11-29T21:25:02.070 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:25:02.064+0000 1694c700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:01.249417+0000 front 2019-11-29T21:24:00.824567+0000 (oldest deadline 2019-11-29T21:24:43.890883+0000) 2019-11-29T21:25:02.071 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:25:02.065+0000 1694c700 -1 osd.1 329 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4325.0:122739 7.0 7:0943defa:::2019-11-29-21-7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.624-aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa:head [append 0~838 in=838b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e328) 2019-11-29T21:25:02.179 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:25:02.174+0000 1694c700 -1 osd.2 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:23:59.107832+0000 front 2019-11-29T21:24:01.326414+0000 (oldest deadline 2019-11-29T21:24:41.295268+0000) 2019-11-29T21:25:02.279 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:25:02.273+0000 1694c700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:00.744358+0000 front 2019-11-29T21:24:01.158637+0000 (oldest deadline 2019-11-29T21:24:44.754406+0000) 2019-11-29T21:25:02.330 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:25:02.324+0000 1694c700 -1 osd.7 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:23:57.018464+0000 front 2019-11-29T21:23:57.019230+0000 (oldest deadline 2019-11-29T21:24:41.644497+0000) 2019-11-29T21:25:02.815 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:25:02.809+0000 1694c700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:00.820010+0000 front 2019-11-29T21:24:00.966468+0000 (oldest deadline 2019-11-29T21:24:44.301697+0000) 2019-11-29T21:25:03.009 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:25:03.003+0000 1694c700 -1 osd.0 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:01.388668+0000 front 2019-11-29T21:24:00.967233+0000 (oldest deadline 2019-11-29T21:24:43.137996+0000) 2019-11-29T21:25:03.034 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:25:03.028+0000 1694c700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:01.249417+0000 front 2019-11-29T21:24:00.824567+0000 (oldest deadline 2019-11-29T21:24:43.890883+0000) 2019-11-29T21:25:03.034 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:25:03.030+0000 1694c700 -1 osd.1 329 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4325.0:122739 7.0 7:0943defa:::2019-11-29-21-7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.624-aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa:head [append 0~838 in=838b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e328) 2019-11-29T21:25:03.191 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:25:03.186+0000 1694c700 -1 osd.2 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:23:59.107832+0000 front 2019-11-29T21:24:01.326414+0000 (oldest deadline 2019-11-29T21:24:41.295268+0000) 2019-11-29T21:25:03.307 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:25:03.300+0000 1694c700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:00.744358+0000 front 2019-11-29T21:24:01.158637+0000 (oldest deadline 2019-11-29T21:24:44.754406+0000) 2019-11-29T21:25:03.340 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:25:03.334+0000 1694c700 -1 osd.7 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:23:57.018464+0000 front 2019-11-29T21:23:57.019230+0000 (oldest deadline 2019-11-29T21:24:41.644497+0000) 2019-11-29T21:25:03.779 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:25:03.772+0000 1694c700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:00.820010+0000 front 2019-11-29T21:24:00.966468+0000 (oldest deadline 2019-11-29T21:24:44.301697+0000) 2019-11-29T21:25:04.006 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:25:04.001+0000 1694c700 -1 osd.0 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:01.388668+0000 front 2019-11-29T21:24:00.967233+0000 (oldest deadline 2019-11-29T21:24:43.137996+0000) 2019-11-29T21:25:04.010 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:25:04.005+0000 1694c700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:01.249417+0000 front 2019-11-29T21:24:00.824567+0000 (oldest deadline 2019-11-29T21:24:43.890883+0000) 2019-11-29T21:25:04.011 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:25:04.006+0000 1694c700 -1 osd.1 329 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4325.0:122739 7.0 7:0943defa:::2019-11-29-21-7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.624-aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa:head [append 0~838 in=838b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e328) 2019-11-29T21:25:04.222 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:25:04.217+0000 1694c700 -1 osd.2 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:23:59.107832+0000 front 2019-11-29T21:24:01.326414+0000 (oldest deadline 2019-11-29T21:24:41.295268+0000) 2019-11-29T21:25:04.314 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:25:04.309+0000 1694c700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:00.744358+0000 front 2019-11-29T21:24:01.158637+0000 (oldest deadline 2019-11-29T21:24:44.754406+0000) 2019-11-29T21:25:04.384 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:25:04.378+0000 1694c700 -1 osd.7 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:23:57.018464+0000 front 2019-11-29T21:23:57.019230+0000 (oldest deadline 2019-11-29T21:24:41.644497+0000) 2019-11-29T21:25:04.805 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:25:04.799+0000 1694c700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:00.820010+0000 front 2019-11-29T21:24:00.966468+0000 (oldest deadline 2019-11-29T21:24:44.301697+0000) 2019-11-29T21:25:04.984 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:25:04.979+0000 1694c700 -1 osd.0 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:01.388668+0000 front 2019-11-29T21:24:00.967233+0000 (oldest deadline 2019-11-29T21:24:43.137996+0000) 2019-11-29T21:25:05.001 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:25:04.996+0000 1694c700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:01.249417+0000 front 2019-11-29T21:24:00.824567+0000 (oldest deadline 2019-11-29T21:24:43.890883+0000) 2019-11-29T21:25:05.002 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:25:04.997+0000 1694c700 -1 osd.1 329 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4325.0:122739 7.0 7:0943defa:::2019-11-29-21-7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.624-aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa:head [append 0~838 in=838b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e328) 2019-11-29T21:25:05.216 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:25:05.212+0000 1694c700 -1 osd.2 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:23:59.107832+0000 front 2019-11-29T21:24:01.326414+0000 (oldest deadline 2019-11-29T21:24:41.295268+0000) 2019-11-29T21:25:05.287 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:25:05.280+0000 1694c700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:00.744358+0000 front 2019-11-29T21:24:01.158637+0000 (oldest deadline 2019-11-29T21:24:44.754406+0000) 2019-11-29T21:25:05.425 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:25:05.419+0000 1694c700 -1 osd.7 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:23:57.018464+0000 front 2019-11-29T21:23:57.019230+0000 (oldest deadline 2019-11-29T21:24:41.644497+0000) 2019-11-29T21:25:05.851 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:25:05.844+0000 1694c700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:00.820010+0000 front 2019-11-29T21:24:00.966468+0000 (oldest deadline 2019-11-29T21:24:44.301697+0000) 2019-11-29T21:25:06.039 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:25:06.034+0000 1694c700 -1 osd.0 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:01.388668+0000 front 2019-11-29T21:24:00.967233+0000 (oldest deadline 2019-11-29T21:24:43.137996+0000) 2019-11-29T21:25:06.049 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:25:06.044+0000 1694c700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:01.249417+0000 front 2019-11-29T21:24:00.824567+0000 (oldest deadline 2019-11-29T21:24:43.890883+0000) 2019-11-29T21:25:06.050 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:25:06.045+0000 1694c700 -1 osd.1 329 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4325.0:122739 7.0 7:0943defa:::2019-11-29-21-7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.624-aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa:head [append 0~838 in=838b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e328) 2019-11-29T21:25:06.207 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:25:06.202+0000 1694c700 -1 osd.2 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:23:59.107832+0000 front 2019-11-29T21:24:01.326414+0000 (oldest deadline 2019-11-29T21:24:41.295268+0000) 2019-11-29T21:25:06.269 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:25:06.263+0000 1694c700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:00.744358+0000 front 2019-11-29T21:24:01.158637+0000 (oldest deadline 2019-11-29T21:24:44.754406+0000) 2019-11-29T21:25:06.400 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:25:06.394+0000 1694c700 -1 osd.7 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:23:57.018464+0000 front 2019-11-29T21:23:57.019230+0000 (oldest deadline 2019-11-29T21:24:41.644497+0000) 2019-11-29T21:25:06.876 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:25:06.870+0000 1694c700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:00.820010+0000 front 2019-11-29T21:24:00.966468+0000 (oldest deadline 2019-11-29T21:24:44.301697+0000) 2019-11-29T21:25:07.051 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:25:07.045+0000 1694c700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:01.249417+0000 front 2019-11-29T21:24:00.824567+0000 (oldest deadline 2019-11-29T21:24:43.890883+0000) 2019-11-29T21:25:07.052 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:25:07.047+0000 1694c700 -1 osd.1 329 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4325.0:122739 7.0 7:0943defa:::2019-11-29-21-7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.624-aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa:head [append 0~838 in=838b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e328) 2019-11-29T21:25:07.069 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:25:07.064+0000 1694c700 -1 osd.0 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:01.388668+0000 front 2019-11-29T21:24:00.967233+0000 (oldest deadline 2019-11-29T21:24:43.137996+0000) 2019-11-29T21:25:07.247 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:25:07.242+0000 1694c700 -1 osd.2 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:23:59.107832+0000 front 2019-11-29T21:24:01.326414+0000 (oldest deadline 2019-11-29T21:24:41.295268+0000) 2019-11-29T21:25:07.269 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:25:07.257+0000 1694c700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:00.744358+0000 front 2019-11-29T21:24:01.158637+0000 (oldest deadline 2019-11-29T21:24:44.754406+0000) 2019-11-29T21:25:07.416 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:25:07.410+0000 1694c700 -1 osd.7 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:23:57.018464+0000 front 2019-11-29T21:23:57.019230+0000 (oldest deadline 2019-11-29T21:24:41.644497+0000) 2019-11-29T21:25:07.862 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:25:07.855+0000 1694c700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:00.820010+0000 front 2019-11-29T21:24:00.966468+0000 (oldest deadline 2019-11-29T21:24:44.301697+0000) 2019-11-29T21:25:08.076 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:25:08.071+0000 1694c700 -1 osd.0 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:01.388668+0000 front 2019-11-29T21:24:00.967233+0000 (oldest deadline 2019-11-29T21:24:43.137996+0000) 2019-11-29T21:25:08.099 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:25:08.094+0000 1694c700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:01.249417+0000 front 2019-11-29T21:24:00.824567+0000 (oldest deadline 2019-11-29T21:24:43.890883+0000) 2019-11-29T21:25:08.100 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:25:08.095+0000 1694c700 -1 osd.1 329 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4325.0:122739 7.0 7:0943defa:::2019-11-29-21-7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.624-aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa:head [append 0~838 in=838b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e328) 2019-11-29T21:25:08.249 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:25:08.244+0000 1694c700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:00.744358+0000 front 2019-11-29T21:24:01.158637+0000 (oldest deadline 2019-11-29T21:24:44.754406+0000) 2019-11-29T21:25:08.262 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:25:08.258+0000 1694c700 -1 osd.2 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:23:59.107832+0000 front 2019-11-29T21:24:01.326414+0000 (oldest deadline 2019-11-29T21:24:41.295268+0000) 2019-11-29T21:25:08.423 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:25:08.416+0000 1694c700 -1 osd.7 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:23:57.018464+0000 front 2019-11-29T21:23:57.019230+0000 (oldest deadline 2019-11-29T21:24:41.644497+0000) 2019-11-29T21:25:08.871 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:25:08.864+0000 1694c700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:00.820010+0000 front 2019-11-29T21:24:00.966468+0000 (oldest deadline 2019-11-29T21:24:44.301697+0000) 2019-11-29T21:25:09.042 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:25:09.037+0000 1694c700 -1 osd.0 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:01.388668+0000 front 2019-11-29T21:24:00.967233+0000 (oldest deadline 2019-11-29T21:24:43.137996+0000) 2019-11-29T21:25:09.079 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:25:09.073+0000 1694c700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:01.249417+0000 front 2019-11-29T21:24:00.824567+0000 (oldest deadline 2019-11-29T21:24:43.890883+0000) 2019-11-29T21:25:09.080 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:25:09.075+0000 1694c700 -1 osd.1 329 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4325.0:122739 7.0 7:0943defa:::2019-11-29-21-7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.624-aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa:head [append 0~838 in=838b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e328) 2019-11-29T21:25:09.214 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:25:09.205+0000 1694c700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:00.744358+0000 front 2019-11-29T21:24:01.158637+0000 (oldest deadline 2019-11-29T21:24:44.754406+0000) 2019-11-29T21:25:09.216 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:25:09.211+0000 1694c700 -1 osd.2 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:23:59.107832+0000 front 2019-11-29T21:24:01.326414+0000 (oldest deadline 2019-11-29T21:24:41.295268+0000) 2019-11-29T21:25:09.457 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:25:09.451+0000 1694c700 -1 osd.7 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:23:57.018464+0000 front 2019-11-29T21:23:57.019230+0000 (oldest deadline 2019-11-29T21:24:41.644497+0000) 2019-11-29T21:25:09.895 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:25:09.889+0000 1694c700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:00.820010+0000 front 2019-11-29T21:24:00.966468+0000 (oldest deadline 2019-11-29T21:24:44.301697+0000) 2019-11-29T21:25:10.039 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:25:10.032+0000 1694c700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:01.249417+0000 front 2019-11-29T21:24:00.824567+0000 (oldest deadline 2019-11-29T21:24:43.890883+0000) 2019-11-29T21:25:10.039 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:25:10.034+0000 1694c700 -1 osd.1 329 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4325.0:122739 7.0 7:0943defa:::2019-11-29-21-7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.624-aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa:head [append 0~838 in=838b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e328) 2019-11-29T21:25:10.068 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:25:10.063+0000 1694c700 -1 osd.0 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:01.388668+0000 front 2019-11-29T21:24:00.967233+0000 (oldest deadline 2019-11-29T21:24:43.137996+0000) 2019-11-29T21:25:10.229 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:25:10.223+0000 1694c700 -1 osd.2 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:23:59.107832+0000 front 2019-11-29T21:24:01.326414+0000 (oldest deadline 2019-11-29T21:24:41.295268+0000) 2019-11-29T21:25:10.253 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:25:10.245+0000 1694c700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:00.744358+0000 front 2019-11-29T21:24:01.158637+0000 (oldest deadline 2019-11-29T21:24:44.754406+0000) 2019-11-29T21:25:10.413 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:25:10.406+0000 1694c700 -1 osd.7 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:23:57.018464+0000 front 2019-11-29T21:23:57.019230+0000 (oldest deadline 2019-11-29T21:24:41.644497+0000) 2019-11-29T21:25:10.903 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:25:10.897+0000 1694c700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:00.820010+0000 front 2019-11-29T21:24:00.966468+0000 (oldest deadline 2019-11-29T21:24:44.301697+0000) 2019-11-29T21:25:11.058 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:25:11.052+0000 1694c700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:01.249417+0000 front 2019-11-29T21:24:00.824567+0000 (oldest deadline 2019-11-29T21:24:43.890883+0000) 2019-11-29T21:25:11.059 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:25:11.054+0000 1694c700 -1 osd.1 329 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4325.0:122739 7.0 7:0943defa:::2019-11-29-21-7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.624-aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa:head [append 0~838 in=838b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e328) 2019-11-29T21:25:11.109 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:25:11.104+0000 1694c700 -1 osd.0 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:01.388668+0000 front 2019-11-29T21:24:00.967233+0000 (oldest deadline 2019-11-29T21:24:43.137996+0000) 2019-11-29T21:25:11.185 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:25:11.179+0000 1694c700 -1 osd.2 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:23:59.107832+0000 front 2019-11-29T21:24:01.326414+0000 (oldest deadline 2019-11-29T21:24:41.295268+0000) 2019-11-29T21:25:11.213 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:25:11.207+0000 1694c700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:00.744358+0000 front 2019-11-29T21:24:01.158637+0000 (oldest deadline 2019-11-29T21:24:44.754406+0000) 2019-11-29T21:25:11.423 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:25:11.417+0000 1694c700 -1 osd.7 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:23:57.018464+0000 front 2019-11-29T21:23:57.019230+0000 (oldest deadline 2019-11-29T21:24:41.644497+0000) 2019-11-29T21:25:11.920 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:25:11.914+0000 1694c700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:00.820010+0000 front 2019-11-29T21:24:00.966468+0000 (oldest deadline 2019-11-29T21:24:44.301697+0000) 2019-11-29T21:25:11.979 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:08:59:52.638 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T21:25:11.985 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:08:59:52.644 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T21:25:11.990 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:08:59:52.597 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T21:25:11.996 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:08:59:52.604 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T21:25:11.999 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:08:59:52.606 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T21:25:12.003 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:08:59:52.610 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T21:25:12.014 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:25:12.009+0000 1694c700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:01.249417+0000 front 2019-11-29T21:24:00.824567+0000 (oldest deadline 2019-11-29T21:24:43.890883+0000) 2019-11-29T21:25:12.015 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:25:12.011+0000 1694c700 -1 osd.1 329 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4325.0:122739 7.0 7:0943defa:::2019-11-29-21-7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.624-aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa:head [append 0~838 in=838b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e328) 2019-11-29T21:25:12.068 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:25:12.063+0000 1694c700 -1 osd.0 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:01.388668+0000 front 2019-11-29T21:24:00.967233+0000 (oldest deadline 2019-11-29T21:24:43.137996+0000) 2019-11-29T21:25:12.147 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:25:12.142+0000 1694c700 -1 osd.2 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:23:59.107832+0000 front 2019-11-29T21:24:01.326414+0000 (oldest deadline 2019-11-29T21:24:41.295268+0000) 2019-11-29T21:25:12.183 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:25:12.178+0000 1694c700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:00.744358+0000 front 2019-11-29T21:24:01.158637+0000 (oldest deadline 2019-11-29T21:24:44.754406+0000) 2019-11-29T21:25:12.237 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:08:59:52.895 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T21:25:12.238 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:08:59:52.845 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T21:25:12.302 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:08:59:52.909 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T21:25:12.397 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:25:12.392+0000 1694c700 -1 osd.7 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:23:57.018464+0000 front 2019-11-29T21:23:57.019230+0000 (oldest deadline 2019-11-29T21:24:41.644497+0000) 2019-11-29T21:25:12.876 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:25:12.869+0000 1694c700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:00.820010+0000 front 2019-11-29T21:24:00.966468+0000 (oldest deadline 2019-11-29T21:24:44.301697+0000) 2019-11-29T21:25:13.014 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:25:13.010+0000 1694c700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:01.249417+0000 front 2019-11-29T21:24:00.824567+0000 (oldest deadline 2019-11-29T21:24:43.890883+0000) 2019-11-29T21:25:13.015 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:25:13.010+0000 1694c700 -1 osd.1 329 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4325.0:122739 7.0 7:0943defa:::2019-11-29-21-7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.624-aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa:head [append 0~838 in=838b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e328) 2019-11-29T21:25:13.099 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:25:13.095+0000 1694c700 -1 osd.0 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:01.388668+0000 front 2019-11-29T21:24:00.967233+0000 (oldest deadline 2019-11-29T21:24:43.137996+0000) 2019-11-29T21:25:13.137 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:25:13.133+0000 1694c700 -1 osd.2 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:23:59.107832+0000 front 2019-11-29T21:24:01.326414+0000 (oldest deadline 2019-11-29T21:24:41.295268+0000) 2019-11-29T21:25:13.212 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:25:13.207+0000 1694c700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:00.744358+0000 front 2019-11-29T21:24:01.158637+0000 (oldest deadline 2019-11-29T21:24:44.754406+0000) 2019-11-29T21:25:13.450 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:25:13.444+0000 1694c700 -1 osd.7 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:23:57.018464+0000 front 2019-11-29T21:23:57.019230+0000 (oldest deadline 2019-11-29T21:24:41.644497+0000) 2019-11-29T21:25:13.894 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:25:13.887+0000 1694c700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:00.820010+0000 front 2019-11-29T21:24:00.966468+0000 (oldest deadline 2019-11-29T21:24:44.301697+0000) 2019-11-29T21:25:14.064 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:25:14.057+0000 1694c700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:01.249417+0000 front 2019-11-29T21:24:00.824567+0000 (oldest deadline 2019-11-29T21:24:43.890883+0000) 2019-11-29T21:25:14.065 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:25:14.060+0000 1694c700 -1 osd.1 329 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4325.0:122739 7.0 7:0943defa:::2019-11-29-21-7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.624-aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa:head [append 0~838 in=838b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e328) 2019-11-29T21:25:14.093 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:25:14.088+0000 1694c700 -1 osd.2 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:23:59.107832+0000 front 2019-11-29T21:24:01.326414+0000 (oldest deadline 2019-11-29T21:24:41.295268+0000) 2019-11-29T21:25:14.111 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:25:14.105+0000 1694c700 -1 osd.0 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:01.388668+0000 front 2019-11-29T21:24:00.967233+0000 (oldest deadline 2019-11-29T21:24:43.137996+0000) 2019-11-29T21:25:14.230 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:25:14.225+0000 1694c700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:00.744358+0000 front 2019-11-29T21:24:01.158637+0000 (oldest deadline 2019-11-29T21:24:44.754406+0000) 2019-11-29T21:25:14.462 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:25:14.455+0000 1694c700 -1 osd.7 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:23:57.018464+0000 front 2019-11-29T21:23:57.019230+0000 (oldest deadline 2019-11-29T21:24:41.644497+0000) 2019-11-29T21:25:14.906 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:25:14.899+0000 1694c700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:00.820010+0000 front 2019-11-29T21:24:00.966468+0000 (oldest deadline 2019-11-29T21:24:44.301697+0000) 2019-11-29T21:25:15.065 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:25:15.059+0000 1694c700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:01.249417+0000 front 2019-11-29T21:24:00.824567+0000 (oldest deadline 2019-11-29T21:24:43.890883+0000) 2019-11-29T21:25:15.067 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:25:15.061+0000 1694c700 -1 osd.1 329 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4325.0:122739 7.0 7:0943defa:::2019-11-29-21-7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.624-aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa:head [append 0~838 in=838b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e328) 2019-11-29T21:25:15.089 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:25:15.083+0000 1694c700 -1 osd.0 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:01.388668+0000 front 2019-11-29T21:24:00.967233+0000 (oldest deadline 2019-11-29T21:24:43.137996+0000) 2019-11-29T21:25:15.123 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:25:15.118+0000 1694c700 -1 osd.2 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:23:59.107832+0000 front 2019-11-29T21:24:01.326414+0000 (oldest deadline 2019-11-29T21:24:41.295268+0000) 2019-11-29T21:25:15.265 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:25:15.260+0000 1694c700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:00.744358+0000 front 2019-11-29T21:24:01.158637+0000 (oldest deadline 2019-11-29T21:24:44.754406+0000) 2019-11-29T21:25:15.494 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:25:15.488+0000 1694c700 -1 osd.7 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:23:57.018464+0000 front 2019-11-29T21:23:57.019230+0000 (oldest deadline 2019-11-29T21:24:41.644497+0000) 2019-11-29T21:25:15.890 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:25:15.884+0000 1694c700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:00.820010+0000 front 2019-11-29T21:24:00.966468+0000 (oldest deadline 2019-11-29T21:24:44.301697+0000) 2019-11-29T21:25:16.105 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:25:16.100+0000 1694c700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:01.249417+0000 front 2019-11-29T21:24:00.824567+0000 (oldest deadline 2019-11-29T21:24:43.890883+0000) 2019-11-29T21:25:16.106 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:25:16.101+0000 1694c700 -1 osd.1 329 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4325.0:122739 7.0 7:0943defa:::2019-11-29-21-7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.624-aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa:head [append 0~838 in=838b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e328) 2019-11-29T21:25:16.125 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:25:16.120+0000 1694c700 -1 osd.0 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:01.388668+0000 front 2019-11-29T21:24:00.967233+0000 (oldest deadline 2019-11-29T21:24:43.137996+0000) 2019-11-29T21:25:16.168 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:25:16.163+0000 1694c700 -1 osd.2 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:23:59.107832+0000 front 2019-11-29T21:24:01.326414+0000 (oldest deadline 2019-11-29T21:24:41.295268+0000) 2019-11-29T21:25:16.319 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:25:16.313+0000 1694c700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:00.744358+0000 front 2019-11-29T21:24:01.158637+0000 (oldest deadline 2019-11-29T21:24:44.754406+0000) 2019-11-29T21:25:16.507 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:25:16.501+0000 1694c700 -1 osd.7 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:23:57.018464+0000 front 2019-11-29T21:23:57.019230+0000 (oldest deadline 2019-11-29T21:24:41.644497+0000) 2019-11-29T21:25:16.874 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:25:16.869+0000 1694c700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:00.820010+0000 front 2019-11-29T21:24:00.966468+0000 (oldest deadline 2019-11-29T21:24:44.301697+0000) 2019-11-29T21:25:17.113 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:25:17.108+0000 1694c700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:01.249417+0000 front 2019-11-29T21:24:00.824567+0000 (oldest deadline 2019-11-29T21:24:43.890883+0000) 2019-11-29T21:25:17.113 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:25:17.109+0000 1694c700 -1 osd.1 329 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4325.0:122739 7.0 7:0943defa:::2019-11-29-21-7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.624-aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa:head [append 0~838 in=838b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e328) 2019-11-29T21:25:17.151 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:25:17.147+0000 1694c700 -1 osd.0 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:01.388668+0000 front 2019-11-29T21:24:00.967233+0000 (oldest deadline 2019-11-29T21:24:43.137996+0000) 2019-11-29T21:25:17.159 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:25:17.155+0000 1694c700 -1 osd.2 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:23:59.107832+0000 front 2019-11-29T21:24:01.326414+0000 (oldest deadline 2019-11-29T21:24:41.295268+0000) 2019-11-29T21:25:17.351 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:25:17.345+0000 1694c700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:00.744358+0000 front 2019-11-29T21:24:01.158637+0000 (oldest deadline 2019-11-29T21:24:44.754406+0000) 2019-11-29T21:25:17.488 INFO:tasks.ceph.mon.b.smithi022.stderr:2019-11-29T21:25:17.479+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.22:6818/9264,v1:172.21.15.22:6819/9264] for 43sec e329 v329) 2019-11-29T21:25:17.517 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:25:17.511+0000 1694c700 -1 osd.7 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:23:57.018464+0000 front 2019-11-29T21:23:57.019230+0000 (oldest deadline 2019-11-29T21:24:41.644497+0000) 2019-11-29T21:25:17.870 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:25:17.864+0000 1694c700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:00.820010+0000 front 2019-11-29T21:24:00.966468+0000 (oldest deadline 2019-11-29T21:24:44.301697+0000) 2019-11-29T21:25:18.120 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:25:18.115+0000 1694c700 -1 osd.2 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:23:59.107832+0000 front 2019-11-29T21:24:01.326414+0000 (oldest deadline 2019-11-29T21:24:41.295268+0000) 2019-11-29T21:25:18.124 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:25:18.117+0000 1694c700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:01.249417+0000 front 2019-11-29T21:24:00.824567+0000 (oldest deadline 2019-11-29T21:24:43.890883+0000) 2019-11-29T21:25:18.133 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:25:18.119+0000 1694c700 -1 osd.1 329 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4325.0:122739 7.0 7:0943defa:::2019-11-29-21-7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.624-aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa:head [append 0~838 in=838b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e328) 2019-11-29T21:25:18.169 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:25:18.164+0000 1694c700 -1 osd.0 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:01.388668+0000 front 2019-11-29T21:24:00.967233+0000 (oldest deadline 2019-11-29T21:24:43.137996+0000) 2019-11-29T21:25:18.315 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:25:18.308+0000 1694c700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:00.744358+0000 front 2019-11-29T21:24:01.158637+0000 (oldest deadline 2019-11-29T21:24:44.754406+0000) 2019-11-29T21:25:18.571 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:25:18.557+0000 1694c700 -1 osd.7 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:23:57.018464+0000 front 2019-11-29T21:23:57.019230+0000 (oldest deadline 2019-11-29T21:24:41.644497+0000) 2019-11-29T21:25:18.904 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:25:18.898+0000 1694c700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:00.820010+0000 front 2019-11-29T21:24:00.966468+0000 (oldest deadline 2019-11-29T21:24:44.301697+0000) 2019-11-29T21:25:19.084 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:25:19.079+0000 1694c700 -1 osd.2 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:23:59.107832+0000 front 2019-11-29T21:24:01.326414+0000 (oldest deadline 2019-11-29T21:24:41.295268+0000) 2019-11-29T21:25:19.124 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:25:19.119+0000 1694c700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:01.249417+0000 front 2019-11-29T21:24:00.824567+0000 (oldest deadline 2019-11-29T21:24:43.890883+0000) 2019-11-29T21:25:19.125 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:25:19.120+0000 1694c700 -1 osd.1 329 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4325.0:122739 7.0 7:0943defa:::2019-11-29-21-7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.624-aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa:head [append 0~838 in=838b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e328) 2019-11-29T21:25:19.225 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:25:19.219+0000 1694c700 -1 osd.0 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:01.388668+0000 front 2019-11-29T21:24:00.967233+0000 (oldest deadline 2019-11-29T21:24:43.137996+0000) 2019-11-29T21:25:19.358 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:25:19.352+0000 1694c700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:00.744358+0000 front 2019-11-29T21:24:01.158637+0000 (oldest deadline 2019-11-29T21:24:44.754406+0000) 2019-11-29T21:25:19.550 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:25:19.543+0000 1694c700 -1 osd.7 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:23:57.018464+0000 front 2019-11-29T21:23:57.019230+0000 (oldest deadline 2019-11-29T21:24:41.644497+0000) 2019-11-29T21:25:19.909 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:25:19.898+0000 1694c700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:00.820010+0000 front 2019-11-29T21:24:00.966468+0000 (oldest deadline 2019-11-29T21:24:44.301697+0000) 2019-11-29T21:25:20.130 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:25:20.123+0000 1694c700 -1 osd.2 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:23:59.107832+0000 front 2019-11-29T21:24:01.326414+0000 (oldest deadline 2019-11-29T21:24:41.295268+0000) 2019-11-29T21:25:20.163 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:25:20.158+0000 1694c700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:01.249417+0000 front 2019-11-29T21:24:00.824567+0000 (oldest deadline 2019-11-29T21:24:43.890883+0000) 2019-11-29T21:25:20.164 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:25:20.159+0000 1694c700 -1 osd.1 329 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4325.0:122739 7.0 7:0943defa:::2019-11-29-21-7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.624-aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa:head [append 0~838 in=838b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e328) 2019-11-29T21:25:20.192 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:25:20.188+0000 1694c700 -1 osd.0 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:01.388668+0000 front 2019-11-29T21:24:00.967233+0000 (oldest deadline 2019-11-29T21:24:43.137996+0000) 2019-11-29T21:25:20.331 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:25:20.324+0000 1694c700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:00.744358+0000 front 2019-11-29T21:24:01.158637+0000 (oldest deadline 2019-11-29T21:24:44.754406+0000) 2019-11-29T21:25:20.578 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:25:20.572+0000 1694c700 -1 osd.7 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:23:57.018464+0000 front 2019-11-29T21:23:57.019230+0000 (oldest deadline 2019-11-29T21:24:41.644497+0000) 2019-11-29T21:25:20.881 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:25:20.874+0000 1694c700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:00.820010+0000 front 2019-11-29T21:24:00.966468+0000 (oldest deadline 2019-11-29T21:24:44.301697+0000) 2019-11-29T21:25:21.171 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:25:21.165+0000 1694c700 -1 osd.2 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:23:59.107832+0000 front 2019-11-29T21:24:01.326414+0000 (oldest deadline 2019-11-29T21:24:41.295268+0000) 2019-11-29T21:25:21.184 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:25:21.179+0000 1694c700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:01.249417+0000 front 2019-11-29T21:24:00.824567+0000 (oldest deadline 2019-11-29T21:24:43.890883+0000) 2019-11-29T21:25:21.185 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:25:21.181+0000 1694c700 -1 osd.1 329 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4325.0:122739 7.0 7:0943defa:::2019-11-29-21-7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.624-aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa:head [append 0~838 in=838b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e328) 2019-11-29T21:25:21.215 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:25:21.211+0000 1694c700 -1 osd.0 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:01.388668+0000 front 2019-11-29T21:24:00.967233+0000 (oldest deadline 2019-11-29T21:24:43.137996+0000) 2019-11-29T21:25:21.359 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:25:21.353+0000 1694c700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:00.744358+0000 front 2019-11-29T21:24:01.158637+0000 (oldest deadline 2019-11-29T21:24:44.754406+0000) 2019-11-29T21:25:21.590 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:25:21.583+0000 1694c700 -1 osd.7 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:23:57.018464+0000 front 2019-11-29T21:23:57.019230+0000 (oldest deadline 2019-11-29T21:24:41.644497+0000) 2019-11-29T21:25:21.893 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:25:21.887+0000 1694c700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:00.820010+0000 front 2019-11-29T21:24:00.966468+0000 (oldest deadline 2019-11-29T21:24:44.301697+0000) 2019-11-29T21:25:22.160 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:25:22.155+0000 1694c700 -1 osd.2 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:23:59.107832+0000 front 2019-11-29T21:24:01.326414+0000 (oldest deadline 2019-11-29T21:24:41.295268+0000) 2019-11-29T21:25:22.195 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:25:22.189+0000 1694c700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:01.249417+0000 front 2019-11-29T21:24:00.824567+0000 (oldest deadline 2019-11-29T21:24:43.890883+0000) 2019-11-29T21:25:22.196 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:25:22.191+0000 1694c700 -1 osd.1 329 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4325.0:122739 7.0 7:0943defa:::2019-11-29-21-7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.624-aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa:head [append 0~838 in=838b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e328) 2019-11-29T21:25:22.253 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:25:22.247+0000 1694c700 -1 osd.0 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:01.388668+0000 front 2019-11-29T21:24:00.967233+0000 (oldest deadline 2019-11-29T21:24:43.137996+0000) 2019-11-29T21:25:22.363 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:25:22.357+0000 1694c700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:24:00.744358+0000 front 2019-11-29T21:24:01.158637+0000 (oldest deadline 2019-11-29T21:24:44.754406+0000) 2019-11-29T21:25:22.556 INFO:tasks.ceph.mon.b.smithi022.stderr:2019-11-29T21:25:22.548+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.22:6818/9264,v1:172.21.15.22:6819/9264] for 43sec e329 v329) 2019-11-29T21:25:22.648 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:25:22.630+0000 1694c700 -1 osd.7 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:23:57.018464+0000 front 2019-11-29T21:23:57.019230+0000 (oldest deadline 2019-11-29T21:24:41.644497+0000) 2019-11-29T21:25:23.121 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:25:23.116+0000 1694c700 -1 osd.2 329 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:23:59.107832+0000 front 2019-11-29T21:24:01.326414+0000 (oldest deadline 2019-11-29T21:24:41.295268+0000) 2019-11-29T21:25:23.546 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:25:23.502+0000 1694c700 -1 osd.1 330 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4325.0:122739 7.0 7:0943defa:::2019-11-29-21-7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.624-aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa:head [append 0~838 in=838b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e328) 2019-11-29T21:25:24.801 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:25:24.782+0000 1694c700 -1 osd.1 331 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4325.0:122739 7.0 7:0943defa:::2019-11-29-21-7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.624-aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa:head [append 0~838 in=838b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e328) 2019-11-29T21:25:56.907 INFO:teuthology.orchestra.run.smithi062.stderr:testFileListingLimitMarkerPrefix (test.functional.tests.TestContainer) ... ok 2019-11-29T21:26:22.544 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:26:22.540+0000 1694c700 -1 osd.0 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:38.647096+0000 front 2019-11-29T21:25:38.667285+0000 (oldest deadline 2019-11-29T21:26:22.485943+0000) 2019-11-29T21:26:23.535 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:26:23.530+0000 1694c700 -1 osd.0 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:38.647096+0000 front 2019-11-29T21:25:38.667285+0000 (oldest deadline 2019-11-29T21:26:22.485943+0000) 2019-11-29T21:26:23.590 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:26:23.584+0000 1694c700 -1 osd.2 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:37.104238+0000 front 2019-11-29T21:25:37.105054+0000 (oldest deadline 2019-11-29T21:26:22.977178+0000) 2019-11-29T21:26:24.519 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:26:24.514+0000 1694c700 -1 osd.0 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:38.647096+0000 front 2019-11-29T21:25:38.667285+0000 (oldest deadline 2019-11-29T21:26:22.485943+0000) 2019-11-29T21:26:24.575 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:26:24.569+0000 1694c700 -1 osd.2 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:37.104238+0000 front 2019-11-29T21:25:37.105054+0000 (oldest deadline 2019-11-29T21:26:22.977178+0000) 2019-11-29T21:26:25.189 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:26:25.182+0000 1694c700 -1 osd.7 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:40.768382+0000 front 2019-11-29T21:25:40.784475+0000 (oldest deadline 2019-11-29T21:26:24.816247+0000) 2019-11-29T21:26:25.520 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:26:25.514+0000 1694c700 -1 osd.0 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:38.647096+0000 front 2019-11-29T21:25:38.667285+0000 (oldest deadline 2019-11-29T21:26:22.485943+0000) 2019-11-29T21:26:25.563 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:26:25.557+0000 1694c700 -1 osd.2 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:37.104238+0000 front 2019-11-29T21:25:37.105054+0000 (oldest deadline 2019-11-29T21:26:22.977178+0000) 2019-11-29T21:26:25.651 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:26:25.643+0000 1694c700 -1 osd.4 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:41.034715+0000 front 2019-11-29T21:25:40.955667+0000 (oldest deadline 2019-11-29T21:26:25.470651+0000) 2019-11-29T21:26:26.033 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:26:26.024+0000 1694c700 -1 osd.6 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:40.975552+0000 front 2019-11-29T21:25:41.013724+0000 (oldest deadline 2019-11-29T21:26:25.463627+0000) 2019-11-29T21:26:26.176 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:26:26.169+0000 1694c700 -1 osd.7 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:40.768382+0000 front 2019-11-29T21:25:40.784475+0000 (oldest deadline 2019-11-29T21:26:24.816247+0000) 2019-11-29T21:26:26.507 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:26:26.501+0000 1694c700 -1 osd.0 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:38.647096+0000 front 2019-11-29T21:25:38.667285+0000 (oldest deadline 2019-11-29T21:26:22.485943+0000) 2019-11-29T21:26:26.551 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:26:26.547+0000 1694c700 -1 osd.2 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:37.104238+0000 front 2019-11-29T21:25:37.105054+0000 (oldest deadline 2019-11-29T21:26:22.977178+0000) 2019-11-29T21:26:26.637 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:26:26.630+0000 1694c700 -1 osd.4 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:41.034715+0000 front 2019-11-29T21:25:40.955667+0000 (oldest deadline 2019-11-29T21:26:25.470651+0000) 2019-11-29T21:26:26.999 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:26:26.992+0000 1694c700 -1 osd.6 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:40.975552+0000 front 2019-11-29T21:25:41.013724+0000 (oldest deadline 2019-11-29T21:26:25.463627+0000) 2019-11-29T21:26:27.209 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:26:27.201+0000 1694c700 -1 osd.7 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:40.768382+0000 front 2019-11-29T21:25:40.784475+0000 (oldest deadline 2019-11-29T21:26:24.816247+0000) 2019-11-29T21:26:27.537 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:26:27.531+0000 1694c700 -1 osd.0 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:38.647096+0000 front 2019-11-29T21:25:38.667285+0000 (oldest deadline 2019-11-29T21:26:22.485943+0000) 2019-11-29T21:26:27.580 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:26:27.574+0000 1694c700 -1 osd.2 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:37.104238+0000 front 2019-11-29T21:25:37.105054+0000 (oldest deadline 2019-11-29T21:26:22.977178+0000) 2019-11-29T21:26:27.646 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:26:27.640+0000 1694c700 -1 osd.4 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:41.034715+0000 front 2019-11-29T21:25:40.955667+0000 (oldest deadline 2019-11-29T21:26:25.470651+0000) 2019-11-29T21:26:27.997 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:26:27.990+0000 1694c700 -1 osd.6 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:40.975552+0000 front 2019-11-29T21:25:41.013724+0000 (oldest deadline 2019-11-29T21:26:25.463627+0000) 2019-11-29T21:26:28.250 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:26:28.243+0000 1694c700 -1 osd.7 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:40.768382+0000 front 2019-11-29T21:25:40.784475+0000 (oldest deadline 2019-11-29T21:26:24.816247+0000) 2019-11-29T21:26:28.547 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:26:28.541+0000 1694c700 -1 osd.2 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:37.104238+0000 front 2019-11-29T21:25:37.105054+0000 (oldest deadline 2019-11-29T21:26:22.977178+0000) 2019-11-29T21:26:28.555 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:26:28.550+0000 1694c700 -1 osd.0 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:38.647096+0000 front 2019-11-29T21:25:38.667285+0000 (oldest deadline 2019-11-29T21:26:22.485943+0000) 2019-11-29T21:26:28.677 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:26:28.670+0000 1694c700 -1 osd.4 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:41.034715+0000 front 2019-11-29T21:25:40.955667+0000 (oldest deadline 2019-11-29T21:26:25.470651+0000) 2019-11-29T21:26:29.008 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:26:29.002+0000 1694c700 -1 osd.6 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:40.975552+0000 front 2019-11-29T21:25:41.013724+0000 (oldest deadline 2019-11-29T21:26:25.463627+0000) 2019-11-29T21:26:29.230 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:26:29.223+0000 1694c700 -1 osd.7 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:40.768382+0000 front 2019-11-29T21:25:40.784475+0000 (oldest deadline 2019-11-29T21:26:24.816247+0000) 2019-11-29T21:26:29.574 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:26:29.569+0000 1694c700 -1 osd.2 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:37.104238+0000 front 2019-11-29T21:25:37.105054+0000 (oldest deadline 2019-11-29T21:26:22.977178+0000) 2019-11-29T21:26:29.607 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:26:29.601+0000 1694c700 -1 osd.0 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:38.647096+0000 front 2019-11-29T21:25:38.667285+0000 (oldest deadline 2019-11-29T21:26:22.485943+0000) 2019-11-29T21:26:29.687 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:26:29.678+0000 1694c700 -1 osd.4 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:41.034715+0000 front 2019-11-29T21:25:40.955667+0000 (oldest deadline 2019-11-29T21:26:25.470651+0000) 2019-11-29T21:26:30.041 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:26:30.035+0000 1694c700 -1 osd.6 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:40.975552+0000 front 2019-11-29T21:25:41.013724+0000 (oldest deadline 2019-11-29T21:26:25.463627+0000) 2019-11-29T21:26:30.217 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:26:30.209+0000 1694c700 -1 osd.7 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:40.768382+0000 front 2019-11-29T21:25:40.784475+0000 (oldest deadline 2019-11-29T21:26:24.816247+0000) 2019-11-29T21:26:30.604 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:26:30.597+0000 1694c700 -1 osd.0 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:38.647096+0000 front 2019-11-29T21:25:38.667285+0000 (oldest deadline 2019-11-29T21:26:22.485943+0000) 2019-11-29T21:26:30.608 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:26:30.601+0000 1694c700 -1 osd.2 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:37.104238+0000 front 2019-11-29T21:25:37.105054+0000 (oldest deadline 2019-11-29T21:26:22.977178+0000) 2019-11-29T21:26:30.647 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:26:30.640+0000 1694c700 -1 osd.4 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:41.034715+0000 front 2019-11-29T21:25:40.955667+0000 (oldest deadline 2019-11-29T21:26:25.470651+0000) 2019-11-29T21:26:31.027 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:26:31.020+0000 1694c700 -1 osd.6 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:40.975552+0000 front 2019-11-29T21:25:41.013724+0000 (oldest deadline 2019-11-29T21:26:25.463627+0000) 2019-11-29T21:26:31.261 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:26:31.254+0000 1694c700 -1 osd.7 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:40.768382+0000 front 2019-11-29T21:25:40.784475+0000 (oldest deadline 2019-11-29T21:26:24.816247+0000) 2019-11-29T21:26:31.313 INFO:teuthology.orchestra.run.smithi062.stderr:testFileOrder (test.functional.tests.TestContainer) ... ok 2019-11-29T21:26:31.433 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:26:31.428+0000 1694c700 -1 osd.5 335 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e333) 2019-11-29T21:26:31.580 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:26:31.574+0000 1694c700 -1 osd.0 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:38.647096+0000 front 2019-11-29T21:25:38.667285+0000 (oldest deadline 2019-11-29T21:26:22.485943+0000) 2019-11-29T21:26:31.604 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:26:31.598+0000 1694c700 -1 osd.2 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:37.104238+0000 front 2019-11-29T21:25:37.105054+0000 (oldest deadline 2019-11-29T21:26:22.977178+0000) 2019-11-29T21:26:31.658 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:26:31.650+0000 1694c700 -1 osd.4 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:41.034715+0000 front 2019-11-29T21:25:40.955667+0000 (oldest deadline 2019-11-29T21:26:25.470651+0000) 2019-11-29T21:26:31.996 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:26:31.988+0000 1694c700 -1 osd.6 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:40.975552+0000 front 2019-11-29T21:25:41.013724+0000 (oldest deadline 2019-11-29T21:26:25.463627+0000) 2019-11-29T21:26:32.218 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:26:32.211+0000 1694c700 -1 osd.7 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:40.768382+0000 front 2019-11-29T21:25:40.784475+0000 (oldest deadline 2019-11-29T21:26:24.816247+0000) 2019-11-29T21:26:32.403 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:26:32.397+0000 1694c700 -1 osd.5 335 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e333) 2019-11-29T21:26:32.601 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:26:32.595+0000 1694c700 -1 osd.0 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:38.647096+0000 front 2019-11-29T21:25:38.667285+0000 (oldest deadline 2019-11-29T21:26:22.485943+0000) 2019-11-29T21:26:32.645 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:26:32.640+0000 1694c700 -1 osd.2 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:37.104238+0000 front 2019-11-29T21:25:37.105054+0000 (oldest deadline 2019-11-29T21:26:22.977178+0000) 2019-11-29T21:26:32.663 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:26:32.654+0000 1694c700 -1 osd.4 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:41.034715+0000 front 2019-11-29T21:25:40.955667+0000 (oldest deadline 2019-11-29T21:26:25.470651+0000) 2019-11-29T21:26:33.028 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:26:33.021+0000 1694c700 -1 osd.6 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:40.975552+0000 front 2019-11-29T21:25:41.013724+0000 (oldest deadline 2019-11-29T21:26:25.463627+0000) 2019-11-29T21:26:33.260 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:26:33.253+0000 1694c700 -1 osd.7 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:40.768382+0000 front 2019-11-29T21:25:40.784475+0000 (oldest deadline 2019-11-29T21:26:24.816247+0000) 2019-11-29T21:26:33.435 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:26:33.429+0000 1694c700 -1 osd.5 335 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e333) 2019-11-29T21:26:33.609 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:26:33.603+0000 1694c700 -1 osd.2 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:37.104238+0000 front 2019-11-29T21:25:37.105054+0000 (oldest deadline 2019-11-29T21:26:22.977178+0000) 2019-11-29T21:26:33.620 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:26:33.614+0000 1694c700 -1 osd.4 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:41.034715+0000 front 2019-11-29T21:25:40.955667+0000 (oldest deadline 2019-11-29T21:26:25.470651+0000) 2019-11-29T21:26:33.647 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:26:33.641+0000 1694c700 -1 osd.0 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:38.647096+0000 front 2019-11-29T21:25:38.667285+0000 (oldest deadline 2019-11-29T21:26:22.485943+0000) 2019-11-29T21:26:33.992 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:26:33.985+0000 1694c700 -1 osd.6 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:40.975552+0000 front 2019-11-29T21:25:41.013724+0000 (oldest deadline 2019-11-29T21:26:25.463627+0000) 2019-11-29T21:26:34.253 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:26:34.246+0000 1694c700 -1 osd.7 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:40.768382+0000 front 2019-11-29T21:25:40.784475+0000 (oldest deadline 2019-11-29T21:26:24.816247+0000) 2019-11-29T21:26:34.423 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:26:34.417+0000 1694c700 -1 osd.5 335 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e333) 2019-11-29T21:26:34.579 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:26:34.568+0000 1694c700 -1 osd.2 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:37.104238+0000 front 2019-11-29T21:25:37.105054+0000 (oldest deadline 2019-11-29T21:26:22.977178+0000) 2019-11-29T21:26:34.626 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:26:34.620+0000 1694c700 -1 osd.4 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:41.034715+0000 front 2019-11-29T21:25:40.955667+0000 (oldest deadline 2019-11-29T21:26:25.470651+0000) 2019-11-29T21:26:34.648 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:26:34.642+0000 1694c700 -1 osd.0 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:38.647096+0000 front 2019-11-29T21:25:38.667285+0000 (oldest deadline 2019-11-29T21:26:22.485943+0000) 2019-11-29T21:26:35.031 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:26:35.023+0000 1694c700 -1 osd.6 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:40.975552+0000 front 2019-11-29T21:25:41.013724+0000 (oldest deadline 2019-11-29T21:26:25.463627+0000) 2019-11-29T21:26:35.233 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:26:35.227+0000 1694c700 -1 osd.7 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:40.768382+0000 front 2019-11-29T21:25:40.784475+0000 (oldest deadline 2019-11-29T21:26:24.816247+0000) 2019-11-29T21:26:35.460 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:26:35.454+0000 1694c700 -1 osd.5 335 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e333) 2019-11-29T21:26:35.584 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:26:35.578+0000 1694c700 -1 osd.2 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:37.104238+0000 front 2019-11-29T21:25:37.105054+0000 (oldest deadline 2019-11-29T21:26:22.977178+0000) 2019-11-29T21:26:35.647 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:26:35.641+0000 1694c700 -1 osd.4 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:41.034715+0000 front 2019-11-29T21:25:40.955667+0000 (oldest deadline 2019-11-29T21:26:25.470651+0000) 2019-11-29T21:26:35.673 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:26:35.667+0000 1694c700 -1 osd.0 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:38.647096+0000 front 2019-11-29T21:25:38.667285+0000 (oldest deadline 2019-11-29T21:26:22.485943+0000) 2019-11-29T21:26:36.079 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:26:36.073+0000 1694c700 -1 osd.6 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:40.975552+0000 front 2019-11-29T21:25:41.013724+0000 (oldest deadline 2019-11-29T21:26:25.463627+0000) 2019-11-29T21:26:36.281 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:26:36.276+0000 1694c700 -1 osd.7 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:40.768382+0000 front 2019-11-29T21:25:40.784475+0000 (oldest deadline 2019-11-29T21:26:24.816247+0000) 2019-11-29T21:26:36.512 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:26:36.506+0000 1694c700 -1 osd.5 335 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e333) 2019-11-29T21:26:36.564 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:26:36.559+0000 1694c700 -1 osd.2 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:37.104238+0000 front 2019-11-29T21:25:37.105054+0000 (oldest deadline 2019-11-29T21:26:22.977178+0000) 2019-11-29T21:26:36.646 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:26:36.639+0000 1694c700 -1 osd.4 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:41.034715+0000 front 2019-11-29T21:25:40.955667+0000 (oldest deadline 2019-11-29T21:26:25.470651+0000) 2019-11-29T21:26:36.652 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:26:36.647+0000 1694c700 -1 osd.0 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:38.647096+0000 front 2019-11-29T21:25:38.667285+0000 (oldest deadline 2019-11-29T21:26:22.485943+0000) 2019-11-29T21:26:37.055 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:26:37.048+0000 1694c700 -1 osd.6 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:40.975552+0000 front 2019-11-29T21:25:41.013724+0000 (oldest deadline 2019-11-29T21:26:25.463627+0000) 2019-11-29T21:26:37.296 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:26:37.290+0000 1694c700 -1 osd.7 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:40.768382+0000 front 2019-11-29T21:25:40.784475+0000 (oldest deadline 2019-11-29T21:26:24.816247+0000) 2019-11-29T21:26:37.543 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:26:37.535+0000 1694c700 -1 osd.5 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:25:56.833874+0000 (oldest deadline 2019-11-29T21:26:36.833874+0000) 2019-11-29T21:26:37.545 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:26:37.538+0000 1694c700 -1 osd.5 335 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e333) 2019-11-29T21:26:37.570 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:26:37.565+0000 1694c700 -1 osd.2 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:37.104238+0000 front 2019-11-29T21:25:37.105054+0000 (oldest deadline 2019-11-29T21:26:22.977178+0000) 2019-11-29T21:26:37.677 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:26:37.667+0000 1694c700 -1 osd.0 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:38.647096+0000 front 2019-11-29T21:25:38.667285+0000 (oldest deadline 2019-11-29T21:26:22.485943+0000) 2019-11-29T21:26:37.691 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:26:37.685+0000 1694c700 -1 osd.4 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:41.034715+0000 front 2019-11-29T21:25:40.955667+0000 (oldest deadline 2019-11-29T21:26:25.470651+0000) 2019-11-29T21:26:38.010 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:26:38.004+0000 1694c700 -1 osd.6 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:40.975552+0000 front 2019-11-29T21:25:41.013724+0000 (oldest deadline 2019-11-29T21:26:25.463627+0000) 2019-11-29T21:26:38.279 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:26:38.272+0000 1694c700 -1 osd.7 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:40.768382+0000 front 2019-11-29T21:25:40.784475+0000 (oldest deadline 2019-11-29T21:26:24.816247+0000) 2019-11-29T21:26:38.539 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:26:38.532+0000 1694c700 -1 osd.5 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:25:56.833874+0000 (oldest deadline 2019-11-29T21:26:36.833874+0000) 2019-11-29T21:26:38.541 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:26:38.534+0000 1694c700 -1 osd.5 335 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e333) 2019-11-29T21:26:38.546 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:26:38.542+0000 1694c700 -1 osd.2 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:37.104238+0000 front 2019-11-29T21:25:37.105054+0000 (oldest deadline 2019-11-29T21:26:22.977178+0000) 2019-11-29T21:26:38.660 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:26:38.655+0000 1694c700 -1 osd.0 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:38.647096+0000 front 2019-11-29T21:25:38.667285+0000 (oldest deadline 2019-11-29T21:26:22.485943+0000) 2019-11-29T21:26:38.744 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:26:38.737+0000 1694c700 -1 osd.4 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:41.034715+0000 front 2019-11-29T21:25:40.955667+0000 (oldest deadline 2019-11-29T21:26:25.470651+0000) 2019-11-29T21:26:38.992 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:26:38.986+0000 1694c700 -1 osd.6 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:40.975552+0000 front 2019-11-29T21:25:41.013724+0000 (oldest deadline 2019-11-29T21:26:25.463627+0000) 2019-11-29T21:26:39.248 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:26:39.241+0000 1694c700 -1 osd.7 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:40.768382+0000 front 2019-11-29T21:25:40.784475+0000 (oldest deadline 2019-11-29T21:26:24.816247+0000) 2019-11-29T21:26:39.569 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:26:39.564+0000 1694c700 -1 osd.2 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:37.104238+0000 front 2019-11-29T21:25:37.105054+0000 (oldest deadline 2019-11-29T21:26:22.977178+0000) 2019-11-29T21:26:39.601 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:26:39.571+0000 1694c700 -1 osd.5 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:25:56.833874+0000 (oldest deadline 2019-11-29T21:26:36.833874+0000) 2019-11-29T21:26:39.602 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:26:39.574+0000 1694c700 -1 osd.5 335 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e333) 2019-11-29T21:26:39.703 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:26:39.696+0000 1694c700 -1 osd.0 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:38.647096+0000 front 2019-11-29T21:25:38.667285+0000 (oldest deadline 2019-11-29T21:26:22.485943+0000) 2019-11-29T21:26:39.797 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:26:39.790+0000 1694c700 -1 osd.4 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:41.034715+0000 front 2019-11-29T21:25:40.955667+0000 (oldest deadline 2019-11-29T21:26:25.470651+0000) 2019-11-29T21:26:39.961 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:26:39.954+0000 1694c700 -1 osd.6 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:40.975552+0000 front 2019-11-29T21:25:41.013724+0000 (oldest deadline 2019-11-29T21:26:25.463627+0000) 2019-11-29T21:26:40.207 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:26:40.201+0000 1694c700 -1 osd.7 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:40.768382+0000 front 2019-11-29T21:25:40.784475+0000 (oldest deadline 2019-11-29T21:26:24.816247+0000) 2019-11-29T21:26:40.571 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:26:40.564+0000 1694c700 -1 osd.5 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:25:56.833874+0000 (oldest deadline 2019-11-29T21:26:36.833874+0000) 2019-11-29T21:26:40.574 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:26:40.569+0000 1694c700 -1 osd.5 335 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e333) 2019-11-29T21:26:40.620 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:26:40.613+0000 1694c700 -1 osd.2 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:37.104238+0000 front 2019-11-29T21:25:37.105054+0000 (oldest deadline 2019-11-29T21:26:22.977178+0000) 2019-11-29T21:26:40.737 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:26:40.732+0000 1694c700 -1 osd.0 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:38.647096+0000 front 2019-11-29T21:25:38.667285+0000 (oldest deadline 2019-11-29T21:26:22.485943+0000) 2019-11-29T21:26:40.809 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:26:40.802+0000 1694c700 -1 osd.4 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:41.034715+0000 front 2019-11-29T21:25:40.955667+0000 (oldest deadline 2019-11-29T21:26:25.470651+0000) 2019-11-29T21:26:40.916 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:26:40.910+0000 1694c700 -1 osd.6 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:40.975552+0000 front 2019-11-29T21:25:41.013724+0000 (oldest deadline 2019-11-29T21:26:25.463627+0000) 2019-11-29T21:26:41.254 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:26:41.248+0000 1694c700 -1 osd.7 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:40.768382+0000 front 2019-11-29T21:25:40.784475+0000 (oldest deadline 2019-11-29T21:26:24.816247+0000) 2019-11-29T21:26:41.589 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:26:41.580+0000 1694c700 -1 osd.5 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:25:56.833874+0000 (oldest deadline 2019-11-29T21:26:36.833874+0000) 2019-11-29T21:26:41.589 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:26:41.582+0000 1694c700 -1 osd.5 335 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e333) 2019-11-29T21:26:41.590 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:26:41.585+0000 1694c700 -1 osd.2 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:37.104238+0000 front 2019-11-29T21:25:37.105054+0000 (oldest deadline 2019-11-29T21:26:22.977178+0000) 2019-11-29T21:26:41.719 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:26:41.715+0000 1694c700 -1 osd.0 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:38.647096+0000 front 2019-11-29T21:25:38.667285+0000 (oldest deadline 2019-11-29T21:26:22.485943+0000) 2019-11-29T21:26:41.801 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:26:41.794+0000 1694c700 -1 osd.4 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:41.034715+0000 front 2019-11-29T21:25:40.955667+0000 (oldest deadline 2019-11-29T21:26:25.470651+0000) 2019-11-29T21:26:41.905 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:26:41.897+0000 1694c700 -1 osd.6 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:40.975552+0000 front 2019-11-29T21:25:41.013724+0000 (oldest deadline 2019-11-29T21:26:25.463627+0000) 2019-11-29T21:26:42.241 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:26:42.234+0000 1694c700 -1 osd.7 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:40.768382+0000 front 2019-11-29T21:25:40.784475+0000 (oldest deadline 2019-11-29T21:26:24.816247+0000) 2019-11-29T21:26:42.586 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:26:42.581+0000 1694c700 -1 osd.2 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:37.104238+0000 front 2019-11-29T21:25:37.105054+0000 (oldest deadline 2019-11-29T21:26:22.977178+0000) 2019-11-29T21:26:42.588 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:26:42.581+0000 1694c700 -1 osd.5 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:25:56.833874+0000 (oldest deadline 2019-11-29T21:26:36.833874+0000) 2019-11-29T21:26:42.589 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:26:42.583+0000 1694c700 -1 osd.5 335 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e333) 2019-11-29T21:26:42.733 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:26:42.727+0000 1694c700 -1 osd.0 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:38.647096+0000 front 2019-11-29T21:25:38.667285+0000 (oldest deadline 2019-11-29T21:26:22.485943+0000) 2019-11-29T21:26:42.819 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:26:42.811+0000 1694c700 -1 osd.4 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:41.034715+0000 front 2019-11-29T21:25:40.955667+0000 (oldest deadline 2019-11-29T21:26:25.470651+0000) 2019-11-29T21:26:42.861 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:26:42.854+0000 1694c700 -1 osd.6 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:40.975552+0000 front 2019-11-29T21:25:41.013724+0000 (oldest deadline 2019-11-29T21:26:25.463627+0000) 2019-11-29T21:26:43.257 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:26:43.250+0000 1694c700 -1 osd.7 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:40.768382+0000 front 2019-11-29T21:25:40.784475+0000 (oldest deadline 2019-11-29T21:26:24.816247+0000) 2019-11-29T21:26:43.546 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:26:43.540+0000 1694c700 -1 osd.5 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:25:56.833874+0000 (oldest deadline 2019-11-29T21:26:36.833874+0000) 2019-11-29T21:26:43.550 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:26:43.545+0000 1694c700 -1 osd.5 335 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e333) 2019-11-29T21:26:43.635 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:26:43.629+0000 1694c700 -1 osd.2 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:37.104238+0000 front 2019-11-29T21:25:37.105054+0000 (oldest deadline 2019-11-29T21:26:22.977178+0000) 2019-11-29T21:26:43.720 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:26:43.715+0000 1694c700 -1 osd.0 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:38.647096+0000 front 2019-11-29T21:25:38.667285+0000 (oldest deadline 2019-11-29T21:26:22.485943+0000) 2019-11-29T21:26:43.820 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:26:43.813+0000 1694c700 -1 osd.6 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:40.975552+0000 front 2019-11-29T21:25:41.013724+0000 (oldest deadline 2019-11-29T21:26:25.463627+0000) 2019-11-29T21:26:43.864 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:26:43.856+0000 1694c700 -1 osd.4 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:41.034715+0000 front 2019-11-29T21:25:40.955667+0000 (oldest deadline 2019-11-29T21:26:25.470651+0000) 2019-11-29T21:26:44.219 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:26:44.213+0000 1694c700 -1 osd.7 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:40.768382+0000 front 2019-11-29T21:25:40.784475+0000 (oldest deadline 2019-11-29T21:26:24.816247+0000) 2019-11-29T21:26:44.533 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:26:44.525+0000 1694c700 -1 osd.5 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:25:56.833874+0000 (oldest deadline 2019-11-29T21:26:36.833874+0000) 2019-11-29T21:26:44.534 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:26:44.528+0000 1694c700 -1 osd.5 335 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e333) 2019-11-29T21:26:44.686 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:26:44.681+0000 1694c700 -1 osd.2 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:37.104238+0000 front 2019-11-29T21:25:37.105054+0000 (oldest deadline 2019-11-29T21:26:22.977178+0000) 2019-11-29T21:26:44.754 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:26:44.749+0000 1694c700 -1 osd.0 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:38.647096+0000 front 2019-11-29T21:25:38.667285+0000 (oldest deadline 2019-11-29T21:26:22.485943+0000) 2019-11-29T21:26:44.829 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:26:44.823+0000 1694c700 -1 osd.6 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:40.975552+0000 front 2019-11-29T21:25:41.013724+0000 (oldest deadline 2019-11-29T21:26:25.463627+0000) 2019-11-29T21:26:44.831 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:26:44.824+0000 1694c700 -1 osd.4 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:41.034715+0000 front 2019-11-29T21:25:40.955667+0000 (oldest deadline 2019-11-29T21:26:25.470651+0000) 2019-11-29T21:26:45.228 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:26:45.221+0000 1694c700 -1 osd.7 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:40.768382+0000 front 2019-11-29T21:25:40.784475+0000 (oldest deadline 2019-11-29T21:26:24.816247+0000) 2019-11-29T21:26:45.545 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:26:45.537+0000 1694c700 -1 osd.5 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:25:56.833874+0000 (oldest deadline 2019-11-29T21:26:36.833874+0000) 2019-11-29T21:26:45.546 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:26:45.540+0000 1694c700 -1 osd.5 335 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e333) 2019-11-29T21:26:45.653 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:26:45.648+0000 1694c700 -1 osd.2 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:37.104238+0000 front 2019-11-29T21:25:37.105054+0000 (oldest deadline 2019-11-29T21:26:22.977178+0000) 2019-11-29T21:26:45.742 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:26:45.736+0000 1694c700 -1 osd.0 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:38.647096+0000 front 2019-11-29T21:25:38.667285+0000 (oldest deadline 2019-11-29T21:26:22.485943+0000) 2019-11-29T21:26:45.789 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:26:45.782+0000 1694c700 -1 osd.4 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:41.034715+0000 front 2019-11-29T21:25:40.955667+0000 (oldest deadline 2019-11-29T21:26:25.470651+0000) 2019-11-29T21:26:45.793 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:26:45.786+0000 1694c700 -1 osd.6 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:40.975552+0000 front 2019-11-29T21:25:41.013724+0000 (oldest deadline 2019-11-29T21:26:25.463627+0000) 2019-11-29T21:26:46.280 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:26:46.274+0000 1694c700 -1 osd.7 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:40.768382+0000 front 2019-11-29T21:25:40.784475+0000 (oldest deadline 2019-11-29T21:26:24.816247+0000) 2019-11-29T21:26:46.550 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:26:46.544+0000 1694c700 -1 osd.5 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:25:56.833874+0000 (oldest deadline 2019-11-29T21:26:36.833874+0000) 2019-11-29T21:26:46.550 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:26:46.546+0000 1694c700 -1 osd.5 335 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e333) 2019-11-29T21:26:46.651 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:26:46.645+0000 1694c700 -1 osd.2 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:37.104238+0000 front 2019-11-29T21:25:37.105054+0000 (oldest deadline 2019-11-29T21:26:22.977178+0000) 2019-11-29T21:26:46.708 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:26:46.702+0000 1694c700 -1 osd.0 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:38.647096+0000 front 2019-11-29T21:25:38.667285+0000 (oldest deadline 2019-11-29T21:26:22.485943+0000) 2019-11-29T21:26:46.780 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:26:46.774+0000 1694c700 -1 osd.4 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:41.034715+0000 front 2019-11-29T21:25:40.955667+0000 (oldest deadline 2019-11-29T21:26:25.470651+0000) 2019-11-29T21:26:46.810 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:26:46.804+0000 1694c700 -1 osd.6 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:40.975552+0000 front 2019-11-29T21:25:41.013724+0000 (oldest deadline 2019-11-29T21:26:25.463627+0000) 2019-11-29T21:26:47.314 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:26:47.308+0000 1694c700 -1 osd.7 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:40.768382+0000 front 2019-11-29T21:25:40.784475+0000 (oldest deadline 2019-11-29T21:26:24.816247+0000) 2019-11-29T21:26:47.582 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:26:47.574+0000 1694c700 -1 osd.5 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:25:56.833874+0000 (oldest deadline 2019-11-29T21:26:36.833874+0000) 2019-11-29T21:26:47.583 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:26:47.577+0000 1694c700 -1 osd.5 335 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e333) 2019-11-29T21:26:47.673 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:26:47.667+0000 1694c700 -1 osd.0 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:38.647096+0000 front 2019-11-29T21:25:38.667285+0000 (oldest deadline 2019-11-29T21:26:22.485943+0000) 2019-11-29T21:26:47.689 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:26:47.684+0000 1694c700 -1 osd.2 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:37.104238+0000 front 2019-11-29T21:25:37.105054+0000 (oldest deadline 2019-11-29T21:26:22.977178+0000) 2019-11-29T21:26:47.755 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:26:47.748+0000 1694c700 -1 osd.4 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:41.034715+0000 front 2019-11-29T21:25:40.955667+0000 (oldest deadline 2019-11-29T21:26:25.470651+0000) 2019-11-29T21:26:47.787 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:26:47.781+0000 1694c700 -1 osd.6 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:40.975552+0000 front 2019-11-29T21:25:41.013724+0000 (oldest deadline 2019-11-29T21:26:25.463627+0000) 2019-11-29T21:26:48.321 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:26:48.314+0000 1694c700 -1 osd.7 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:40.768382+0000 front 2019-11-29T21:25:40.784475+0000 (oldest deadline 2019-11-29T21:26:24.816247+0000) 2019-11-29T21:26:48.555 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:26:48.548+0000 1694c700 -1 osd.5 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:25:56.833874+0000 (oldest deadline 2019-11-29T21:26:36.833874+0000) 2019-11-29T21:26:48.556 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:26:48.551+0000 1694c700 -1 osd.5 335 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e333) 2019-11-29T21:26:48.658 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:26:48.653+0000 1694c700 -1 osd.2 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:37.104238+0000 front 2019-11-29T21:25:37.105054+0000 (oldest deadline 2019-11-29T21:26:22.977178+0000) 2019-11-29T21:26:48.680 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:26:48.675+0000 1694c700 -1 osd.0 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:38.647096+0000 front 2019-11-29T21:25:38.667285+0000 (oldest deadline 2019-11-29T21:26:22.485943+0000) 2019-11-29T21:26:48.780 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:26:48.772+0000 1694c700 -1 osd.4 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:41.034715+0000 front 2019-11-29T21:25:40.955667+0000 (oldest deadline 2019-11-29T21:26:25.470651+0000) 2019-11-29T21:26:48.791 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:26:48.785+0000 1694c700 -1 osd.6 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:40.975552+0000 front 2019-11-29T21:25:41.013724+0000 (oldest deadline 2019-11-29T21:26:25.463627+0000) 2019-11-29T21:26:49.282 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:26:49.276+0000 1694c700 -1 osd.7 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:40.768382+0000 front 2019-11-29T21:25:40.784475+0000 (oldest deadline 2019-11-29T21:26:24.816247+0000) 2019-11-29T21:26:49.514 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:26:49.506+0000 1694c700 -1 osd.5 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:25:56.833874+0000 (oldest deadline 2019-11-29T21:26:36.833874+0000) 2019-11-29T21:26:49.515 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:26:49.509+0000 1694c700 -1 osd.5 335 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e333) 2019-11-29T21:26:49.635 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:26:49.630+0000 1694c700 -1 osd.2 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:37.104238+0000 front 2019-11-29T21:25:37.105054+0000 (oldest deadline 2019-11-29T21:26:22.977178+0000) 2019-11-29T21:26:49.707 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:26:49.702+0000 1694c700 -1 osd.0 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:38.647096+0000 front 2019-11-29T21:25:38.667285+0000 (oldest deadline 2019-11-29T21:26:22.485943+0000) 2019-11-29T21:26:49.765 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:26:49.759+0000 1694c700 -1 osd.4 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:41.034715+0000 front 2019-11-29T21:25:40.955667+0000 (oldest deadline 2019-11-29T21:26:25.470651+0000) 2019-11-29T21:26:49.809 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:26:49.803+0000 1694c700 -1 osd.6 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:40.975552+0000 front 2019-11-29T21:25:41.013724+0000 (oldest deadline 2019-11-29T21:26:25.463627+0000) 2019-11-29T21:26:50.293 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:26:50.285+0000 1694c700 -1 osd.7 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:40.768382+0000 front 2019-11-29T21:25:40.784475+0000 (oldest deadline 2019-11-29T21:26:24.816247+0000) 2019-11-29T21:26:50.508 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:26:50.502+0000 1694c700 -1 osd.5 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:25:56.833874+0000 (oldest deadline 2019-11-29T21:26:36.833874+0000) 2019-11-29T21:26:50.511 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:26:50.507+0000 1694c700 -1 osd.5 335 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e333) 2019-11-29T21:26:50.653 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:26:50.648+0000 1694c700 -1 osd.2 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:37.104238+0000 front 2019-11-29T21:25:37.105054+0000 (oldest deadline 2019-11-29T21:26:22.977178+0000) 2019-11-29T21:26:50.663 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:26:50.657+0000 1694c700 -1 osd.0 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:38.647096+0000 front 2019-11-29T21:25:38.667285+0000 (oldest deadline 2019-11-29T21:26:22.485943+0000) 2019-11-29T21:26:50.766 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:26:50.760+0000 1694c700 -1 osd.6 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:40.975552+0000 front 2019-11-29T21:25:41.013724+0000 (oldest deadline 2019-11-29T21:26:25.463627+0000) 2019-11-29T21:26:50.784 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:26:50.774+0000 1694c700 -1 osd.4 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:41.034715+0000 front 2019-11-29T21:25:40.955667+0000 (oldest deadline 2019-11-29T21:26:25.470651+0000) 2019-11-29T21:26:51.297 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:26:51.291+0000 1694c700 -1 osd.7 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:40.768382+0000 front 2019-11-29T21:25:40.784475+0000 (oldest deadline 2019-11-29T21:26:24.816247+0000) 2019-11-29T21:26:51.513 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:26:51.507+0000 1694c700 -1 osd.5 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:25:56.833874+0000 (oldest deadline 2019-11-29T21:26:36.833874+0000) 2019-11-29T21:26:51.514 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:26:51.509+0000 1694c700 -1 osd.5 335 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e333) 2019-11-29T21:26:51.650 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:26:51.645+0000 1694c700 -1 osd.2 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:37.104238+0000 front 2019-11-29T21:25:37.105054+0000 (oldest deadline 2019-11-29T21:26:22.977178+0000) 2019-11-29T21:26:51.652 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:26:51.646+0000 1694c700 -1 osd.0 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:38.647096+0000 front 2019-11-29T21:25:38.667285+0000 (oldest deadline 2019-11-29T21:26:22.485943+0000) 2019-11-29T21:26:51.754 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:26:51.748+0000 1694c700 -1 osd.6 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:40.975552+0000 front 2019-11-29T21:25:41.013724+0000 (oldest deadline 2019-11-29T21:26:25.463627+0000) 2019-11-29T21:26:51.773 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:26:51.767+0000 1694c700 -1 osd.4 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:41.034715+0000 front 2019-11-29T21:25:40.955667+0000 (oldest deadline 2019-11-29T21:26:25.470651+0000) 2019-11-29T21:26:52.284 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:26:52.279+0000 1694c700 -1 osd.7 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:40.768382+0000 front 2019-11-29T21:25:40.784475+0000 (oldest deadline 2019-11-29T21:26:24.816247+0000) 2019-11-29T21:26:52.555 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:26:52.547+0000 1694c700 -1 osd.5 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:25:56.833874+0000 (oldest deadline 2019-11-29T21:26:36.833874+0000) 2019-11-29T21:26:52.558 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:26:52.550+0000 1694c700 -1 osd.5 335 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e333) 2019-11-29T21:26:52.641 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:26:52.635+0000 1694c700 -1 osd.0 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:38.647096+0000 front 2019-11-29T21:25:38.667285+0000 (oldest deadline 2019-11-29T21:26:22.485943+0000) 2019-11-29T21:26:52.703 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:26:52.697+0000 1694c700 -1 osd.2 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:37.104238+0000 front 2019-11-29T21:25:37.105054+0000 (oldest deadline 2019-11-29T21:26:22.977178+0000) 2019-11-29T21:26:52.758 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:26:52.751+0000 1694c700 -1 osd.4 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:41.034715+0000 front 2019-11-29T21:25:40.955667+0000 (oldest deadline 2019-11-29T21:26:25.470651+0000) 2019-11-29T21:26:52.803 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:26:52.797+0000 1694c700 -1 osd.6 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:40.975552+0000 front 2019-11-29T21:25:41.013724+0000 (oldest deadline 2019-11-29T21:26:25.463627+0000) 2019-11-29T21:26:53.305 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:26:53.294+0000 1694c700 -1 osd.7 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:40.768382+0000 front 2019-11-29T21:25:40.784475+0000 (oldest deadline 2019-11-29T21:26:24.816247+0000) 2019-11-29T21:26:53.591 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:26:53.585+0000 1694c700 -1 osd.5 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:25:56.833874+0000 (oldest deadline 2019-11-29T21:26:36.833874+0000) 2019-11-29T21:26:53.594 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:26:53.590+0000 1694c700 -1 osd.5 335 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e333) 2019-11-29T21:26:53.665 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:26:53.660+0000 1694c700 -1 osd.2 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:37.104238+0000 front 2019-11-29T21:25:37.105054+0000 (oldest deadline 2019-11-29T21:26:22.977178+0000) 2019-11-29T21:26:53.694 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:26:53.688+0000 1694c700 -1 osd.0 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:38.647096+0000 front 2019-11-29T21:25:38.667285+0000 (oldest deadline 2019-11-29T21:26:22.485943+0000) 2019-11-29T21:26:53.751 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:26:53.745+0000 1694c700 -1 osd.4 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:41.034715+0000 front 2019-11-29T21:25:40.955667+0000 (oldest deadline 2019-11-29T21:26:25.470651+0000) 2019-11-29T21:26:53.809 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:26:53.803+0000 1694c700 -1 osd.6 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:40.975552+0000 front 2019-11-29T21:25:41.013724+0000 (oldest deadline 2019-11-29T21:26:25.463627+0000) 2019-11-29T21:26:54.291 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:26:54.285+0000 1694c700 -1 osd.7 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:40.768382+0000 front 2019-11-29T21:25:40.784475+0000 (oldest deadline 2019-11-29T21:26:24.816247+0000) 2019-11-29T21:26:54.551 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:26:54.546+0000 1694c700 -1 osd.5 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:25:56.833874+0000 (oldest deadline 2019-11-29T21:26:36.833874+0000) 2019-11-29T21:26:54.556 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:26:54.552+0000 1694c700 -1 osd.5 335 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e333) 2019-11-29T21:26:54.657 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:26:54.651+0000 1694c700 -1 osd.2 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:37.104238+0000 front 2019-11-29T21:25:37.105054+0000 (oldest deadline 2019-11-29T21:26:22.977178+0000) 2019-11-29T21:26:54.703 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:26:54.697+0000 1694c700 -1 osd.0 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:38.647096+0000 front 2019-11-29T21:25:38.667285+0000 (oldest deadline 2019-11-29T21:26:22.485943+0000) 2019-11-29T21:26:54.730 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:26:54.724+0000 1694c700 -1 osd.4 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:41.034715+0000 front 2019-11-29T21:25:40.955667+0000 (oldest deadline 2019-11-29T21:26:25.470651+0000) 2019-11-29T21:26:54.829 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:26:54.824+0000 1694c700 -1 osd.6 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:40.975552+0000 front 2019-11-29T21:25:41.013724+0000 (oldest deadline 2019-11-29T21:26:25.463627+0000) 2019-11-29T21:26:55.254 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:26:55.249+0000 1694c700 -1 osd.7 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:40.768382+0000 front 2019-11-29T21:25:40.784475+0000 (oldest deadline 2019-11-29T21:26:24.816247+0000) 2019-11-29T21:26:55.527 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:26:55.520+0000 1694c700 -1 osd.5 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:25:56.833874+0000 (oldest deadline 2019-11-29T21:26:36.833874+0000) 2019-11-29T21:26:55.528 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:26:55.523+0000 1694c700 -1 osd.5 335 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e333) 2019-11-29T21:26:55.681 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:26:55.674+0000 1694c700 -1 osd.0 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:38.647096+0000 front 2019-11-29T21:25:38.667285+0000 (oldest deadline 2019-11-29T21:26:22.485943+0000) 2019-11-29T21:26:55.685 INFO:teuthology.orchestra.run.smithi062.stderr:testFileThenContainerDelete (test.functional.tests.TestContainer) ... ok 2019-11-29T21:26:55.703 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:26:55.698+0000 1694c700 -1 osd.2 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:37.104238+0000 front 2019-11-29T21:25:37.105054+0000 (oldest deadline 2019-11-29T21:26:22.977178+0000) 2019-11-29T21:26:55.762 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:26:55.755+0000 1694c700 -1 osd.4 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:41.034715+0000 front 2019-11-29T21:25:40.955667+0000 (oldest deadline 2019-11-29T21:26:25.470651+0000) 2019-11-29T21:26:55.874 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:26:55.868+0000 1694c700 -1 osd.6 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:40.975552+0000 front 2019-11-29T21:25:41.013724+0000 (oldest deadline 2019-11-29T21:26:25.463627+0000) 2019-11-29T21:26:56.295 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:26:56.289+0000 1694c700 -1 osd.7 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:40.768382+0000 front 2019-11-29T21:25:40.784475+0000 (oldest deadline 2019-11-29T21:26:24.816247+0000) 2019-11-29T21:26:56.485 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:26:56.478+0000 1694c700 -1 osd.5 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:25:56.833874+0000 (oldest deadline 2019-11-29T21:26:36.833874+0000) 2019-11-29T21:26:56.485 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:26:56.481+0000 1694c700 -1 osd.5 335 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e333) 2019-11-29T21:26:56.694 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:26:56.688+0000 1694c700 -1 osd.2 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:37.104238+0000 front 2019-11-29T21:25:37.105054+0000 (oldest deadline 2019-11-29T21:26:22.977178+0000) 2019-11-29T21:26:56.716 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:26:56.711+0000 1694c700 -1 osd.0 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:38.647096+0000 front 2019-11-29T21:25:38.667285+0000 (oldest deadline 2019-11-29T21:26:22.485943+0000) 2019-11-29T21:26:56.763 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:26:56.758+0000 1694c700 -1 osd.4 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:41.034715+0000 front 2019-11-29T21:25:40.955667+0000 (oldest deadline 2019-11-29T21:26:25.470651+0000) 2019-11-29T21:26:56.841 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:26:56.836+0000 1694c700 -1 osd.6 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:40.975552+0000 front 2019-11-29T21:25:41.013724+0000 (oldest deadline 2019-11-29T21:26:25.463627+0000) 2019-11-29T21:26:57.290 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:26:57.284+0000 1694c700 -1 osd.7 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:40.768382+0000 front 2019-11-29T21:25:40.784475+0000 (oldest deadline 2019-11-29T21:26:24.816247+0000) 2019-11-29T21:26:57.462 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:26:57.454+0000 1694c700 -1 osd.5 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:25:56.833874+0000 (oldest deadline 2019-11-29T21:26:36.833874+0000) 2019-11-29T21:26:57.464 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:26:57.458+0000 1694c700 -1 osd.5 335 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e333) 2019-11-29T21:26:57.679 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:26:57.674+0000 1694c700 -1 osd.2 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:37.104238+0000 front 2019-11-29T21:25:37.105054+0000 (oldest deadline 2019-11-29T21:26:22.977178+0000) 2019-11-29T21:26:57.692 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:26:57.686+0000 1694c700 -1 osd.0 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:38.647096+0000 front 2019-11-29T21:25:38.667285+0000 (oldest deadline 2019-11-29T21:26:22.485943+0000) 2019-11-29T21:26:57.751 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:26:57.745+0000 1694c700 -1 osd.4 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:41.034715+0000 front 2019-11-29T21:25:40.955667+0000 (oldest deadline 2019-11-29T21:26:25.470651+0000) 2019-11-29T21:26:57.877 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:26:57.872+0000 1694c700 -1 osd.6 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:40.975552+0000 front 2019-11-29T21:25:41.013724+0000 (oldest deadline 2019-11-29T21:26:25.463627+0000) 2019-11-29T21:26:57.983 INFO:tasks.ceph.mon.b.smithi022.stderr:2019-11-29T21:26:57.979+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.1 [v2:172.21.15.62:6800/10370,v1:172.21.15.62:6801/10370] for 45sec e335 v335) 2019-11-29T21:26:58.334 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:26:58.329+0000 1694c700 -1 osd.7 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:40.768382+0000 front 2019-11-29T21:25:40.784475+0000 (oldest deadline 2019-11-29T21:26:24.816247+0000) 2019-11-29T21:26:58.458 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:26:58.451+0000 1694c700 -1 osd.5 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:25:56.833874+0000 (oldest deadline 2019-11-29T21:26:36.833874+0000) 2019-11-29T21:26:58.491 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:26:58.453+0000 1694c700 -1 osd.5 335 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e333) 2019-11-29T21:26:58.671 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:26:58.666+0000 1694c700 -1 osd.2 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:37.104238+0000 front 2019-11-29T21:25:37.105054+0000 (oldest deadline 2019-11-29T21:26:22.977178+0000) 2019-11-29T21:26:58.709 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:26:58.705+0000 1694c700 -1 osd.0 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:38.647096+0000 front 2019-11-29T21:25:38.667285+0000 (oldest deadline 2019-11-29T21:26:22.485943+0000) 2019-11-29T21:26:58.757 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:26:58.751+0000 1694c700 -1 osd.4 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:41.034715+0000 front 2019-11-29T21:25:40.955667+0000 (oldest deadline 2019-11-29T21:26:25.470651+0000) 2019-11-29T21:26:58.918 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:26:58.912+0000 1694c700 -1 osd.6 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:40.975552+0000 front 2019-11-29T21:25:41.013724+0000 (oldest deadline 2019-11-29T21:26:25.463627+0000) 2019-11-29T21:26:59.365 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:26:59.359+0000 1694c700 -1 osd.7 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:40.768382+0000 front 2019-11-29T21:25:40.784475+0000 (oldest deadline 2019-11-29T21:26:24.816247+0000) 2019-11-29T21:26:59.428 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:26:59.421+0000 1694c700 -1 osd.5 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:25:56.833874+0000 (oldest deadline 2019-11-29T21:26:36.833874+0000) 2019-11-29T21:26:59.429 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:26:59.424+0000 1694c700 -1 osd.5 335 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e333) 2019-11-29T21:26:59.693 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:26:59.688+0000 1694c700 -1 osd.0 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:38.647096+0000 front 2019-11-29T21:25:38.667285+0000 (oldest deadline 2019-11-29T21:26:22.485943+0000) 2019-11-29T21:26:59.696 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:26:59.691+0000 1694c700 -1 osd.2 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:37.104238+0000 front 2019-11-29T21:25:37.105054+0000 (oldest deadline 2019-11-29T21:26:22.977178+0000) 2019-11-29T21:26:59.774 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:26:59.768+0000 1694c700 -1 osd.4 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:41.034715+0000 front 2019-11-29T21:25:40.955667+0000 (oldest deadline 2019-11-29T21:26:25.470651+0000) 2019-11-29T21:26:59.900 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:26:59.893+0000 1694c700 -1 osd.6 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:40.975552+0000 front 2019-11-29T21:25:41.013724+0000 (oldest deadline 2019-11-29T21:26:25.463627+0000) 2019-11-29T21:27:00.363 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:27:00.357+0000 1694c700 -1 osd.7 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:40.768382+0000 front 2019-11-29T21:25:40.784475+0000 (oldest deadline 2019-11-29T21:26:24.816247+0000) 2019-11-29T21:27:00.427 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:27:00.421+0000 1694c700 -1 osd.5 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:25:56.833874+0000 (oldest deadline 2019-11-29T21:26:36.833874+0000) 2019-11-29T21:27:00.430 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:27:00.426+0000 1694c700 -1 osd.5 335 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e333) 2019-11-29T21:27:00.664 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:27:00.658+0000 1694c700 -1 osd.0 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:38.647096+0000 front 2019-11-29T21:25:38.667285+0000 (oldest deadline 2019-11-29T21:26:22.485943+0000) 2019-11-29T21:27:00.726 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:27:00.721+0000 1694c700 -1 osd.2 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:37.104238+0000 front 2019-11-29T21:25:37.105054+0000 (oldest deadline 2019-11-29T21:26:22.977178+0000) 2019-11-29T21:27:00.753 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:27:00.748+0000 1694c700 -1 osd.4 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:41.034715+0000 front 2019-11-29T21:25:40.955667+0000 (oldest deadline 2019-11-29T21:26:25.470651+0000) 2019-11-29T21:27:00.879 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:27:00.873+0000 1694c700 -1 osd.6 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:40.975552+0000 front 2019-11-29T21:25:41.013724+0000 (oldest deadline 2019-11-29T21:26:25.463627+0000) 2019-11-29T21:27:01.411 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:27:01.405+0000 1694c700 -1 osd.7 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:40.768382+0000 front 2019-11-29T21:25:40.784475+0000 (oldest deadline 2019-11-29T21:26:24.816247+0000) 2019-11-29T21:27:01.484 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:27:01.478+0000 1694c700 -1 osd.5 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:25:56.833874+0000 (oldest deadline 2019-11-29T21:26:36.833874+0000) 2019-11-29T21:27:01.487 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:27:01.483+0000 1694c700 -1 osd.5 335 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e333) 2019-11-29T21:27:01.658 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:27:01.653+0000 1694c700 -1 osd.0 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:38.647096+0000 front 2019-11-29T21:25:38.667285+0000 (oldest deadline 2019-11-29T21:26:22.485943+0000) 2019-11-29T21:27:01.733 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:27:01.727+0000 1694c700 -1 osd.4 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:41.034715+0000 front 2019-11-29T21:25:40.955667+0000 (oldest deadline 2019-11-29T21:26:25.470651+0000) 2019-11-29T21:27:01.778 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:27:01.773+0000 1694c700 -1 osd.2 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:37.104238+0000 front 2019-11-29T21:25:37.105054+0000 (oldest deadline 2019-11-29T21:26:22.977178+0000) 2019-11-29T21:27:01.883 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:27:01.879+0000 1694c700 -1 osd.6 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:40.975552+0000 front 2019-11-29T21:25:41.013724+0000 (oldest deadline 2019-11-29T21:26:25.463627+0000) 2019-11-29T21:27:02.445 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:27:02.439+0000 1694c700 -1 osd.7 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:40.768382+0000 front 2019-11-29T21:25:40.784475+0000 (oldest deadline 2019-11-29T21:26:24.816247+0000) 2019-11-29T21:27:02.468 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:27:02.460+0000 1694c700 -1 osd.5 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:25:56.833874+0000 (oldest deadline 2019-11-29T21:26:36.833874+0000) 2019-11-29T21:27:02.468 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:27:02.464+0000 1694c700 -1 osd.5 335 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e333) 2019-11-29T21:27:02.670 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:27:02.665+0000 1694c700 -1 osd.0 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:38.647096+0000 front 2019-11-29T21:25:38.667285+0000 (oldest deadline 2019-11-29T21:26:22.485943+0000) 2019-11-29T21:27:02.691 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:27:02.685+0000 1694c700 -1 osd.4 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:41.034715+0000 front 2019-11-29T21:25:40.955667+0000 (oldest deadline 2019-11-29T21:26:25.470651+0000) 2019-11-29T21:27:02.743 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:27:02.737+0000 1694c700 -1 osd.2 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:37.104238+0000 front 2019-11-29T21:25:37.105054+0000 (oldest deadline 2019-11-29T21:26:22.977178+0000) 2019-11-29T21:27:02.841 INFO:teuthology.orchestra.run.smithi062.stderr:testLastFileMarker (test.functional.tests.TestContainer) ... ok 2019-11-29T21:27:02.863 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:27:02.857+0000 1694c700 -1 osd.6 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:40.975552+0000 front 2019-11-29T21:25:41.013724+0000 (oldest deadline 2019-11-29T21:26:25.463627+0000) 2019-11-29T21:27:03.003 INFO:tasks.ceph.mon.b.smithi022.stderr:2019-11-29T21:27:02.998+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.1 [v2:172.21.15.62:6800/10370,v1:172.21.15.62:6801/10370] for 45sec e335 v335) 2019-11-29T21:27:03.433 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:27:03.427+0000 1694c700 -1 osd.7 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:40.768382+0000 front 2019-11-29T21:25:40.784475+0000 (oldest deadline 2019-11-29T21:26:24.816247+0000) 2019-11-29T21:27:03.484 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:27:03.477+0000 1694c700 -1 osd.5 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:25:56.833874+0000 (oldest deadline 2019-11-29T21:26:36.833874+0000) 2019-11-29T21:27:03.485 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:27:03.480+0000 1694c700 -1 osd.5 335 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e333) 2019-11-29T21:27:03.681 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:27:03.675+0000 1694c700 -1 osd.0 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:38.647096+0000 front 2019-11-29T21:25:38.667285+0000 (oldest deadline 2019-11-29T21:26:22.485943+0000) 2019-11-29T21:27:03.729 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:27:03.723+0000 1694c700 -1 osd.4 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:41.034715+0000 front 2019-11-29T21:25:40.955667+0000 (oldest deadline 2019-11-29T21:26:25.470651+0000) 2019-11-29T21:27:03.755 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:27:03.748+0000 1694c700 -1 osd.2 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:37.104238+0000 front 2019-11-29T21:25:37.105054+0000 (oldest deadline 2019-11-29T21:26:22.977178+0000) 2019-11-29T21:27:03.821 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:27:03.815+0000 1694c700 -1 osd.6 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:40.975552+0000 front 2019-11-29T21:25:41.013724+0000 (oldest deadline 2019-11-29T21:26:25.463627+0000) 2019-11-29T21:27:04.448 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:27:04.441+0000 1694c700 -1 osd.7 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:40.768382+0000 front 2019-11-29T21:25:40.784475+0000 (oldest deadline 2019-11-29T21:26:24.816247+0000) 2019-11-29T21:27:04.456 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:27:04.449+0000 1694c700 -1 osd.5 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:25:56.833874+0000 (oldest deadline 2019-11-29T21:26:36.833874+0000) 2019-11-29T21:27:04.457 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:27:04.452+0000 1694c700 -1 osd.5 335 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e333) 2019-11-29T21:27:04.703 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:27:04.697+0000 1694c700 -1 osd.0 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:38.647096+0000 front 2019-11-29T21:25:38.667285+0000 (oldest deadline 2019-11-29T21:26:22.485943+0000) 2019-11-29T21:27:04.740 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:27:04.733+0000 1694c700 -1 osd.4 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:41.034715+0000 front 2019-11-29T21:25:40.955667+0000 (oldest deadline 2019-11-29T21:26:25.470651+0000) 2019-11-29T21:27:04.790 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:27:04.785+0000 1694c700 -1 osd.2 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:37.104238+0000 front 2019-11-29T21:25:37.105054+0000 (oldest deadline 2019-11-29T21:26:22.977178+0000) 2019-11-29T21:27:04.799 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:27:04.794+0000 1694c700 -1 osd.6 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:40.975552+0000 front 2019-11-29T21:25:41.013724+0000 (oldest deadline 2019-11-29T21:26:25.463627+0000) 2019-11-29T21:27:05.438 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:27:05.432+0000 1694c700 -1 osd.5 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:25:56.833874+0000 (oldest deadline 2019-11-29T21:26:36.833874+0000) 2019-11-29T21:27:05.439 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:27:05.434+0000 1694c700 -1 osd.5 335 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e333) 2019-11-29T21:27:05.487 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:27:05.480+0000 1694c700 -1 osd.7 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:40.768382+0000 front 2019-11-29T21:25:40.784475+0000 (oldest deadline 2019-11-29T21:26:24.816247+0000) 2019-11-29T21:27:05.743 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:27:05.738+0000 1694c700 -1 osd.4 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:41.034715+0000 front 2019-11-29T21:25:40.955667+0000 (oldest deadline 2019-11-29T21:26:25.470651+0000) 2019-11-29T21:27:05.752 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:27:05.747+0000 1694c700 -1 osd.0 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:38.647096+0000 front 2019-11-29T21:25:38.667285+0000 (oldest deadline 2019-11-29T21:26:22.485943+0000) 2019-11-29T21:27:05.812 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:27:05.806+0000 1694c700 -1 osd.6 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:40.975552+0000 front 2019-11-29T21:25:41.013724+0000 (oldest deadline 2019-11-29T21:26:25.463627+0000) 2019-11-29T21:27:05.832 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:27:05.826+0000 1694c700 -1 osd.2 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:37.104238+0000 front 2019-11-29T21:25:37.105054+0000 (oldest deadline 2019-11-29T21:26:22.977178+0000) 2019-11-29T21:27:06.494 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:27:06.482+0000 1694c700 -1 osd.5 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:25:56.833874+0000 (oldest deadline 2019-11-29T21:26:36.833874+0000) 2019-11-29T21:27:06.496 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:27:06.485+0000 1694c700 -1 osd.5 335 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e333) 2019-11-29T21:27:06.508 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:27:06.502+0000 1694c700 -1 osd.7 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:40.768382+0000 front 2019-11-29T21:25:40.784475+0000 (oldest deadline 2019-11-29T21:26:24.816247+0000) 2019-11-29T21:27:06.747 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:27:06.741+0000 1694c700 -1 osd.0 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:38.647096+0000 front 2019-11-29T21:25:38.667285+0000 (oldest deadline 2019-11-29T21:26:22.485943+0000) 2019-11-29T21:27:06.791 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:27:06.785+0000 1694c700 -1 osd.4 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:41.034715+0000 front 2019-11-29T21:25:40.955667+0000 (oldest deadline 2019-11-29T21:26:25.470651+0000) 2019-11-29T21:27:06.824 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:27:06.819+0000 1694c700 -1 osd.6 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:40.975552+0000 front 2019-11-29T21:25:41.013724+0000 (oldest deadline 2019-11-29T21:26:25.463627+0000) 2019-11-29T21:27:06.876 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:27:06.871+0000 1694c700 -1 osd.2 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:37.104238+0000 front 2019-11-29T21:25:37.105054+0000 (oldest deadline 2019-11-29T21:26:22.977178+0000) 2019-11-29T21:27:07.494 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:27:07.488+0000 1694c700 -1 osd.7 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:40.768382+0000 front 2019-11-29T21:25:40.784475+0000 (oldest deadline 2019-11-29T21:26:24.816247+0000) 2019-11-29T21:27:07.567 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:27:07.534+0000 1694c700 -1 osd.5 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:25:56.833874+0000 (oldest deadline 2019-11-29T21:26:36.833874+0000) 2019-11-29T21:27:07.568 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:27:07.537+0000 1694c700 -1 osd.5 335 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e333) 2019-11-29T21:27:07.758 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:27:07.751+0000 1694c700 -1 osd.4 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:41.034715+0000 front 2019-11-29T21:25:40.955667+0000 (oldest deadline 2019-11-29T21:26:25.470651+0000) 2019-11-29T21:27:07.781 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:27:07.774+0000 1694c700 -1 osd.0 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:38.647096+0000 front 2019-11-29T21:25:38.667285+0000 (oldest deadline 2019-11-29T21:26:22.485943+0000) 2019-11-29T21:27:07.868 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:27:07.859+0000 1694c700 -1 osd.2 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:37.104238+0000 front 2019-11-29T21:25:37.105054+0000 (oldest deadline 2019-11-29T21:26:22.977178+0000) 2019-11-29T21:27:07.880 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:27:07.871+0000 1694c700 -1 osd.6 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:40.975552+0000 front 2019-11-29T21:25:41.013724+0000 (oldest deadline 2019-11-29T21:26:25.463627+0000) 2019-11-29T21:27:08.021 INFO:tasks.ceph.mon.b.smithi022.stderr:2019-11-29T21:27:08.017+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.1 [v2:172.21.15.62:6800/10370,v1:172.21.15.62:6801/10370] for 45sec e335 v335) 2019-11-29T21:27:08.504 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:27:08.498+0000 1694c700 -1 osd.7 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:40.768382+0000 front 2019-11-29T21:25:40.784475+0000 (oldest deadline 2019-11-29T21:26:24.816247+0000) 2019-11-29T21:27:08.585 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:27:08.578+0000 1694c700 -1 osd.5 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:25:56.833874+0000 (oldest deadline 2019-11-29T21:26:36.833874+0000) 2019-11-29T21:27:08.586 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:27:08.581+0000 1694c700 -1 osd.5 335 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e333) 2019-11-29T21:27:08.796 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:27:08.790+0000 1694c700 -1 osd.4 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:41.034715+0000 front 2019-11-29T21:25:40.955667+0000 (oldest deadline 2019-11-29T21:26:25.470651+0000) 2019-11-29T21:27:08.824 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:27:08.818+0000 1694c700 -1 osd.0 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:38.647096+0000 front 2019-11-29T21:25:38.667285+0000 (oldest deadline 2019-11-29T21:26:22.485943+0000) 2019-11-29T21:27:08.871 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:27:08.867+0000 1694c700 -1 osd.2 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:37.104238+0000 front 2019-11-29T21:25:37.105054+0000 (oldest deadline 2019-11-29T21:26:22.977178+0000) 2019-11-29T21:27:08.905 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:27:08.899+0000 1694c700 -1 osd.6 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:40.975552+0000 front 2019-11-29T21:25:41.013724+0000 (oldest deadline 2019-11-29T21:26:25.463627+0000) 2019-11-29T21:27:09.515 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:27:09.509+0000 1694c700 -1 osd.7 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:40.768382+0000 front 2019-11-29T21:25:40.784475+0000 (oldest deadline 2019-11-29T21:26:24.816247+0000) 2019-11-29T21:27:09.572 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:27:09.566+0000 1694c700 -1 osd.5 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:25:56.833874+0000 (oldest deadline 2019-11-29T21:26:36.833874+0000) 2019-11-29T21:27:09.576 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:27:09.571+0000 1694c700 -1 osd.5 335 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e333) 2019-11-29T21:27:09.783 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:27:09.776+0000 1694c700 -1 osd.4 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:41.034715+0000 front 2019-11-29T21:25:40.955667+0000 (oldest deadline 2019-11-29T21:26:25.470651+0000) 2019-11-29T21:27:09.803 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:27:09.797+0000 1694c700 -1 osd.0 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:38.647096+0000 front 2019-11-29T21:25:38.667285+0000 (oldest deadline 2019-11-29T21:26:22.485943+0000) 2019-11-29T21:27:09.854 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:27:09.848+0000 1694c700 -1 osd.2 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:37.104238+0000 front 2019-11-29T21:25:37.105054+0000 (oldest deadline 2019-11-29T21:26:22.977178+0000) 2019-11-29T21:27:09.859 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:27:09.853+0000 1694c700 -1 osd.6 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:40.975552+0000 front 2019-11-29T21:25:41.013724+0000 (oldest deadline 2019-11-29T21:26:25.463627+0000) 2019-11-29T21:27:10.561 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:27:10.554+0000 1694c700 -1 osd.5 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:25:56.833874+0000 (oldest deadline 2019-11-29T21:26:36.833874+0000) 2019-11-29T21:27:10.562 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:27:10.555+0000 1694c700 -1 osd.7 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:40.768382+0000 front 2019-11-29T21:25:40.784475+0000 (oldest deadline 2019-11-29T21:26:24.816247+0000) 2019-11-29T21:27:10.563 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:27:10.557+0000 1694c700 -1 osd.5 335 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e333) 2019-11-29T21:27:10.771 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:27:10.765+0000 1694c700 -1 osd.4 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:41.034715+0000 front 2019-11-29T21:25:40.955667+0000 (oldest deadline 2019-11-29T21:26:25.470651+0000) 2019-11-29T21:27:10.838 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:27:10.834+0000 1694c700 -1 osd.0 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:38.647096+0000 front 2019-11-29T21:25:38.667285+0000 (oldest deadline 2019-11-29T21:26:22.485943+0000) 2019-11-29T21:27:10.844 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:27:10.840+0000 1694c700 -1 osd.2 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:37.104238+0000 front 2019-11-29T21:25:37.105054+0000 (oldest deadline 2019-11-29T21:26:22.977178+0000) 2019-11-29T21:27:10.914 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:27:10.908+0000 1694c700 -1 osd.6 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:40.975552+0000 front 2019-11-29T21:25:41.013724+0000 (oldest deadline 2019-11-29T21:26:25.463627+0000) 2019-11-29T21:27:11.524 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:27:11.518+0000 1694c700 -1 osd.5 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:25:56.833874+0000 (oldest deadline 2019-11-29T21:26:36.833874+0000) 2019-11-29T21:27:11.527 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:27:11.523+0000 1694c700 -1 osd.5 335 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e333) 2019-11-29T21:27:11.573 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:27:11.567+0000 1694c700 -1 osd.7 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:40.768382+0000 front 2019-11-29T21:25:40.784475+0000 (oldest deadline 2019-11-29T21:26:24.816247+0000) 2019-11-29T21:27:11.752 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:27:11.746+0000 1694c700 -1 osd.4 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:41.034715+0000 front 2019-11-29T21:25:40.955667+0000 (oldest deadline 2019-11-29T21:26:25.470651+0000) 2019-11-29T21:27:11.821 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:27:11.816+0000 1694c700 -1 osd.0 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:38.647096+0000 front 2019-11-29T21:25:38.667285+0000 (oldest deadline 2019-11-29T21:26:22.485943+0000) 2019-11-29T21:27:11.830 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:27:11.825+0000 1694c700 -1 osd.2 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:37.104238+0000 front 2019-11-29T21:25:37.105054+0000 (oldest deadline 2019-11-29T21:26:22.977178+0000) 2019-11-29T21:27:11.907 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:27:11.902+0000 1694c700 -1 osd.6 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:40.975552+0000 front 2019-11-29T21:25:41.013724+0000 (oldest deadline 2019-11-29T21:26:25.463627+0000) 2019-11-29T21:27:12.555 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:27:12.549+0000 1694c700 -1 osd.7 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:40.768382+0000 front 2019-11-29T21:25:40.784475+0000 (oldest deadline 2019-11-29T21:26:24.816247+0000) 2019-11-29T21:27:12.559 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:27:12.553+0000 1694c700 -1 osd.5 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:25:56.833874+0000 (oldest deadline 2019-11-29T21:26:36.833874+0000) 2019-11-29T21:27:12.560 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:27:12.555+0000 1694c700 -1 osd.5 335 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e333) 2019-11-29T21:27:12.778 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:27:12.771+0000 1694c700 -1 osd.4 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:41.034715+0000 front 2019-11-29T21:25:40.955667+0000 (oldest deadline 2019-11-29T21:26:25.470651+0000) 2019-11-29T21:27:12.798 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:27:12.793+0000 1694c700 -1 osd.2 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:37.104238+0000 front 2019-11-29T21:25:37.105054+0000 (oldest deadline 2019-11-29T21:26:22.977178+0000) 2019-11-29T21:27:12.815 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:27:12.810+0000 1694c700 -1 osd.0 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:38.647096+0000 front 2019-11-29T21:25:38.667285+0000 (oldest deadline 2019-11-29T21:26:22.485943+0000) 2019-11-29T21:27:12.910 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:27:12.904+0000 1694c700 -1 osd.6 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:40.975552+0000 front 2019-11-29T21:25:41.013724+0000 (oldest deadline 2019-11-29T21:26:25.463627+0000) 2019-11-29T21:27:13.127 INFO:tasks.ceph.mon.b.smithi022.stderr:2019-11-29T21:27:13.123+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.1 [v2:172.21.15.62:6800/10370,v1:172.21.15.62:6801/10370] for 45sec e335 v335) 2019-11-29T21:27:13.561 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:27:13.555+0000 1694c700 -1 osd.7 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:40.768382+0000 front 2019-11-29T21:25:40.784475+0000 (oldest deadline 2019-11-29T21:26:24.816247+0000) 2019-11-29T21:27:13.815 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:27:13.811+0000 1694c700 -1 osd.2 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:37.104238+0000 front 2019-11-29T21:25:37.105054+0000 (oldest deadline 2019-11-29T21:26:22.977178+0000) 2019-11-29T21:27:13.895 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:27:13.891+0000 1694c700 -1 osd.6 335 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:25:40.975552+0000 front 2019-11-29T21:25:41.013724+0000 (oldest deadline 2019-11-29T21:26:25.463627+0000) 2019-11-29T21:27:53.254 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:27:53.207+0000 35f8c700 -1 osd.1 339 build_incremental_map_msg missing incremental map 339 2019-11-29T21:27:53.341 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:27:53.240+0000 3678d700 -1 osd.1 339 build_incremental_map_msg missing incremental map 339 2019-11-29T21:27:53.686 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:27:53.673+0000 31f84700 -1 osd.1 339 build_incremental_map_msg missing incremental map 339 2019-11-29T21:27:53.711 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:27:53.703+0000 31f84700 -1 osd.1 339 build_incremental_map_msg missing incremental map 339 2019-11-29T21:27:54.354 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:27:54.324+0000 3578b700 -1 osd.1 340 build_incremental_map_msg missing incremental map 340 2019-11-29T21:27:54.386 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:27:54.357+0000 3578b700 -1 osd.1 340 build_incremental_map_msg missing incremental map 340 2019-11-29T21:27:54.565 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:27:54.490+0000 3678d700 -1 osd.1 340 build_incremental_map_msg missing incremental map 340 2019-11-29T21:27:54.810 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:27:54.709+0000 31783700 -1 osd.1 340 build_incremental_map_msg missing incremental map 340 2019-11-29T21:27:56.222 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:27:56.200+0000 38f92700 -1 osd.1 340 build_incremental_map_msg missing incremental map 339 2019-11-29T21:27:56.222 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:27:56.208+0000 38f92700 -1 osd.1 340 build_incremental_map_msg missing incremental map 340 2019-11-29T21:28:53.654 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:28:53.649+0000 1694c700 -1 osd.1 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:08.971813+0000 front 2019-11-29T21:28:09.025217+0000 (oldest deadline 2019-11-29T21:28:53.459103+0000) 2019-11-29T21:28:54.269 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:28:54.263+0000 1694c700 -1 osd.2 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:08.775814+0000 front 2019-11-29T21:28:13.465597+0000 (oldest deadline 2019-11-29T21:28:53.357580+0000) 2019-11-29T21:28:54.487 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:28:54.480+0000 1694c700 -1 osd.7 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:08.265839+0000 front 2019-11-29T21:28:08.261336+0000 (oldest deadline 2019-11-29T21:28:53.639055+0000) 2019-11-29T21:28:54.701 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:28:54.695+0000 1694c700 -1 osd.1 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:08.971813+0000 front 2019-11-29T21:28:09.025217+0000 (oldest deadline 2019-11-29T21:28:53.459103+0000) 2019-11-29T21:28:55.296 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:28:55.290+0000 1694c700 -1 osd.2 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:08.775814+0000 front 2019-11-29T21:28:13.465597+0000 (oldest deadline 2019-11-29T21:28:53.357580+0000) 2019-11-29T21:28:55.456 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:28:55.443+0000 1694c700 -1 osd.7 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:08.265839+0000 front 2019-11-29T21:28:08.261336+0000 (oldest deadline 2019-11-29T21:28:53.639055+0000) 2019-11-29T21:28:55.695 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:28:55.691+0000 1694c700 -1 osd.1 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:08.971813+0000 front 2019-11-29T21:28:09.025217+0000 (oldest deadline 2019-11-29T21:28:53.459103+0000) 2019-11-29T21:28:55.781 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:28:55.775+0000 1694c700 -1 osd.4 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:11.539579+0000 front 2019-11-29T21:28:11.941979+0000 (oldest deadline 2019-11-29T21:28:54.947453+0000) 2019-11-29T21:28:56.322 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:28:56.317+0000 1694c700 -1 osd.2 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:08.775814+0000 front 2019-11-29T21:28:13.465597+0000 (oldest deadline 2019-11-29T21:28:53.357580+0000) 2019-11-29T21:28:56.453 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:28:56.446+0000 1694c700 -1 osd.7 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:08.265839+0000 front 2019-11-29T21:28:08.261336+0000 (oldest deadline 2019-11-29T21:28:53.639055+0000) 2019-11-29T21:28:56.743 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:28:56.738+0000 1694c700 -1 osd.1 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:08.971813+0000 front 2019-11-29T21:28:09.025217+0000 (oldest deadline 2019-11-29T21:28:53.459103+0000) 2019-11-29T21:28:56.793 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:28:56.787+0000 1694c700 -1 osd.4 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:11.539579+0000 front 2019-11-29T21:28:11.941979+0000 (oldest deadline 2019-11-29T21:28:54.947453+0000) 2019-11-29T21:28:57.358 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:28:57.353+0000 1694c700 -1 osd.2 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:08.775814+0000 front 2019-11-29T21:28:13.465597+0000 (oldest deadline 2019-11-29T21:28:53.357580+0000) 2019-11-29T21:28:57.485 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:28:57.479+0000 1694c700 -1 osd.7 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:08.265839+0000 front 2019-11-29T21:28:08.261336+0000 (oldest deadline 2019-11-29T21:28:53.639055+0000) 2019-11-29T21:28:57.776 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:28:57.770+0000 1694c700 -1 osd.4 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:11.539579+0000 front 2019-11-29T21:28:11.941979+0000 (oldest deadline 2019-11-29T21:28:54.947453+0000) 2019-11-29T21:28:57.781 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:28:57.775+0000 1694c700 -1 osd.1 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:08.971813+0000 front 2019-11-29T21:28:09.025217+0000 (oldest deadline 2019-11-29T21:28:53.459103+0000) 2019-11-29T21:28:58.026 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:28:58.020+0000 1694c700 -1 osd.0 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:12.201423+0000 front 2019-11-29T21:28:11.652288+0000 (oldest deadline 2019-11-29T21:28:57.435770+0000) 2019-11-29T21:28:58.246 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:28:58.239+0000 1694c700 -1 osd.6 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:12.622038+0000 front 2019-11-29T21:28:12.623879+0000 (oldest deadline 2019-11-29T21:28:57.743643+0000) 2019-11-29T21:28:58.332 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:28:58.327+0000 1694c700 -1 osd.2 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:08.775814+0000 front 2019-11-29T21:28:13.465597+0000 (oldest deadline 2019-11-29T21:28:53.357580+0000) 2019-11-29T21:28:58.513 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:28:58.503+0000 1694c700 -1 osd.7 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:08.265839+0000 front 2019-11-29T21:28:08.261336+0000 (oldest deadline 2019-11-29T21:28:53.639055+0000) 2019-11-29T21:28:58.769 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:28:58.763+0000 1694c700 -1 osd.4 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:11.539579+0000 front 2019-11-29T21:28:11.941979+0000 (oldest deadline 2019-11-29T21:28:54.947453+0000) 2019-11-29T21:28:58.811 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:28:58.806+0000 1694c700 -1 osd.1 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:08.971813+0000 front 2019-11-29T21:28:09.025217+0000 (oldest deadline 2019-11-29T21:28:53.459103+0000) 2019-11-29T21:28:59.065 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:28:59.057+0000 1694c700 -1 osd.0 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:12.201423+0000 front 2019-11-29T21:28:11.652288+0000 (oldest deadline 2019-11-29T21:28:57.435770+0000) 2019-11-29T21:28:59.226 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:28:59.220+0000 1694c700 -1 osd.6 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:12.622038+0000 front 2019-11-29T21:28:12.623879+0000 (oldest deadline 2019-11-29T21:28:57.743643+0000) 2019-11-29T21:28:59.302 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:28:59.296+0000 1694c700 -1 osd.2 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:08.775814+0000 front 2019-11-29T21:28:13.465597+0000 (oldest deadline 2019-11-29T21:28:53.357580+0000) 2019-11-29T21:28:59.499 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:28:59.493+0000 1694c700 -1 osd.7 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:08.265839+0000 front 2019-11-29T21:28:08.261336+0000 (oldest deadline 2019-11-29T21:28:53.639055+0000) 2019-11-29T21:28:59.750 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:28:59.744+0000 1694c700 -1 osd.4 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:11.539579+0000 front 2019-11-29T21:28:11.941979+0000 (oldest deadline 2019-11-29T21:28:54.947453+0000) 2019-11-29T21:28:59.847 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:28:59.842+0000 1694c700 -1 osd.1 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:08.971813+0000 front 2019-11-29T21:28:09.025217+0000 (oldest deadline 2019-11-29T21:28:53.459103+0000) 2019-11-29T21:29:00.088 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:29:00.082+0000 1694c700 -1 osd.0 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:12.201423+0000 front 2019-11-29T21:28:11.652288+0000 (oldest deadline 2019-11-29T21:28:57.435770+0000) 2019-11-29T21:29:00.246 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:29:00.240+0000 1694c700 -1 osd.6 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:12.622038+0000 front 2019-11-29T21:28:12.623879+0000 (oldest deadline 2019-11-29T21:28:57.743643+0000) 2019-11-29T21:29:00.300 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:29:00.294+0000 1694c700 -1 osd.2 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:08.775814+0000 front 2019-11-29T21:28:13.465597+0000 (oldest deadline 2019-11-29T21:28:53.357580+0000) 2019-11-29T21:29:00.472 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:29:00.466+0000 1694c700 -1 osd.7 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:08.265839+0000 front 2019-11-29T21:28:08.261336+0000 (oldest deadline 2019-11-29T21:28:53.639055+0000) 2019-11-29T21:29:00.750 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:29:00.744+0000 1694c700 -1 osd.4 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:11.539579+0000 front 2019-11-29T21:28:11.941979+0000 (oldest deadline 2019-11-29T21:28:54.947453+0000) 2019-11-29T21:29:00.828 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:29:00.823+0000 1694c700 -1 osd.1 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:08.971813+0000 front 2019-11-29T21:28:09.025217+0000 (oldest deadline 2019-11-29T21:28:53.459103+0000) 2019-11-29T21:29:01.132 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:29:01.127+0000 1694c700 -1 osd.0 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:12.201423+0000 front 2019-11-29T21:28:11.652288+0000 (oldest deadline 2019-11-29T21:28:57.435770+0000) 2019-11-29T21:29:01.222 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:29:01.216+0000 1694c700 -1 osd.6 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:12.622038+0000 front 2019-11-29T21:28:12.623879+0000 (oldest deadline 2019-11-29T21:28:57.743643+0000) 2019-11-29T21:29:01.268 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:29:01.263+0000 1694c700 -1 osd.2 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:08.775814+0000 front 2019-11-29T21:28:13.465597+0000 (oldest deadline 2019-11-29T21:28:53.357580+0000) 2019-11-29T21:29:01.442 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:29:01.435+0000 1694c700 -1 osd.7 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:08.265839+0000 front 2019-11-29T21:28:08.261336+0000 (oldest deadline 2019-11-29T21:28:53.639055+0000) 2019-11-29T21:29:01.740 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:29:01.734+0000 1694c700 -1 osd.4 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:11.539579+0000 front 2019-11-29T21:28:11.941979+0000 (oldest deadline 2019-11-29T21:28:54.947453+0000) 2019-11-29T21:29:01.800 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:29:01.794+0000 1694c700 -1 osd.1 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:08.971813+0000 front 2019-11-29T21:28:09.025217+0000 (oldest deadline 2019-11-29T21:28:53.459103+0000) 2019-11-29T21:29:02.152 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:29:02.148+0000 1694c700 -1 osd.0 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:12.201423+0000 front 2019-11-29T21:28:11.652288+0000 (oldest deadline 2019-11-29T21:28:57.435770+0000) 2019-11-29T21:29:02.203 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:29:02.197+0000 1694c700 -1 osd.6 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:12.622038+0000 front 2019-11-29T21:28:12.623879+0000 (oldest deadline 2019-11-29T21:28:57.743643+0000) 2019-11-29T21:29:02.240 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:29:02.235+0000 1694c700 -1 osd.2 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:08.775814+0000 front 2019-11-29T21:28:13.465597+0000 (oldest deadline 2019-11-29T21:28:53.357580+0000) 2019-11-29T21:29:02.464 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:29:02.458+0000 1694c700 -1 osd.7 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:08.265839+0000 front 2019-11-29T21:28:08.261336+0000 (oldest deadline 2019-11-29T21:28:53.639055+0000) 2019-11-29T21:29:02.728 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:29:02.720+0000 1694c700 -1 osd.4 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:11.539579+0000 front 2019-11-29T21:28:11.941979+0000 (oldest deadline 2019-11-29T21:28:54.947453+0000) 2019-11-29T21:29:02.849 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:29:02.844+0000 1694c700 -1 osd.1 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:08.971813+0000 front 2019-11-29T21:28:09.025217+0000 (oldest deadline 2019-11-29T21:28:53.459103+0000) 2019-11-29T21:29:03.123 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:29:03.118+0000 1694c700 -1 osd.0 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:12.201423+0000 front 2019-11-29T21:28:11.652288+0000 (oldest deadline 2019-11-29T21:28:57.435770+0000) 2019-11-29T21:29:03.221 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:29:03.214+0000 1694c700 -1 osd.6 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:12.622038+0000 front 2019-11-29T21:28:12.623879+0000 (oldest deadline 2019-11-29T21:28:57.743643+0000) 2019-11-29T21:29:03.252 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:29:03.246+0000 1694c700 -1 osd.2 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:08.775814+0000 front 2019-11-29T21:28:13.465597+0000 (oldest deadline 2019-11-29T21:28:53.357580+0000) 2019-11-29T21:29:03.502 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:29:03.497+0000 1694c700 -1 osd.7 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:08.265839+0000 front 2019-11-29T21:28:08.261336+0000 (oldest deadline 2019-11-29T21:28:53.639055+0000) 2019-11-29T21:29:03.741 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:29:03.735+0000 1694c700 -1 osd.4 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:11.539579+0000 front 2019-11-29T21:28:11.941979+0000 (oldest deadline 2019-11-29T21:28:54.947453+0000) 2019-11-29T21:29:03.873 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:29:03.868+0000 1694c700 -1 osd.1 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:08.971813+0000 front 2019-11-29T21:28:09.025217+0000 (oldest deadline 2019-11-29T21:28:53.459103+0000) 2019-11-29T21:29:04.160 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:29:04.155+0000 1694c700 -1 osd.0 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:12.201423+0000 front 2019-11-29T21:28:11.652288+0000 (oldest deadline 2019-11-29T21:28:57.435770+0000) 2019-11-29T21:29:04.260 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:29:04.254+0000 1694c700 -1 osd.6 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:12.622038+0000 front 2019-11-29T21:28:12.623879+0000 (oldest deadline 2019-11-29T21:28:57.743643+0000) 2019-11-29T21:29:04.265 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:29:04.259+0000 1694c700 -1 osd.2 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:08.775814+0000 front 2019-11-29T21:28:13.465597+0000 (oldest deadline 2019-11-29T21:28:53.357580+0000) 2019-11-29T21:29:04.500 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:29:04.493+0000 1694c700 -1 osd.7 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:08.265839+0000 front 2019-11-29T21:28:08.261336+0000 (oldest deadline 2019-11-29T21:28:53.639055+0000) 2019-11-29T21:29:04.703 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:29:04.697+0000 1694c700 -1 osd.4 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:11.539579+0000 front 2019-11-29T21:28:11.941979+0000 (oldest deadline 2019-11-29T21:28:54.947453+0000) 2019-11-29T21:29:04.911 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:29:04.906+0000 1694c700 -1 osd.1 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:08.971813+0000 front 2019-11-29T21:28:09.025217+0000 (oldest deadline 2019-11-29T21:28:53.459103+0000) 2019-11-29T21:29:05.186 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:29:05.181+0000 1694c700 -1 osd.0 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:12.201423+0000 front 2019-11-29T21:28:11.652288+0000 (oldest deadline 2019-11-29T21:28:57.435770+0000) 2019-11-29T21:29:05.272 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:29:05.267+0000 1694c700 -1 osd.2 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:08.775814+0000 front 2019-11-29T21:28:13.465597+0000 (oldest deadline 2019-11-29T21:28:53.357580+0000) 2019-11-29T21:29:05.274 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:29:05.269+0000 1694c700 -1 osd.6 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:12.622038+0000 front 2019-11-29T21:28:12.623879+0000 (oldest deadline 2019-11-29T21:28:57.743643+0000) 2019-11-29T21:29:05.553 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:29:05.546+0000 1694c700 -1 osd.7 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:08.265839+0000 front 2019-11-29T21:28:08.261336+0000 (oldest deadline 2019-11-29T21:28:53.639055+0000) 2019-11-29T21:29:05.693 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:29:05.687+0000 1694c700 -1 osd.4 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:11.539579+0000 front 2019-11-29T21:28:11.941979+0000 (oldest deadline 2019-11-29T21:28:54.947453+0000) 2019-11-29T21:29:05.931 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:29:05.925+0000 1694c700 -1 osd.1 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:08.971813+0000 front 2019-11-29T21:28:09.025217+0000 (oldest deadline 2019-11-29T21:28:53.459103+0000) 2019-11-29T21:29:06.177 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:29:06.172+0000 1694c700 -1 osd.0 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:12.201423+0000 front 2019-11-29T21:28:11.652288+0000 (oldest deadline 2019-11-29T21:28:57.435770+0000) 2019-11-29T21:29:06.318 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:29:06.312+0000 1694c700 -1 osd.6 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:12.622038+0000 front 2019-11-29T21:28:12.623879+0000 (oldest deadline 2019-11-29T21:28:57.743643+0000) 2019-11-29T21:29:06.320 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:29:06.315+0000 1694c700 -1 osd.2 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:08.775814+0000 front 2019-11-29T21:28:13.465597+0000 (oldest deadline 2019-11-29T21:28:53.357580+0000) 2019-11-29T21:29:06.473 INFO:teuthology.orchestra.run.smithi062.stderr:testMarkerLimitFileList (test.functional.tests.TestContainer) ... ok 2019-11-29T21:29:06.512 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:29:06.506+0000 1694c700 -1 osd.7 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:08.265839+0000 front 2019-11-29T21:28:08.261336+0000 (oldest deadline 2019-11-29T21:28:53.639055+0000) 2019-11-29T21:29:06.672 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:29:06.667+0000 1694c700 -1 osd.4 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:11.539579+0000 front 2019-11-29T21:28:11.941979+0000 (oldest deadline 2019-11-29T21:28:54.947453+0000) 2019-11-29T21:29:06.927 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:29:06.922+0000 1694c700 -1 osd.1 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:08.971813+0000 front 2019-11-29T21:28:09.025217+0000 (oldest deadline 2019-11-29T21:28:53.459103+0000) 2019-11-29T21:29:07.217 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:29:07.212+0000 1694c700 -1 osd.0 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:12.201423+0000 front 2019-11-29T21:28:11.652288+0000 (oldest deadline 2019-11-29T21:28:57.435770+0000) 2019-11-29T21:29:07.313 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:29:07.307+0000 1694c700 -1 osd.2 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:08.775814+0000 front 2019-11-29T21:28:13.465597+0000 (oldest deadline 2019-11-29T21:28:53.357580+0000) 2019-11-29T21:29:07.361 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:29:07.355+0000 1694c700 -1 osd.6 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:12.622038+0000 front 2019-11-29T21:28:12.623879+0000 (oldest deadline 2019-11-29T21:28:57.743643+0000) 2019-11-29T21:29:07.493 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:29:07.487+0000 1694c700 -1 osd.7 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:08.265839+0000 front 2019-11-29T21:28:08.261336+0000 (oldest deadline 2019-11-29T21:28:53.639055+0000) 2019-11-29T21:29:07.719 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:29:07.712+0000 1694c700 -1 osd.4 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:11.539579+0000 front 2019-11-29T21:28:11.941979+0000 (oldest deadline 2019-11-29T21:28:54.947453+0000) 2019-11-29T21:29:07.941 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:29:07.935+0000 1694c700 -1 osd.1 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:08.971813+0000 front 2019-11-29T21:28:09.025217+0000 (oldest deadline 2019-11-29T21:28:53.459103+0000) 2019-11-29T21:29:08.221 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:29:08.215+0000 1694c700 -1 osd.0 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:12.201423+0000 front 2019-11-29T21:28:11.652288+0000 (oldest deadline 2019-11-29T21:28:57.435770+0000) 2019-11-29T21:29:08.315 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:29:08.306+0000 1694c700 -1 osd.2 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:08.775814+0000 front 2019-11-29T21:28:13.465597+0000 (oldest deadline 2019-11-29T21:28:53.357580+0000) 2019-11-29T21:29:08.372 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:29:08.366+0000 1694c700 -1 osd.6 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:12.622038+0000 front 2019-11-29T21:28:12.623879+0000 (oldest deadline 2019-11-29T21:28:57.743643+0000) 2019-11-29T21:29:08.478 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:29:08.472+0000 1694c700 -1 osd.7 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:08.265839+0000 front 2019-11-29T21:28:08.261336+0000 (oldest deadline 2019-11-29T21:28:53.639055+0000) 2019-11-29T21:29:08.726 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:29:08.719+0000 1694c700 -1 osd.4 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:11.539579+0000 front 2019-11-29T21:28:11.941979+0000 (oldest deadline 2019-11-29T21:28:54.947453+0000) 2019-11-29T21:29:08.926 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:29:08.920+0000 1694c700 -1 osd.1 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:08.971813+0000 front 2019-11-29T21:28:09.025217+0000 (oldest deadline 2019-11-29T21:28:53.459103+0000) 2019-11-29T21:29:09.221 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:29:09.214+0000 1694c700 -1 osd.0 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:12.201423+0000 front 2019-11-29T21:28:11.652288+0000 (oldest deadline 2019-11-29T21:28:57.435770+0000) 2019-11-29T21:29:09.344 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:29:09.339+0000 1694c700 -1 osd.6 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:12.622038+0000 front 2019-11-29T21:28:12.623879+0000 (oldest deadline 2019-11-29T21:28:57.743643+0000) 2019-11-29T21:29:09.350 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:29:09.343+0000 1694c700 -1 osd.2 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:08.775814+0000 front 2019-11-29T21:28:13.465597+0000 (oldest deadline 2019-11-29T21:28:53.357580+0000) 2019-11-29T21:29:09.504 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:29:09.497+0000 1694c700 -1 osd.7 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:08.265839+0000 front 2019-11-29T21:28:08.261336+0000 (oldest deadline 2019-11-29T21:28:53.639055+0000) 2019-11-29T21:29:09.724 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:29:09.716+0000 1694c700 -1 osd.4 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:11.539579+0000 front 2019-11-29T21:28:11.941979+0000 (oldest deadline 2019-11-29T21:28:54.947453+0000) 2019-11-29T21:29:09.905 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:29:09.900+0000 1694c700 -1 osd.1 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:08.971813+0000 front 2019-11-29T21:28:09.025217+0000 (oldest deadline 2019-11-29T21:28:53.459103+0000) 2019-11-29T21:29:10.211 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:29:10.206+0000 1694c700 -1 osd.0 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:12.201423+0000 front 2019-11-29T21:28:11.652288+0000 (oldest deadline 2019-11-29T21:28:57.435770+0000) 2019-11-29T21:29:10.307 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:29:10.303+0000 1694c700 -1 osd.2 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:08.775814+0000 front 2019-11-29T21:28:13.465597+0000 (oldest deadline 2019-11-29T21:28:53.357580+0000) 2019-11-29T21:29:10.381 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:29:10.374+0000 1694c700 -1 osd.6 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:12.622038+0000 front 2019-11-29T21:28:12.623879+0000 (oldest deadline 2019-11-29T21:28:57.743643+0000) 2019-11-29T21:29:10.509 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:29:10.502+0000 1694c700 -1 osd.7 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:08.265839+0000 front 2019-11-29T21:28:08.261336+0000 (oldest deadline 2019-11-29T21:28:53.639055+0000) 2019-11-29T21:29:10.716 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:29:10.710+0000 1694c700 -1 osd.4 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:11.539579+0000 front 2019-11-29T21:28:11.941979+0000 (oldest deadline 2019-11-29T21:28:54.947453+0000) 2019-11-29T21:29:10.910 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:29:10.904+0000 1694c700 -1 osd.1 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:08.971813+0000 front 2019-11-29T21:28:09.025217+0000 (oldest deadline 2019-11-29T21:28:53.459103+0000) 2019-11-29T21:29:11.253 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:29:11.248+0000 1694c700 -1 osd.0 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:12.201423+0000 front 2019-11-29T21:28:11.652288+0000 (oldest deadline 2019-11-29T21:28:57.435770+0000) 2019-11-29T21:29:11.324 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:29:11.319+0000 1694c700 -1 osd.2 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:08.775814+0000 front 2019-11-29T21:28:13.465597+0000 (oldest deadline 2019-11-29T21:28:53.357580+0000) 2019-11-29T21:29:11.375 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:29:11.369+0000 1694c700 -1 osd.6 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:12.622038+0000 front 2019-11-29T21:28:12.623879+0000 (oldest deadline 2019-11-29T21:28:57.743643+0000) 2019-11-29T21:29:11.486 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:29:11.480+0000 1694c700 -1 osd.7 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:08.265839+0000 front 2019-11-29T21:28:08.261336+0000 (oldest deadline 2019-11-29T21:28:53.639055+0000) 2019-11-29T21:29:11.767 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:29:11.761+0000 1694c700 -1 osd.4 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:11.539579+0000 front 2019-11-29T21:28:11.941979+0000 (oldest deadline 2019-11-29T21:28:54.947453+0000) 2019-11-29T21:29:11.962 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:29:11.957+0000 1694c700 -1 osd.1 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:08.971813+0000 front 2019-11-29T21:28:09.025217+0000 (oldest deadline 2019-11-29T21:28:53.459103+0000) 2019-11-29T21:29:12.299 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:29:12.294+0000 1694c700 -1 osd.2 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:08.775814+0000 front 2019-11-29T21:28:13.465597+0000 (oldest deadline 2019-11-29T21:28:53.357580+0000) 2019-11-29T21:29:12.310 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:29:12.301+0000 1694c700 -1 osd.0 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:12.201423+0000 front 2019-11-29T21:28:11.652288+0000 (oldest deadline 2019-11-29T21:28:57.435770+0000) 2019-11-29T21:29:12.343 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:29:12.337+0000 1694c700 -1 osd.6 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:12.622038+0000 front 2019-11-29T21:28:12.623879+0000 (oldest deadline 2019-11-29T21:28:57.743643+0000) 2019-11-29T21:29:12.521 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:29:12.514+0000 1694c700 -1 osd.7 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:08.265839+0000 front 2019-11-29T21:28:08.261336+0000 (oldest deadline 2019-11-29T21:28:53.639055+0000) 2019-11-29T21:29:12.819 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:29:12.812+0000 1694c700 -1 osd.4 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:11.539579+0000 front 2019-11-29T21:28:11.941979+0000 (oldest deadline 2019-11-29T21:28:54.947453+0000) 2019-11-29T21:29:12.988 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:29:12.980+0000 1694c700 -1 osd.1 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:08.971813+0000 front 2019-11-29T21:28:09.025217+0000 (oldest deadline 2019-11-29T21:28:53.459103+0000) 2019-11-29T21:29:13.285 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:29:13.281+0000 1694c700 -1 osd.2 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:08.775814+0000 front 2019-11-29T21:28:13.465597+0000 (oldest deadline 2019-11-29T21:28:53.357580+0000) 2019-11-29T21:29:13.303 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:29:13.296+0000 1694c700 -1 osd.6 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:12.622038+0000 front 2019-11-29T21:28:12.623879+0000 (oldest deadline 2019-11-29T21:28:57.743643+0000) 2019-11-29T21:29:13.335 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:29:13.326+0000 1694c700 -1 osd.0 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:12.201423+0000 front 2019-11-29T21:28:11.652288+0000 (oldest deadline 2019-11-29T21:28:57.435770+0000) 2019-11-29T21:29:13.477 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:29:13.471+0000 1694c700 -1 osd.7 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:08.265839+0000 front 2019-11-29T21:28:08.261336+0000 (oldest deadline 2019-11-29T21:28:53.639055+0000) 2019-11-29T21:29:13.656 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:09:03:54.315 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T21:29:13.667 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:09:03:54.326 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T21:29:13.671 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:09:03:54.278 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T21:29:13.671 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:09:03:54.278 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T21:29:13.675 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:09:03:54.283 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T21:29:13.676 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:09:03:54.284 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T21:29:13.792 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:29:13.785+0000 1694c700 -1 osd.4 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:11.539579+0000 front 2019-11-29T21:28:11.941979+0000 (oldest deadline 2019-11-29T21:28:54.947453+0000) 2019-11-29T21:29:13.949 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:09:03:54.556 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T21:29:13.957 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:09:03:54.564 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T21:29:13.996 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:29:13.991+0000 1694c700 -1 osd.1 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:08.971813+0000 front 2019-11-29T21:28:09.025217+0000 (oldest deadline 2019-11-29T21:28:53.459103+0000) 2019-11-29T21:29:14.018 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:09:03:54.677 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T21:29:14.303 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:29:14.297+0000 1694c700 -1 osd.2 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:08.775814+0000 front 2019-11-29T21:28:13.465597+0000 (oldest deadline 2019-11-29T21:28:53.357580+0000) 2019-11-29T21:29:14.338 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:29:14.332+0000 1694c700 -1 osd.6 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:12.622038+0000 front 2019-11-29T21:28:12.623879+0000 (oldest deadline 2019-11-29T21:28:57.743643+0000) 2019-11-29T21:29:14.356 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:29:14.350+0000 1694c700 -1 osd.0 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:12.201423+0000 front 2019-11-29T21:28:11.652288+0000 (oldest deadline 2019-11-29T21:28:57.435770+0000) 2019-11-29T21:29:14.501 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:29:14.495+0000 1694c700 -1 osd.7 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:08.265839+0000 front 2019-11-29T21:28:08.261336+0000 (oldest deadline 2019-11-29T21:28:53.639055+0000) 2019-11-29T21:29:14.844 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:29:14.838+0000 1694c700 -1 osd.4 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:11.539579+0000 front 2019-11-29T21:28:11.941979+0000 (oldest deadline 2019-11-29T21:28:54.947453+0000) 2019-11-29T21:29:14.969 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:29:14.965+0000 1694c700 -1 osd.1 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:08.971813+0000 front 2019-11-29T21:28:09.025217+0000 (oldest deadline 2019-11-29T21:28:53.459103+0000) 2019-11-29T21:29:15.329 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:29:15.323+0000 1694c700 -1 osd.6 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:12.622038+0000 front 2019-11-29T21:28:12.623879+0000 (oldest deadline 2019-11-29T21:28:57.743643+0000) 2019-11-29T21:29:15.331 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:29:15.326+0000 1694c700 -1 osd.2 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:08.775814+0000 front 2019-11-29T21:28:13.465597+0000 (oldest deadline 2019-11-29T21:28:53.357580+0000) 2019-11-29T21:29:15.354 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:29:15.349+0000 1694c700 -1 osd.0 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:12.201423+0000 front 2019-11-29T21:28:11.652288+0000 (oldest deadline 2019-11-29T21:28:57.435770+0000) 2019-11-29T21:29:15.539 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:29:15.534+0000 1694c700 -1 osd.7 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:08.265839+0000 front 2019-11-29T21:28:08.261336+0000 (oldest deadline 2019-11-29T21:28:53.639055+0000) 2019-11-29T21:29:15.855 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:29:15.850+0000 1694c700 -1 osd.4 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:11.539579+0000 front 2019-11-29T21:28:11.941979+0000 (oldest deadline 2019-11-29T21:28:54.947453+0000) 2019-11-29T21:29:15.958 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:29:15.953+0000 1694c700 -1 osd.1 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:08.971813+0000 front 2019-11-29T21:28:09.025217+0000 (oldest deadline 2019-11-29T21:28:53.459103+0000) 2019-11-29T21:29:16.291 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:29:16.286+0000 1694c700 -1 osd.2 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:08.775814+0000 front 2019-11-29T21:28:13.465597+0000 (oldest deadline 2019-11-29T21:28:53.357580+0000) 2019-11-29T21:29:16.364 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:29:16.358+0000 1694c700 -1 osd.6 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:12.622038+0000 front 2019-11-29T21:28:12.623879+0000 (oldest deadline 2019-11-29T21:28:57.743643+0000) 2019-11-29T21:29:16.398 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:29:16.393+0000 1694c700 -1 osd.0 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:12.201423+0000 front 2019-11-29T21:28:11.652288+0000 (oldest deadline 2019-11-29T21:28:57.435770+0000) 2019-11-29T21:29:16.541 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:29:16.535+0000 1694c700 -1 osd.7 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:08.265839+0000 front 2019-11-29T21:28:08.261336+0000 (oldest deadline 2019-11-29T21:28:53.639055+0000) 2019-11-29T21:29:16.896 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:29:16.890+0000 1694c700 -1 osd.4 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:11.539579+0000 front 2019-11-29T21:28:11.941979+0000 (oldest deadline 2019-11-29T21:28:54.947453+0000) 2019-11-29T21:29:16.962 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:29:16.957+0000 1694c700 -1 osd.1 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:08.971813+0000 front 2019-11-29T21:28:09.025217+0000 (oldest deadline 2019-11-29T21:28:53.459103+0000) 2019-11-29T21:29:17.287 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:29:17.282+0000 1694c700 -1 osd.2 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:08.775814+0000 front 2019-11-29T21:28:13.465597+0000 (oldest deadline 2019-11-29T21:28:53.357580+0000) 2019-11-29T21:29:17.334 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:29:17.328+0000 1694c700 -1 osd.6 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:12.622038+0000 front 2019-11-29T21:28:12.623879+0000 (oldest deadline 2019-11-29T21:28:57.743643+0000) 2019-11-29T21:29:17.379 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:29:17.374+0000 1694c700 -1 osd.0 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:12.201423+0000 front 2019-11-29T21:28:11.652288+0000 (oldest deadline 2019-11-29T21:28:57.435770+0000) 2019-11-29T21:29:17.537 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:29:17.530+0000 1694c700 -1 osd.7 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:08.265839+0000 front 2019-11-29T21:28:08.261336+0000 (oldest deadline 2019-11-29T21:28:53.639055+0000) 2019-11-29T21:29:17.853 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:29:17.846+0000 1694c700 -1 osd.4 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:11.539579+0000 front 2019-11-29T21:28:11.941979+0000 (oldest deadline 2019-11-29T21:28:54.947453+0000) 2019-11-29T21:29:17.993 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:29:17.988+0000 1694c700 -1 osd.1 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:08.971813+0000 front 2019-11-29T21:28:09.025217+0000 (oldest deadline 2019-11-29T21:28:53.459103+0000) 2019-11-29T21:29:18.308 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:29:18.303+0000 1694c700 -1 osd.2 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:08.775814+0000 front 2019-11-29T21:28:13.465597+0000 (oldest deadline 2019-11-29T21:28:53.357580+0000) 2019-11-29T21:29:18.327 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:29:18.321+0000 1694c700 -1 osd.6 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:12.622038+0000 front 2019-11-29T21:28:12.623879+0000 (oldest deadline 2019-11-29T21:28:57.743643+0000) 2019-11-29T21:29:18.355 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:29:18.350+0000 1694c700 -1 osd.0 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:12.201423+0000 front 2019-11-29T21:28:11.652288+0000 (oldest deadline 2019-11-29T21:28:57.435770+0000) 2019-11-29T21:29:18.555 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:29:18.550+0000 1694c700 -1 osd.7 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:08.265839+0000 front 2019-11-29T21:28:08.261336+0000 (oldest deadline 2019-11-29T21:28:53.639055+0000) 2019-11-29T21:29:18.819 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:29:18.813+0000 1694c700 -1 osd.4 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:11.539579+0000 front 2019-11-29T21:28:11.941979+0000 (oldest deadline 2019-11-29T21:28:54.947453+0000) 2019-11-29T21:29:19.004 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:29:18.998+0000 1694c700 -1 osd.1 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:08.971813+0000 front 2019-11-29T21:28:09.025217+0000 (oldest deadline 2019-11-29T21:28:53.459103+0000) 2019-11-29T21:29:19.321 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:29:19.316+0000 1694c700 -1 osd.2 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:08.775814+0000 front 2019-11-29T21:28:13.465597+0000 (oldest deadline 2019-11-29T21:28:53.357580+0000) 2019-11-29T21:29:19.358 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:29:19.351+0000 1694c700 -1 osd.6 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:12.622038+0000 front 2019-11-29T21:28:12.623879+0000 (oldest deadline 2019-11-29T21:28:57.743643+0000) 2019-11-29T21:29:19.372 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:29:19.367+0000 1694c700 -1 osd.0 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:12.201423+0000 front 2019-11-29T21:28:11.652288+0000 (oldest deadline 2019-11-29T21:28:57.435770+0000) 2019-11-29T21:29:19.541 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:29:19.535+0000 1694c700 -1 osd.7 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:08.265839+0000 front 2019-11-29T21:28:08.261336+0000 (oldest deadline 2019-11-29T21:28:53.639055+0000) 2019-11-29T21:29:19.828 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:29:19.821+0000 1694c700 -1 osd.4 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:11.539579+0000 front 2019-11-29T21:28:11.941979+0000 (oldest deadline 2019-11-29T21:28:54.947453+0000) 2019-11-29T21:29:19.978 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:29:19.973+0000 1694c700 -1 osd.1 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:08.971813+0000 front 2019-11-29T21:28:09.025217+0000 (oldest deadline 2019-11-29T21:28:53.459103+0000) 2019-11-29T21:29:20.366 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:29:20.361+0000 1694c700 -1 osd.2 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:08.775814+0000 front 2019-11-29T21:28:13.465597+0000 (oldest deadline 2019-11-29T21:28:53.357580+0000) 2019-11-29T21:29:20.401 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:29:20.396+0000 1694c700 -1 osd.0 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:12.201423+0000 front 2019-11-29T21:28:11.652288+0000 (oldest deadline 2019-11-29T21:28:57.435770+0000) 2019-11-29T21:29:20.405 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:29:20.399+0000 1694c700 -1 osd.6 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:12.622038+0000 front 2019-11-29T21:28:12.623879+0000 (oldest deadline 2019-11-29T21:28:57.743643+0000) 2019-11-29T21:29:20.519 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:29:20.511+0000 1694c700 -1 osd.7 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:08.265839+0000 front 2019-11-29T21:28:08.261336+0000 (oldest deadline 2019-11-29T21:28:53.639055+0000) 2019-11-29T21:29:20.860 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:29:20.842+0000 1694c700 -1 osd.4 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:11.539579+0000 front 2019-11-29T21:28:11.941979+0000 (oldest deadline 2019-11-29T21:28:54.947453+0000) 2019-11-29T21:29:20.950 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:29:20.943+0000 1694c700 -1 osd.1 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:08.971813+0000 front 2019-11-29T21:28:09.025217+0000 (oldest deadline 2019-11-29T21:28:53.459103+0000) 2019-11-29T21:29:21.344 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:29:21.339+0000 1694c700 -1 osd.2 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:08.775814+0000 front 2019-11-29T21:28:13.465597+0000 (oldest deadline 2019-11-29T21:28:53.357580+0000) 2019-11-29T21:29:21.382 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:29:21.375+0000 1694c700 -1 osd.6 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:12.622038+0000 front 2019-11-29T21:28:12.623879+0000 (oldest deadline 2019-11-29T21:28:57.743643+0000) 2019-11-29T21:29:21.407 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:29:21.402+0000 1694c700 -1 osd.0 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:12.201423+0000 front 2019-11-29T21:28:11.652288+0000 (oldest deadline 2019-11-29T21:28:57.435770+0000) 2019-11-29T21:29:21.526 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:29:21.521+0000 1694c700 -1 osd.7 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:08.265839+0000 front 2019-11-29T21:28:08.261336+0000 (oldest deadline 2019-11-29T21:28:53.639055+0000) 2019-11-29T21:29:21.853 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:29:21.846+0000 1694c700 -1 osd.4 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:11.539579+0000 front 2019-11-29T21:28:11.941979+0000 (oldest deadline 2019-11-29T21:28:54.947453+0000) 2019-11-29T21:29:21.975 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:29:21.970+0000 1694c700 -1 osd.1 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:08.971813+0000 front 2019-11-29T21:28:09.025217+0000 (oldest deadline 2019-11-29T21:28:53.459103+0000) 2019-11-29T21:29:22.361 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:29:22.355+0000 1694c700 -1 osd.6 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:12.622038+0000 front 2019-11-29T21:28:12.623879+0000 (oldest deadline 2019-11-29T21:28:57.743643+0000) 2019-11-29T21:29:22.365 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:29:22.360+0000 1694c700 -1 osd.2 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:08.775814+0000 front 2019-11-29T21:28:13.465597+0000 (oldest deadline 2019-11-29T21:28:53.357580+0000) 2019-11-29T21:29:22.372 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:29:22.368+0000 1694c700 -1 osd.0 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:12.201423+0000 front 2019-11-29T21:28:11.652288+0000 (oldest deadline 2019-11-29T21:28:57.435770+0000) 2019-11-29T21:29:22.576 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:29:22.570+0000 1694c700 -1 osd.7 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:08.265839+0000 front 2019-11-29T21:28:08.261336+0000 (oldest deadline 2019-11-29T21:28:53.639055+0000) 2019-11-29T21:29:22.875 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:29:22.868+0000 1694c700 -1 osd.4 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:11.539579+0000 front 2019-11-29T21:28:11.941979+0000 (oldest deadline 2019-11-29T21:28:54.947453+0000) 2019-11-29T21:29:22.983 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:29:22.975+0000 1694c700 -1 osd.1 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:08.971813+0000 front 2019-11-29T21:28:09.025217+0000 (oldest deadline 2019-11-29T21:28:53.459103+0000) 2019-11-29T21:29:23.335 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:29:23.330+0000 1694c700 -1 osd.2 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:08.775814+0000 front 2019-11-29T21:28:13.465597+0000 (oldest deadline 2019-11-29T21:28:53.357580+0000) 2019-11-29T21:29:23.410 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:29:23.403+0000 1694c700 -1 osd.6 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:12.622038+0000 front 2019-11-29T21:28:12.623879+0000 (oldest deadline 2019-11-29T21:28:57.743643+0000) 2019-11-29T21:29:23.425 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:29:23.420+0000 1694c700 -1 osd.0 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:12.201423+0000 front 2019-11-29T21:28:11.652288+0000 (oldest deadline 2019-11-29T21:28:57.435770+0000) 2019-11-29T21:29:23.588 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:29:23.582+0000 1694c700 -1 osd.7 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:08.265839+0000 front 2019-11-29T21:28:08.261336+0000 (oldest deadline 2019-11-29T21:28:53.639055+0000) 2019-11-29T21:29:23.876 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:29:23.870+0000 1694c700 -1 osd.4 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:11.539579+0000 front 2019-11-29T21:28:11.941979+0000 (oldest deadline 2019-11-29T21:28:54.947453+0000) 2019-11-29T21:29:23.994 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:29:23.989+0000 1694c700 -1 osd.1 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:08.971813+0000 front 2019-11-29T21:28:09.025217+0000 (oldest deadline 2019-11-29T21:28:53.459103+0000) 2019-11-29T21:29:24.325 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:29:24.312+0000 1694c700 -1 osd.2 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:08.775814+0000 front 2019-11-29T21:28:13.465597+0000 (oldest deadline 2019-11-29T21:28:53.357580+0000) 2019-11-29T21:29:24.389 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:29:24.383+0000 1694c700 -1 osd.6 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:12.622038+0000 front 2019-11-29T21:28:12.623879+0000 (oldest deadline 2019-11-29T21:28:57.743643+0000) 2019-11-29T21:29:24.435 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:29:24.430+0000 1694c700 -1 osd.0 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:12.201423+0000 front 2019-11-29T21:28:11.652288+0000 (oldest deadline 2019-11-29T21:28:57.435770+0000) 2019-11-29T21:29:24.615 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:29:24.611+0000 1694c700 -1 osd.7 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:08.265839+0000 front 2019-11-29T21:28:08.261336+0000 (oldest deadline 2019-11-29T21:28:53.639055+0000) 2019-11-29T21:29:24.837 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:29:24.832+0000 1694c700 -1 osd.4 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:11.539579+0000 front 2019-11-29T21:28:11.941979+0000 (oldest deadline 2019-11-29T21:28:54.947453+0000) 2019-11-29T21:29:24.977 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:29:24.971+0000 1694c700 -1 osd.1 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:08.971813+0000 front 2019-11-29T21:28:09.025217+0000 (oldest deadline 2019-11-29T21:28:53.459103+0000) 2019-11-29T21:29:25.361 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:29:25.356+0000 1694c700 -1 osd.2 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:08.775814+0000 front 2019-11-29T21:28:13.465597+0000 (oldest deadline 2019-11-29T21:28:53.357580+0000) 2019-11-29T21:29:25.434 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:29:25.430+0000 1694c700 -1 osd.6 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:12.622038+0000 front 2019-11-29T21:28:12.623879+0000 (oldest deadline 2019-11-29T21:28:57.743643+0000) 2019-11-29T21:29:25.472 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:29:25.466+0000 1694c700 -1 osd.0 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:12.201423+0000 front 2019-11-29T21:28:11.652288+0000 (oldest deadline 2019-11-29T21:28:57.435770+0000) 2019-11-29T21:29:25.570 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:29:25.566+0000 1694c700 -1 osd.7 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:08.265839+0000 front 2019-11-29T21:28:08.261336+0000 (oldest deadline 2019-11-29T21:28:53.639055+0000) 2019-11-29T21:29:25.798 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:29:25.791+0000 1694c700 -1 osd.4 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:11.539579+0000 front 2019-11-29T21:28:11.941979+0000 (oldest deadline 2019-11-29T21:28:54.947453+0000) 2019-11-29T21:29:25.974 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:29:25.968+0000 1694c700 -1 osd.1 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:08.971813+0000 front 2019-11-29T21:28:09.025217+0000 (oldest deadline 2019-11-29T21:28:53.459103+0000) 2019-11-29T21:29:26.332 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:29:26.326+0000 1694c700 -1 osd.2 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:08.775814+0000 front 2019-11-29T21:28:13.465597+0000 (oldest deadline 2019-11-29T21:28:53.357580+0000) 2019-11-29T21:29:26.393 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:29:26.387+0000 1694c700 -1 osd.6 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:12.622038+0000 front 2019-11-29T21:28:12.623879+0000 (oldest deadline 2019-11-29T21:28:57.743643+0000) 2019-11-29T21:29:26.515 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:29:26.510+0000 1694c700 -1 osd.0 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:12.201423+0000 front 2019-11-29T21:28:11.652288+0000 (oldest deadline 2019-11-29T21:28:57.435770+0000) 2019-11-29T21:29:26.539 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:29:26.534+0000 1694c700 -1 osd.7 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:08.265839+0000 front 2019-11-29T21:28:08.261336+0000 (oldest deadline 2019-11-29T21:28:53.639055+0000) 2019-11-29T21:29:26.793 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:29:26.787+0000 1694c700 -1 osd.4 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:11.539579+0000 front 2019-11-29T21:28:11.941979+0000 (oldest deadline 2019-11-29T21:28:54.947453+0000) 2019-11-29T21:29:26.949 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:29:26.944+0000 1694c700 -1 osd.1 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:08.971813+0000 front 2019-11-29T21:28:09.025217+0000 (oldest deadline 2019-11-29T21:28:53.459103+0000) 2019-11-29T21:29:27.321 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:29:27.315+0000 1694c700 -1 osd.2 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:08.775814+0000 front 2019-11-29T21:28:13.465597+0000 (oldest deadline 2019-11-29T21:28:53.357580+0000) 2019-11-29T21:29:27.371 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:29:27.366+0000 1694c700 -1 osd.6 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:12.622038+0000 front 2019-11-29T21:28:12.623879+0000 (oldest deadline 2019-11-29T21:28:57.743643+0000) 2019-11-29T21:29:27.477 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:29:27.471+0000 1694c700 -1 osd.0 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:12.201423+0000 front 2019-11-29T21:28:11.652288+0000 (oldest deadline 2019-11-29T21:28:57.435770+0000) 2019-11-29T21:29:27.535 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:29:27.529+0000 1694c700 -1 osd.7 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:08.265839+0000 front 2019-11-29T21:28:08.261336+0000 (oldest deadline 2019-11-29T21:28:53.639055+0000) 2019-11-29T21:29:27.778 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:29:27.773+0000 1694c700 -1 osd.4 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:11.539579+0000 front 2019-11-29T21:28:11.941979+0000 (oldest deadline 2019-11-29T21:28:54.947453+0000) 2019-11-29T21:29:27.964 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:29:27.958+0000 1694c700 -1 osd.1 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:08.971813+0000 front 2019-11-29T21:28:09.025217+0000 (oldest deadline 2019-11-29T21:28:53.459103+0000) 2019-11-29T21:29:28.340 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:29:28.334+0000 1694c700 -1 osd.2 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:08.775814+0000 front 2019-11-29T21:28:13.465597+0000 (oldest deadline 2019-11-29T21:28:53.357580+0000) 2019-11-29T21:29:28.375 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:29:28.370+0000 1694c700 -1 osd.6 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:12.622038+0000 front 2019-11-29T21:28:12.623879+0000 (oldest deadline 2019-11-29T21:28:57.743643+0000) 2019-11-29T21:29:28.441 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:29:28.435+0000 1694c700 -1 osd.0 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:12.201423+0000 front 2019-11-29T21:28:11.652288+0000 (oldest deadline 2019-11-29T21:28:57.435770+0000) 2019-11-29T21:29:28.494 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:29:28.489+0000 1694c700 -1 osd.7 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:08.265839+0000 front 2019-11-29T21:28:08.261336+0000 (oldest deadline 2019-11-29T21:28:53.639055+0000) 2019-11-29T21:29:28.553 INFO:tasks.ceph.mon.b.smithi022.stderr:2019-11-29T21:29:28.549+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 4 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.22:6818/9264,v1:172.21.15.22:6819/9264] for 45sec e340 v340) 2019-11-29T21:29:28.785 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:29:28.779+0000 1694c700 -1 osd.4 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:11.539579+0000 front 2019-11-29T21:28:11.941979+0000 (oldest deadline 2019-11-29T21:28:54.947453+0000) 2019-11-29T21:29:28.982 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:29:28.976+0000 1694c700 -1 osd.1 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:08.971813+0000 front 2019-11-29T21:28:09.025217+0000 (oldest deadline 2019-11-29T21:28:53.459103+0000) 2019-11-29T21:29:29.332 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:29:29.327+0000 1694c700 -1 osd.6 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:12.622038+0000 front 2019-11-29T21:28:12.623879+0000 (oldest deadline 2019-11-29T21:28:57.743643+0000) 2019-11-29T21:29:29.342 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:29:29.338+0000 1694c700 -1 osd.2 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:08.775814+0000 front 2019-11-29T21:28:13.465597+0000 (oldest deadline 2019-11-29T21:28:53.357580+0000) 2019-11-29T21:29:29.483 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:29:29.477+0000 1694c700 -1 osd.7 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:08.265839+0000 front 2019-11-29T21:28:08.261336+0000 (oldest deadline 2019-11-29T21:28:53.639055+0000) 2019-11-29T21:29:29.493 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:29:29.487+0000 1694c700 -1 osd.0 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:12.201423+0000 front 2019-11-29T21:28:11.652288+0000 (oldest deadline 2019-11-29T21:28:57.435770+0000) 2019-11-29T21:29:29.807 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:29:29.803+0000 1694c700 -1 osd.4 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:11.539579+0000 front 2019-11-29T21:28:11.941979+0000 (oldest deadline 2019-11-29T21:28:54.947453+0000) 2019-11-29T21:29:30.034 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:29:30.029+0000 1694c700 -1 osd.1 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:08.971813+0000 front 2019-11-29T21:28:09.025217+0000 (oldest deadline 2019-11-29T21:28:53.459103+0000) 2019-11-29T21:29:30.334 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:29:30.328+0000 1694c700 -1 osd.2 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:08.775814+0000 front 2019-11-29T21:28:13.465597+0000 (oldest deadline 2019-11-29T21:28:53.357580+0000) 2019-11-29T21:29:30.369 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:29:30.364+0000 1694c700 -1 osd.6 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:12.622038+0000 front 2019-11-29T21:28:12.623879+0000 (oldest deadline 2019-11-29T21:28:57.743643+0000) 2019-11-29T21:29:30.475 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:29:30.466+0000 1694c700 -1 osd.7 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:08.265839+0000 front 2019-11-29T21:28:08.261336+0000 (oldest deadline 2019-11-29T21:28:53.639055+0000) 2019-11-29T21:29:30.505 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:29:30.500+0000 1694c700 -1 osd.0 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:12.201423+0000 front 2019-11-29T21:28:11.652288+0000 (oldest deadline 2019-11-29T21:28:57.435770+0000) 2019-11-29T21:29:30.787 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:29:30.782+0000 1694c700 -1 osd.4 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:11.539579+0000 front 2019-11-29T21:28:11.941979+0000 (oldest deadline 2019-11-29T21:28:54.947453+0000) 2019-11-29T21:29:31.072 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:29:31.066+0000 1694c700 -1 osd.1 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:08.971813+0000 front 2019-11-29T21:28:09.025217+0000 (oldest deadline 2019-11-29T21:28:53.459103+0000) 2019-11-29T21:29:31.346 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:29:31.341+0000 1694c700 -1 osd.2 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:08.775814+0000 front 2019-11-29T21:28:13.465597+0000 (oldest deadline 2019-11-29T21:28:53.357580+0000) 2019-11-29T21:29:31.392 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:29:31.386+0000 1694c700 -1 osd.6 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:12.622038+0000 front 2019-11-29T21:28:12.623879+0000 (oldest deadline 2019-11-29T21:28:57.743643+0000) 2019-11-29T21:29:31.435 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:29:31.430+0000 1694c700 -1 osd.7 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:08.265839+0000 front 2019-11-29T21:28:08.261336+0000 (oldest deadline 2019-11-29T21:28:53.639055+0000) 2019-11-29T21:29:31.464 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:29:31.458+0000 1694c700 -1 osd.0 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:12.201423+0000 front 2019-11-29T21:28:11.652288+0000 (oldest deadline 2019-11-29T21:28:57.435770+0000) 2019-11-29T21:29:31.813 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:29:31.807+0000 1694c700 -1 osd.4 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:11.539579+0000 front 2019-11-29T21:28:11.941979+0000 (oldest deadline 2019-11-29T21:28:54.947453+0000) 2019-11-29T21:29:32.109 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:29:32.102+0000 1694c700 -1 osd.1 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:08.971813+0000 front 2019-11-29T21:28:09.025217+0000 (oldest deadline 2019-11-29T21:28:53.459103+0000) 2019-11-29T21:29:32.341 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:29:32.336+0000 1694c700 -1 osd.2 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:08.775814+0000 front 2019-11-29T21:28:13.465597+0000 (oldest deadline 2019-11-29T21:28:53.357580+0000) 2019-11-29T21:29:32.385 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:29:32.380+0000 1694c700 -1 osd.6 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:12.622038+0000 front 2019-11-29T21:28:12.623879+0000 (oldest deadline 2019-11-29T21:28:57.743643+0000) 2019-11-29T21:29:32.408 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:29:32.404+0000 1694c700 -1 osd.7 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:08.265839+0000 front 2019-11-29T21:28:08.261336+0000 (oldest deadline 2019-11-29T21:28:53.639055+0000) 2019-11-29T21:29:32.457 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:29:32.453+0000 1694c700 -1 osd.0 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:12.201423+0000 front 2019-11-29T21:28:11.652288+0000 (oldest deadline 2019-11-29T21:28:57.435770+0000) 2019-11-29T21:29:32.857 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:29:32.850+0000 1694c700 -1 osd.4 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:11.539579+0000 front 2019-11-29T21:28:11.941979+0000 (oldest deadline 2019-11-29T21:28:54.947453+0000) 2019-11-29T21:29:33.069 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:29:33.065+0000 1694c700 -1 osd.1 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:08.971813+0000 front 2019-11-29T21:28:09.025217+0000 (oldest deadline 2019-11-29T21:28:53.459103+0000) 2019-11-29T21:29:33.352 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:29:33.346+0000 1694c700 -1 osd.6 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:12.622038+0000 front 2019-11-29T21:28:12.623879+0000 (oldest deadline 2019-11-29T21:28:57.743643+0000) 2019-11-29T21:29:33.357 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:29:33.352+0000 1694c700 -1 osd.2 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:08.775814+0000 front 2019-11-29T21:28:13.465597+0000 (oldest deadline 2019-11-29T21:28:53.357580+0000) 2019-11-29T21:29:33.404 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:29:33.398+0000 1694c700 -1 osd.7 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:08.265839+0000 front 2019-11-29T21:28:08.261336+0000 (oldest deadline 2019-11-29T21:28:53.639055+0000) 2019-11-29T21:29:33.426 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:29:33.420+0000 1694c700 -1 osd.0 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:12.201423+0000 front 2019-11-29T21:28:11.652288+0000 (oldest deadline 2019-11-29T21:28:57.435770+0000) 2019-11-29T21:29:33.605 INFO:tasks.ceph.mon.b.smithi022.stderr:2019-11-29T21:29:33.600+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.22:6818/9264,v1:172.21.15.22:6819/9264] for 45sec e340 v340) 2019-11-29T21:29:34.375 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:29:34.368+0000 1694c700 -1 osd.7 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:08.265839+0000 front 2019-11-29T21:28:08.261336+0000 (oldest deadline 2019-11-29T21:28:53.639055+0000) 2019-11-29T21:29:34.474 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:29:34.469+0000 1694c700 -1 osd.0 340 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:28:12.201423+0000 front 2019-11-29T21:28:11.652288+0000 (oldest deadline 2019-11-29T21:28:57.435770+0000) 2019-11-29T21:30:28.988 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:09:05:09.646 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T21:30:28.990 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:09:05:09.649 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T21:30:29.046 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:09:05:09.653 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T21:30:29.051 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:09:05:09.658 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T21:30:29.051 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:09:05:09.658 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T21:30:29.055 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:09:05:09.662 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T21:30:29.087 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:09:05:09.746 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T21:30:29.182 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:09:05:09.784 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T21:30:29.182 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:09:05:09.786 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T21:30:31.285 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:30:31.276+0000 1694c700 -1 osd.4 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:50.704244+0000 front 2019-11-29T21:29:47.846787+0000 (oldest deadline 2019-11-29T21:30:30.517643+0000) 2019-11-29T21:30:31.528 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:30:31.520+0000 1694c700 -1 osd.7 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:49.202039+0000 front 2019-11-29T21:29:49.379035+0000 (oldest deadline 2019-11-29T21:30:31.477297+0000) 2019-11-29T21:30:31.678 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:30:31.673+0000 1694c700 -1 osd.0 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:46.155734+0000 front 2019-11-29T21:29:46.412030+0000 (oldest deadline 2019-11-29T21:30:31.066202+0000) 2019-11-29T21:30:32.328 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:30:32.315+0000 1694c700 -1 osd.4 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:50.704244+0000 front 2019-11-29T21:29:47.846787+0000 (oldest deadline 2019-11-29T21:30:30.517643+0000) 2019-11-29T21:30:32.556 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:30:32.548+0000 1694c700 -1 osd.7 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:49.202039+0000 front 2019-11-29T21:29:49.379035+0000 (oldest deadline 2019-11-29T21:30:31.477297+0000) 2019-11-29T21:30:32.732 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:30:32.727+0000 1694c700 -1 osd.0 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:46.155734+0000 front 2019-11-29T21:29:46.412030+0000 (oldest deadline 2019-11-29T21:30:31.066202+0000) 2019-11-29T21:30:33.290 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:30:33.284+0000 1694c700 -1 osd.4 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:50.704244+0000 front 2019-11-29T21:29:47.846787+0000 (oldest deadline 2019-11-29T21:30:30.517643+0000) 2019-11-29T21:30:33.606 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:30:33.600+0000 1694c700 -1 osd.7 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:49.202039+0000 front 2019-11-29T21:29:49.379035+0000 (oldest deadline 2019-11-29T21:30:31.477297+0000) 2019-11-29T21:30:33.697 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:30:33.691+0000 1694c700 -1 osd.0 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:46.155734+0000 front 2019-11-29T21:29:46.412030+0000 (oldest deadline 2019-11-29T21:30:31.066202+0000) 2019-11-29T21:30:34.339 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:30:34.331+0000 1694c700 -1 osd.4 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:50.704244+0000 front 2019-11-29T21:29:47.846787+0000 (oldest deadline 2019-11-29T21:30:30.517643+0000) 2019-11-29T21:30:34.617 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:30:34.610+0000 1694c700 -1 osd.7 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:49.202039+0000 front 2019-11-29T21:29:49.379035+0000 (oldest deadline 2019-11-29T21:30:31.477297+0000) 2019-11-29T21:30:34.656 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:30:34.649+0000 1694c700 -1 osd.2 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:50.055680+0000 front 2019-11-29T21:29:49.542893+0000 (oldest deadline 2019-11-29T21:30:33.951513+0000) 2019-11-29T21:30:34.713 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:30:34.707+0000 1694c700 -1 osd.0 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:46.155734+0000 front 2019-11-29T21:29:46.412030+0000 (oldest deadline 2019-11-29T21:30:31.066202+0000) 2019-11-29T21:30:35.308 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:30:35.299+0000 1694c700 -1 osd.4 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:50.704244+0000 front 2019-11-29T21:29:47.846787+0000 (oldest deadline 2019-11-29T21:30:30.517643+0000) 2019-11-29T21:30:35.628 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:30:35.622+0000 1694c700 -1 osd.2 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:50.055680+0000 front 2019-11-29T21:29:49.542893+0000 (oldest deadline 2019-11-29T21:30:33.951513+0000) 2019-11-29T21:30:35.639 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:30:35.632+0000 1694c700 -1 osd.7 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:49.202039+0000 front 2019-11-29T21:29:49.379035+0000 (oldest deadline 2019-11-29T21:30:31.477297+0000) 2019-11-29T21:30:35.714 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:30:35.709+0000 1694c700 -1 osd.0 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:46.155734+0000 front 2019-11-29T21:29:46.412030+0000 (oldest deadline 2019-11-29T21:30:31.066202+0000) 2019-11-29T21:30:36.276 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:30:36.269+0000 1694c700 -1 osd.4 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:50.704244+0000 front 2019-11-29T21:29:47.846787+0000 (oldest deadline 2019-11-29T21:30:30.517643+0000) 2019-11-29T21:30:36.636 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:30:36.628+0000 1694c700 -1 osd.7 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:49.202039+0000 front 2019-11-29T21:29:49.379035+0000 (oldest deadline 2019-11-29T21:30:31.477297+0000) 2019-11-29T21:30:36.656 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:30:36.650+0000 1694c700 -1 osd.2 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:50.055680+0000 front 2019-11-29T21:29:49.542893+0000 (oldest deadline 2019-11-29T21:30:33.951513+0000) 2019-11-29T21:30:36.711 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:30:36.705+0000 1694c700 -1 osd.0 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:46.155734+0000 front 2019-11-29T21:29:46.412030+0000 (oldest deadline 2019-11-29T21:30:31.066202+0000) 2019-11-29T21:30:37.276 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:30:37.269+0000 1694c700 -1 osd.4 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:50.704244+0000 front 2019-11-29T21:29:47.846787+0000 (oldest deadline 2019-11-29T21:30:30.517643+0000) 2019-11-29T21:30:37.629 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:30:37.623+0000 1694c700 -1 osd.7 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:49.202039+0000 front 2019-11-29T21:29:49.379035+0000 (oldest deadline 2019-11-29T21:30:31.477297+0000) 2019-11-29T21:30:37.679 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:30:37.674+0000 1694c700 -1 osd.2 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:50.055680+0000 front 2019-11-29T21:29:49.542893+0000 (oldest deadline 2019-11-29T21:30:33.951513+0000) 2019-11-29T21:30:37.755 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:30:37.751+0000 1694c700 -1 osd.0 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:46.155734+0000 front 2019-11-29T21:29:46.412030+0000 (oldest deadline 2019-11-29T21:30:31.066202+0000) 2019-11-29T21:30:38.259 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:30:38.252+0000 1694c700 -1 osd.4 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:50.704244+0000 front 2019-11-29T21:29:47.846787+0000 (oldest deadline 2019-11-29T21:30:30.517643+0000) 2019-11-29T21:30:38.602 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:30:38.588+0000 1694c700 -1 osd.7 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:49.202039+0000 front 2019-11-29T21:29:49.379035+0000 (oldest deadline 2019-11-29T21:30:31.477297+0000) 2019-11-29T21:30:38.646 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:30:38.641+0000 1694c700 -1 osd.2 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:50.055680+0000 front 2019-11-29T21:29:49.542893+0000 (oldest deadline 2019-11-29T21:30:33.951513+0000) 2019-11-29T21:30:38.755 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:30:38.750+0000 1694c700 -1 osd.0 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:46.155734+0000 front 2019-11-29T21:29:46.412030+0000 (oldest deadline 2019-11-29T21:30:31.066202+0000) 2019-11-29T21:30:39.218 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:30:39.211+0000 1694c700 -1 osd.4 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:50.704244+0000 front 2019-11-29T21:29:47.846787+0000 (oldest deadline 2019-11-29T21:30:30.517643+0000) 2019-11-29T21:30:39.578 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:30:39.572+0000 1694c700 -1 osd.7 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:49.202039+0000 front 2019-11-29T21:29:49.379035+0000 (oldest deadline 2019-11-29T21:30:31.477297+0000) 2019-11-29T21:30:39.671 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:30:39.665+0000 1694c700 -1 osd.2 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:50.055680+0000 front 2019-11-29T21:29:49.542893+0000 (oldest deadline 2019-11-29T21:30:33.951513+0000) 2019-11-29T21:30:39.726 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:30:39.721+0000 1694c700 -1 osd.0 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:46.155734+0000 front 2019-11-29T21:29:46.412030+0000 (oldest deadline 2019-11-29T21:30:31.066202+0000) 2019-11-29T21:30:40.263 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:30:40.256+0000 1694c700 -1 osd.4 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:50.704244+0000 front 2019-11-29T21:29:47.846787+0000 (oldest deadline 2019-11-29T21:30:30.517643+0000) 2019-11-29T21:30:40.555 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:30:40.547+0000 1694c700 -1 osd.7 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:49.202039+0000 front 2019-11-29T21:29:49.379035+0000 (oldest deadline 2019-11-29T21:30:31.477297+0000) 2019-11-29T21:30:40.686 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:30:40.682+0000 1694c700 -1 osd.2 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:50.055680+0000 front 2019-11-29T21:29:49.542893+0000 (oldest deadline 2019-11-29T21:30:33.951513+0000) 2019-11-29T21:30:40.691 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:30:40.685+0000 1694c700 -1 osd.0 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:46.155734+0000 front 2019-11-29T21:29:46.412030+0000 (oldest deadline 2019-11-29T21:30:31.066202+0000) 2019-11-29T21:30:41.266 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:30:41.259+0000 1694c700 -1 osd.4 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:50.704244+0000 front 2019-11-29T21:29:47.846787+0000 (oldest deadline 2019-11-29T21:30:30.517643+0000) 2019-11-29T21:30:41.515 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:30:41.509+0000 1694c700 -1 osd.7 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:49.202039+0000 front 2019-11-29T21:29:49.379035+0000 (oldest deadline 2019-11-29T21:30:31.477297+0000) 2019-11-29T21:30:41.663 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:30:41.657+0000 1694c700 -1 osd.2 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:50.055680+0000 front 2019-11-29T21:29:49.542893+0000 (oldest deadline 2019-11-29T21:30:33.951513+0000) 2019-11-29T21:30:41.689 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:30:41.683+0000 1694c700 -1 osd.0 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:46.155734+0000 front 2019-11-29T21:29:46.412030+0000 (oldest deadline 2019-11-29T21:30:31.066202+0000) 2019-11-29T21:30:42.295 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:30:42.287+0000 1694c700 -1 osd.4 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:50.704244+0000 front 2019-11-29T21:29:47.846787+0000 (oldest deadline 2019-11-29T21:30:30.517643+0000) 2019-11-29T21:30:42.517 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:30:42.504+0000 1694c700 -1 osd.7 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:49.202039+0000 front 2019-11-29T21:29:49.379035+0000 (oldest deadline 2019-11-29T21:30:31.477297+0000) 2019-11-29T21:30:42.596 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:30:42.590+0000 1694c700 -1 osd.5 348 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e345) 2019-11-29T21:30:42.624 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:30:42.616+0000 1694c700 -1 osd.2 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:50.055680+0000 front 2019-11-29T21:29:49.542893+0000 (oldest deadline 2019-11-29T21:30:33.951513+0000) 2019-11-29T21:30:42.692 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:30:42.686+0000 1694c700 -1 osd.0 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:46.155734+0000 front 2019-11-29T21:29:46.412030+0000 (oldest deadline 2019-11-29T21:30:31.066202+0000) 2019-11-29T21:30:43.277 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:30:43.270+0000 1694c700 -1 osd.4 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:50.704244+0000 front 2019-11-29T21:29:47.846787+0000 (oldest deadline 2019-11-29T21:30:30.517643+0000) 2019-11-29T21:30:43.481 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:30:43.474+0000 1694c700 -1 osd.7 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:49.202039+0000 front 2019-11-29T21:29:49.379035+0000 (oldest deadline 2019-11-29T21:30:31.477297+0000) 2019-11-29T21:30:43.580 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:30:43.574+0000 1694c700 -1 osd.2 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:50.055680+0000 front 2019-11-29T21:29:49.542893+0000 (oldest deadline 2019-11-29T21:30:33.951513+0000) 2019-11-29T21:30:43.586 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:30:43.581+0000 1694c700 -1 osd.5 348 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e345) 2019-11-29T21:30:43.670 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:30:43.665+0000 1694c700 -1 osd.0 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:46.155734+0000 front 2019-11-29T21:29:46.412030+0000 (oldest deadline 2019-11-29T21:30:31.066202+0000) 2019-11-29T21:30:44.252 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:30:44.245+0000 1694c700 -1 osd.4 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:50.704244+0000 front 2019-11-29T21:29:47.846787+0000 (oldest deadline 2019-11-29T21:30:30.517643+0000) 2019-11-29T21:30:44.487 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:30:44.480+0000 1694c700 -1 osd.7 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:49.202039+0000 front 2019-11-29T21:29:49.379035+0000 (oldest deadline 2019-11-29T21:30:31.477297+0000) 2019-11-29T21:30:44.544 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:30:44.539+0000 1694c700 -1 osd.5 348 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e345) 2019-11-29T21:30:44.570 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:30:44.566+0000 1694c700 -1 osd.2 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:50.055680+0000 front 2019-11-29T21:29:49.542893+0000 (oldest deadline 2019-11-29T21:30:33.951513+0000) 2019-11-29T21:30:44.660 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:30:44.654+0000 1694c700 -1 osd.0 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:46.155734+0000 front 2019-11-29T21:29:46.412030+0000 (oldest deadline 2019-11-29T21:30:31.066202+0000) 2019-11-29T21:30:45.252 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:30:45.247+0000 1694c700 -1 osd.4 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:50.704244+0000 front 2019-11-29T21:29:47.846787+0000 (oldest deadline 2019-11-29T21:30:30.517643+0000) 2019-11-29T21:30:45.540 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:30:45.535+0000 1694c700 -1 osd.7 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:49.202039+0000 front 2019-11-29T21:29:49.379035+0000 (oldest deadline 2019-11-29T21:30:31.477297+0000) 2019-11-29T21:30:45.562 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:30:45.557+0000 1694c700 -1 osd.5 348 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e345) 2019-11-29T21:30:45.581 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:30:45.577+0000 1694c700 -1 osd.2 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:50.055680+0000 front 2019-11-29T21:29:49.542893+0000 (oldest deadline 2019-11-29T21:30:33.951513+0000) 2019-11-29T21:30:45.656 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:30:45.651+0000 1694c700 -1 osd.0 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:46.155734+0000 front 2019-11-29T21:29:46.412030+0000 (oldest deadline 2019-11-29T21:30:31.066202+0000) 2019-11-29T21:30:46.287 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:30:46.281+0000 1694c700 -1 osd.4 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:50.704244+0000 front 2019-11-29T21:29:47.846787+0000 (oldest deadline 2019-11-29T21:30:30.517643+0000) 2019-11-29T21:30:46.576 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:30:46.572+0000 1694c700 -1 osd.2 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:50.055680+0000 front 2019-11-29T21:29:49.542893+0000 (oldest deadline 2019-11-29T21:30:33.951513+0000) 2019-11-29T21:30:46.585 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:30:46.580+0000 1694c700 -1 osd.5 348 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e345) 2019-11-29T21:30:46.596 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:30:46.590+0000 1694c700 -1 osd.7 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:49.202039+0000 front 2019-11-29T21:29:49.379035+0000 (oldest deadline 2019-11-29T21:30:31.477297+0000) 2019-11-29T21:30:46.708 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:30:46.703+0000 1694c700 -1 osd.0 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:46.155734+0000 front 2019-11-29T21:29:46.412030+0000 (oldest deadline 2019-11-29T21:30:31.066202+0000) 2019-11-29T21:30:47.243 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:30:47.238+0000 1694c700 -1 osd.4 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:50.704244+0000 front 2019-11-29T21:29:47.846787+0000 (oldest deadline 2019-11-29T21:30:30.517643+0000) 2019-11-29T21:30:47.559 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:30:47.553+0000 1694c700 -1 osd.7 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:49.202039+0000 front 2019-11-29T21:29:49.379035+0000 (oldest deadline 2019-11-29T21:30:31.477297+0000) 2019-11-29T21:30:47.590 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:30:47.585+0000 1694c700 -1 osd.2 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:50.055680+0000 front 2019-11-29T21:29:49.542893+0000 (oldest deadline 2019-11-29T21:30:33.951513+0000) 2019-11-29T21:30:47.632 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:30:47.627+0000 1694c700 -1 osd.5 348 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e345) 2019-11-29T21:30:47.756 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:30:47.750+0000 1694c700 -1 osd.0 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:46.155734+0000 front 2019-11-29T21:29:46.412030+0000 (oldest deadline 2019-11-29T21:30:31.066202+0000) 2019-11-29T21:30:48.257 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:30:48.250+0000 1694c700 -1 osd.4 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:50.704244+0000 front 2019-11-29T21:29:47.846787+0000 (oldest deadline 2019-11-29T21:30:30.517643+0000) 2019-11-29T21:30:48.550 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:30:48.545+0000 1694c700 -1 osd.7 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:49.202039+0000 front 2019-11-29T21:29:49.379035+0000 (oldest deadline 2019-11-29T21:30:31.477297+0000) 2019-11-29T21:30:48.577 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:30:48.571+0000 1694c700 -1 osd.2 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:50.055680+0000 front 2019-11-29T21:29:49.542893+0000 (oldest deadline 2019-11-29T21:30:33.951513+0000) 2019-11-29T21:30:48.668 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:30:48.663+0000 1694c700 -1 osd.5 348 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e345) 2019-11-29T21:30:48.746 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:30:48.740+0000 1694c700 -1 osd.0 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:46.155734+0000 front 2019-11-29T21:29:46.412030+0000 (oldest deadline 2019-11-29T21:30:31.066202+0000) 2019-11-29T21:30:49.312 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:30:49.307+0000 1694c700 -1 osd.4 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:50.704244+0000 front 2019-11-29T21:29:47.846787+0000 (oldest deadline 2019-11-29T21:30:30.517643+0000) 2019-11-29T21:30:49.560 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:30:49.554+0000 1694c700 -1 osd.2 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:50.055680+0000 front 2019-11-29T21:29:49.542893+0000 (oldest deadline 2019-11-29T21:30:33.951513+0000) 2019-11-29T21:30:49.561 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:30:49.555+0000 1694c700 -1 osd.7 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:49.202039+0000 front 2019-11-29T21:29:49.379035+0000 (oldest deadline 2019-11-29T21:30:31.477297+0000) 2019-11-29T21:30:49.667 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:30:49.662+0000 1694c700 -1 osd.5 348 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e345) 2019-11-29T21:30:49.752 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:30:49.747+0000 1694c700 -1 osd.0 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:46.155734+0000 front 2019-11-29T21:29:46.412030+0000 (oldest deadline 2019-11-29T21:30:31.066202+0000) 2019-11-29T21:30:50.341 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:30:50.336+0000 1694c700 -1 osd.4 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:50.704244+0000 front 2019-11-29T21:29:47.846787+0000 (oldest deadline 2019-11-29T21:30:30.517643+0000) 2019-11-29T21:30:50.582 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:30:50.576+0000 1694c700 -1 osd.7 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:49.202039+0000 front 2019-11-29T21:29:49.379035+0000 (oldest deadline 2019-11-29T21:30:31.477297+0000) 2019-11-29T21:30:50.591 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:30:50.585+0000 1694c700 -1 osd.2 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:50.055680+0000 front 2019-11-29T21:29:49.542893+0000 (oldest deadline 2019-11-29T21:30:33.951513+0000) 2019-11-29T21:30:50.643 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:30:50.636+0000 1694c700 -1 osd.5 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:30:09.887215+0000 (oldest deadline 2019-11-29T21:30:49.887215+0000) 2019-11-29T21:30:50.644 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:30:50.639+0000 1694c700 -1 osd.5 348 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e345) 2019-11-29T21:30:50.802 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:30:50.797+0000 1694c700 -1 osd.0 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:46.155734+0000 front 2019-11-29T21:29:46.412030+0000 (oldest deadline 2019-11-29T21:30:31.066202+0000) 2019-11-29T21:30:51.302 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:30:51.296+0000 1694c700 -1 osd.4 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:50.704244+0000 front 2019-11-29T21:29:47.846787+0000 (oldest deadline 2019-11-29T21:30:30.517643+0000) 2019-11-29T21:30:51.541 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:30:51.535+0000 1694c700 -1 osd.7 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:49.202039+0000 front 2019-11-29T21:29:49.379035+0000 (oldest deadline 2019-11-29T21:30:31.477297+0000) 2019-11-29T21:30:51.610 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:30:51.605+0000 1694c700 -1 osd.2 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:50.055680+0000 front 2019-11-29T21:29:49.542893+0000 (oldest deadline 2019-11-29T21:30:33.951513+0000) 2019-11-29T21:30:51.676 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:30:51.671+0000 1694c700 -1 osd.5 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:30:09.887215+0000 (oldest deadline 2019-11-29T21:30:49.887215+0000) 2019-11-29T21:30:51.679 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:30:51.675+0000 1694c700 -1 osd.5 348 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e345) 2019-11-29T21:30:51.853 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:30:51.848+0000 1694c700 -1 osd.0 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:46.155734+0000 front 2019-11-29T21:29:46.412030+0000 (oldest deadline 2019-11-29T21:30:31.066202+0000) 2019-11-29T21:30:52.269 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:30:52.263+0000 1694c700 -1 osd.4 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:50.704244+0000 front 2019-11-29T21:29:47.846787+0000 (oldest deadline 2019-11-29T21:30:30.517643+0000) 2019-11-29T21:30:52.540 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:30:52.534+0000 1694c700 -1 osd.7 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:49.202039+0000 front 2019-11-29T21:29:49.379035+0000 (oldest deadline 2019-11-29T21:30:31.477297+0000) 2019-11-29T21:30:52.580 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:30:52.574+0000 1694c700 -1 osd.2 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:50.055680+0000 front 2019-11-29T21:29:49.542893+0000 (oldest deadline 2019-11-29T21:30:33.951513+0000) 2019-11-29T21:30:52.637 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:30:52.632+0000 1694c700 -1 osd.5 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:30:09.887215+0000 (oldest deadline 2019-11-29T21:30:49.887215+0000) 2019-11-29T21:30:52.639 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:30:52.635+0000 1694c700 -1 osd.5 348 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e345) 2019-11-29T21:30:52.823 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:30:52.817+0000 1694c700 -1 osd.0 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:46.155734+0000 front 2019-11-29T21:29:46.412030+0000 (oldest deadline 2019-11-29T21:30:31.066202+0000) 2019-11-29T21:30:53.276 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:30:53.270+0000 1694c700 -1 osd.4 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:50.704244+0000 front 2019-11-29T21:29:47.846787+0000 (oldest deadline 2019-11-29T21:30:30.517643+0000) 2019-11-29T21:30:53.498 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:30:53.493+0000 1694c700 -1 osd.7 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:49.202039+0000 front 2019-11-29T21:29:49.379035+0000 (oldest deadline 2019-11-29T21:30:31.477297+0000) 2019-11-29T21:30:53.604 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:30:53.599+0000 1694c700 -1 osd.2 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:50.055680+0000 front 2019-11-29T21:29:49.542893+0000 (oldest deadline 2019-11-29T21:30:33.951513+0000) 2019-11-29T21:30:53.674 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:30:53.668+0000 1694c700 -1 osd.5 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:30:09.887215+0000 (oldest deadline 2019-11-29T21:30:49.887215+0000) 2019-11-29T21:30:53.675 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:30:53.670+0000 1694c700 -1 osd.5 348 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e345) 2019-11-29T21:30:53.817 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:30:53.811+0000 1694c700 -1 osd.0 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:46.155734+0000 front 2019-11-29T21:29:46.412030+0000 (oldest deadline 2019-11-29T21:30:31.066202+0000) 2019-11-29T21:30:54.292 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:30:54.277+0000 1694c700 -1 osd.4 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:50.704244+0000 front 2019-11-29T21:29:47.846787+0000 (oldest deadline 2019-11-29T21:30:30.517643+0000) 2019-11-29T21:30:54.523 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:30:54.517+0000 1694c700 -1 osd.7 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:49.202039+0000 front 2019-11-29T21:29:49.379035+0000 (oldest deadline 2019-11-29T21:30:31.477297+0000) 2019-11-29T21:30:54.577 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:30:54.572+0000 1694c700 -1 osd.2 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:50.055680+0000 front 2019-11-29T21:29:49.542893+0000 (oldest deadline 2019-11-29T21:30:33.951513+0000) 2019-11-29T21:30:54.675 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:30:54.669+0000 1694c700 -1 osd.5 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:30:09.887215+0000 (oldest deadline 2019-11-29T21:30:49.887215+0000) 2019-11-29T21:30:54.676 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:30:54.671+0000 1694c700 -1 osd.5 348 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e345) 2019-11-29T21:30:54.806 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:30:54.799+0000 1694c700 -1 osd.0 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:46.155734+0000 front 2019-11-29T21:29:46.412030+0000 (oldest deadline 2019-11-29T21:30:31.066202+0000) 2019-11-29T21:30:55.267 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:30:55.261+0000 1694c700 -1 osd.4 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:50.704244+0000 front 2019-11-29T21:29:47.846787+0000 (oldest deadline 2019-11-29T21:30:30.517643+0000) 2019-11-29T21:30:55.555 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:30:55.549+0000 1694c700 -1 osd.2 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:50.055680+0000 front 2019-11-29T21:29:49.542893+0000 (oldest deadline 2019-11-29T21:30:33.951513+0000) 2019-11-29T21:30:55.571 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:30:55.565+0000 1694c700 -1 osd.7 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:49.202039+0000 front 2019-11-29T21:29:49.379035+0000 (oldest deadline 2019-11-29T21:30:31.477297+0000) 2019-11-29T21:30:55.676 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:30:55.669+0000 1694c700 -1 osd.5 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:30:09.887215+0000 (oldest deadline 2019-11-29T21:30:49.887215+0000) 2019-11-29T21:30:55.677 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:30:55.672+0000 1694c700 -1 osd.5 348 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e345) 2019-11-29T21:30:55.761 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:30:55.754+0000 1694c700 -1 osd.0 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:46.155734+0000 front 2019-11-29T21:29:46.412030+0000 (oldest deadline 2019-11-29T21:30:31.066202+0000) 2019-11-29T21:30:56.261 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:30:56.255+0000 1694c700 -1 osd.4 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:50.704244+0000 front 2019-11-29T21:29:47.846787+0000 (oldest deadline 2019-11-29T21:30:30.517643+0000) 2019-11-29T21:30:56.572 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:30:56.565+0000 1694c700 -1 osd.2 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:50.055680+0000 front 2019-11-29T21:29:49.542893+0000 (oldest deadline 2019-11-29T21:30:33.951513+0000) 2019-11-29T21:30:56.605 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:30:56.600+0000 1694c700 -1 osd.7 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:49.202039+0000 front 2019-11-29T21:29:49.379035+0000 (oldest deadline 2019-11-29T21:30:31.477297+0000) 2019-11-29T21:30:56.708 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:30:56.701+0000 1694c700 -1 osd.5 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:30:09.887215+0000 (oldest deadline 2019-11-29T21:30:49.887215+0000) 2019-11-29T21:30:56.709 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:30:56.704+0000 1694c700 -1 osd.5 348 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e345) 2019-11-29T21:30:56.731 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:30:56.725+0000 1694c700 -1 osd.0 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:46.155734+0000 front 2019-11-29T21:29:46.412030+0000 (oldest deadline 2019-11-29T21:30:31.066202+0000) 2019-11-29T21:30:57.243 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:30:57.237+0000 1694c700 -1 osd.4 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:50.704244+0000 front 2019-11-29T21:29:47.846787+0000 (oldest deadline 2019-11-29T21:30:30.517643+0000) 2019-11-29T21:30:57.561 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:30:57.556+0000 1694c700 -1 osd.2 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:50.055680+0000 front 2019-11-29T21:29:49.542893+0000 (oldest deadline 2019-11-29T21:30:33.951513+0000) 2019-11-29T21:30:57.637 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:30:57.629+0000 1694c700 -1 osd.7 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:49.202039+0000 front 2019-11-29T21:29:49.379035+0000 (oldest deadline 2019-11-29T21:30:31.477297+0000) 2019-11-29T21:30:57.692 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:30:57.685+0000 1694c700 -1 osd.0 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:46.155734+0000 front 2019-11-29T21:29:46.412030+0000 (oldest deadline 2019-11-29T21:30:31.066202+0000) 2019-11-29T21:30:57.758 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:30:57.751+0000 1694c700 -1 osd.5 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:30:09.887215+0000 (oldest deadline 2019-11-29T21:30:49.887215+0000) 2019-11-29T21:30:57.759 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:30:57.754+0000 1694c700 -1 osd.5 348 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e345) 2019-11-29T21:30:58.209 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:30:58.203+0000 1694c700 -1 osd.4 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:50.704244+0000 front 2019-11-29T21:29:47.846787+0000 (oldest deadline 2019-11-29T21:30:30.517643+0000) 2019-11-29T21:30:58.552 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:30:58.546+0000 1694c700 -1 osd.2 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:50.055680+0000 front 2019-11-29T21:29:49.542893+0000 (oldest deadline 2019-11-29T21:30:33.951513+0000) 2019-11-29T21:30:58.640 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:30:58.634+0000 1694c700 -1 osd.7 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:49.202039+0000 front 2019-11-29T21:29:49.379035+0000 (oldest deadline 2019-11-29T21:30:31.477297+0000) 2019-11-29T21:30:58.658 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:30:58.653+0000 1694c700 -1 osd.0 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:46.155734+0000 front 2019-11-29T21:29:46.412030+0000 (oldest deadline 2019-11-29T21:30:31.066202+0000) 2019-11-29T21:30:58.747 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:30:58.740+0000 1694c700 -1 osd.5 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:30:09.887215+0000 (oldest deadline 2019-11-29T21:30:49.887215+0000) 2019-11-29T21:30:58.751 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:30:58.743+0000 1694c700 -1 osd.5 348 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e345) 2019-11-29T21:30:59.180 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:30:59.175+0000 1694c700 -1 osd.4 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:50.704244+0000 front 2019-11-29T21:29:47.846787+0000 (oldest deadline 2019-11-29T21:30:30.517643+0000) 2019-11-29T21:30:59.573 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:30:59.566+0000 1694c700 -1 osd.2 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:50.055680+0000 front 2019-11-29T21:29:49.542893+0000 (oldest deadline 2019-11-29T21:30:33.951513+0000) 2019-11-29T21:30:59.637 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:30:59.628+0000 1694c700 -1 osd.7 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:49.202039+0000 front 2019-11-29T21:29:49.379035+0000 (oldest deadline 2019-11-29T21:30:31.477297+0000) 2019-11-29T21:30:59.687 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:30:59.680+0000 1694c700 -1 osd.0 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:46.155734+0000 front 2019-11-29T21:29:46.412030+0000 (oldest deadline 2019-11-29T21:30:31.066202+0000) 2019-11-29T21:30:59.735 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:30:59.729+0000 1694c700 -1 osd.5 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:30:09.887215+0000 (oldest deadline 2019-11-29T21:30:49.887215+0000) 2019-11-29T21:30:59.739 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:30:59.734+0000 1694c700 -1 osd.5 348 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e345) 2019-11-29T21:31:00.180 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:31:00.173+0000 1694c700 -1 osd.4 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:50.704244+0000 front 2019-11-29T21:29:47.846787+0000 (oldest deadline 2019-11-29T21:30:30.517643+0000) 2019-11-29T21:31:00.615 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:31:00.610+0000 1694c700 -1 osd.2 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:50.055680+0000 front 2019-11-29T21:29:49.542893+0000 (oldest deadline 2019-11-29T21:30:33.951513+0000) 2019-11-29T21:31:00.669 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:31:00.664+0000 1694c700 -1 osd.7 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:49.202039+0000 front 2019-11-29T21:29:49.379035+0000 (oldest deadline 2019-11-29T21:30:31.477297+0000) 2019-11-29T21:31:00.693 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:31:00.687+0000 1694c700 -1 osd.0 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:46.155734+0000 front 2019-11-29T21:29:46.412030+0000 (oldest deadline 2019-11-29T21:30:31.066202+0000) 2019-11-29T21:31:00.704 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:31:00.693+0000 1694c700 -1 osd.5 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:30:09.887215+0000 (oldest deadline 2019-11-29T21:30:49.887215+0000) 2019-11-29T21:31:00.707 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:31:00.695+0000 1694c700 -1 osd.5 348 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e345) 2019-11-29T21:31:01.179 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:31:01.174+0000 1694c700 -1 osd.4 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:50.704244+0000 front 2019-11-29T21:29:47.846787+0000 (oldest deadline 2019-11-29T21:30:30.517643+0000) 2019-11-29T21:31:01.609 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:31:01.599+0000 1694c700 -1 osd.2 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:50.055680+0000 front 2019-11-29T21:29:49.542893+0000 (oldest deadline 2019-11-29T21:30:33.951513+0000) 2019-11-29T21:31:01.639 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:31:01.635+0000 1694c700 -1 osd.7 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:49.202039+0000 front 2019-11-29T21:29:49.379035+0000 (oldest deadline 2019-11-29T21:30:31.477297+0000) 2019-11-29T21:31:01.663 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:31:01.657+0000 1694c700 -1 osd.5 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:30:09.887215+0000 (oldest deadline 2019-11-29T21:30:49.887215+0000) 2019-11-29T21:31:01.663 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:31:01.659+0000 1694c700 -1 osd.5 348 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e345) 2019-11-29T21:31:01.720 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:31:01.714+0000 1694c700 -1 osd.0 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:46.155734+0000 front 2019-11-29T21:29:46.412030+0000 (oldest deadline 2019-11-29T21:30:31.066202+0000) 2019-11-29T21:31:02.221 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:31:02.215+0000 1694c700 -1 osd.4 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:50.704244+0000 front 2019-11-29T21:29:47.846787+0000 (oldest deadline 2019-11-29T21:30:30.517643+0000) 2019-11-29T21:31:02.596 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:31:02.590+0000 1694c700 -1 osd.7 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:49.202039+0000 front 2019-11-29T21:29:49.379035+0000 (oldest deadline 2019-11-29T21:30:31.477297+0000) 2019-11-29T21:31:02.601 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:31:02.595+0000 1694c700 -1 osd.2 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:50.055680+0000 front 2019-11-29T21:29:49.542893+0000 (oldest deadline 2019-11-29T21:30:33.951513+0000) 2019-11-29T21:31:02.711 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:31:02.699+0000 1694c700 -1 osd.0 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:46.155734+0000 front 2019-11-29T21:29:46.412030+0000 (oldest deadline 2019-11-29T21:30:31.066202+0000) 2019-11-29T21:31:02.717 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:31:02.710+0000 1694c700 -1 osd.5 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:30:09.887215+0000 (oldest deadline 2019-11-29T21:30:49.887215+0000) 2019-11-29T21:31:02.718 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:31:02.713+0000 1694c700 -1 osd.5 348 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e345) 2019-11-29T21:31:03.189 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:31:03.185+0000 1694c700 -1 osd.4 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:50.704244+0000 front 2019-11-29T21:29:47.846787+0000 (oldest deadline 2019-11-29T21:30:30.517643+0000) 2019-11-29T21:31:03.602 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:31:03.596+0000 1694c700 -1 osd.7 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:49.202039+0000 front 2019-11-29T21:29:49.379035+0000 (oldest deadline 2019-11-29T21:30:31.477297+0000) 2019-11-29T21:31:03.620 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:31:03.615+0000 1694c700 -1 osd.2 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:50.055680+0000 front 2019-11-29T21:29:49.542893+0000 (oldest deadline 2019-11-29T21:30:33.951513+0000) 2019-11-29T21:31:03.755 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:31:03.748+0000 1694c700 -1 osd.5 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:30:09.887215+0000 (oldest deadline 2019-11-29T21:30:49.887215+0000) 2019-11-29T21:31:03.756 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:31:03.750+0000 1694c700 -1 osd.0 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:46.155734+0000 front 2019-11-29T21:29:46.412030+0000 (oldest deadline 2019-11-29T21:30:31.066202+0000) 2019-11-29T21:31:03.756 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:31:03.751+0000 1694c700 -1 osd.5 348 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e345) 2019-11-29T21:31:04.165 INFO:tasks.ceph.mon.b.smithi022.stderr:2019-11-29T21:31:04.159+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.1 [v2:172.21.15.62:6800/10370,v1:172.21.15.62:6801/10370] for 43sec e348 v348) 2019-11-29T21:31:04.197 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:31:04.192+0000 1694c700 -1 osd.4 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:50.704244+0000 front 2019-11-29T21:29:47.846787+0000 (oldest deadline 2019-11-29T21:30:30.517643+0000) 2019-11-29T21:31:04.591 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:31:04.584+0000 1694c700 -1 osd.7 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:49.202039+0000 front 2019-11-29T21:29:49.379035+0000 (oldest deadline 2019-11-29T21:30:31.477297+0000) 2019-11-29T21:31:04.626 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:31:04.620+0000 1694c700 -1 osd.2 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:50.055680+0000 front 2019-11-29T21:29:49.542893+0000 (oldest deadline 2019-11-29T21:30:33.951513+0000) 2019-11-29T21:31:04.716 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:31:04.711+0000 1694c700 -1 osd.0 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:46.155734+0000 front 2019-11-29T21:29:46.412030+0000 (oldest deadline 2019-11-29T21:30:31.066202+0000) 2019-11-29T21:31:04.775 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:31:04.769+0000 1694c700 -1 osd.5 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:30:09.887215+0000 (oldest deadline 2019-11-29T21:30:49.887215+0000) 2019-11-29T21:31:04.779 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:31:04.775+0000 1694c700 -1 osd.5 348 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e345) 2019-11-29T21:31:05.189 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:31:05.183+0000 1694c700 -1 osd.4 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:50.704244+0000 front 2019-11-29T21:29:47.846787+0000 (oldest deadline 2019-11-29T21:30:30.517643+0000) 2019-11-29T21:31:05.592 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:31:05.585+0000 1694c700 -1 osd.7 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:49.202039+0000 front 2019-11-29T21:29:49.379035+0000 (oldest deadline 2019-11-29T21:30:31.477297+0000) 2019-11-29T21:31:05.598 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:31:05.592+0000 1694c700 -1 osd.2 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:50.055680+0000 front 2019-11-29T21:29:49.542893+0000 (oldest deadline 2019-11-29T21:30:33.951513+0000) 2019-11-29T21:31:05.713 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:31:05.697+0000 1694c700 -1 osd.0 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:46.155734+0000 front 2019-11-29T21:29:46.412030+0000 (oldest deadline 2019-11-29T21:30:31.066202+0000) 2019-11-29T21:31:05.795 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:31:05.789+0000 1694c700 -1 osd.5 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:30:09.887215+0000 (oldest deadline 2019-11-29T21:30:49.887215+0000) 2019-11-29T21:31:05.796 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:31:05.791+0000 1694c700 -1 osd.5 348 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e345) 2019-11-29T21:31:06.184 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:31:06.178+0000 1694c700 -1 osd.4 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:50.704244+0000 front 2019-11-29T21:29:47.846787+0000 (oldest deadline 2019-11-29T21:30:30.517643+0000) 2019-11-29T21:31:06.576 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:31:06.570+0000 1694c700 -1 osd.7 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:49.202039+0000 front 2019-11-29T21:29:49.379035+0000 (oldest deadline 2019-11-29T21:30:31.477297+0000) 2019-11-29T21:31:06.639 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:31:06.634+0000 1694c700 -1 osd.2 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:50.055680+0000 front 2019-11-29T21:29:49.542893+0000 (oldest deadline 2019-11-29T21:30:33.951513+0000) 2019-11-29T21:31:06.674 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:31:06.670+0000 1694c700 -1 osd.0 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:46.155734+0000 front 2019-11-29T21:29:46.412030+0000 (oldest deadline 2019-11-29T21:30:31.066202+0000) 2019-11-29T21:31:06.780 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:31:06.772+0000 1694c700 -1 osd.5 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:30:09.887215+0000 (oldest deadline 2019-11-29T21:30:49.887215+0000) 2019-11-29T21:31:06.781 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:31:06.775+0000 1694c700 -1 osd.5 348 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e345) 2019-11-29T21:31:07.168 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:31:07.162+0000 1694c700 -1 osd.4 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:50.704244+0000 front 2019-11-29T21:29:47.846787+0000 (oldest deadline 2019-11-29T21:30:30.517643+0000) 2019-11-29T21:31:07.617 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:31:07.611+0000 1694c700 -1 osd.7 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:49.202039+0000 front 2019-11-29T21:29:49.379035+0000 (oldest deadline 2019-11-29T21:30:31.477297+0000) 2019-11-29T21:31:07.669 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:31:07.664+0000 1694c700 -1 osd.2 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:50.055680+0000 front 2019-11-29T21:29:49.542893+0000 (oldest deadline 2019-11-29T21:30:33.951513+0000) 2019-11-29T21:31:07.685 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:31:07.674+0000 1694c700 -1 osd.0 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:46.155734+0000 front 2019-11-29T21:29:46.412030+0000 (oldest deadline 2019-11-29T21:30:31.066202+0000) 2019-11-29T21:31:07.810 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:31:07.803+0000 1694c700 -1 osd.5 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:30:09.887215+0000 (oldest deadline 2019-11-29T21:30:49.887215+0000) 2019-11-29T21:31:07.811 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:31:07.805+0000 1694c700 -1 osd.5 348 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e345) 2019-11-29T21:31:08.190 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:31:08.180+0000 1694c700 -1 osd.4 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:50.704244+0000 front 2019-11-29T21:29:47.846787+0000 (oldest deadline 2019-11-29T21:30:30.517643+0000) 2019-11-29T21:31:08.624 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:31:08.618+0000 1694c700 -1 osd.7 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:49.202039+0000 front 2019-11-29T21:29:49.379035+0000 (oldest deadline 2019-11-29T21:30:31.477297+0000) 2019-11-29T21:31:08.636 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:31:08.630+0000 1694c700 -1 osd.2 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:50.055680+0000 front 2019-11-29T21:29:49.542893+0000 (oldest deadline 2019-11-29T21:30:33.951513+0000) 2019-11-29T21:31:08.666 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:31:08.660+0000 1694c700 -1 osd.0 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:46.155734+0000 front 2019-11-29T21:29:46.412030+0000 (oldest deadline 2019-11-29T21:30:31.066202+0000) 2019-11-29T21:31:08.842 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:31:08.836+0000 1694c700 -1 osd.5 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:30:09.887215+0000 (oldest deadline 2019-11-29T21:30:49.887215+0000) 2019-11-29T21:31:08.846 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:31:08.841+0000 1694c700 -1 osd.5 348 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e345) 2019-11-29T21:31:09.186 INFO:tasks.ceph.mon.b.smithi022.stderr:2019-11-29T21:31:09.179+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 4 slow ops, oldest is osd_failure(failed timeout osd.1 [v2:172.21.15.62:6800/10370,v1:172.21.15.62:6801/10370] for 43sec e348 v348) 2019-11-29T21:31:09.210 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:31:09.204+0000 1694c700 -1 osd.4 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:50.704244+0000 front 2019-11-29T21:29:47.846787+0000 (oldest deadline 2019-11-29T21:30:30.517643+0000) 2019-11-29T21:31:09.598 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:31:09.593+0000 1694c700 -1 osd.7 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:49.202039+0000 front 2019-11-29T21:29:49.379035+0000 (oldest deadline 2019-11-29T21:30:31.477297+0000) 2019-11-29T21:31:09.618 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:31:09.614+0000 1694c700 -1 osd.2 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:50.055680+0000 front 2019-11-29T21:29:49.542893+0000 (oldest deadline 2019-11-29T21:30:33.951513+0000) 2019-11-29T21:31:09.693 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:31:09.689+0000 1694c700 -1 osd.0 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:46.155734+0000 front 2019-11-29T21:29:46.412030+0000 (oldest deadline 2019-11-29T21:30:31.066202+0000) 2019-11-29T21:31:09.845 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:31:09.839+0000 1694c700 -1 osd.5 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:30:09.887215+0000 (oldest deadline 2019-11-29T21:30:49.887215+0000) 2019-11-29T21:31:09.846 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:31:09.841+0000 1694c700 -1 osd.5 348 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e345) 2019-11-29T21:31:10.169 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:31:10.164+0000 1694c700 -1 osd.4 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:50.704244+0000 front 2019-11-29T21:29:47.846787+0000 (oldest deadline 2019-11-29T21:30:30.517643+0000) 2019-11-29T21:31:10.614 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:31:10.609+0000 1694c700 -1 osd.7 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:49.202039+0000 front 2019-11-29T21:29:49.379035+0000 (oldest deadline 2019-11-29T21:30:31.477297+0000) 2019-11-29T21:31:10.669 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:31:10.665+0000 1694c700 -1 osd.2 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:50.055680+0000 front 2019-11-29T21:29:49.542893+0000 (oldest deadline 2019-11-29T21:30:33.951513+0000) 2019-11-29T21:31:10.715 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:31:10.709+0000 1694c700 -1 osd.0 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:46.155734+0000 front 2019-11-29T21:29:46.412030+0000 (oldest deadline 2019-11-29T21:30:31.066202+0000) 2019-11-29T21:31:10.829 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:31:10.822+0000 1694c700 -1 osd.5 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:30:09.887215+0000 (oldest deadline 2019-11-29T21:30:49.887215+0000) 2019-11-29T21:31:10.829 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:31:10.825+0000 1694c700 -1 osd.5 348 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e345) 2019-11-29T21:31:11.151 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:31:11.147+0000 1694c700 -1 osd.4 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:50.704244+0000 front 2019-11-29T21:29:47.846787+0000 (oldest deadline 2019-11-29T21:30:30.517643+0000) 2019-11-29T21:31:11.612 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:31:11.605+0000 1694c700 -1 osd.7 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:49.202039+0000 front 2019-11-29T21:29:49.379035+0000 (oldest deadline 2019-11-29T21:30:31.477297+0000) 2019-11-29T21:31:11.686 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:31:11.680+0000 1694c700 -1 osd.2 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:50.055680+0000 front 2019-11-29T21:29:49.542893+0000 (oldest deadline 2019-11-29T21:30:33.951513+0000) 2019-11-29T21:31:11.750 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:31:11.745+0000 1694c700 -1 osd.0 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:46.155734+0000 front 2019-11-29T21:29:46.412030+0000 (oldest deadline 2019-11-29T21:30:31.066202+0000) 2019-11-29T21:31:11.816 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:31:11.810+0000 1694c700 -1 osd.5 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:30:09.887215+0000 (oldest deadline 2019-11-29T21:30:49.887215+0000) 2019-11-29T21:31:11.817 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:31:11.812+0000 1694c700 -1 osd.5 348 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e345) 2019-11-29T21:31:12.183 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:31:12.177+0000 1694c700 -1 osd.4 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:50.704244+0000 front 2019-11-29T21:29:47.846787+0000 (oldest deadline 2019-11-29T21:30:30.517643+0000) 2019-11-29T21:31:12.584 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:31:12.578+0000 1694c700 -1 osd.7 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:49.202039+0000 front 2019-11-29T21:29:49.379035+0000 (oldest deadline 2019-11-29T21:30:31.477297+0000) 2019-11-29T21:31:12.684 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:31:12.679+0000 1694c700 -1 osd.2 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:50.055680+0000 front 2019-11-29T21:29:49.542893+0000 (oldest deadline 2019-11-29T21:30:33.951513+0000) 2019-11-29T21:31:12.777 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:31:12.771+0000 1694c700 -1 osd.0 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:46.155734+0000 front 2019-11-29T21:29:46.412030+0000 (oldest deadline 2019-11-29T21:30:31.066202+0000) 2019-11-29T21:31:12.789 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:31:12.782+0000 1694c700 -1 osd.5 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:30:09.887215+0000 (oldest deadline 2019-11-29T21:30:49.887215+0000) 2019-11-29T21:31:12.790 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:31:12.785+0000 1694c700 -1 osd.5 348 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e345) 2019-11-29T21:31:13.195 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:31:13.189+0000 1694c700 -1 osd.4 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:50.704244+0000 front 2019-11-29T21:29:47.846787+0000 (oldest deadline 2019-11-29T21:30:30.517643+0000) 2019-11-29T21:31:13.547 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:31:13.540+0000 1694c700 -1 osd.7 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:49.202039+0000 front 2019-11-29T21:29:49.379035+0000 (oldest deadline 2019-11-29T21:30:31.477297+0000) 2019-11-29T21:31:13.652 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:31:13.646+0000 1694c700 -1 osd.2 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:50.055680+0000 front 2019-11-29T21:29:49.542893+0000 (oldest deadline 2019-11-29T21:30:33.951513+0000) 2019-11-29T21:31:13.781 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:31:13.776+0000 1694c700 -1 osd.0 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:46.155734+0000 front 2019-11-29T21:29:46.412030+0000 (oldest deadline 2019-11-29T21:30:31.066202+0000) 2019-11-29T21:31:13.831 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:31:13.826+0000 1694c700 -1 osd.5 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:30:09.887215+0000 (oldest deadline 2019-11-29T21:30:49.887215+0000) 2019-11-29T21:31:13.835 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:31:13.831+0000 1694c700 -1 osd.5 348 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e345) 2019-11-29T21:31:14.220 INFO:tasks.ceph.mon.b.smithi022.stderr:2019-11-29T21:31:14.216+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 4 slow ops, oldest is osd_failure(failed timeout osd.1 [v2:172.21.15.62:6800/10370,v1:172.21.15.62:6801/10370] for 43sec e348 v348) 2019-11-29T21:31:14.232 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:31:14.227+0000 1694c700 -1 osd.4 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:50.704244+0000 front 2019-11-29T21:29:47.846787+0000 (oldest deadline 2019-11-29T21:30:30.517643+0000) 2019-11-29T21:31:14.518 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:31:14.514+0000 1694c700 -1 osd.7 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:49.202039+0000 front 2019-11-29T21:29:49.379035+0000 (oldest deadline 2019-11-29T21:30:31.477297+0000) 2019-11-29T21:31:14.660 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:31:14.655+0000 1694c700 -1 osd.2 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:50.055680+0000 front 2019-11-29T21:29:49.542893+0000 (oldest deadline 2019-11-29T21:30:33.951513+0000) 2019-11-29T21:31:14.776 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:31:14.770+0000 1694c700 -1 osd.0 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:46.155734+0000 front 2019-11-29T21:29:46.412030+0000 (oldest deadline 2019-11-29T21:30:31.066202+0000) 2019-11-29T21:31:14.806 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:31:14.799+0000 1694c700 -1 osd.5 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:30:09.887215+0000 (oldest deadline 2019-11-29T21:30:49.887215+0000) 2019-11-29T21:31:14.807 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:31:14.802+0000 1694c700 -1 osd.5 348 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e345) 2019-11-29T21:31:15.216 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:31:15.210+0000 1694c700 -1 osd.4 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:50.704244+0000 front 2019-11-29T21:29:47.846787+0000 (oldest deadline 2019-11-29T21:30:30.517643+0000) 2019-11-29T21:31:15.563 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:31:15.557+0000 1694c700 -1 osd.7 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:49.202039+0000 front 2019-11-29T21:29:49.379035+0000 (oldest deadline 2019-11-29T21:30:31.477297+0000) 2019-11-29T21:31:15.652 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:31:15.646+0000 1694c700 -1 osd.2 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:50.055680+0000 front 2019-11-29T21:29:49.542893+0000 (oldest deadline 2019-11-29T21:30:33.951513+0000) 2019-11-29T21:31:15.748 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:31:15.741+0000 1694c700 -1 osd.0 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:46.155734+0000 front 2019-11-29T21:29:46.412030+0000 (oldest deadline 2019-11-29T21:30:31.066202+0000) 2019-11-29T21:31:15.777 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:31:15.771+0000 1694c700 -1 osd.5 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:30:09.887215+0000 (oldest deadline 2019-11-29T21:30:49.887215+0000) 2019-11-29T21:31:15.778 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:31:15.773+0000 1694c700 -1 osd.5 348 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e345) 2019-11-29T21:31:16.249 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:31:16.242+0000 1694c700 -1 osd.4 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:50.704244+0000 front 2019-11-29T21:29:47.846787+0000 (oldest deadline 2019-11-29T21:30:30.517643+0000) 2019-11-29T21:31:16.584 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:31:16.577+0000 1694c700 -1 osd.7 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:49.202039+0000 front 2019-11-29T21:29:49.379035+0000 (oldest deadline 2019-11-29T21:30:31.477297+0000) 2019-11-29T21:31:16.690 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:31:16.684+0000 1694c700 -1 osd.2 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:50.055680+0000 front 2019-11-29T21:29:49.542893+0000 (oldest deadline 2019-11-29T21:30:33.951513+0000) 2019-11-29T21:31:16.732 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:31:16.725+0000 1694c700 -1 osd.0 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:46.155734+0000 front 2019-11-29T21:29:46.412030+0000 (oldest deadline 2019-11-29T21:30:31.066202+0000) 2019-11-29T21:31:16.805 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:31:16.798+0000 1694c700 -1 osd.5 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:30:09.887215+0000 (oldest deadline 2019-11-29T21:30:49.887215+0000) 2019-11-29T21:31:16.806 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:31:16.801+0000 1694c700 -1 osd.5 348 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e345) 2019-11-29T21:31:17.206 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:31:17.199+0000 1694c700 -1 osd.4 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:50.704244+0000 front 2019-11-29T21:29:47.846787+0000 (oldest deadline 2019-11-29T21:30:30.517643+0000) 2019-11-29T21:31:17.614 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:31:17.609+0000 1694c700 -1 osd.7 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:49.202039+0000 front 2019-11-29T21:29:49.379035+0000 (oldest deadline 2019-11-29T21:30:31.477297+0000) 2019-11-29T21:31:17.682 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:31:17.677+0000 1694c700 -1 osd.2 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:50.055680+0000 front 2019-11-29T21:29:49.542893+0000 (oldest deadline 2019-11-29T21:30:33.951513+0000) 2019-11-29T21:31:17.686 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:31:17.681+0000 1694c700 -1 osd.0 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:46.155734+0000 front 2019-11-29T21:29:46.412030+0000 (oldest deadline 2019-11-29T21:30:31.066202+0000) 2019-11-29T21:31:17.851 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:31:17.845+0000 1694c700 -1 osd.5 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:30:09.887215+0000 (oldest deadline 2019-11-29T21:30:49.887215+0000) 2019-11-29T21:31:17.854 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:31:17.850+0000 1694c700 -1 osd.5 348 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e345) 2019-11-29T21:31:18.179 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:31:18.173+0000 1694c700 -1 osd.4 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:50.704244+0000 front 2019-11-29T21:29:47.846787+0000 (oldest deadline 2019-11-29T21:30:30.517643+0000) 2019-11-29T21:31:18.629 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:31:18.623+0000 1694c700 -1 osd.7 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:49.202039+0000 front 2019-11-29T21:29:49.379035+0000 (oldest deadline 2019-11-29T21:30:31.477297+0000) 2019-11-29T21:31:18.682 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:31:18.677+0000 1694c700 -1 osd.2 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:50.055680+0000 front 2019-11-29T21:29:49.542893+0000 (oldest deadline 2019-11-29T21:30:33.951513+0000) 2019-11-29T21:31:18.696 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:31:18.691+0000 1694c700 -1 osd.0 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:46.155734+0000 front 2019-11-29T21:29:46.412030+0000 (oldest deadline 2019-11-29T21:30:31.066202+0000) 2019-11-29T21:31:18.901 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:31:18.895+0000 1694c700 -1 osd.5 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:30:09.887215+0000 (oldest deadline 2019-11-29T21:30:49.887215+0000) 2019-11-29T21:31:18.907 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:31:18.903+0000 1694c700 -1 osd.5 348 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e345) 2019-11-29T21:31:18.962 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:31:18.956+0000 1694c700 -1 osd.6 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:50.204863+0000 front 2019-11-29T21:29:50.212333+0000 (oldest deadline 2019-11-29T21:31:18.133884+0000) 2019-11-29T21:31:19.158 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:31:19.153+0000 1694c700 -1 osd.4 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:50.704244+0000 front 2019-11-29T21:29:47.846787+0000 (oldest deadline 2019-11-29T21:30:30.517643+0000) 2019-11-29T21:31:19.232 INFO:tasks.ceph.mon.b.smithi022.stderr:2019-11-29T21:31:19.227+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 4 slow ops, oldest is osd_failure(failed timeout osd.1 [v2:172.21.15.62:6800/10370,v1:172.21.15.62:6801/10370] for 43sec e348 v348) 2019-11-29T21:31:19.641 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:31:19.637+0000 1694c700 -1 osd.2 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:50.055680+0000 front 2019-11-29T21:29:49.542893+0000 (oldest deadline 2019-11-29T21:30:33.951513+0000) 2019-11-29T21:31:19.669 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:31:19.663+0000 1694c700 -1 osd.7 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:49.202039+0000 front 2019-11-29T21:29:49.379035+0000 (oldest deadline 2019-11-29T21:30:31.477297+0000) 2019-11-29T21:31:19.672 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:31:19.667+0000 1694c700 -1 osd.0 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:46.155734+0000 front 2019-11-29T21:29:46.412030+0000 (oldest deadline 2019-11-29T21:30:31.066202+0000) 2019-11-29T21:31:19.894 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:31:19.888+0000 1694c700 -1 osd.5 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:30:09.887215+0000 (oldest deadline 2019-11-29T21:30:49.887215+0000) 2019-11-29T21:31:19.895 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:31:19.890+0000 1694c700 -1 osd.5 348 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e345) 2019-11-29T21:31:19.947 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:31:19.941+0000 1694c700 -1 osd.6 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:50.204863+0000 front 2019-11-29T21:29:50.212333+0000 (oldest deadline 2019-11-29T21:31:18.133884+0000) 2019-11-29T21:31:20.180 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:31:20.174+0000 1694c700 -1 osd.4 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:50.704244+0000 front 2019-11-29T21:29:47.846787+0000 (oldest deadline 2019-11-29T21:30:30.517643+0000) 2019-11-29T21:31:20.631 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:31:20.625+0000 1694c700 -1 osd.2 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:50.055680+0000 front 2019-11-29T21:29:49.542893+0000 (oldest deadline 2019-11-29T21:30:33.951513+0000) 2019-11-29T21:31:20.637 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:31:20.631+0000 1694c700 -1 osd.0 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:46.155734+0000 front 2019-11-29T21:29:46.412030+0000 (oldest deadline 2019-11-29T21:30:31.066202+0000) 2019-11-29T21:31:20.676 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:31:20.670+0000 1694c700 -1 osd.7 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:49.202039+0000 front 2019-11-29T21:29:49.379035+0000 (oldest deadline 2019-11-29T21:30:31.477297+0000) 2019-11-29T21:31:20.906 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:31:20.901+0000 1694c700 -1 osd.5 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:30:09.887215+0000 (oldest deadline 2019-11-29T21:30:49.887215+0000) 2019-11-29T21:31:20.909 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:31:20.905+0000 1694c700 -1 osd.5 348 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e345) 2019-11-29T21:31:20.968 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:31:20.961+0000 1694c700 -1 osd.6 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:50.204863+0000 front 2019-11-29T21:29:50.212333+0000 (oldest deadline 2019-11-29T21:31:18.133884+0000) 2019-11-29T21:31:21.193 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:31:21.188+0000 1694c700 -1 osd.4 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:50.704244+0000 front 2019-11-29T21:29:47.846787+0000 (oldest deadline 2019-11-29T21:30:30.517643+0000) 2019-11-29T21:31:21.604 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:31:21.598+0000 1694c700 -1 osd.0 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:46.155734+0000 front 2019-11-29T21:29:46.412030+0000 (oldest deadline 2019-11-29T21:30:31.066202+0000) 2019-11-29T21:31:21.640 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:31:21.632+0000 1694c700 -1 osd.2 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:50.055680+0000 front 2019-11-29T21:29:49.542893+0000 (oldest deadline 2019-11-29T21:30:33.951513+0000) 2019-11-29T21:31:21.689 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:31:21.683+0000 1694c700 -1 osd.7 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:49.202039+0000 front 2019-11-29T21:29:49.379035+0000 (oldest deadline 2019-11-29T21:30:31.477297+0000) 2019-11-29T21:31:21.911 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:31:21.905+0000 1694c700 -1 osd.5 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:30:09.887215+0000 (oldest deadline 2019-11-29T21:30:49.887215+0000) 2019-11-29T21:31:21.912 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:31:21.908+0000 1694c700 -1 osd.5 348 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e345) 2019-11-29T21:31:21.949 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:31:21.943+0000 1694c700 -1 osd.6 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:50.204863+0000 front 2019-11-29T21:29:50.212333+0000 (oldest deadline 2019-11-29T21:31:18.133884+0000) 2019-11-29T21:31:22.203 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:31:22.197+0000 1694c700 -1 osd.4 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:50.704244+0000 front 2019-11-29T21:29:47.846787+0000 (oldest deadline 2019-11-29T21:30:30.517643+0000) 2019-11-29T21:31:22.583 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:31:22.578+0000 1694c700 -1 osd.0 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:46.155734+0000 front 2019-11-29T21:29:46.412030+0000 (oldest deadline 2019-11-29T21:30:31.066202+0000) 2019-11-29T21:31:22.600 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:31:22.595+0000 1694c700 -1 osd.2 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:50.055680+0000 front 2019-11-29T21:29:49.542893+0000 (oldest deadline 2019-11-29T21:30:33.951513+0000) 2019-11-29T21:31:22.681 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:31:22.675+0000 1694c700 -1 osd.7 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:49.202039+0000 front 2019-11-29T21:29:49.379035+0000 (oldest deadline 2019-11-29T21:30:31.477297+0000) 2019-11-29T21:31:22.904 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:31:22.898+0000 1694c700 -1 osd.5 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:30:09.887215+0000 (oldest deadline 2019-11-29T21:30:49.887215+0000) 2019-11-29T21:31:22.905 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:31:22.900+0000 1694c700 -1 osd.5 348 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e345) 2019-11-29T21:31:22.928 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:31:22.922+0000 1694c700 -1 osd.6 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:50.204863+0000 front 2019-11-29T21:29:50.212333+0000 (oldest deadline 2019-11-29T21:31:18.133884+0000) 2019-11-29T21:31:23.235 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:31:23.229+0000 1694c700 -1 osd.4 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:50.704244+0000 front 2019-11-29T21:29:47.846787+0000 (oldest deadline 2019-11-29T21:30:30.517643+0000) 2019-11-29T21:31:23.575 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:31:23.570+0000 1694c700 -1 osd.2 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:50.055680+0000 front 2019-11-29T21:29:49.542893+0000 (oldest deadline 2019-11-29T21:30:33.951513+0000) 2019-11-29T21:31:23.584 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:31:23.579+0000 1694c700 -1 osd.0 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:46.155734+0000 front 2019-11-29T21:29:46.412030+0000 (oldest deadline 2019-11-29T21:30:31.066202+0000) 2019-11-29T21:31:23.695 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:31:23.689+0000 1694c700 -1 osd.7 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:49.202039+0000 front 2019-11-29T21:29:49.379035+0000 (oldest deadline 2019-11-29T21:30:31.477297+0000) 2019-11-29T21:31:23.889 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:31:23.876+0000 1694c700 -1 osd.5 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:30:09.887215+0000 (oldest deadline 2019-11-29T21:30:49.887215+0000) 2019-11-29T21:31:23.893 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:31:23.886+0000 1694c700 -1 osd.5 348 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e345) 2019-11-29T21:31:23.908 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:31:23.903+0000 1694c700 -1 osd.6 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:50.204863+0000 front 2019-11-29T21:29:50.212333+0000 (oldest deadline 2019-11-29T21:31:18.133884+0000) 2019-11-29T21:31:24.257 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:31:24.252+0000 1694c700 -1 osd.4 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:50.704244+0000 front 2019-11-29T21:29:47.846787+0000 (oldest deadline 2019-11-29T21:30:30.517643+0000) 2019-11-29T21:31:24.303 INFO:tasks.ceph.mon.b.smithi022.stderr:2019-11-29T21:31:24.298+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.1 [v2:172.21.15.62:6800/10370,v1:172.21.15.62:6801/10370] for 43sec e348 v348) 2019-11-29T21:31:24.555 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:31:24.549+0000 1694c700 -1 osd.0 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:46.155734+0000 front 2019-11-29T21:29:46.412030+0000 (oldest deadline 2019-11-29T21:30:31.066202+0000) 2019-11-29T21:31:24.592 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:31:24.587+0000 1694c700 -1 osd.2 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:50.055680+0000 front 2019-11-29T21:29:49.542893+0000 (oldest deadline 2019-11-29T21:30:33.951513+0000) 2019-11-29T21:31:24.689 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:31:24.683+0000 1694c700 -1 osd.7 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:49.202039+0000 front 2019-11-29T21:29:49.379035+0000 (oldest deadline 2019-11-29T21:30:31.477297+0000) 2019-11-29T21:31:24.916 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:31:24.910+0000 1694c700 -1 osd.5 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:30:09.887215+0000 (oldest deadline 2019-11-29T21:30:49.887215+0000) 2019-11-29T21:31:24.919 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:31:24.915+0000 1694c700 -1 osd.5 348 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e345) 2019-11-29T21:31:24.926 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:31:24.921+0000 1694c700 -1 osd.6 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:50.204863+0000 front 2019-11-29T21:29:50.212333+0000 (oldest deadline 2019-11-29T21:31:18.133884+0000) 2019-11-29T21:31:25.248 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:31:25.242+0000 1694c700 -1 osd.4 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:50.704244+0000 front 2019-11-29T21:29:47.846787+0000 (oldest deadline 2019-11-29T21:30:30.517643+0000) 2019-11-29T21:31:25.535 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:31:25.529+0000 1694c700 -1 osd.0 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:46.155734+0000 front 2019-11-29T21:29:46.412030+0000 (oldest deadline 2019-11-29T21:30:31.066202+0000) 2019-11-29T21:31:25.644 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:31:25.638+0000 1694c700 -1 osd.2 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:50.055680+0000 front 2019-11-29T21:29:49.542893+0000 (oldest deadline 2019-11-29T21:30:33.951513+0000) 2019-11-29T21:31:25.671 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:31:25.666+0000 1694c700 -1 osd.7 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:49.202039+0000 front 2019-11-29T21:29:49.379035+0000 (oldest deadline 2019-11-29T21:30:31.477297+0000) 2019-11-29T21:31:25.909 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:31:25.903+0000 1694c700 -1 osd.6 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:50.204863+0000 front 2019-11-29T21:29:50.212333+0000 (oldest deadline 2019-11-29T21:31:18.133884+0000) 2019-11-29T21:31:25.956 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:31:25.949+0000 1694c700 -1 osd.5 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:30:09.887215+0000 (oldest deadline 2019-11-29T21:30:49.887215+0000) 2019-11-29T21:31:25.957 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:31:25.952+0000 1694c700 -1 osd.5 348 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e345) 2019-11-29T21:31:26.241 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:31:26.236+0000 1694c700 -1 osd.4 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:50.704244+0000 front 2019-11-29T21:29:47.846787+0000 (oldest deadline 2019-11-29T21:30:30.517643+0000) 2019-11-29T21:31:26.526 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:31:26.521+0000 1694c700 -1 osd.0 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:46.155734+0000 front 2019-11-29T21:29:46.412030+0000 (oldest deadline 2019-11-29T21:30:31.066202+0000) 2019-11-29T21:31:26.670 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:31:26.663+0000 1694c700 -1 osd.2 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:50.055680+0000 front 2019-11-29T21:29:49.542893+0000 (oldest deadline 2019-11-29T21:30:33.951513+0000) 2019-11-29T21:31:26.690 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:31:26.685+0000 1694c700 -1 osd.7 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:49.202039+0000 front 2019-11-29T21:29:49.379035+0000 (oldest deadline 2019-11-29T21:30:31.477297+0000) 2019-11-29T21:31:26.919 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:31:26.913+0000 1694c700 -1 osd.6 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:50.204863+0000 front 2019-11-29T21:29:50.212333+0000 (oldest deadline 2019-11-29T21:31:18.133884+0000) 2019-11-29T21:31:26.948 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:31:26.942+0000 1694c700 -1 osd.5 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:30:09.887215+0000 (oldest deadline 2019-11-29T21:30:49.887215+0000) 2019-11-29T21:31:26.951 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:31:26.947+0000 1694c700 -1 osd.5 348 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e345) 2019-11-29T21:31:27.215 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:31:27.209+0000 1694c700 -1 osd.4 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:50.704244+0000 front 2019-11-29T21:29:47.846787+0000 (oldest deadline 2019-11-29T21:30:30.517643+0000) 2019-11-29T21:31:27.483 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:31:27.478+0000 1694c700 -1 osd.0 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:46.155734+0000 front 2019-11-29T21:29:46.412030+0000 (oldest deadline 2019-11-29T21:30:31.066202+0000) 2019-11-29T21:31:27.665 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:31:27.660+0000 1694c700 -1 osd.2 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:50.055680+0000 front 2019-11-29T21:29:49.542893+0000 (oldest deadline 2019-11-29T21:30:33.951513+0000) 2019-11-29T21:31:27.723 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:31:27.717+0000 1694c700 -1 osd.7 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:49.202039+0000 front 2019-11-29T21:29:49.379035+0000 (oldest deadline 2019-11-29T21:30:31.477297+0000) 2019-11-29T21:31:27.888 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:31:27.882+0000 1694c700 -1 osd.6 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:50.204863+0000 front 2019-11-29T21:29:50.212333+0000 (oldest deadline 2019-11-29T21:31:18.133884+0000) 2019-11-29T21:31:27.929 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:31:27.924+0000 1694c700 -1 osd.5 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:30:09.887215+0000 (oldest deadline 2019-11-29T21:30:49.887215+0000) 2019-11-29T21:31:27.933 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:31:27.929+0000 1694c700 -1 osd.5 348 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e345) 2019-11-29T21:31:28.191 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:31:28.185+0000 1694c700 -1 osd.4 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:50.704244+0000 front 2019-11-29T21:29:47.846787+0000 (oldest deadline 2019-11-29T21:30:30.517643+0000) 2019-11-29T21:31:28.492 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:31:28.486+0000 1694c700 -1 osd.0 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:46.155734+0000 front 2019-11-29T21:29:46.412030+0000 (oldest deadline 2019-11-29T21:30:31.066202+0000) 2019-11-29T21:31:28.693 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:31:28.688+0000 1694c700 -1 osd.2 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:50.055680+0000 front 2019-11-29T21:29:49.542893+0000 (oldest deadline 2019-11-29T21:30:33.951513+0000) 2019-11-29T21:31:28.732 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:31:28.726+0000 1694c700 -1 osd.7 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:49.202039+0000 front 2019-11-29T21:29:49.379035+0000 (oldest deadline 2019-11-29T21:30:31.477297+0000) 2019-11-29T21:31:28.852 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:31:28.845+0000 1694c700 -1 osd.6 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:50.204863+0000 front 2019-11-29T21:29:50.212333+0000 (oldest deadline 2019-11-29T21:31:18.133884+0000) 2019-11-29T21:31:28.967 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:31:28.960+0000 1694c700 -1 osd.5 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:30:09.887215+0000 (oldest deadline 2019-11-29T21:30:49.887215+0000) 2019-11-29T21:31:28.968 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:31:28.962+0000 1694c700 -1 osd.5 348 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e345) 2019-11-29T21:31:29.171 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:31:29.164+0000 1694c700 -1 osd.4 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:50.704244+0000 front 2019-11-29T21:29:47.846787+0000 (oldest deadline 2019-11-29T21:30:30.517643+0000) 2019-11-29T21:31:29.381 INFO:tasks.ceph.mon.b.smithi022.stderr:2019-11-29T21:31:29.371+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.1 [v2:172.21.15.62:6800/10370,v1:172.21.15.62:6801/10370] for 43sec e348 v348) 2019-11-29T21:31:29.499 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:31:29.495+0000 1694c700 -1 osd.0 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:46.155734+0000 front 2019-11-29T21:29:46.412030+0000 (oldest deadline 2019-11-29T21:30:31.066202+0000) 2019-11-29T21:31:29.660 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:31:29.655+0000 1694c700 -1 osd.2 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:50.055680+0000 front 2019-11-29T21:29:49.542893+0000 (oldest deadline 2019-11-29T21:30:33.951513+0000) 2019-11-29T21:31:29.854 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:31:29.848+0000 1694c700 -1 osd.6 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:50.204863+0000 front 2019-11-29T21:29:50.212333+0000 (oldest deadline 2019-11-29T21:31:18.133884+0000) 2019-11-29T21:31:30.677 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:31:30.671+0000 1694c700 -1 osd.2 348 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:29:50.055680+0000 front 2019-11-29T21:29:49.542893+0000 (oldest deadline 2019-11-29T21:30:33.951513+0000) 2019-11-29T21:32:33.422 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:32:33.418+0000 1694c700 -1 osd.1 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130612 7.0 7:02683654:reshard::reshard.0000000010:head [call lock.lock in=70b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e353) 2019-11-29T21:32:34.455 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:32:34.451+0000 1694c700 -1 osd.1 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130612 7.0 7:02683654:reshard::reshard.0000000010:head [call lock.lock in=70b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e353) 2019-11-29T21:32:35.499 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:32:35.496+0000 1694c700 -1 osd.1 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130612 7.0 7:02683654:reshard::reshard.0000000010:head [call lock.lock in=70b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e353) 2019-11-29T21:32:36.480 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:32:36.475+0000 1694c700 -1 osd.1 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130612 7.0 7:02683654:reshard::reshard.0000000010:head [call lock.lock in=70b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e353) 2019-11-29T21:32:37.505 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:32:37.501+0000 1694c700 -1 osd.1 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130612 7.0 7:02683654:reshard::reshard.0000000010:head [call lock.lock in=70b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e353) 2019-11-29T21:32:38.480 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:32:38.475+0000 1694c700 -1 osd.1 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130612 7.0 7:02683654:reshard::reshard.0000000010:head [call lock.lock in=70b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e353) 2019-11-29T21:32:38.954 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:32:38.949+0000 1694c700 -1 osd.6 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:124438 6.8 6:1594c276:root::.bucket.meta.7995bad2bc5d4a958746a7cd44134f2b%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.631:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e356) 2019-11-29T21:32:39.485 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:32:39.480+0000 1694c700 -1 osd.1 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130612 7.0 7:02683654:reshard::reshard.0000000010:head [call lock.lock in=70b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e353) 2019-11-29T21:32:39.959 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:32:39.954+0000 1694c700 -1 osd.6 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:124438 6.8 6:1594c276:root::.bucket.meta.7995bad2bc5d4a958746a7cd44134f2b%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.631:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e356) 2019-11-29T21:32:40.485 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:32:40.480+0000 1694c700 -1 osd.1 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130612 7.0 7:02683654:reshard::reshard.0000000010:head [call lock.lock in=70b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e353) 2019-11-29T21:32:40.983 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:32:40.979+0000 1694c700 -1 osd.6 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:124438 6.8 6:1594c276:root::.bucket.meta.7995bad2bc5d4a958746a7cd44134f2b%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.631:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e356) 2019-11-29T21:32:41.467 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:32:41.462+0000 1694c700 -1 osd.1 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130612 7.0 7:02683654:reshard::reshard.0000000010:head [call lock.lock in=70b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e353) 2019-11-29T21:32:41.973 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:32:41.968+0000 1694c700 -1 osd.6 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:124438 6.8 6:1594c276:root::.bucket.meta.7995bad2bc5d4a958746a7cd44134f2b%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.631:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e356) 2019-11-29T21:32:42.447 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:32:42.442+0000 1694c700 -1 osd.1 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130612 7.0 7:02683654:reshard::reshard.0000000010:head [call lock.lock in=70b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e353) 2019-11-29T21:32:42.993 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:32:42.989+0000 1694c700 -1 osd.6 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:124438 6.8 6:1594c276:root::.bucket.meta.7995bad2bc5d4a958746a7cd44134f2b%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.631:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e356) 2019-11-29T21:32:43.467 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:32:43.463+0000 1694c700 -1 osd.1 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130612 7.0 7:02683654:reshard::reshard.0000000010:head [call lock.lock in=70b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e353) 2019-11-29T21:32:44.001 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:32:43.996+0000 1694c700 -1 osd.6 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:124438 6.8 6:1594c276:root::.bucket.meta.7995bad2bc5d4a958746a7cd44134f2b%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.631:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e356) 2019-11-29T21:32:44.471 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:32:44.467+0000 1694c700 -1 osd.1 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130612 7.0 7:02683654:reshard::reshard.0000000010:head [call lock.lock in=70b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e353) 2019-11-29T21:32:44.967 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:32:44.963+0000 1694c700 -1 osd.6 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:124438 6.8 6:1594c276:root::.bucket.meta.7995bad2bc5d4a958746a7cd44134f2b%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.631:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e356) 2019-11-29T21:32:45.495 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:32:45.491+0000 1694c700 -1 osd.1 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130612 7.0 7:02683654:reshard::reshard.0000000010:head [call lock.lock in=70b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e353) 2019-11-29T21:32:45.947 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:32:45.942+0000 1694c700 -1 osd.6 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:124438 6.8 6:1594c276:root::.bucket.meta.7995bad2bc5d4a958746a7cd44134f2b%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.631:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e356) 2019-11-29T21:32:46.527 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:32:46.521+0000 1694c700 -1 osd.1 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130612 7.0 7:02683654:reshard::reshard.0000000010:head [call lock.lock in=70b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e353) 2019-11-29T21:32:46.964 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:32:46.959+0000 1694c700 -1 osd.6 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:124438 6.8 6:1594c276:root::.bucket.meta.7995bad2bc5d4a958746a7cd44134f2b%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.631:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e356) 2019-11-29T21:32:47.544 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:32:47.540+0000 1694c700 -1 osd.1 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130612 7.0 7:02683654:reshard::reshard.0000000010:head [call lock.lock in=70b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e353) 2019-11-29T21:32:47.928 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:32:47.923+0000 1694c700 -1 osd.6 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:124438 6.8 6:1594c276:root::.bucket.meta.7995bad2bc5d4a958746a7cd44134f2b%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.631:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e356) 2019-11-29T21:32:48.594 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:32:48.589+0000 1694c700 -1 osd.1 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130612 7.0 7:02683654:reshard::reshard.0000000010:head [call lock.lock in=70b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e353) 2019-11-29T21:32:48.887 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:32:48.882+0000 1694c700 -1 osd.6 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:124438 6.8 6:1594c276:root::.bucket.meta.7995bad2bc5d4a958746a7cd44134f2b%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.631:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e356) 2019-11-29T21:32:49.582 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:32:49.577+0000 1694c700 -1 osd.1 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130612 7.0 7:02683654:reshard::reshard.0000000010:head [call lock.lock in=70b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e353) 2019-11-29T21:32:49.895 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:32:49.890+0000 1694c700 -1 osd.6 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:124438 6.8 6:1594c276:root::.bucket.meta.7995bad2bc5d4a958746a7cd44134f2b%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.631:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e356) 2019-11-29T21:32:50.540 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:32:50.535+0000 1694c700 -1 osd.1 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130612 7.0 7:02683654:reshard::reshard.0000000010:head [call lock.lock in=70b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e353) 2019-11-29T21:32:50.943 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:32:50.938+0000 1694c700 -1 osd.6 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:124438 6.8 6:1594c276:root::.bucket.meta.7995bad2bc5d4a958746a7cd44134f2b%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.631:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e356) 2019-11-29T21:32:51.571 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:32:51.566+0000 1694c700 -1 osd.1 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130612 7.0 7:02683654:reshard::reshard.0000000010:head [call lock.lock in=70b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e353) 2019-11-29T21:32:51.919 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:32:51.914+0000 1694c700 -1 osd.6 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:124438 6.8 6:1594c276:root::.bucket.meta.7995bad2bc5d4a958746a7cd44134f2b%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.631:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e356) 2019-11-29T21:32:52.555 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:32:52.551+0000 1694c700 -1 osd.1 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130612 7.0 7:02683654:reshard::reshard.0000000010:head [call lock.lock in=70b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e353) 2019-11-29T21:32:52.958 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:32:52.953+0000 1694c700 -1 osd.6 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:124438 6.8 6:1594c276:root::.bucket.meta.7995bad2bc5d4a958746a7cd44134f2b%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.631:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e356) 2019-11-29T21:32:53.615 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:32:53.602+0000 1694c700 -1 osd.1 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130612 7.0 7:02683654:reshard::reshard.0000000010:head [call lock.lock in=70b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e353) 2019-11-29T21:32:53.942 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:32:53.936+0000 1694c700 -1 osd.6 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:124438 6.8 6:1594c276:root::.bucket.meta.7995bad2bc5d4a958746a7cd44134f2b%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.631:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e356) 2019-11-29T21:32:54.646 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:32:54.641+0000 1694c700 -1 osd.1 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130612 7.0 7:02683654:reshard::reshard.0000000010:head [call lock.lock in=70b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e353) 2019-11-29T21:32:54.904 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:32:54.899+0000 1694c700 -1 osd.6 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:124438 6.8 6:1594c276:root::.bucket.meta.7995bad2bc5d4a958746a7cd44134f2b%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.631:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e356) 2019-11-29T21:32:55.620 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:32:55.616+0000 1694c700 -1 osd.1 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130612 7.0 7:02683654:reshard::reshard.0000000010:head [call lock.lock in=70b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e353) 2019-11-29T21:32:55.901 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:32:55.896+0000 1694c700 -1 osd.6 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:124438 6.8 6:1594c276:root::.bucket.meta.7995bad2bc5d4a958746a7cd44134f2b%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.631:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e356) 2019-11-29T21:32:56.627 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:32:56.623+0000 1694c700 -1 osd.1 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130612 7.0 7:02683654:reshard::reshard.0000000010:head [call lock.lock in=70b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e353) 2019-11-29T21:32:56.896 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:32:56.887+0000 1694c700 -1 osd.6 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:124438 6.8 6:1594c276:root::.bucket.meta.7995bad2bc5d4a958746a7cd44134f2b%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.631:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e356) 2019-11-29T21:32:57.607 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:32:57.602+0000 1694c700 -1 osd.1 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130612 7.0 7:02683654:reshard::reshard.0000000010:head [call lock.lock in=70b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e353) 2019-11-29T21:32:57.939 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:32:57.934+0000 1694c700 -1 osd.6 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:124438 6.8 6:1594c276:root::.bucket.meta.7995bad2bc5d4a958746a7cd44134f2b%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.631:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e356) 2019-11-29T21:32:58.633 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:32:58.628+0000 1694c700 -1 osd.1 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130612 7.0 7:02683654:reshard::reshard.0000000010:head [call lock.lock in=70b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e353) 2019-11-29T21:32:58.959 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:32:58.954+0000 1694c700 -1 osd.6 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:124438 6.8 6:1594c276:root::.bucket.meta.7995bad2bc5d4a958746a7cd44134f2b%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.631:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e356) 2019-11-29T21:32:59.615 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:32:59.611+0000 1694c700 -1 osd.1 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130612 7.0 7:02683654:reshard::reshard.0000000010:head [call lock.lock in=70b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e353) 2019-11-29T21:32:59.965 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:32:59.959+0000 1694c700 -1 osd.6 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:124438 6.8 6:1594c276:root::.bucket.meta.7995bad2bc5d4a958746a7cd44134f2b%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.631:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e356) 2019-11-29T21:33:00.609 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:33:00.600+0000 1694c700 -1 osd.1 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130612 7.0 7:02683654:reshard::reshard.0000000010:head [call lock.lock in=70b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e353) 2019-11-29T21:33:00.921 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:33:00.916+0000 1694c700 -1 osd.6 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:124438 6.8 6:1594c276:root::.bucket.meta.7995bad2bc5d4a958746a7cd44134f2b%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.631:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e356) 2019-11-29T21:33:01.559 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:33:01.554+0000 1694c700 -1 osd.1 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130612 7.0 7:02683654:reshard::reshard.0000000010:head [call lock.lock in=70b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e353) 2019-11-29T21:33:01.922 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:33:01.915+0000 1694c700 -1 osd.6 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:124438 6.8 6:1594c276:root::.bucket.meta.7995bad2bc5d4a958746a7cd44134f2b%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.631:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e356) 2019-11-29T21:33:02.535 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:33:02.531+0000 1694c700 -1 osd.1 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130612 7.0 7:02683654:reshard::reshard.0000000010:head [call lock.lock in=70b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e353) 2019-11-29T21:33:02.883 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:33:02.878+0000 1694c700 -1 osd.6 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:124438 6.8 6:1594c276:root::.bucket.meta.7995bad2bc5d4a958746a7cd44134f2b%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.631:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e356) 2019-11-29T21:33:03.545 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:33:03.541+0000 1694c700 -1 osd.1 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130612 7.0 7:02683654:reshard::reshard.0000000010:head [call lock.lock in=70b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e353) 2019-11-29T21:33:03.847 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:33:03.841+0000 1694c700 -1 osd.6 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:23.028369+0000 front 2019-11-29T21:32:23.247693+0000 (oldest deadline 2019-11-29T21:33:03.542189+0000) 2019-11-29T21:33:03.848 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:33:03.842+0000 1694c700 -1 osd.6 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:124438 6.8 6:1594c276:root::.bucket.meta.7995bad2bc5d4a958746a7cd44134f2b%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.631:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e356) 2019-11-29T21:33:03.913 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:33:03.908+0000 1694c700 -1 osd.0 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:19.302731+0000 front 2019-11-29T21:32:19.260382+0000 (oldest deadline 2019-11-29T21:33:03.891219+0000) 2019-11-29T21:33:04.577 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:33:04.573+0000 1694c700 -1 osd.1 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130612 7.0 7:02683654:reshard::reshard.0000000010:head [call lock.lock in=70b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e353) 2019-11-29T21:33:04.838 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:33:04.831+0000 1694c700 -1 osd.6 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:23.028369+0000 front 2019-11-29T21:32:23.247693+0000 (oldest deadline 2019-11-29T21:33:03.542189+0000) 2019-11-29T21:33:04.839 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:33:04.833+0000 1694c700 -1 osd.6 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:124438 6.8 6:1594c276:root::.bucket.meta.7995bad2bc5d4a958746a7cd44134f2b%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.631:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e356) 2019-11-29T21:33:04.948 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:33:04.942+0000 1694c700 -1 osd.0 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:19.302731+0000 front 2019-11-29T21:32:19.260382+0000 (oldest deadline 2019-11-29T21:33:03.891219+0000) 2019-11-29T21:33:05.574 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:33:05.570+0000 1694c700 -1 osd.1 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130612 7.0 7:02683654:reshard::reshard.0000000010:head [call lock.lock in=70b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e353) 2019-11-29T21:33:05.801 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:33:05.794+0000 1694c700 -1 osd.6 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:23.028369+0000 front 2019-11-29T21:32:23.247693+0000 (oldest deadline 2019-11-29T21:33:03.542189+0000) 2019-11-29T21:33:05.801 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:33:05.796+0000 1694c700 -1 osd.6 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:124438 6.8 6:1594c276:root::.bucket.meta.7995bad2bc5d4a958746a7cd44134f2b%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.631:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e356) 2019-11-29T21:33:05.936 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:33:05.929+0000 1694c700 -1 osd.0 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:19.302731+0000 front 2019-11-29T21:32:19.260382+0000 (oldest deadline 2019-11-29T21:33:03.891219+0000) 2019-11-29T21:33:06.193 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:33:06.189+0000 1694c700 -1 osd.7 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:23.045505+0000 front 2019-11-29T21:32:22.623906+0000 (oldest deadline 2019-11-29T21:33:06.102623+0000) 2019-11-29T21:33:06.234 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:33:06.230+0000 1694c700 -1 osd.2 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:21.646753+0000 front 2019-11-29T21:32:21.407557+0000 (oldest deadline 2019-11-29T21:33:06.050491+0000) 2019-11-29T21:33:06.369 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:09:07:47.028 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T21:33:06.374 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:09:07:47.033 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T21:33:06.379 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:09:07:46.986 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T21:33:06.386 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:09:07:46.993 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T21:33:06.393 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:09:07:47.000 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T21:33:06.397 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:09:07:47.004 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T21:33:06.531 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:33:06.527+0000 1694c700 -1 osd.1 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130612 7.0 7:02683654:reshard::reshard.0000000010:head [call lock.lock in=70b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e353) 2019-11-29T21:33:06.574 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:09:07:47.232 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T21:33:06.579 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:09:07:47.186 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T21:33:06.580 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:09:07:47.188 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T21:33:06.607 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:33:06.601+0000 1694c700 -1 osd.4 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:21.434647+0000 front 2019-11-29T21:32:21.450517+0000 (oldest deadline 2019-11-29T21:33:06.260251+0000) 2019-11-29T21:33:06.847 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:33:06.842+0000 1694c700 -1 osd.6 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:23.028369+0000 front 2019-11-29T21:32:23.247693+0000 (oldest deadline 2019-11-29T21:33:03.542189+0000) 2019-11-29T21:33:06.850 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:33:06.845+0000 1694c700 -1 osd.6 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:124438 6.8 6:1594c276:root::.bucket.meta.7995bad2bc5d4a958746a7cd44134f2b%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.631:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e356) 2019-11-29T21:33:06.932 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:33:06.927+0000 1694c700 -1 osd.0 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:19.302731+0000 front 2019-11-29T21:32:19.260382+0000 (oldest deadline 2019-11-29T21:33:03.891219+0000) 2019-11-29T21:33:07.232 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:33:07.227+0000 1694c700 -1 osd.2 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:21.646753+0000 front 2019-11-29T21:32:21.407557+0000 (oldest deadline 2019-11-29T21:33:06.050491+0000) 2019-11-29T21:33:07.248 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:33:07.242+0000 1694c700 -1 osd.7 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:23.045505+0000 front 2019-11-29T21:32:22.623906+0000 (oldest deadline 2019-11-29T21:33:06.102623+0000) 2019-11-29T21:33:07.530 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:33:07.526+0000 1694c700 -1 osd.1 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:23.248988+0000 front 2019-11-29T21:32:23.247950+0000 (oldest deadline 2019-11-29T21:33:07.428735+0000) 2019-11-29T21:33:07.530 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:33:07.527+0000 1694c700 -1 osd.1 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130612 7.0 7:02683654:reshard::reshard.0000000010:head [call lock.lock in=70b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e353) 2019-11-29T21:33:07.572 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:33:07.567+0000 1694c700 -1 osd.4 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:21.434647+0000 front 2019-11-29T21:32:21.450517+0000 (oldest deadline 2019-11-29T21:33:06.260251+0000) 2019-11-29T21:33:07.853 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:33:07.846+0000 1694c700 -1 osd.6 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:23.028369+0000 front 2019-11-29T21:32:23.247693+0000 (oldest deadline 2019-11-29T21:33:03.542189+0000) 2019-11-29T21:33:07.853 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:33:07.848+0000 1694c700 -1 osd.6 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:124438 6.8 6:1594c276:root::.bucket.meta.7995bad2bc5d4a958746a7cd44134f2b%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.631:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e356) 2019-11-29T21:33:07.937 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:33:07.932+0000 1694c700 -1 osd.0 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:19.302731+0000 front 2019-11-29T21:32:19.260382+0000 (oldest deadline 2019-11-29T21:33:03.891219+0000) 2019-11-29T21:33:08.234 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:33:08.229+0000 1694c700 -1 osd.2 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:21.646753+0000 front 2019-11-29T21:32:21.407557+0000 (oldest deadline 2019-11-29T21:33:06.050491+0000) 2019-11-29T21:33:08.295 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:33:08.289+0000 1694c700 -1 osd.7 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:23.045505+0000 front 2019-11-29T21:32:22.623906+0000 (oldest deadline 2019-11-29T21:33:06.102623+0000) 2019-11-29T21:33:08.568 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:33:08.562+0000 1694c700 -1 osd.4 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:21.434647+0000 front 2019-11-29T21:32:21.450517+0000 (oldest deadline 2019-11-29T21:33:06.260251+0000) 2019-11-29T21:33:08.579 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:33:08.575+0000 1694c700 -1 osd.1 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:23.248988+0000 front 2019-11-29T21:32:23.247950+0000 (oldest deadline 2019-11-29T21:33:07.428735+0000) 2019-11-29T21:33:08.579 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:33:08.575+0000 1694c700 -1 osd.1 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130612 7.0 7:02683654:reshard::reshard.0000000010:head [call lock.lock in=70b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e353) 2019-11-29T21:33:08.871 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:33:08.865+0000 1694c700 -1 osd.6 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:23.028369+0000 front 2019-11-29T21:32:23.247693+0000 (oldest deadline 2019-11-29T21:33:03.542189+0000) 2019-11-29T21:33:08.874 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:33:08.869+0000 1694c700 -1 osd.6 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:124438 6.8 6:1594c276:root::.bucket.meta.7995bad2bc5d4a958746a7cd44134f2b%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.631:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e356) 2019-11-29T21:33:08.944 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:33:08.939+0000 1694c700 -1 osd.0 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:19.302731+0000 front 2019-11-29T21:32:19.260382+0000 (oldest deadline 2019-11-29T21:33:03.891219+0000) 2019-11-29T21:33:09.198 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:33:09.193+0000 1694c700 -1 osd.2 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:21.646753+0000 front 2019-11-29T21:32:21.407557+0000 (oldest deadline 2019-11-29T21:33:06.050491+0000) 2019-11-29T21:33:09.283 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:33:09.276+0000 1694c700 -1 osd.7 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:23.045505+0000 front 2019-11-29T21:32:22.623906+0000 (oldest deadline 2019-11-29T21:33:06.102623+0000) 2019-11-29T21:33:09.524 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:33:09.519+0000 1694c700 -1 osd.4 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:21.434647+0000 front 2019-11-29T21:32:21.450517+0000 (oldest deadline 2019-11-29T21:33:06.260251+0000) 2019-11-29T21:33:09.546 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:33:09.540+0000 1694c700 -1 osd.1 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:23.248988+0000 front 2019-11-29T21:32:23.247950+0000 (oldest deadline 2019-11-29T21:33:07.428735+0000) 2019-11-29T21:33:09.547 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:33:09.542+0000 1694c700 -1 osd.1 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130612 7.0 7:02683654:reshard::reshard.0000000010:head [call lock.lock in=70b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e353) 2019-11-29T21:33:09.846 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:33:09.840+0000 1694c700 -1 osd.6 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:23.028369+0000 front 2019-11-29T21:32:23.247693+0000 (oldest deadline 2019-11-29T21:33:03.542189+0000) 2019-11-29T21:33:09.847 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:33:09.843+0000 1694c700 -1 osd.6 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:124438 6.8 6:1594c276:root::.bucket.meta.7995bad2bc5d4a958746a7cd44134f2b%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.631:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e356) 2019-11-29T21:33:09.960 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:33:09.956+0000 1694c700 -1 osd.0 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:19.302731+0000 front 2019-11-29T21:32:19.260382+0000 (oldest deadline 2019-11-29T21:33:03.891219+0000) 2019-11-29T21:33:10.226 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:33:10.220+0000 1694c700 -1 osd.2 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:21.646753+0000 front 2019-11-29T21:32:21.407557+0000 (oldest deadline 2019-11-29T21:33:06.050491+0000) 2019-11-29T21:33:10.289 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:33:10.283+0000 1694c700 -1 osd.7 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:23.045505+0000 front 2019-11-29T21:32:22.623906+0000 (oldest deadline 2019-11-29T21:33:06.102623+0000) 2019-11-29T21:33:10.573 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:33:10.564+0000 1694c700 -1 osd.4 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:21.434647+0000 front 2019-11-29T21:32:21.450517+0000 (oldest deadline 2019-11-29T21:33:06.260251+0000) 2019-11-29T21:33:10.593 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:33:10.588+0000 1694c700 -1 osd.1 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:23.248988+0000 front 2019-11-29T21:32:23.247950+0000 (oldest deadline 2019-11-29T21:33:07.428735+0000) 2019-11-29T21:33:10.594 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:33:10.590+0000 1694c700 -1 osd.1 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130612 7.0 7:02683654:reshard::reshard.0000000010:head [call lock.lock in=70b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e353) 2019-11-29T21:33:10.809 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:33:10.802+0000 1694c700 -1 osd.6 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:23.028369+0000 front 2019-11-29T21:32:23.247693+0000 (oldest deadline 2019-11-29T21:33:03.542189+0000) 2019-11-29T21:33:10.810 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:33:10.804+0000 1694c700 -1 osd.6 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:124438 6.8 6:1594c276:root::.bucket.meta.7995bad2bc5d4a958746a7cd44134f2b%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.631:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e356) 2019-11-29T21:33:10.944 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:33:10.939+0000 1694c700 -1 osd.0 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:19.302731+0000 front 2019-11-29T21:32:19.260382+0000 (oldest deadline 2019-11-29T21:33:03.891219+0000) 2019-11-29T21:33:11.266 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:33:11.261+0000 1694c700 -1 osd.2 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:21.646753+0000 front 2019-11-29T21:32:21.407557+0000 (oldest deadline 2019-11-29T21:33:06.050491+0000) 2019-11-29T21:33:11.345 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:33:11.336+0000 1694c700 -1 osd.7 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:23.045505+0000 front 2019-11-29T21:32:22.623906+0000 (oldest deadline 2019-11-29T21:33:06.102623+0000) 2019-11-29T21:33:11.564 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:33:11.557+0000 1694c700 -1 osd.4 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:21.434647+0000 front 2019-11-29T21:32:21.450517+0000 (oldest deadline 2019-11-29T21:33:06.260251+0000) 2019-11-29T21:33:11.633 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:33:11.628+0000 1694c700 -1 osd.1 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:23.248988+0000 front 2019-11-29T21:32:23.247950+0000 (oldest deadline 2019-11-29T21:33:07.428735+0000) 2019-11-29T21:33:11.634 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:33:11.630+0000 1694c700 -1 osd.1 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130612 7.0 7:02683654:reshard::reshard.0000000010:head [call lock.lock in=70b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e353) 2019-11-29T21:33:11.850 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:33:11.844+0000 1694c700 -1 osd.6 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:23.028369+0000 front 2019-11-29T21:32:23.247693+0000 (oldest deadline 2019-11-29T21:33:03.542189+0000) 2019-11-29T21:33:11.851 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:33:11.846+0000 1694c700 -1 osd.6 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:124438 6.8 6:1594c276:root::.bucket.meta.7995bad2bc5d4a958746a7cd44134f2b%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.631:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e356) 2019-11-29T21:33:11.997 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:33:11.991+0000 1694c700 -1 osd.0 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:19.302731+0000 front 2019-11-29T21:32:19.260382+0000 (oldest deadline 2019-11-29T21:33:03.891219+0000) 2019-11-29T21:33:12.293 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:33:12.288+0000 1694c700 -1 osd.2 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:21.646753+0000 front 2019-11-29T21:32:21.407557+0000 (oldest deadline 2019-11-29T21:33:06.050491+0000) 2019-11-29T21:33:12.315 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:33:12.309+0000 1694c700 -1 osd.7 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:23.045505+0000 front 2019-11-29T21:32:22.623906+0000 (oldest deadline 2019-11-29T21:33:06.102623+0000) 2019-11-29T21:33:12.564 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:33:12.557+0000 1694c700 -1 osd.4 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:21.434647+0000 front 2019-11-29T21:32:21.450517+0000 (oldest deadline 2019-11-29T21:33:06.260251+0000) 2019-11-29T21:33:12.589 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:33:12.583+0000 1694c700 -1 osd.1 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:23.248988+0000 front 2019-11-29T21:32:23.247950+0000 (oldest deadline 2019-11-29T21:33:07.428735+0000) 2019-11-29T21:33:12.590 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:33:12.585+0000 1694c700 -1 osd.1 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130612 7.0 7:02683654:reshard::reshard.0000000010:head [call lock.lock in=70b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e353) 2019-11-29T21:33:12.863 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:33:12.858+0000 1694c700 -1 osd.6 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:23.028369+0000 front 2019-11-29T21:32:23.247693+0000 (oldest deadline 2019-11-29T21:33:03.542189+0000) 2019-11-29T21:33:12.864 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:33:12.859+0000 1694c700 -1 osd.6 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:124438 6.8 6:1594c276:root::.bucket.meta.7995bad2bc5d4a958746a7cd44134f2b%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.631:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e356) 2019-11-29T21:33:13.027 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:33:13.020+0000 1694c700 -1 osd.0 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:19.302731+0000 front 2019-11-29T21:32:19.260382+0000 (oldest deadline 2019-11-29T21:33:03.891219+0000) 2019-11-29T21:33:13.272 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:33:13.267+0000 1694c700 -1 osd.2 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:21.646753+0000 front 2019-11-29T21:32:21.407557+0000 (oldest deadline 2019-11-29T21:33:06.050491+0000) 2019-11-29T21:33:13.317 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:33:13.310+0000 1694c700 -1 osd.7 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:23.045505+0000 front 2019-11-29T21:32:22.623906+0000 (oldest deadline 2019-11-29T21:33:06.102623+0000) 2019-11-29T21:33:13.574 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:33:13.568+0000 1694c700 -1 osd.1 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:23.248988+0000 front 2019-11-29T21:32:23.247950+0000 (oldest deadline 2019-11-29T21:33:07.428735+0000) 2019-11-29T21:33:13.574 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:33:13.570+0000 1694c700 -1 osd.1 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130612 7.0 7:02683654:reshard::reshard.0000000010:head [call lock.lock in=70b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e353) 2019-11-29T21:33:13.578 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:33:13.572+0000 1694c700 -1 osd.4 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:21.434647+0000 front 2019-11-29T21:32:21.450517+0000 (oldest deadline 2019-11-29T21:33:06.260251+0000) 2019-11-29T21:33:13.887 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:33:13.882+0000 1694c700 -1 osd.6 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:23.028369+0000 front 2019-11-29T21:32:23.247693+0000 (oldest deadline 2019-11-29T21:33:03.542189+0000) 2019-11-29T21:33:13.888 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:33:13.883+0000 1694c700 -1 osd.6 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:124438 6.8 6:1594c276:root::.bucket.meta.7995bad2bc5d4a958746a7cd44134f2b%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.631:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e356) 2019-11-29T21:33:14.007 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:33:14.002+0000 1694c700 -1 osd.0 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:19.302731+0000 front 2019-11-29T21:32:19.260382+0000 (oldest deadline 2019-11-29T21:33:03.891219+0000) 2019-11-29T21:33:14.256 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:33:14.250+0000 1694c700 -1 osd.2 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:21.646753+0000 front 2019-11-29T21:32:21.407557+0000 (oldest deadline 2019-11-29T21:33:06.050491+0000) 2019-11-29T21:33:14.295 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:33:14.290+0000 1694c700 -1 osd.7 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:23.045505+0000 front 2019-11-29T21:32:22.623906+0000 (oldest deadline 2019-11-29T21:33:06.102623+0000) 2019-11-29T21:33:14.542 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:33:14.535+0000 1694c700 -1 osd.1 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:23.248988+0000 front 2019-11-29T21:32:23.247950+0000 (oldest deadline 2019-11-29T21:33:07.428735+0000) 2019-11-29T21:33:14.542 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:33:14.538+0000 1694c700 -1 osd.1 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130612 7.0 7:02683654:reshard::reshard.0000000010:head [call lock.lock in=70b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e353) 2019-11-29T21:33:14.575 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:33:14.568+0000 1694c700 -1 osd.4 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:21.434647+0000 front 2019-11-29T21:32:21.450517+0000 (oldest deadline 2019-11-29T21:33:06.260251+0000) 2019-11-29T21:33:14.914 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:33:14.908+0000 1694c700 -1 osd.6 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:23.028369+0000 front 2019-11-29T21:32:23.247693+0000 (oldest deadline 2019-11-29T21:33:03.542189+0000) 2019-11-29T21:33:14.915 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:33:14.910+0000 1694c700 -1 osd.6 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:124438 6.8 6:1594c276:root::.bucket.meta.7995bad2bc5d4a958746a7cd44134f2b%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.631:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e356) 2019-11-29T21:33:15.009 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:33:15.004+0000 1694c700 -1 osd.0 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:19.302731+0000 front 2019-11-29T21:32:19.260382+0000 (oldest deadline 2019-11-29T21:33:03.891219+0000) 2019-11-29T21:33:15.224 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:33:15.219+0000 1694c700 -1 osd.2 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:21.646753+0000 front 2019-11-29T21:32:21.407557+0000 (oldest deadline 2019-11-29T21:33:06.050491+0000) 2019-11-29T21:33:15.279 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:33:15.273+0000 1694c700 -1 osd.7 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:23.045505+0000 front 2019-11-29T21:32:22.623906+0000 (oldest deadline 2019-11-29T21:33:06.102623+0000) 2019-11-29T21:33:15.543 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:33:15.537+0000 1694c700 -1 osd.4 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:21.434647+0000 front 2019-11-29T21:32:21.450517+0000 (oldest deadline 2019-11-29T21:33:06.260251+0000) 2019-11-29T21:33:15.560 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:33:15.553+0000 1694c700 -1 osd.1 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:23.248988+0000 front 2019-11-29T21:32:23.247950+0000 (oldest deadline 2019-11-29T21:33:07.428735+0000) 2019-11-29T21:33:15.560 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:33:15.555+0000 1694c700 -1 osd.1 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130612 7.0 7:02683654:reshard::reshard.0000000010:head [call lock.lock in=70b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e353) 2019-11-29T21:33:15.959 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:33:15.952+0000 1694c700 -1 osd.6 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:23.028369+0000 front 2019-11-29T21:32:23.247693+0000 (oldest deadline 2019-11-29T21:33:03.542189+0000) 2019-11-29T21:33:15.960 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:33:15.954+0000 1694c700 -1 osd.6 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:124438 6.8 6:1594c276:root::.bucket.meta.7995bad2bc5d4a958746a7cd44134f2b%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.631:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e356) 2019-11-29T21:33:16.060 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:33:16.055+0000 1694c700 -1 osd.0 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:19.302731+0000 front 2019-11-29T21:32:19.260382+0000 (oldest deadline 2019-11-29T21:33:03.891219+0000) 2019-11-29T21:33:16.248 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:33:16.241+0000 1694c700 -1 osd.7 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:23.045505+0000 front 2019-11-29T21:32:22.623906+0000 (oldest deadline 2019-11-29T21:33:06.102623+0000) 2019-11-29T21:33:16.261 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:33:16.256+0000 1694c700 -1 osd.2 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:21.646753+0000 front 2019-11-29T21:32:21.407557+0000 (oldest deadline 2019-11-29T21:33:06.050491+0000) 2019-11-29T21:33:16.515 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:33:16.508+0000 1694c700 -1 osd.4 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:21.434647+0000 front 2019-11-29T21:32:21.450517+0000 (oldest deadline 2019-11-29T21:33:06.260251+0000) 2019-11-29T21:33:16.589 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:33:16.581+0000 1694c700 -1 osd.1 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:23.248988+0000 front 2019-11-29T21:32:23.247950+0000 (oldest deadline 2019-11-29T21:33:07.428735+0000) 2019-11-29T21:33:16.590 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:33:16.583+0000 1694c700 -1 osd.1 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130612 7.0 7:02683654:reshard::reshard.0000000010:head [call lock.lock in=70b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e353) 2019-11-29T21:33:16.967 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:33:16.961+0000 1694c700 -1 osd.6 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:23.028369+0000 front 2019-11-29T21:32:23.247693+0000 (oldest deadline 2019-11-29T21:33:03.542189+0000) 2019-11-29T21:33:16.970 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:33:16.965+0000 1694c700 -1 osd.6 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:124438 6.8 6:1594c276:root::.bucket.meta.7995bad2bc5d4a958746a7cd44134f2b%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.631:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e356) 2019-11-29T21:33:17.090 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:33:17.085+0000 1694c700 -1 osd.0 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:19.302731+0000 front 2019-11-29T21:32:19.260382+0000 (oldest deadline 2019-11-29T21:33:03.891219+0000) 2019-11-29T21:33:17.255 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:33:17.249+0000 1694c700 -1 osd.7 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:23.045505+0000 front 2019-11-29T21:32:22.623906+0000 (oldest deadline 2019-11-29T21:33:06.102623+0000) 2019-11-29T21:33:17.261 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:33:17.256+0000 1694c700 -1 osd.2 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:21.646753+0000 front 2019-11-29T21:32:21.407557+0000 (oldest deadline 2019-11-29T21:33:06.050491+0000) 2019-11-29T21:33:17.499 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:33:17.493+0000 1694c700 -1 osd.4 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:21.434647+0000 front 2019-11-29T21:32:21.450517+0000 (oldest deadline 2019-11-29T21:33:06.260251+0000) 2019-11-29T21:33:17.555 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:33:17.549+0000 1694c700 -1 osd.1 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:23.248988+0000 front 2019-11-29T21:32:23.247950+0000 (oldest deadline 2019-11-29T21:33:07.428735+0000) 2019-11-29T21:33:17.555 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:33:17.551+0000 1694c700 -1 osd.1 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130612 7.0 7:02683654:reshard::reshard.0000000010:head [call lock.lock in=70b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e353) 2019-11-29T21:33:18.018 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:33:18.011+0000 1694c700 -1 osd.6 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:23.028369+0000 front 2019-11-29T21:32:23.247693+0000 (oldest deadline 2019-11-29T21:33:03.542189+0000) 2019-11-29T21:33:18.019 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:33:18.013+0000 1694c700 -1 osd.6 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:124438 6.8 6:1594c276:root::.bucket.meta.7995bad2bc5d4a958746a7cd44134f2b%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.631:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e356) 2019-11-29T21:33:18.055 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:33:18.050+0000 1694c700 -1 osd.0 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:19.302731+0000 front 2019-11-29T21:32:19.260382+0000 (oldest deadline 2019-11-29T21:33:03.891219+0000) 2019-11-29T21:33:18.218 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:33:18.212+0000 1694c700 -1 osd.7 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:23.045505+0000 front 2019-11-29T21:32:22.623906+0000 (oldest deadline 2019-11-29T21:33:06.102623+0000) 2019-11-29T21:33:18.251 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:33:18.245+0000 1694c700 -1 osd.2 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:21.646753+0000 front 2019-11-29T21:32:21.407557+0000 (oldest deadline 2019-11-29T21:33:06.050491+0000) 2019-11-29T21:33:18.452 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:33:18.447+0000 1694c700 -1 osd.4 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:21.434647+0000 front 2019-11-29T21:32:21.450517+0000 (oldest deadline 2019-11-29T21:33:06.260251+0000) 2019-11-29T21:33:18.582 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:33:18.576+0000 1694c700 -1 osd.1 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:23.248988+0000 front 2019-11-29T21:32:23.247950+0000 (oldest deadline 2019-11-29T21:33:07.428735+0000) 2019-11-29T21:33:18.582 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:33:18.578+0000 1694c700 -1 osd.1 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130612 7.0 7:02683654:reshard::reshard.0000000010:head [call lock.lock in=70b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e353) 2019-11-29T21:33:19.020 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:33:19.015+0000 1694c700 -1 osd.6 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:23.028369+0000 front 2019-11-29T21:32:23.247693+0000 (oldest deadline 2019-11-29T21:33:03.542189+0000) 2019-11-29T21:33:19.023 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:33:19.018+0000 1694c700 -1 osd.6 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:124438 6.8 6:1594c276:root::.bucket.meta.7995bad2bc5d4a958746a7cd44134f2b%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.631:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e356) 2019-11-29T21:33:19.067 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:33:19.062+0000 1694c700 -1 osd.0 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:19.302731+0000 front 2019-11-29T21:32:19.260382+0000 (oldest deadline 2019-11-29T21:33:03.891219+0000) 2019-11-29T21:33:19.193 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:33:19.179+0000 1694c700 -1 osd.7 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:23.045505+0000 front 2019-11-29T21:32:22.623906+0000 (oldest deadline 2019-11-29T21:33:06.102623+0000) 2019-11-29T21:33:19.301 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:33:19.295+0000 1694c700 -1 osd.2 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:21.646753+0000 front 2019-11-29T21:32:21.407557+0000 (oldest deadline 2019-11-29T21:33:06.050491+0000) 2019-11-29T21:33:19.469 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:33:19.462+0000 1694c700 -1 osd.4 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:21.434647+0000 front 2019-11-29T21:32:21.450517+0000 (oldest deadline 2019-11-29T21:33:06.260251+0000) 2019-11-29T21:33:19.630 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:33:19.624+0000 1694c700 -1 osd.1 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:23.248988+0000 front 2019-11-29T21:32:23.247950+0000 (oldest deadline 2019-11-29T21:33:07.428735+0000) 2019-11-29T21:33:19.631 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:33:19.626+0000 1694c700 -1 osd.1 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130612 7.0 7:02683654:reshard::reshard.0000000010:head [call lock.lock in=70b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e353) 2019-11-29T21:33:19.995 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:33:19.988+0000 1694c700 -1 osd.6 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:23.028369+0000 front 2019-11-29T21:32:23.247693+0000 (oldest deadline 2019-11-29T21:33:03.542189+0000) 2019-11-29T21:33:19.997 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:33:19.991+0000 1694c700 -1 osd.6 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:124438 6.8 6:1594c276:root::.bucket.meta.7995bad2bc5d4a958746a7cd44134f2b%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.631:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e356) 2019-11-29T21:33:20.118 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:33:20.113+0000 1694c700 -1 osd.0 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:19.302731+0000 front 2019-11-29T21:32:19.260382+0000 (oldest deadline 2019-11-29T21:33:03.891219+0000) 2019-11-29T21:33:20.171 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:33:20.165+0000 1694c700 -1 osd.7 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:23.045505+0000 front 2019-11-29T21:32:22.623906+0000 (oldest deadline 2019-11-29T21:33:06.102623+0000) 2019-11-29T21:33:20.277 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:33:20.272+0000 1694c700 -1 osd.2 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:21.646753+0000 front 2019-11-29T21:32:21.407557+0000 (oldest deadline 2019-11-29T21:33:06.050491+0000) 2019-11-29T21:33:20.475 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:33:20.469+0000 1694c700 -1 osd.4 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:21.434647+0000 front 2019-11-29T21:32:21.450517+0000 (oldest deadline 2019-11-29T21:33:06.260251+0000) 2019-11-29T21:33:20.646 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:33:20.640+0000 1694c700 -1 osd.1 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:23.248988+0000 front 2019-11-29T21:32:23.247950+0000 (oldest deadline 2019-11-29T21:33:07.428735+0000) 2019-11-29T21:33:20.646 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:33:20.642+0000 1694c700 -1 osd.1 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130612 7.0 7:02683654:reshard::reshard.0000000010:head [call lock.lock in=70b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e353) 2019-11-29T21:33:20.985 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:33:20.979+0000 1694c700 -1 osd.6 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:23.028369+0000 front 2019-11-29T21:32:23.247693+0000 (oldest deadline 2019-11-29T21:33:03.542189+0000) 2019-11-29T21:33:20.986 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:33:20.981+0000 1694c700 -1 osd.6 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:124438 6.8 6:1594c276:root::.bucket.meta.7995bad2bc5d4a958746a7cd44134f2b%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.631:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e356) 2019-11-29T21:33:21.134 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:33:21.128+0000 1694c700 -1 osd.7 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:23.045505+0000 front 2019-11-29T21:32:22.623906+0000 (oldest deadline 2019-11-29T21:33:06.102623+0000) 2019-11-29T21:33:21.164 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:33:21.159+0000 1694c700 -1 osd.0 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:19.302731+0000 front 2019-11-29T21:32:19.260382+0000 (oldest deadline 2019-11-29T21:33:03.891219+0000) 2019-11-29T21:33:21.301 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:33:21.295+0000 1694c700 -1 osd.2 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:21.646753+0000 front 2019-11-29T21:32:21.407557+0000 (oldest deadline 2019-11-29T21:33:06.050491+0000) 2019-11-29T21:33:21.475 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:33:21.468+0000 1694c700 -1 osd.4 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:21.434647+0000 front 2019-11-29T21:32:21.450517+0000 (oldest deadline 2019-11-29T21:33:06.260251+0000) 2019-11-29T21:33:21.609 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:33:21.603+0000 1694c700 -1 osd.1 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:23.248988+0000 front 2019-11-29T21:32:23.247950+0000 (oldest deadline 2019-11-29T21:33:07.428735+0000) 2019-11-29T21:33:21.609 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:33:21.605+0000 1694c700 -1 osd.1 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130612 7.0 7:02683654:reshard::reshard.0000000010:head [call lock.lock in=70b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e353) 2019-11-29T21:33:21.963 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:33:21.954+0000 1694c700 -1 osd.6 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:23.028369+0000 front 2019-11-29T21:32:23.247693+0000 (oldest deadline 2019-11-29T21:33:03.542189+0000) 2019-11-29T21:33:21.968 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:33:21.955+0000 1694c700 -1 osd.6 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:124438 6.8 6:1594c276:root::.bucket.meta.7995bad2bc5d4a958746a7cd44134f2b%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.631:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e356) 2019-11-29T21:33:22.135 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:33:22.131+0000 1694c700 -1 osd.7 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:23.045505+0000 front 2019-11-29T21:32:22.623906+0000 (oldest deadline 2019-11-29T21:33:06.102623+0000) 2019-11-29T21:33:22.189 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:33:22.184+0000 1694c700 -1 osd.0 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:19.302731+0000 front 2019-11-29T21:32:19.260382+0000 (oldest deadline 2019-11-29T21:33:03.891219+0000) 2019-11-29T21:33:22.328 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:33:22.319+0000 1694c700 -1 osd.2 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:21.646753+0000 front 2019-11-29T21:32:21.407557+0000 (oldest deadline 2019-11-29T21:33:06.050491+0000) 2019-11-29T21:33:22.459 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:33:22.454+0000 1694c700 -1 osd.4 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:21.434647+0000 front 2019-11-29T21:32:21.450517+0000 (oldest deadline 2019-11-29T21:33:06.260251+0000) 2019-11-29T21:33:22.600 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:33:22.594+0000 1694c700 -1 osd.1 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:23.248988+0000 front 2019-11-29T21:32:23.247950+0000 (oldest deadline 2019-11-29T21:33:07.428735+0000) 2019-11-29T21:33:22.601 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:33:22.596+0000 1694c700 -1 osd.1 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130612 7.0 7:02683654:reshard::reshard.0000000010:head [call lock.lock in=70b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e353) 2019-11-29T21:33:22.932 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:33:22.926+0000 1694c700 -1 osd.6 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:23.028369+0000 front 2019-11-29T21:32:23.247693+0000 (oldest deadline 2019-11-29T21:33:03.542189+0000) 2019-11-29T21:33:22.932 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:33:22.927+0000 1694c700 -1 osd.6 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:124438 6.8 6:1594c276:root::.bucket.meta.7995bad2bc5d4a958746a7cd44134f2b%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.631:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e356) 2019-11-29T21:33:23.180 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:33:23.175+0000 1694c700 -1 osd.7 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:23.045505+0000 front 2019-11-29T21:32:22.623906+0000 (oldest deadline 2019-11-29T21:33:06.102623+0000) 2019-11-29T21:33:23.228 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:33:23.224+0000 1694c700 -1 osd.0 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:19.302731+0000 front 2019-11-29T21:32:19.260382+0000 (oldest deadline 2019-11-29T21:33:03.891219+0000) 2019-11-29T21:33:23.286 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:33:23.282+0000 1694c700 -1 osd.2 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:21.646753+0000 front 2019-11-29T21:32:21.407557+0000 (oldest deadline 2019-11-29T21:33:06.050491+0000) 2019-11-29T21:33:23.482 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:33:23.478+0000 1694c700 -1 osd.4 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:21.434647+0000 front 2019-11-29T21:32:21.450517+0000 (oldest deadline 2019-11-29T21:33:06.260251+0000) 2019-11-29T21:33:23.643 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:33:23.637+0000 1694c700 -1 osd.1 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:23.248988+0000 front 2019-11-29T21:32:23.247950+0000 (oldest deadline 2019-11-29T21:33:07.428735+0000) 2019-11-29T21:33:23.644 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:33:23.639+0000 1694c700 -1 osd.1 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130612 7.0 7:02683654:reshard::reshard.0000000010:head [call lock.lock in=70b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e353) 2019-11-29T21:33:23.893 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:33:23.887+0000 1694c700 -1 osd.6 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:23.028369+0000 front 2019-11-29T21:32:23.247693+0000 (oldest deadline 2019-11-29T21:33:03.542189+0000) 2019-11-29T21:33:23.893 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:33:23.888+0000 1694c700 -1 osd.6 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:124438 6.8 6:1594c276:root::.bucket.meta.7995bad2bc5d4a958746a7cd44134f2b%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.631:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e356) 2019-11-29T21:33:24.202 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:33:24.196+0000 1694c700 -1 osd.0 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:19.302731+0000 front 2019-11-29T21:32:19.260382+0000 (oldest deadline 2019-11-29T21:33:03.891219+0000) 2019-11-29T21:33:24.210 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:33:24.205+0000 1694c700 -1 osd.7 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:23.045505+0000 front 2019-11-29T21:32:22.623906+0000 (oldest deadline 2019-11-29T21:33:06.102623+0000) 2019-11-29T21:33:24.300 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:33:24.296+0000 1694c700 -1 osd.2 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:21.646753+0000 front 2019-11-29T21:32:21.407557+0000 (oldest deadline 2019-11-29T21:33:06.050491+0000) 2019-11-29T21:33:24.463 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:33:24.458+0000 1694c700 -1 osd.4 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:21.434647+0000 front 2019-11-29T21:32:21.450517+0000 (oldest deadline 2019-11-29T21:33:06.260251+0000) 2019-11-29T21:33:24.655 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:33:24.650+0000 1694c700 -1 osd.1 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:23.248988+0000 front 2019-11-29T21:32:23.247950+0000 (oldest deadline 2019-11-29T21:33:07.428735+0000) 2019-11-29T21:33:24.656 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:33:24.651+0000 1694c700 -1 osd.1 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130612 7.0 7:02683654:reshard::reshard.0000000010:head [call lock.lock in=70b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e353) 2019-11-29T21:33:24.864 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:33:24.859+0000 1694c700 -1 osd.6 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:23.028369+0000 front 2019-11-29T21:32:23.247693+0000 (oldest deadline 2019-11-29T21:33:03.542189+0000) 2019-11-29T21:33:24.866 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:33:24.862+0000 1694c700 -1 osd.6 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:124438 6.8 6:1594c276:root::.bucket.meta.7995bad2bc5d4a958746a7cd44134f2b%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.631:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e356) 2019-11-29T21:33:25.183 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:33:25.177+0000 1694c700 -1 osd.7 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:23.045505+0000 front 2019-11-29T21:32:22.623906+0000 (oldest deadline 2019-11-29T21:33:06.102623+0000) 2019-11-29T21:33:25.244 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:33:25.239+0000 1694c700 -1 osd.0 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:19.302731+0000 front 2019-11-29T21:32:19.260382+0000 (oldest deadline 2019-11-29T21:33:03.891219+0000) 2019-11-29T21:33:25.309 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:33:25.305+0000 1694c700 -1 osd.2 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:21.646753+0000 front 2019-11-29T21:32:21.407557+0000 (oldest deadline 2019-11-29T21:33:06.050491+0000) 2019-11-29T21:33:25.464 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:33:25.457+0000 1694c700 -1 osd.4 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:21.434647+0000 front 2019-11-29T21:32:21.450517+0000 (oldest deadline 2019-11-29T21:33:06.260251+0000) 2019-11-29T21:33:25.664 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:33:25.659+0000 1694c700 -1 osd.1 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:23.248988+0000 front 2019-11-29T21:32:23.247950+0000 (oldest deadline 2019-11-29T21:33:07.428735+0000) 2019-11-29T21:33:25.665 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:33:25.660+0000 1694c700 -1 osd.1 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130612 7.0 7:02683654:reshard::reshard.0000000010:head [call lock.lock in=70b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e353) 2019-11-29T21:33:25.842 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:33:25.836+0000 1694c700 -1 osd.6 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:23.028369+0000 front 2019-11-29T21:32:23.247693+0000 (oldest deadline 2019-11-29T21:33:03.542189+0000) 2019-11-29T21:33:25.842 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:33:25.838+0000 1694c700 -1 osd.6 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:124438 6.8 6:1594c276:root::.bucket.meta.7995bad2bc5d4a958746a7cd44134f2b%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.631:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e356) 2019-11-29T21:33:26.149 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:33:26.144+0000 1694c700 -1 osd.7 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:23.045505+0000 front 2019-11-29T21:32:22.623906+0000 (oldest deadline 2019-11-29T21:33:06.102623+0000) 2019-11-29T21:33:26.295 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:33:26.290+0000 1694c700 -1 osd.2 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:21.646753+0000 front 2019-11-29T21:32:21.407557+0000 (oldest deadline 2019-11-29T21:33:06.050491+0000) 2019-11-29T21:33:26.298 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:33:26.293+0000 1694c700 -1 osd.0 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:19.302731+0000 front 2019-11-29T21:32:19.260382+0000 (oldest deadline 2019-11-29T21:33:03.891219+0000) 2019-11-29T21:33:26.429 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:33:26.424+0000 1694c700 -1 osd.4 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:21.434647+0000 front 2019-11-29T21:32:21.450517+0000 (oldest deadline 2019-11-29T21:33:06.260251+0000) 2019-11-29T21:33:26.699 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:33:26.693+0000 1694c700 -1 osd.1 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:23.248988+0000 front 2019-11-29T21:32:23.247950+0000 (oldest deadline 2019-11-29T21:33:07.428735+0000) 2019-11-29T21:33:26.700 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:33:26.695+0000 1694c700 -1 osd.1 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130612 7.0 7:02683654:reshard::reshard.0000000010:head [call lock.lock in=70b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e353) 2019-11-29T21:33:26.816 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:33:26.811+0000 1694c700 -1 osd.6 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:23.028369+0000 front 2019-11-29T21:32:23.247693+0000 (oldest deadline 2019-11-29T21:33:03.542189+0000) 2019-11-29T21:33:26.817 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:33:26.812+0000 1694c700 -1 osd.6 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:124438 6.8 6:1594c276:root::.bucket.meta.7995bad2bc5d4a958746a7cd44134f2b%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.631:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e356) 2019-11-29T21:33:27.148 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:33:27.143+0000 1694c700 -1 osd.7 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:23.045505+0000 front 2019-11-29T21:32:22.623906+0000 (oldest deadline 2019-11-29T21:33:06.102623+0000) 2019-11-29T21:33:27.289 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:33:27.283+0000 1694c700 -1 osd.2 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:21.646753+0000 front 2019-11-29T21:32:21.407557+0000 (oldest deadline 2019-11-29T21:33:06.050491+0000) 2019-11-29T21:33:27.341 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:33:27.336+0000 1694c700 -1 osd.0 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:19.302731+0000 front 2019-11-29T21:32:19.260382+0000 (oldest deadline 2019-11-29T21:33:03.891219+0000) 2019-11-29T21:33:27.437 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:33:27.432+0000 1694c700 -1 osd.4 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:21.434647+0000 front 2019-11-29T21:32:21.450517+0000 (oldest deadline 2019-11-29T21:33:06.260251+0000) 2019-11-29T21:33:27.701 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:33:27.695+0000 1694c700 -1 osd.1 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:23.248988+0000 front 2019-11-29T21:32:23.247950+0000 (oldest deadline 2019-11-29T21:33:07.428735+0000) 2019-11-29T21:33:27.702 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:33:27.697+0000 1694c700 -1 osd.1 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130612 7.0 7:02683654:reshard::reshard.0000000010:head [call lock.lock in=70b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e353) 2019-11-29T21:33:27.857 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:33:27.851+0000 1694c700 -1 osd.6 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:23.028369+0000 front 2019-11-29T21:32:23.247693+0000 (oldest deadline 2019-11-29T21:33:03.542189+0000) 2019-11-29T21:33:27.857 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:33:27.853+0000 1694c700 -1 osd.6 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:124438 6.8 6:1594c276:root::.bucket.meta.7995bad2bc5d4a958746a7cd44134f2b%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.631:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e356) 2019-11-29T21:33:28.164 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:33:28.159+0000 1694c700 -1 osd.7 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:23.045505+0000 front 2019-11-29T21:32:22.623906+0000 (oldest deadline 2019-11-29T21:33:06.102623+0000) 2019-11-29T21:33:28.329 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:33:28.324+0000 1694c700 -1 osd.2 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:21.646753+0000 front 2019-11-29T21:32:21.407557+0000 (oldest deadline 2019-11-29T21:33:06.050491+0000) 2019-11-29T21:33:28.338 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:33:28.334+0000 1694c700 -1 osd.0 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:19.302731+0000 front 2019-11-29T21:32:19.260382+0000 (oldest deadline 2019-11-29T21:33:03.891219+0000) 2019-11-29T21:33:28.398 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:33:28.392+0000 1694c700 -1 osd.4 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:21.434647+0000 front 2019-11-29T21:32:21.450517+0000 (oldest deadline 2019-11-29T21:33:06.260251+0000) 2019-11-29T21:33:28.754 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:33:28.749+0000 1694c700 -1 osd.1 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:23.248988+0000 front 2019-11-29T21:32:23.247950+0000 (oldest deadline 2019-11-29T21:33:07.428735+0000) 2019-11-29T21:33:28.754 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:33:28.750+0000 1694c700 -1 osd.1 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130612 7.0 7:02683654:reshard::reshard.0000000010:head [call lock.lock in=70b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e353) 2019-11-29T21:33:28.888 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:33:28.882+0000 1694c700 -1 osd.6 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:23.028369+0000 front 2019-11-29T21:32:23.247693+0000 (oldest deadline 2019-11-29T21:33:03.542189+0000) 2019-11-29T21:33:28.888 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:33:28.884+0000 1694c700 -1 osd.6 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:124438 6.8 6:1594c276:root::.bucket.meta.7995bad2bc5d4a958746a7cd44134f2b%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.631:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e356) 2019-11-29T21:33:29.212 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:33:29.206+0000 1694c700 -1 osd.7 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:23.045505+0000 front 2019-11-29T21:32:22.623906+0000 (oldest deadline 2019-11-29T21:33:06.102623+0000) 2019-11-29T21:33:29.288 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:33:29.283+0000 1694c700 -1 osd.2 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:21.646753+0000 front 2019-11-29T21:32:21.407557+0000 (oldest deadline 2019-11-29T21:33:06.050491+0000) 2019-11-29T21:33:29.361 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:33:29.356+0000 1694c700 -1 osd.0 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:19.302731+0000 front 2019-11-29T21:32:19.260382+0000 (oldest deadline 2019-11-29T21:33:03.891219+0000) 2019-11-29T21:33:29.449 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:33:29.444+0000 1694c700 -1 osd.4 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:21.434647+0000 front 2019-11-29T21:32:21.450517+0000 (oldest deadline 2019-11-29T21:33:06.260251+0000) 2019-11-29T21:33:29.800 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:33:29.795+0000 1694c700 -1 osd.1 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:23.248988+0000 front 2019-11-29T21:32:23.247950+0000 (oldest deadline 2019-11-29T21:33:07.428735+0000) 2019-11-29T21:33:29.801 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:33:29.796+0000 1694c700 -1 osd.1 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130612 7.0 7:02683654:reshard::reshard.0000000010:head [call lock.lock in=70b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e353) 2019-11-29T21:33:29.845 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:33:29.841+0000 1694c700 -1 osd.6 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:23.028369+0000 front 2019-11-29T21:32:23.247693+0000 (oldest deadline 2019-11-29T21:33:03.542189+0000) 2019-11-29T21:33:29.847 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:33:29.843+0000 1694c700 -1 osd.6 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:124438 6.8 6:1594c276:root::.bucket.meta.7995bad2bc5d4a958746a7cd44134f2b%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.631:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e356) 2019-11-29T21:33:30.214 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:33:30.208+0000 1694c700 -1 osd.7 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:23.045505+0000 front 2019-11-29T21:32:22.623906+0000 (oldest deadline 2019-11-29T21:33:06.102623+0000) 2019-11-29T21:33:30.267 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:33:30.262+0000 1694c700 -1 osd.2 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:21.646753+0000 front 2019-11-29T21:32:21.407557+0000 (oldest deadline 2019-11-29T21:33:06.050491+0000) 2019-11-29T21:33:30.326 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:33:30.320+0000 1694c700 -1 osd.0 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:19.302731+0000 front 2019-11-29T21:32:19.260382+0000 (oldest deadline 2019-11-29T21:33:03.891219+0000) 2019-11-29T21:33:30.404 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:33:30.399+0000 1694c700 -1 osd.4 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:21.434647+0000 front 2019-11-29T21:32:21.450517+0000 (oldest deadline 2019-11-29T21:33:06.260251+0000) 2019-11-29T21:33:30.809 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:33:30.803+0000 1694c700 -1 osd.1 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:23.248988+0000 front 2019-11-29T21:32:23.247950+0000 (oldest deadline 2019-11-29T21:33:07.428735+0000) 2019-11-29T21:33:30.810 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:33:30.805+0000 1694c700 -1 osd.1 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130612 7.0 7:02683654:reshard::reshard.0000000010:head [call lock.lock in=70b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e353) 2019-11-29T21:33:30.832 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:33:30.827+0000 1694c700 -1 osd.6 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:23.028369+0000 front 2019-11-29T21:32:23.247693+0000 (oldest deadline 2019-11-29T21:33:03.542189+0000) 2019-11-29T21:33:30.832 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:33:30.828+0000 1694c700 -1 osd.6 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:124438 6.8 6:1594c276:root::.bucket.meta.7995bad2bc5d4a958746a7cd44134f2b%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.631:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e356) 2019-11-29T21:33:31.211 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:33:31.206+0000 1694c700 -1 osd.7 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:23.045505+0000 front 2019-11-29T21:32:22.623906+0000 (oldest deadline 2019-11-29T21:33:06.102623+0000) 2019-11-29T21:33:31.233 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:33:31.228+0000 1694c700 -1 osd.2 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:21.646753+0000 front 2019-11-29T21:32:21.407557+0000 (oldest deadline 2019-11-29T21:33:06.050491+0000) 2019-11-29T21:33:31.357 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:33:31.351+0000 1694c700 -1 osd.0 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:19.302731+0000 front 2019-11-29T21:32:19.260382+0000 (oldest deadline 2019-11-29T21:33:03.891219+0000) 2019-11-29T21:33:31.382 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:33:31.377+0000 1694c700 -1 osd.4 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:21.434647+0000 front 2019-11-29T21:32:21.450517+0000 (oldest deadline 2019-11-29T21:33:06.260251+0000) 2019-11-29T21:33:31.784 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:33:31.778+0000 1694c700 -1 osd.1 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:23.248988+0000 front 2019-11-29T21:32:23.247950+0000 (oldest deadline 2019-11-29T21:33:07.428735+0000) 2019-11-29T21:33:31.785 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:33:31.780+0000 1694c700 -1 osd.1 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130612 7.0 7:02683654:reshard::reshard.0000000010:head [call lock.lock in=70b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e353) 2019-11-29T21:33:31.835 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:33:31.829+0000 1694c700 -1 osd.6 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:23.028369+0000 front 2019-11-29T21:32:23.247693+0000 (oldest deadline 2019-11-29T21:33:03.542189+0000) 2019-11-29T21:33:31.835 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:33:31.831+0000 1694c700 -1 osd.6 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:124438 6.8 6:1594c276:root::.bucket.meta.7995bad2bc5d4a958746a7cd44134f2b%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.631:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e356) 2019-11-29T21:33:32.207 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:33:32.203+0000 1694c700 -1 osd.2 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:21.646753+0000 front 2019-11-29T21:32:21.407557+0000 (oldest deadline 2019-11-29T21:33:06.050491+0000) 2019-11-29T21:33:32.238 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:33:32.234+0000 1694c700 -1 osd.7 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:23.045505+0000 front 2019-11-29T21:32:22.623906+0000 (oldest deadline 2019-11-29T21:33:06.102623+0000) 2019-11-29T21:33:32.337 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:33:32.333+0000 1694c700 -1 osd.0 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:19.302731+0000 front 2019-11-29T21:32:19.260382+0000 (oldest deadline 2019-11-29T21:33:03.891219+0000) 2019-11-29T21:33:32.397 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:33:32.393+0000 1694c700 -1 osd.4 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:21.434647+0000 front 2019-11-29T21:32:21.450517+0000 (oldest deadline 2019-11-29T21:33:06.260251+0000) 2019-11-29T21:33:32.817 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:33:32.811+0000 1694c700 -1 osd.1 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:23.248988+0000 front 2019-11-29T21:32:23.247950+0000 (oldest deadline 2019-11-29T21:33:07.428735+0000) 2019-11-29T21:33:32.818 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:33:32.813+0000 1694c700 -1 osd.1 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130612 7.0 7:02683654:reshard::reshard.0000000010:head [call lock.lock in=70b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e353) 2019-11-29T21:33:32.887 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:33:32.881+0000 1694c700 -1 osd.6 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:23.028369+0000 front 2019-11-29T21:32:23.247693+0000 (oldest deadline 2019-11-29T21:33:03.542189+0000) 2019-11-29T21:33:32.890 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:33:32.885+0000 1694c700 -1 osd.6 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:124438 6.8 6:1594c276:root::.bucket.meta.7995bad2bc5d4a958746a7cd44134f2b%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.631:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e356) 2019-11-29T21:33:33.165 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:33:33.160+0000 1694c700 -1 osd.2 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:21.646753+0000 front 2019-11-29T21:32:21.407557+0000 (oldest deadline 2019-11-29T21:33:06.050491+0000) 2019-11-29T21:33:33.212 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:33:33.207+0000 1694c700 -1 osd.7 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:23.045505+0000 front 2019-11-29T21:32:22.623906+0000 (oldest deadline 2019-11-29T21:33:06.102623+0000) 2019-11-29T21:33:33.326 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:33:33.320+0000 1694c700 -1 osd.0 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:19.302731+0000 front 2019-11-29T21:32:19.260382+0000 (oldest deadline 2019-11-29T21:33:03.891219+0000) 2019-11-29T21:33:33.374 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:33:33.369+0000 1694c700 -1 osd.4 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:21.434647+0000 front 2019-11-29T21:32:21.450517+0000 (oldest deadline 2019-11-29T21:33:06.260251+0000) 2019-11-29T21:33:33.858 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:33:33.852+0000 1694c700 -1 osd.1 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:23.248988+0000 front 2019-11-29T21:32:23.247950+0000 (oldest deadline 2019-11-29T21:33:07.428735+0000) 2019-11-29T21:33:33.859 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:33:33.854+0000 1694c700 -1 osd.1 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130612 7.0 7:02683654:reshard::reshard.0000000010:head [call lock.lock in=70b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e353) 2019-11-29T21:33:33.860 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:33:33.855+0000 1694c700 -1 osd.6 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:23.028369+0000 front 2019-11-29T21:32:23.247693+0000 (oldest deadline 2019-11-29T21:33:03.542189+0000) 2019-11-29T21:33:33.861 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:33:33.856+0000 1694c700 -1 osd.6 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:124438 6.8 6:1594c276:root::.bucket.meta.7995bad2bc5d4a958746a7cd44134f2b%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.631:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e356) 2019-11-29T21:33:34.219 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:33:34.215+0000 1694c700 -1 osd.2 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:21.646753+0000 front 2019-11-29T21:32:21.407557+0000 (oldest deadline 2019-11-29T21:33:06.050491+0000) 2019-11-29T21:33:34.245 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:33:34.241+0000 1694c700 -1 osd.7 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:23.045505+0000 front 2019-11-29T21:32:22.623906+0000 (oldest deadline 2019-11-29T21:33:06.102623+0000) 2019-11-29T21:33:34.294 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:33:34.289+0000 1694c700 -1 osd.0 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:19.302731+0000 front 2019-11-29T21:32:19.260382+0000 (oldest deadline 2019-11-29T21:33:03.891219+0000) 2019-11-29T21:33:34.332 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:33:34.326+0000 1694c700 -1 osd.4 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:21.434647+0000 front 2019-11-29T21:32:21.450517+0000 (oldest deadline 2019-11-29T21:33:06.260251+0000) 2019-11-29T21:33:34.836 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:33:34.832+0000 1694c700 -1 osd.1 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:23.248988+0000 front 2019-11-29T21:32:23.247950+0000 (oldest deadline 2019-11-29T21:33:07.428735+0000) 2019-11-29T21:33:34.837 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:33:34.833+0000 1694c700 -1 osd.1 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130612 7.0 7:02683654:reshard::reshard.0000000010:head [call lock.lock in=70b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e353) 2019-11-29T21:33:34.840 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:33:34.835+0000 1694c700 -1 osd.6 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:23.028369+0000 front 2019-11-29T21:32:23.247693+0000 (oldest deadline 2019-11-29T21:33:03.542189+0000) 2019-11-29T21:33:34.841 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:33:34.836+0000 1694c700 -1 osd.6 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:124438 6.8 6:1594c276:root::.bucket.meta.7995bad2bc5d4a958746a7cd44134f2b%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.631:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e356) 2019-11-29T21:33:35.228 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:33:35.224+0000 1694c700 -1 osd.7 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:23.045505+0000 front 2019-11-29T21:32:22.623906+0000 (oldest deadline 2019-11-29T21:33:06.102623+0000) 2019-11-29T21:33:35.265 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:33:35.260+0000 1694c700 -1 osd.2 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:21.646753+0000 front 2019-11-29T21:32:21.407557+0000 (oldest deadline 2019-11-29T21:33:06.050491+0000) 2019-11-29T21:33:35.299 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:33:35.295+0000 1694c700 -1 osd.4 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:21.434647+0000 front 2019-11-29T21:32:21.450517+0000 (oldest deadline 2019-11-29T21:33:06.260251+0000) 2019-11-29T21:33:35.307 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:33:35.303+0000 1694c700 -1 osd.0 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:19.302731+0000 front 2019-11-29T21:32:19.260382+0000 (oldest deadline 2019-11-29T21:33:03.891219+0000) 2019-11-29T21:33:35.850 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:33:35.845+0000 1694c700 -1 osd.6 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:23.028369+0000 front 2019-11-29T21:32:23.247693+0000 (oldest deadline 2019-11-29T21:33:03.542189+0000) 2019-11-29T21:33:35.851 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:33:35.846+0000 1694c700 -1 osd.6 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:124438 6.8 6:1594c276:root::.bucket.meta.7995bad2bc5d4a958746a7cd44134f2b%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.631:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e356) 2019-11-29T21:33:35.885 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:33:35.879+0000 1694c700 -1 osd.1 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:23.248988+0000 front 2019-11-29T21:32:23.247950+0000 (oldest deadline 2019-11-29T21:33:07.428735+0000) 2019-11-29T21:33:35.886 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:33:35.881+0000 1694c700 -1 osd.1 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130612 7.0 7:02683654:reshard::reshard.0000000010:head [call lock.lock in=70b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e353) 2019-11-29T21:33:36.204 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:33:36.200+0000 1694c700 -1 osd.7 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:23.045505+0000 front 2019-11-29T21:32:22.623906+0000 (oldest deadline 2019-11-29T21:33:06.102623+0000) 2019-11-29T21:33:36.222 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:33:36.217+0000 1694c700 -1 osd.2 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:21.646753+0000 front 2019-11-29T21:32:21.407557+0000 (oldest deadline 2019-11-29T21:33:06.050491+0000) 2019-11-29T21:33:36.284 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:33:36.279+0000 1694c700 -1 osd.4 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:21.434647+0000 front 2019-11-29T21:32:21.450517+0000 (oldest deadline 2019-11-29T21:33:06.260251+0000) 2019-11-29T21:33:36.312 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:33:36.307+0000 1694c700 -1 osd.0 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:19.302731+0000 front 2019-11-29T21:32:19.260382+0000 (oldest deadline 2019-11-29T21:33:03.891219+0000) 2019-11-29T21:33:36.810 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:33:36.805+0000 1694c700 -1 osd.6 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:23.028369+0000 front 2019-11-29T21:32:23.247693+0000 (oldest deadline 2019-11-29T21:33:03.542189+0000) 2019-11-29T21:33:36.813 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:33:36.809+0000 1694c700 -1 osd.6 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:124438 6.8 6:1594c276:root::.bucket.meta.7995bad2bc5d4a958746a7cd44134f2b%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.631:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e356) 2019-11-29T21:33:36.854 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:33:36.848+0000 1694c700 -1 osd.1 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:23.248988+0000 front 2019-11-29T21:32:23.247950+0000 (oldest deadline 2019-11-29T21:33:07.428735+0000) 2019-11-29T21:33:36.855 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:33:36.850+0000 1694c700 -1 osd.1 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130612 7.0 7:02683654:reshard::reshard.0000000010:head [call lock.lock in=70b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e353) 2019-11-29T21:33:37.180 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:33:37.176+0000 1694c700 -1 osd.7 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:23.045505+0000 front 2019-11-29T21:32:22.623906+0000 (oldest deadline 2019-11-29T21:33:06.102623+0000) 2019-11-29T21:33:37.221 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:33:37.216+0000 1694c700 -1 osd.2 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:21.646753+0000 front 2019-11-29T21:32:21.407557+0000 (oldest deadline 2019-11-29T21:33:06.050491+0000) 2019-11-29T21:33:37.268 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:33:37.264+0000 1694c700 -1 osd.4 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:21.434647+0000 front 2019-11-29T21:32:21.450517+0000 (oldest deadline 2019-11-29T21:33:06.260251+0000) 2019-11-29T21:33:37.282 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:33:37.277+0000 1694c700 -1 osd.0 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:19.302731+0000 front 2019-11-29T21:32:19.260382+0000 (oldest deadline 2019-11-29T21:33:03.891219+0000) 2019-11-29T21:33:37.847 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:33:37.839+0000 1694c700 -1 osd.6 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:23.028369+0000 front 2019-11-29T21:32:23.247693+0000 (oldest deadline 2019-11-29T21:33:03.542189+0000) 2019-11-29T21:33:37.848 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:33:37.840+0000 1694c700 -1 osd.6 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:124438 6.8 6:1594c276:root::.bucket.meta.7995bad2bc5d4a958746a7cd44134f2b%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.631:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e356) 2019-11-29T21:33:37.849 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:33:37.842+0000 1694c700 -1 osd.1 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:23.248988+0000 front 2019-11-29T21:32:23.247950+0000 (oldest deadline 2019-11-29T21:33:07.428735+0000) 2019-11-29T21:33:37.851 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:33:37.844+0000 1694c700 -1 osd.1 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130612 7.0 7:02683654:reshard::reshard.0000000010:head [call lock.lock in=70b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e353) 2019-11-29T21:33:38.229 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:33:38.221+0000 1694c700 -1 osd.7 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:23.045505+0000 front 2019-11-29T21:32:22.623906+0000 (oldest deadline 2019-11-29T21:33:06.102623+0000) 2019-11-29T21:33:38.261 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:33:38.255+0000 1694c700 -1 osd.2 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:21.646753+0000 front 2019-11-29T21:32:21.407557+0000 (oldest deadline 2019-11-29T21:33:06.050491+0000) 2019-11-29T21:33:38.262 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:33:38.257+0000 1694c700 -1 osd.0 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:19.302731+0000 front 2019-11-29T21:32:19.260382+0000 (oldest deadline 2019-11-29T21:33:03.891219+0000) 2019-11-29T21:33:38.267 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:33:38.261+0000 1694c700 -1 osd.4 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:21.434647+0000 front 2019-11-29T21:32:21.450517+0000 (oldest deadline 2019-11-29T21:33:06.260251+0000) 2019-11-29T21:33:38.802 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:33:38.798+0000 1694c700 -1 osd.6 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:23.028369+0000 front 2019-11-29T21:32:23.247693+0000 (oldest deadline 2019-11-29T21:33:03.542189+0000) 2019-11-29T21:33:38.805 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:33:38.801+0000 1694c700 -1 osd.6 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:124438 6.8 6:1594c276:root::.bucket.meta.7995bad2bc5d4a958746a7cd44134f2b%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.631:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e356) 2019-11-29T21:33:38.823 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:33:38.817+0000 1694c700 -1 osd.1 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:23.248988+0000 front 2019-11-29T21:32:23.247950+0000 (oldest deadline 2019-11-29T21:33:07.428735+0000) 2019-11-29T21:33:38.823 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:33:38.819+0000 1694c700 -1 osd.1 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130612 7.0 7:02683654:reshard::reshard.0000000010:head [call lock.lock in=70b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e353) 2019-11-29T21:33:39.228 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:33:39.224+0000 1694c700 -1 osd.0 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:19.302731+0000 front 2019-11-29T21:32:19.260382+0000 (oldest deadline 2019-11-29T21:33:03.891219+0000) 2019-11-29T21:33:39.257 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:33:39.253+0000 1694c700 -1 osd.2 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:21.646753+0000 front 2019-11-29T21:32:21.407557+0000 (oldest deadline 2019-11-29T21:33:06.050491+0000) 2019-11-29T21:33:39.264 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:33:39.260+0000 1694c700 -1 osd.7 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:23.045505+0000 front 2019-11-29T21:32:22.623906+0000 (oldest deadline 2019-11-29T21:33:06.102623+0000) 2019-11-29T21:33:39.273 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:33:39.269+0000 1694c700 -1 osd.4 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:21.434647+0000 front 2019-11-29T21:32:21.450517+0000 (oldest deadline 2019-11-29T21:33:06.260251+0000) 2019-11-29T21:33:39.788 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:33:39.783+0000 1694c700 -1 osd.1 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:23.248988+0000 front 2019-11-29T21:32:23.247950+0000 (oldest deadline 2019-11-29T21:33:07.428735+0000) 2019-11-29T21:33:39.788 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:33:39.784+0000 1694c700 -1 osd.1 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130612 7.0 7:02683654:reshard::reshard.0000000010:head [call lock.lock in=70b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e353) 2019-11-29T21:33:39.798 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:33:39.794+0000 1694c700 -1 osd.6 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:23.028369+0000 front 2019-11-29T21:32:23.247693+0000 (oldest deadline 2019-11-29T21:33:03.542189+0000) 2019-11-29T21:33:39.800 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:33:39.797+0000 1694c700 -1 osd.6 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:124438 6.8 6:1594c276:root::.bucket.meta.7995bad2bc5d4a958746a7cd44134f2b%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.631:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e356) 2019-11-29T21:33:40.094 INFO:tasks.ceph.mon.b.smithi022.stderr:2019-11-29T21:33:40.084+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 4 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.22:6818/9264,v1:172.21.15.22:6819/9264] for 46sec e356 v356) 2019-11-29T21:33:40.201 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:09:08:20.859 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T21:33:40.247 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:33:40.242+0000 1694c700 -1 osd.0 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:19.302731+0000 front 2019-11-29T21:32:19.260382+0000 (oldest deadline 2019-11-29T21:33:03.891219+0000) 2019-11-29T21:33:40.250 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:09:08:20.909 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T21:33:40.273 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:33:40.268+0000 1694c700 -1 osd.2 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:21.646753+0000 front 2019-11-29T21:32:21.407557+0000 (oldest deadline 2019-11-29T21:33:06.050491+0000) 2019-11-29T21:33:40.274 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:33:40.269+0000 1694c700 -1 osd.7 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:23.045505+0000 front 2019-11-29T21:32:22.623906+0000 (oldest deadline 2019-11-29T21:33:06.102623+0000) 2019-11-29T21:33:40.292 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:09:08:20.899 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T21:33:40.303 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:33:40.299+0000 1694c700 -1 osd.4 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:21.434647+0000 front 2019-11-29T21:32:21.450517+0000 (oldest deadline 2019-11-29T21:33:06.260251+0000) 2019-11-29T21:33:40.306 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:09:08:20.913 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T21:33:40.311 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:09:08:20.970 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T21:33:40.313 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:09:08:20.920 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T21:33:40.329 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:09:08:20.936 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T21:33:40.380 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:09:08:20.987 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T21:33:40.395 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:09:08:21.002 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T21:33:40.780 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:33:40.774+0000 1694c700 -1 osd.1 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:23.248988+0000 front 2019-11-29T21:32:23.247950+0000 (oldest deadline 2019-11-29T21:33:07.428735+0000) 2019-11-29T21:33:40.781 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:33:40.776+0000 1694c700 -1 osd.1 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130612 7.0 7:02683654:reshard::reshard.0000000010:head [call lock.lock in=70b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e353) 2019-11-29T21:33:40.828 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:33:40.824+0000 1694c700 -1 osd.6 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:23.028369+0000 front 2019-11-29T21:32:23.247693+0000 (oldest deadline 2019-11-29T21:33:03.542189+0000) 2019-11-29T21:33:40.829 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:33:40.825+0000 1694c700 -1 osd.6 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:124438 6.8 6:1594c276:root::.bucket.meta.7995bad2bc5d4a958746a7cd44134f2b%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.631:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e356) 2019-11-29T21:33:41.260 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:33:41.255+0000 1694c700 -1 osd.7 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:23.045505+0000 front 2019-11-29T21:32:22.623906+0000 (oldest deadline 2019-11-29T21:33:06.102623+0000) 2019-11-29T21:33:41.260 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:33:41.255+0000 1694c700 -1 osd.0 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:19.302731+0000 front 2019-11-29T21:32:19.260382+0000 (oldest deadline 2019-11-29T21:33:03.891219+0000) 2019-11-29T21:33:41.296 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:33:41.292+0000 1694c700 -1 osd.2 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:21.646753+0000 front 2019-11-29T21:32:21.407557+0000 (oldest deadline 2019-11-29T21:33:06.050491+0000) 2019-11-29T21:33:41.316 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:33:41.312+0000 1694c700 -1 osd.4 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:21.434647+0000 front 2019-11-29T21:32:21.450517+0000 (oldest deadline 2019-11-29T21:33:06.260251+0000) 2019-11-29T21:33:41.827 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:33:41.822+0000 1694c700 -1 osd.1 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:23.248988+0000 front 2019-11-29T21:32:23.247950+0000 (oldest deadline 2019-11-29T21:33:07.428735+0000) 2019-11-29T21:33:41.828 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:33:41.824+0000 1694c700 -1 osd.1 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130612 7.0 7:02683654:reshard::reshard.0000000010:head [call lock.lock in=70b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e353) 2019-11-29T21:33:41.882 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:33:41.876+0000 1694c700 -1 osd.6 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:23.028369+0000 front 2019-11-29T21:32:23.247693+0000 (oldest deadline 2019-11-29T21:33:03.542189+0000) 2019-11-29T21:33:41.882 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:33:41.878+0000 1694c700 -1 osd.6 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:124438 6.8 6:1594c276:root::.bucket.meta.7995bad2bc5d4a958746a7cd44134f2b%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.631:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e356) 2019-11-29T21:33:42.252 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:33:42.247+0000 1694c700 -1 osd.7 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:23.045505+0000 front 2019-11-29T21:32:22.623906+0000 (oldest deadline 2019-11-29T21:33:06.102623+0000) 2019-11-29T21:33:42.255 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:33:42.250+0000 1694c700 -1 osd.0 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:19.302731+0000 front 2019-11-29T21:32:19.260382+0000 (oldest deadline 2019-11-29T21:33:03.891219+0000) 2019-11-29T21:33:42.296 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:33:42.290+0000 1694c700 -1 osd.2 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:21.646753+0000 front 2019-11-29T21:32:21.407557+0000 (oldest deadline 2019-11-29T21:33:06.050491+0000) 2019-11-29T21:33:42.327 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:33:42.322+0000 1694c700 -1 osd.4 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:21.434647+0000 front 2019-11-29T21:32:21.450517+0000 (oldest deadline 2019-11-29T21:33:06.260251+0000) 2019-11-29T21:33:42.842 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:33:42.836+0000 1694c700 -1 osd.1 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:23.248988+0000 front 2019-11-29T21:32:23.247950+0000 (oldest deadline 2019-11-29T21:33:07.428735+0000) 2019-11-29T21:33:42.843 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:33:42.838+0000 1694c700 -1 osd.1 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130612 7.0 7:02683654:reshard::reshard.0000000010:head [call lock.lock in=70b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e353) 2019-11-29T21:33:42.851 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:33:42.847+0000 1694c700 -1 osd.6 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:23.028369+0000 front 2019-11-29T21:32:23.247693+0000 (oldest deadline 2019-11-29T21:33:03.542189+0000) 2019-11-29T21:33:42.853 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:33:42.849+0000 1694c700 -1 osd.6 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:124438 6.8 6:1594c276:root::.bucket.meta.7995bad2bc5d4a958746a7cd44134f2b%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.631:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e356) 2019-11-29T21:33:43.252 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:33:43.247+0000 1694c700 -1 osd.2 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:21.646753+0000 front 2019-11-29T21:32:21.407557+0000 (oldest deadline 2019-11-29T21:33:06.050491+0000) 2019-11-29T21:33:43.265 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:33:43.260+0000 1694c700 -1 osd.0 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:19.302731+0000 front 2019-11-29T21:32:19.260382+0000 (oldest deadline 2019-11-29T21:33:03.891219+0000) 2019-11-29T21:33:43.273 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:33:43.269+0000 1694c700 -1 osd.7 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:23.045505+0000 front 2019-11-29T21:32:22.623906+0000 (oldest deadline 2019-11-29T21:33:06.102623+0000) 2019-11-29T21:33:43.292 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:33:43.287+0000 1694c700 -1 osd.4 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:21.434647+0000 front 2019-11-29T21:32:21.450517+0000 (oldest deadline 2019-11-29T21:33:06.260251+0000) 2019-11-29T21:33:43.873 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:33:43.868+0000 1694c700 -1 osd.6 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:23.028369+0000 front 2019-11-29T21:32:23.247693+0000 (oldest deadline 2019-11-29T21:33:03.542189+0000) 2019-11-29T21:33:43.874 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:33:43.869+0000 1694c700 -1 osd.6 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:124438 6.8 6:1594c276:root::.bucket.meta.7995bad2bc5d4a958746a7cd44134f2b%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.631:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e356) 2019-11-29T21:33:43.877 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:33:43.873+0000 1694c700 -1 osd.1 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:23.248988+0000 front 2019-11-29T21:32:23.247950+0000 (oldest deadline 2019-11-29T21:33:07.428735+0000) 2019-11-29T21:33:43.877 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:33:43.873+0000 1694c700 -1 osd.1 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130612 7.0 7:02683654:reshard::reshard.0000000010:head [call lock.lock in=70b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e353) 2019-11-29T21:33:44.277 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:33:44.262+0000 1694c700 -1 osd.7 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:23.045505+0000 front 2019-11-29T21:32:22.623906+0000 (oldest deadline 2019-11-29T21:33:06.102623+0000) 2019-11-29T21:33:44.288 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:33:44.283+0000 1694c700 -1 osd.2 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:21.646753+0000 front 2019-11-29T21:32:21.407557+0000 (oldest deadline 2019-11-29T21:33:06.050491+0000) 2019-11-29T21:33:44.313 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:33:44.309+0000 1694c700 -1 osd.4 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:21.434647+0000 front 2019-11-29T21:32:21.450517+0000 (oldest deadline 2019-11-29T21:33:06.260251+0000) 2019-11-29T21:33:44.319 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:33:44.313+0000 1694c700 -1 osd.0 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:19.302731+0000 front 2019-11-29T21:32:19.260382+0000 (oldest deadline 2019-11-29T21:33:03.891219+0000) 2019-11-29T21:33:44.829 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:33:44.824+0000 1694c700 -1 osd.6 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:23.028369+0000 front 2019-11-29T21:32:23.247693+0000 (oldest deadline 2019-11-29T21:33:03.542189+0000) 2019-11-29T21:33:44.832 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:33:44.828+0000 1694c700 -1 osd.6 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:124438 6.8 6:1594c276:root::.bucket.meta.7995bad2bc5d4a958746a7cd44134f2b%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.631:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e356) 2019-11-29T21:33:44.860 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:33:44.855+0000 1694c700 -1 osd.1 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:23.248988+0000 front 2019-11-29T21:32:23.247950+0000 (oldest deadline 2019-11-29T21:33:07.428735+0000) 2019-11-29T21:33:44.861 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:33:44.857+0000 1694c700 -1 osd.1 356 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130612 7.0 7:02683654:reshard::reshard.0000000010:head [call lock.lock in=70b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e353) 2019-11-29T21:33:45.186 INFO:tasks.ceph.mon.b.smithi022.stderr:2019-11-29T21:33:45.174+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.22:6818/9264,v1:172.21.15.22:6819/9264] for 46sec e356 v356) 2019-11-29T21:33:45.254 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:33:45.247+0000 1694c700 -1 osd.2 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:21.646753+0000 front 2019-11-29T21:32:21.407557+0000 (oldest deadline 2019-11-29T21:33:06.050491+0000) 2019-11-29T21:33:45.312 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:33:45.307+0000 1694c700 -1 osd.0 356 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:32:19.302731+0000 front 2019-11-29T21:32:19.260382+0000 (oldest deadline 2019-11-29T21:33:03.891219+0000) 2019-11-29T21:33:45.872 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:33:45.832+0000 1694c700 -1 osd.6 357 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:124438 6.8 6:1594c276:root::.bucket.meta.7995bad2bc5d4a958746a7cd44134f2b%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.631:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e356) 2019-11-29T21:33:46.058 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:33:46.054+0000 1694c700 -1 osd.1 357 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130612 7.0 7:02683654:reshard::reshard.0000000010:head [call lock.lock in=70b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e353) 2019-11-29T21:33:46.990 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:33:46.955+0000 1694c700 -1 osd.6 358 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4325.0:124438 6.8 6:1594c276:root::.bucket.meta.7995bad2bc5d4a958746a7cd44134f2b%3a7f922895-c6d7-4b1b-a19c-be3df5b5a899.4331.631:head [create,call version.set in=58b,writefull 0~306 in=306b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e356) 2019-11-29T21:34:43.045 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:34:43.038+0000 1694c700 -1 osd.0 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:02.234588+0000 front 2019-11-29T21:34:03.083843+0000 (oldest deadline 2019-11-29T21:34:42.945601+0000) 2019-11-29T21:34:44.049 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:34:44.043+0000 1694c700 -1 osd.0 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:02.234588+0000 front 2019-11-29T21:34:03.083843+0000 (oldest deadline 2019-11-29T21:34:42.945601+0000) 2019-11-29T21:34:44.519 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:34:44.512+0000 1694c700 -1 osd.2 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.721415+0000 front 2019-11-29T21:34:01.939370+0000 (oldest deadline 2019-11-29T21:34:44.003144+0000) 2019-11-29T21:34:45.067 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:34:45.061+0000 1694c700 -1 osd.0 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:02.234588+0000 front 2019-11-29T21:34:03.083843+0000 (oldest deadline 2019-11-29T21:34:42.945601+0000) 2019-11-29T21:34:45.528 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:34:45.523+0000 1694c700 -1 osd.2 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.721415+0000 front 2019-11-29T21:34:01.939370+0000 (oldest deadline 2019-11-29T21:34:44.003144+0000) 2019-11-29T21:34:45.562 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:34:45.557+0000 1694c700 -1 osd.4 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.239185+0000 front 2019-11-29T21:34:01.216873+0000 (oldest deadline 2019-11-29T21:34:45.177244+0000) 2019-11-29T21:34:45.643 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:34:45.636+0000 1694c700 -1 osd.6 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:33:59.565649+0000 front 2019-11-29T21:34:00.280209+0000 (oldest deadline 2019-11-29T21:34:45.384917+0000) 2019-11-29T21:34:46.067 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:34:46.061+0000 1694c700 -1 osd.0 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:02.234588+0000 front 2019-11-29T21:34:03.083843+0000 (oldest deadline 2019-11-29T21:34:42.945601+0000) 2019-11-29T21:34:46.515 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:34:46.509+0000 1694c700 -1 osd.2 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.721415+0000 front 2019-11-29T21:34:01.939370+0000 (oldest deadline 2019-11-29T21:34:44.003144+0000) 2019-11-29T21:34:46.578 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:34:46.573+0000 1694c700 -1 osd.4 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.239185+0000 front 2019-11-29T21:34:01.216873+0000 (oldest deadline 2019-11-29T21:34:45.177244+0000) 2019-11-29T21:34:46.653 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:34:46.648+0000 1694c700 -1 osd.6 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:33:59.565649+0000 front 2019-11-29T21:34:00.280209+0000 (oldest deadline 2019-11-29T21:34:45.384917+0000) 2019-11-29T21:34:47.095 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:34:47.089+0000 1694c700 -1 osd.0 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:02.234588+0000 front 2019-11-29T21:34:03.083843+0000 (oldest deadline 2019-11-29T21:34:42.945601+0000) 2019-11-29T21:34:47.459 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:34:47.453+0000 1694c700 -1 osd.7 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.472363+0000 front 2019-11-29T21:34:01.720825+0000 (oldest deadline 2019-11-29T21:34:46.765621+0000) 2019-11-29T21:34:47.537 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:34:47.532+0000 1694c700 -1 osd.2 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.721415+0000 front 2019-11-29T21:34:01.939370+0000 (oldest deadline 2019-11-29T21:34:44.003144+0000) 2019-11-29T21:34:47.600 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:34:47.594+0000 1694c700 -1 osd.4 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.239185+0000 front 2019-11-29T21:34:01.216873+0000 (oldest deadline 2019-11-29T21:34:45.177244+0000) 2019-11-29T21:34:47.694 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:34:47.688+0000 1694c700 -1 osd.6 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:33:59.565649+0000 front 2019-11-29T21:34:00.280209+0000 (oldest deadline 2019-11-29T21:34:45.384917+0000) 2019-11-29T21:34:48.103 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:34:48.099+0000 1694c700 -1 osd.0 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:02.234588+0000 front 2019-11-29T21:34:03.083843+0000 (oldest deadline 2019-11-29T21:34:42.945601+0000) 2019-11-29T21:34:48.508 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:34:48.502+0000 1694c700 -1 osd.7 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.472363+0000 front 2019-11-29T21:34:01.720825+0000 (oldest deadline 2019-11-29T21:34:46.765621+0000) 2019-11-29T21:34:48.550 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:34:48.544+0000 1694c700 -1 osd.2 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.721415+0000 front 2019-11-29T21:34:01.939370+0000 (oldest deadline 2019-11-29T21:34:44.003144+0000) 2019-11-29T21:34:48.638 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:34:48.630+0000 1694c700 -1 osd.4 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.239185+0000 front 2019-11-29T21:34:01.216873+0000 (oldest deadline 2019-11-29T21:34:45.177244+0000) 2019-11-29T21:34:48.655 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:34:48.650+0000 1694c700 -1 osd.6 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:33:59.565649+0000 front 2019-11-29T21:34:00.280209+0000 (oldest deadline 2019-11-29T21:34:45.384917+0000) 2019-11-29T21:34:49.064 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:34:49.059+0000 1694c700 -1 osd.0 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:02.234588+0000 front 2019-11-29T21:34:03.083843+0000 (oldest deadline 2019-11-29T21:34:42.945601+0000) 2019-11-29T21:34:49.241 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:34:49.237+0000 1694c700 -1 osd.5 362 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e360) 2019-11-29T21:34:49.475 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:34:49.462+0000 1694c700 -1 osd.7 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.472363+0000 front 2019-11-29T21:34:01.720825+0000 (oldest deadline 2019-11-29T21:34:46.765621+0000) 2019-11-29T21:34:49.590 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:34:49.585+0000 1694c700 -1 osd.2 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.721415+0000 front 2019-11-29T21:34:01.939370+0000 (oldest deadline 2019-11-29T21:34:44.003144+0000) 2019-11-29T21:34:49.629 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:34:49.624+0000 1694c700 -1 osd.4 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.239185+0000 front 2019-11-29T21:34:01.216873+0000 (oldest deadline 2019-11-29T21:34:45.177244+0000) 2019-11-29T21:34:49.635 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:34:49.630+0000 1694c700 -1 osd.6 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:33:59.565649+0000 front 2019-11-29T21:34:00.280209+0000 (oldest deadline 2019-11-29T21:34:45.384917+0000) 2019-11-29T21:34:50.061 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:34:50.053+0000 1694c700 -1 osd.0 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:02.234588+0000 front 2019-11-29T21:34:03.083843+0000 (oldest deadline 2019-11-29T21:34:42.945601+0000) 2019-11-29T21:34:50.294 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:34:50.288+0000 1694c700 -1 osd.5 362 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e360) 2019-11-29T21:34:50.519 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:34:50.512+0000 1694c700 -1 osd.7 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.472363+0000 front 2019-11-29T21:34:01.720825+0000 (oldest deadline 2019-11-29T21:34:46.765621+0000) 2019-11-29T21:34:50.557 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:34:50.551+0000 1694c700 -1 osd.2 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.721415+0000 front 2019-11-29T21:34:01.939370+0000 (oldest deadline 2019-11-29T21:34:44.003144+0000) 2019-11-29T21:34:50.630 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:34:50.624+0000 1694c700 -1 osd.6 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:33:59.565649+0000 front 2019-11-29T21:34:00.280209+0000 (oldest deadline 2019-11-29T21:34:45.384917+0000) 2019-11-29T21:34:50.668 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:34:50.663+0000 1694c700 -1 osd.4 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.239185+0000 front 2019-11-29T21:34:01.216873+0000 (oldest deadline 2019-11-29T21:34:45.177244+0000) 2019-11-29T21:34:51.053 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:34:51.048+0000 1694c700 -1 osd.0 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:02.234588+0000 front 2019-11-29T21:34:03.083843+0000 (oldest deadline 2019-11-29T21:34:42.945601+0000) 2019-11-29T21:34:51.293 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:34:51.289+0000 1694c700 -1 osd.5 362 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e360) 2019-11-29T21:34:51.541 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:34:51.536+0000 1694c700 -1 osd.7 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.472363+0000 front 2019-11-29T21:34:01.720825+0000 (oldest deadline 2019-11-29T21:34:46.765621+0000) 2019-11-29T21:34:51.576 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:34:51.572+0000 1694c700 -1 osd.2 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.721415+0000 front 2019-11-29T21:34:01.939370+0000 (oldest deadline 2019-11-29T21:34:44.003144+0000) 2019-11-29T21:34:51.674 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:34:51.669+0000 1694c700 -1 osd.6 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:33:59.565649+0000 front 2019-11-29T21:34:00.280209+0000 (oldest deadline 2019-11-29T21:34:45.384917+0000) 2019-11-29T21:34:51.681 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:34:51.672+0000 1694c700 -1 osd.4 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.239185+0000 front 2019-11-29T21:34:01.216873+0000 (oldest deadline 2019-11-29T21:34:45.177244+0000) 2019-11-29T21:34:52.010 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:34:52.005+0000 1694c700 -1 osd.0 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:02.234588+0000 front 2019-11-29T21:34:03.083843+0000 (oldest deadline 2019-11-29T21:34:42.945601+0000) 2019-11-29T21:34:52.331 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:34:52.327+0000 1694c700 -1 osd.5 362 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e360) 2019-11-29T21:34:52.529 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:34:52.521+0000 1694c700 -1 osd.7 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.472363+0000 front 2019-11-29T21:34:01.720825+0000 (oldest deadline 2019-11-29T21:34:46.765621+0000) 2019-11-29T21:34:52.600 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:34:52.595+0000 1694c700 -1 osd.2 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.721415+0000 front 2019-11-29T21:34:01.939370+0000 (oldest deadline 2019-11-29T21:34:44.003144+0000) 2019-11-29T21:34:52.657 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:34:52.651+0000 1694c700 -1 osd.4 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.239185+0000 front 2019-11-29T21:34:01.216873+0000 (oldest deadline 2019-11-29T21:34:45.177244+0000) 2019-11-29T21:34:52.689 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:34:52.683+0000 1694c700 -1 osd.6 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:33:59.565649+0000 front 2019-11-29T21:34:00.280209+0000 (oldest deadline 2019-11-29T21:34:45.384917+0000) 2019-11-29T21:34:53.016 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:34:53.011+0000 1694c700 -1 osd.0 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:02.234588+0000 front 2019-11-29T21:34:03.083843+0000 (oldest deadline 2019-11-29T21:34:42.945601+0000) 2019-11-29T21:34:53.359 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:34:53.355+0000 1694c700 -1 osd.5 362 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e360) 2019-11-29T21:34:53.504 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:34:53.498+0000 1694c700 -1 osd.7 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.472363+0000 front 2019-11-29T21:34:01.720825+0000 (oldest deadline 2019-11-29T21:34:46.765621+0000) 2019-11-29T21:34:53.616 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:34:53.611+0000 1694c700 -1 osd.2 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.721415+0000 front 2019-11-29T21:34:01.939370+0000 (oldest deadline 2019-11-29T21:34:44.003144+0000) 2019-11-29T21:34:53.657 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:34:53.651+0000 1694c700 -1 osd.4 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.239185+0000 front 2019-11-29T21:34:01.216873+0000 (oldest deadline 2019-11-29T21:34:45.177244+0000) 2019-11-29T21:34:53.698 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:34:53.693+0000 1694c700 -1 osd.6 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:33:59.565649+0000 front 2019-11-29T21:34:00.280209+0000 (oldest deadline 2019-11-29T21:34:45.384917+0000) 2019-11-29T21:34:53.995 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:34:53.989+0000 1694c700 -1 osd.0 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:02.234588+0000 front 2019-11-29T21:34:03.083843+0000 (oldest deadline 2019-11-29T21:34:42.945601+0000) 2019-11-29T21:34:54.333 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:34:54.328+0000 1694c700 -1 osd.5 362 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e360) 2019-11-29T21:34:54.488 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:34:54.484+0000 1694c700 -1 osd.7 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.472363+0000 front 2019-11-29T21:34:01.720825+0000 (oldest deadline 2019-11-29T21:34:46.765621+0000) 2019-11-29T21:34:54.607 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:34:54.602+0000 1694c700 -1 osd.2 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.721415+0000 front 2019-11-29T21:34:01.939370+0000 (oldest deadline 2019-11-29T21:34:44.003144+0000) 2019-11-29T21:34:54.625 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:34:54.619+0000 1694c700 -1 osd.4 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.239185+0000 front 2019-11-29T21:34:01.216873+0000 (oldest deadline 2019-11-29T21:34:45.177244+0000) 2019-11-29T21:34:54.752 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:34:54.746+0000 1694c700 -1 osd.6 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:33:59.565649+0000 front 2019-11-29T21:34:00.280209+0000 (oldest deadline 2019-11-29T21:34:45.384917+0000) 2019-11-29T21:34:55.014 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:34:55.008+0000 1694c700 -1 osd.0 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:02.234588+0000 front 2019-11-29T21:34:03.083843+0000 (oldest deadline 2019-11-29T21:34:42.945601+0000) 2019-11-29T21:34:55.288 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:34:55.281+0000 1694c700 -1 osd.5 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:34:15.039882+0000 (oldest deadline 2019-11-29T21:34:55.039882+0000) 2019-11-29T21:34:55.289 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:34:55.284+0000 1694c700 -1 osd.5 362 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e360) 2019-11-29T21:34:55.451 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:34:55.445+0000 1694c700 -1 osd.7 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.472363+0000 front 2019-11-29T21:34:01.720825+0000 (oldest deadline 2019-11-29T21:34:46.765621+0000) 2019-11-29T21:34:55.632 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:34:55.627+0000 1694c700 -1 osd.4 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.239185+0000 front 2019-11-29T21:34:01.216873+0000 (oldest deadline 2019-11-29T21:34:45.177244+0000) 2019-11-29T21:34:55.637 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:34:55.631+0000 1694c700 -1 osd.2 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.721415+0000 front 2019-11-29T21:34:01.939370+0000 (oldest deadline 2019-11-29T21:34:44.003144+0000) 2019-11-29T21:34:55.766 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:34:55.761+0000 1694c700 -1 osd.6 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:33:59.565649+0000 front 2019-11-29T21:34:00.280209+0000 (oldest deadline 2019-11-29T21:34:45.384917+0000) 2019-11-29T21:34:56.037 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:34:56.031+0000 1694c700 -1 osd.0 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:02.234588+0000 front 2019-11-29T21:34:03.083843+0000 (oldest deadline 2019-11-29T21:34:42.945601+0000) 2019-11-29T21:34:56.268 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:34:56.262+0000 1694c700 -1 osd.5 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:34:15.039882+0000 (oldest deadline 2019-11-29T21:34:55.039882+0000) 2019-11-29T21:34:56.272 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:34:56.268+0000 1694c700 -1 osd.5 362 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e360) 2019-11-29T21:34:56.451 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:34:56.446+0000 1694c700 -1 osd.7 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.472363+0000 front 2019-11-29T21:34:01.720825+0000 (oldest deadline 2019-11-29T21:34:46.765621+0000) 2019-11-29T21:34:56.641 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:34:56.636+0000 1694c700 -1 osd.2 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.721415+0000 front 2019-11-29T21:34:01.939370+0000 (oldest deadline 2019-11-29T21:34:44.003144+0000) 2019-11-29T21:34:56.675 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:34:56.669+0000 1694c700 -1 osd.4 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.239185+0000 front 2019-11-29T21:34:01.216873+0000 (oldest deadline 2019-11-29T21:34:45.177244+0000) 2019-11-29T21:34:56.785 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:34:56.777+0000 1694c700 -1 osd.6 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:33:59.565649+0000 front 2019-11-29T21:34:00.280209+0000 (oldest deadline 2019-11-29T21:34:45.384917+0000) 2019-11-29T21:34:57.027 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:34:57.022+0000 1694c700 -1 osd.0 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:02.234588+0000 front 2019-11-29T21:34:03.083843+0000 (oldest deadline 2019-11-29T21:34:42.945601+0000) 2019-11-29T21:34:57.245 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:34:57.238+0000 1694c700 -1 osd.5 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:34:15.039882+0000 (oldest deadline 2019-11-29T21:34:55.039882+0000) 2019-11-29T21:34:57.246 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:34:57.241+0000 1694c700 -1 osd.5 362 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e360) 2019-11-29T21:34:57.432 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:34:57.426+0000 1694c700 -1 osd.7 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.472363+0000 front 2019-11-29T21:34:01.720825+0000 (oldest deadline 2019-11-29T21:34:46.765621+0000) 2019-11-29T21:34:57.629 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:34:57.624+0000 1694c700 -1 osd.2 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.721415+0000 front 2019-11-29T21:34:01.939370+0000 (oldest deadline 2019-11-29T21:34:44.003144+0000) 2019-11-29T21:34:57.657 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:34:57.643+0000 1694c700 -1 osd.4 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.239185+0000 front 2019-11-29T21:34:01.216873+0000 (oldest deadline 2019-11-29T21:34:45.177244+0000) 2019-11-29T21:34:57.785 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:34:57.780+0000 1694c700 -1 osd.6 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:33:59.565649+0000 front 2019-11-29T21:34:00.280209+0000 (oldest deadline 2019-11-29T21:34:45.384917+0000) 2019-11-29T21:34:58.050 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:34:58.044+0000 1694c700 -1 osd.0 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:02.234588+0000 front 2019-11-29T21:34:03.083843+0000 (oldest deadline 2019-11-29T21:34:42.945601+0000) 2019-11-29T21:34:58.201 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:34:58.193+0000 1694c700 -1 osd.5 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:34:15.039882+0000 (oldest deadline 2019-11-29T21:34:55.039882+0000) 2019-11-29T21:34:58.202 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:34:58.197+0000 1694c700 -1 osd.5 362 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e360) 2019-11-29T21:34:58.468 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:34:58.462+0000 1694c700 -1 osd.7 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.472363+0000 front 2019-11-29T21:34:01.720825+0000 (oldest deadline 2019-11-29T21:34:46.765621+0000) 2019-11-29T21:34:58.656 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:34:58.651+0000 1694c700 -1 osd.2 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.721415+0000 front 2019-11-29T21:34:01.939370+0000 (oldest deadline 2019-11-29T21:34:44.003144+0000) 2019-11-29T21:34:58.700 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:34:58.695+0000 1694c700 -1 osd.4 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.239185+0000 front 2019-11-29T21:34:01.216873+0000 (oldest deadline 2019-11-29T21:34:45.177244+0000) 2019-11-29T21:34:58.767 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:34:58.763+0000 1694c700 -1 osd.6 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:33:59.565649+0000 front 2019-11-29T21:34:00.280209+0000 (oldest deadline 2019-11-29T21:34:45.384917+0000) 2019-11-29T21:34:59.057 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:34:59.050+0000 1694c700 -1 osd.0 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:02.234588+0000 front 2019-11-29T21:34:03.083843+0000 (oldest deadline 2019-11-29T21:34:42.945601+0000) 2019-11-29T21:34:59.201 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:34:59.194+0000 1694c700 -1 osd.5 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:34:15.039882+0000 (oldest deadline 2019-11-29T21:34:55.039882+0000) 2019-11-29T21:34:59.201 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:34:59.197+0000 1694c700 -1 osd.5 362 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e360) 2019-11-29T21:34:59.507 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:34:59.502+0000 1694c700 -1 osd.7 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.472363+0000 front 2019-11-29T21:34:01.720825+0000 (oldest deadline 2019-11-29T21:34:46.765621+0000) 2019-11-29T21:34:59.643 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:34:59.638+0000 1694c700 -1 osd.2 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.721415+0000 front 2019-11-29T21:34:01.939370+0000 (oldest deadline 2019-11-29T21:34:44.003144+0000) 2019-11-29T21:34:59.695 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:34:59.689+0000 1694c700 -1 osd.4 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.239185+0000 front 2019-11-29T21:34:01.216873+0000 (oldest deadline 2019-11-29T21:34:45.177244+0000) 2019-11-29T21:34:59.784 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:34:59.777+0000 1694c700 -1 osd.6 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:33:59.565649+0000 front 2019-11-29T21:34:00.280209+0000 (oldest deadline 2019-11-29T21:34:45.384917+0000) 2019-11-29T21:35:00.010 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:35:00.005+0000 1694c700 -1 osd.0 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:02.234588+0000 front 2019-11-29T21:34:03.083843+0000 (oldest deadline 2019-11-29T21:34:42.945601+0000) 2019-11-29T21:35:00.197 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:35:00.190+0000 1694c700 -1 osd.5 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:34:15.039882+0000 (oldest deadline 2019-11-29T21:34:55.039882+0000) 2019-11-29T21:35:00.199 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:35:00.193+0000 1694c700 -1 osd.5 362 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e360) 2019-11-29T21:35:00.483 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:35:00.477+0000 1694c700 -1 osd.7 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.472363+0000 front 2019-11-29T21:34:01.720825+0000 (oldest deadline 2019-11-29T21:34:46.765621+0000) 2019-11-29T21:35:00.609 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:35:00.605+0000 1694c700 -1 osd.2 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.721415+0000 front 2019-11-29T21:34:01.939370+0000 (oldest deadline 2019-11-29T21:34:44.003144+0000) 2019-11-29T21:35:00.685 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:35:00.679+0000 1694c700 -1 osd.4 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.239185+0000 front 2019-11-29T21:34:01.216873+0000 (oldest deadline 2019-11-29T21:34:45.177244+0000) 2019-11-29T21:35:00.814 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:35:00.808+0000 1694c700 -1 osd.6 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:33:59.565649+0000 front 2019-11-29T21:34:00.280209+0000 (oldest deadline 2019-11-29T21:34:45.384917+0000) 2019-11-29T21:35:00.980 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:35:00.975+0000 1694c700 -1 osd.0 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:02.234588+0000 front 2019-11-29T21:34:03.083843+0000 (oldest deadline 2019-11-29T21:34:42.945601+0000) 2019-11-29T21:35:01.187 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:35:01.180+0000 1694c700 -1 osd.5 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:34:15.039882+0000 (oldest deadline 2019-11-29T21:34:55.039882+0000) 2019-11-29T21:35:01.188 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:35:01.183+0000 1694c700 -1 osd.5 362 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e360) 2019-11-29T21:35:01.458 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:35:01.453+0000 1694c700 -1 osd.7 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.472363+0000 front 2019-11-29T21:34:01.720825+0000 (oldest deadline 2019-11-29T21:34:46.765621+0000) 2019-11-29T21:35:01.571 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:35:01.566+0000 1694c700 -1 osd.2 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.721415+0000 front 2019-11-29T21:34:01.939370+0000 (oldest deadline 2019-11-29T21:34:44.003144+0000) 2019-11-29T21:35:01.714 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:35:01.706+0000 1694c700 -1 osd.4 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.239185+0000 front 2019-11-29T21:34:01.216873+0000 (oldest deadline 2019-11-29T21:34:45.177244+0000) 2019-11-29T21:35:01.787 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:35:01.781+0000 1694c700 -1 osd.6 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:33:59.565649+0000 front 2019-11-29T21:34:00.280209+0000 (oldest deadline 2019-11-29T21:34:45.384917+0000) 2019-11-29T21:35:01.984 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:35:01.979+0000 1694c700 -1 osd.0 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:02.234588+0000 front 2019-11-29T21:34:03.083843+0000 (oldest deadline 2019-11-29T21:34:42.945601+0000) 2019-11-29T21:35:02.194 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:35:02.188+0000 1694c700 -1 osd.5 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:34:15.039882+0000 (oldest deadline 2019-11-29T21:34:55.039882+0000) 2019-11-29T21:35:02.195 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:35:02.190+0000 1694c700 -1 osd.5 362 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e360) 2019-11-29T21:35:02.483 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:35:02.475+0000 1694c700 -1 osd.7 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.472363+0000 front 2019-11-29T21:34:01.720825+0000 (oldest deadline 2019-11-29T21:34:46.765621+0000) 2019-11-29T21:35:02.593 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:35:02.588+0000 1694c700 -1 osd.2 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.721415+0000 front 2019-11-29T21:34:01.939370+0000 (oldest deadline 2019-11-29T21:34:44.003144+0000) 2019-11-29T21:35:02.755 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:35:02.748+0000 1694c700 -1 osd.4 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.239185+0000 front 2019-11-29T21:34:01.216873+0000 (oldest deadline 2019-11-29T21:34:45.177244+0000) 2019-11-29T21:35:02.834 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:35:02.827+0000 1694c700 -1 osd.6 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:33:59.565649+0000 front 2019-11-29T21:34:00.280209+0000 (oldest deadline 2019-11-29T21:34:45.384917+0000) 2019-11-29T21:35:02.942 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:35:02.937+0000 1694c700 -1 osd.0 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:02.234588+0000 front 2019-11-29T21:34:03.083843+0000 (oldest deadline 2019-11-29T21:34:42.945601+0000) 2019-11-29T21:35:03.162 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:35:03.154+0000 1694c700 -1 osd.5 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:34:15.039882+0000 (oldest deadline 2019-11-29T21:34:55.039882+0000) 2019-11-29T21:35:03.163 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:35:03.158+0000 1694c700 -1 osd.5 362 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e360) 2019-11-29T21:35:03.490 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:35:03.484+0000 1694c700 -1 osd.7 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.472363+0000 front 2019-11-29T21:34:01.720825+0000 (oldest deadline 2019-11-29T21:34:46.765621+0000) 2019-11-29T21:35:03.588 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:35:03.582+0000 1694c700 -1 osd.2 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.721415+0000 front 2019-11-29T21:34:01.939370+0000 (oldest deadline 2019-11-29T21:34:44.003144+0000) 2019-11-29T21:35:03.807 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:35:03.802+0000 1694c700 -1 osd.6 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:33:59.565649+0000 front 2019-11-29T21:34:00.280209+0000 (oldest deadline 2019-11-29T21:34:45.384917+0000) 2019-11-29T21:35:03.810 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:35:03.801+0000 1694c700 -1 osd.4 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.239185+0000 front 2019-11-29T21:34:01.216873+0000 (oldest deadline 2019-11-29T21:34:45.177244+0000) 2019-11-29T21:35:03.978 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:35:03.971+0000 1694c700 -1 osd.0 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:02.234588+0000 front 2019-11-29T21:34:03.083843+0000 (oldest deadline 2019-11-29T21:34:42.945601+0000) 2019-11-29T21:35:04.180 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:35:04.175+0000 1694c700 -1 osd.5 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:34:15.039882+0000 (oldest deadline 2019-11-29T21:34:55.039882+0000) 2019-11-29T21:35:04.184 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:35:04.180+0000 1694c700 -1 osd.5 362 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e360) 2019-11-29T21:35:04.530 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:35:04.524+0000 1694c700 -1 osd.7 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.472363+0000 front 2019-11-29T21:34:01.720825+0000 (oldest deadline 2019-11-29T21:34:46.765621+0000) 2019-11-29T21:35:04.620 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:35:04.615+0000 1694c700 -1 osd.2 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.721415+0000 front 2019-11-29T21:34:01.939370+0000 (oldest deadline 2019-11-29T21:34:44.003144+0000) 2019-11-29T21:35:04.778 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:35:04.772+0000 1694c700 -1 osd.4 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.239185+0000 front 2019-11-29T21:34:01.216873+0000 (oldest deadline 2019-11-29T21:34:45.177244+0000) 2019-11-29T21:35:04.790 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:35:04.784+0000 1694c700 -1 osd.6 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:33:59.565649+0000 front 2019-11-29T21:34:00.280209+0000 (oldest deadline 2019-11-29T21:34:45.384917+0000) 2019-11-29T21:35:04.952 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:35:04.946+0000 1694c700 -1 osd.0 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:02.234588+0000 front 2019-11-29T21:34:03.083843+0000 (oldest deadline 2019-11-29T21:34:42.945601+0000) 2019-11-29T21:35:05.212 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:35:05.205+0000 1694c700 -1 osd.5 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:34:15.039882+0000 (oldest deadline 2019-11-29T21:34:55.039882+0000) 2019-11-29T21:35:05.213 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:35:05.208+0000 1694c700 -1 osd.5 362 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e360) 2019-11-29T21:35:05.582 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:35:05.577+0000 1694c700 -1 osd.7 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.472363+0000 front 2019-11-29T21:34:01.720825+0000 (oldest deadline 2019-11-29T21:34:46.765621+0000) 2019-11-29T21:35:05.615 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:35:05.610+0000 1694c700 -1 osd.2 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.721415+0000 front 2019-11-29T21:34:01.939370+0000 (oldest deadline 2019-11-29T21:34:44.003144+0000) 2019-11-29T21:35:05.738 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:35:05.733+0000 1694c700 -1 osd.4 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.239185+0000 front 2019-11-29T21:34:01.216873+0000 (oldest deadline 2019-11-29T21:34:45.177244+0000) 2019-11-29T21:35:05.839 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:35:05.832+0000 1694c700 -1 osd.6 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:33:59.565649+0000 front 2019-11-29T21:34:00.280209+0000 (oldest deadline 2019-11-29T21:34:45.384917+0000) 2019-11-29T21:35:05.939 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:35:05.934+0000 1694c700 -1 osd.0 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:02.234588+0000 front 2019-11-29T21:34:03.083843+0000 (oldest deadline 2019-11-29T21:34:42.945601+0000) 2019-11-29T21:35:06.189 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:35:06.184+0000 1694c700 -1 osd.5 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:34:15.039882+0000 (oldest deadline 2019-11-29T21:34:55.039882+0000) 2019-11-29T21:35:06.192 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:35:06.188+0000 1694c700 -1 osd.5 362 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e360) 2019-11-29T21:35:06.558 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:35:06.552+0000 1694c700 -1 osd.7 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.472363+0000 front 2019-11-29T21:34:01.720825+0000 (oldest deadline 2019-11-29T21:34:46.765621+0000) 2019-11-29T21:35:06.652 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:35:06.647+0000 1694c700 -1 osd.2 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.721415+0000 front 2019-11-29T21:34:01.939370+0000 (oldest deadline 2019-11-29T21:34:44.003144+0000) 2019-11-29T21:35:06.771 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:35:06.765+0000 1694c700 -1 osd.4 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.239185+0000 front 2019-11-29T21:34:01.216873+0000 (oldest deadline 2019-11-29T21:34:45.177244+0000) 2019-11-29T21:35:06.889 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:35:06.882+0000 1694c700 -1 osd.6 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:33:59.565649+0000 front 2019-11-29T21:34:00.280209+0000 (oldest deadline 2019-11-29T21:34:45.384917+0000) 2019-11-29T21:35:06.954 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:35:06.949+0000 1694c700 -1 osd.0 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:02.234588+0000 front 2019-11-29T21:34:03.083843+0000 (oldest deadline 2019-11-29T21:34:42.945601+0000) 2019-11-29T21:35:07.217 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:35:07.210+0000 1694c700 -1 osd.5 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:34:15.039882+0000 (oldest deadline 2019-11-29T21:34:55.039882+0000) 2019-11-29T21:35:07.218 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:35:07.213+0000 1694c700 -1 osd.5 362 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e360) 2019-11-29T21:35:07.587 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:35:07.581+0000 1694c700 -1 osd.7 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.472363+0000 front 2019-11-29T21:34:01.720825+0000 (oldest deadline 2019-11-29T21:34:46.765621+0000) 2019-11-29T21:35:07.696 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:35:07.691+0000 1694c700 -1 osd.2 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.721415+0000 front 2019-11-29T21:34:01.939370+0000 (oldest deadline 2019-11-29T21:34:44.003144+0000) 2019-11-29T21:35:07.757 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:35:07.750+0000 1694c700 -1 osd.4 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.239185+0000 front 2019-11-29T21:34:01.216873+0000 (oldest deadline 2019-11-29T21:34:45.177244+0000) 2019-11-29T21:35:07.895 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:35:07.889+0000 1694c700 -1 osd.6 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:33:59.565649+0000 front 2019-11-29T21:34:00.280209+0000 (oldest deadline 2019-11-29T21:34:45.384917+0000) 2019-11-29T21:35:07.908 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:35:07.903+0000 1694c700 -1 osd.0 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:02.234588+0000 front 2019-11-29T21:34:03.083843+0000 (oldest deadline 2019-11-29T21:34:42.945601+0000) 2019-11-29T21:35:08.231 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:35:08.224+0000 1694c700 -1 osd.5 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:34:15.039882+0000 (oldest deadline 2019-11-29T21:34:55.039882+0000) 2019-11-29T21:35:08.232 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:35:08.227+0000 1694c700 -1 osd.5 362 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e360) 2019-11-29T21:35:08.550 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:35:08.544+0000 1694c700 -1 osd.7 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.472363+0000 front 2019-11-29T21:34:01.720825+0000 (oldest deadline 2019-11-29T21:34:46.765621+0000) 2019-11-29T21:35:08.712 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:35:08.708+0000 1694c700 -1 osd.2 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.721415+0000 front 2019-11-29T21:34:01.939370+0000 (oldest deadline 2019-11-29T21:34:44.003144+0000) 2019-11-29T21:35:08.786 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:35:08.780+0000 1694c700 -1 osd.4 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.239185+0000 front 2019-11-29T21:34:01.216873+0000 (oldest deadline 2019-11-29T21:34:45.177244+0000) 2019-11-29T21:35:08.855 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:35:08.849+0000 1694c700 -1 osd.6 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:33:59.565649+0000 front 2019-11-29T21:34:00.280209+0000 (oldest deadline 2019-11-29T21:34:45.384917+0000) 2019-11-29T21:35:08.917 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:35:08.911+0000 1694c700 -1 osd.0 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:02.234588+0000 front 2019-11-29T21:34:03.083843+0000 (oldest deadline 2019-11-29T21:34:42.945601+0000) 2019-11-29T21:35:09.206 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:35:09.199+0000 1694c700 -1 osd.5 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:34:15.039882+0000 (oldest deadline 2019-11-29T21:34:55.039882+0000) 2019-11-29T21:35:09.214 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:35:09.209+0000 1694c700 -1 osd.5 362 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e360) 2019-11-29T21:35:09.543 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:35:09.538+0000 1694c700 -1 osd.7 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.472363+0000 front 2019-11-29T21:34:01.720825+0000 (oldest deadline 2019-11-29T21:34:46.765621+0000) 2019-11-29T21:35:09.696 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:35:09.690+0000 1694c700 -1 osd.2 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.721415+0000 front 2019-11-29T21:34:01.939370+0000 (oldest deadline 2019-11-29T21:34:44.003144+0000) 2019-11-29T21:35:09.775 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:35:09.769+0000 1694c700 -1 osd.4 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.239185+0000 front 2019-11-29T21:34:01.216873+0000 (oldest deadline 2019-11-29T21:34:45.177244+0000) 2019-11-29T21:35:09.846 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:35:09.841+0000 1694c700 -1 osd.6 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:33:59.565649+0000 front 2019-11-29T21:34:00.280209+0000 (oldest deadline 2019-11-29T21:34:45.384917+0000) 2019-11-29T21:35:09.889 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:35:09.884+0000 1694c700 -1 osd.0 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:02.234588+0000 front 2019-11-29T21:34:03.083843+0000 (oldest deadline 2019-11-29T21:34:42.945601+0000) 2019-11-29T21:35:10.240 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:35:10.233+0000 1694c700 -1 osd.5 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:34:15.039882+0000 (oldest deadline 2019-11-29T21:34:55.039882+0000) 2019-11-29T21:35:10.241 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:35:10.235+0000 1694c700 -1 osd.5 362 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e360) 2019-11-29T21:35:10.550 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:35:10.545+0000 1694c700 -1 osd.7 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.472363+0000 front 2019-11-29T21:34:01.720825+0000 (oldest deadline 2019-11-29T21:34:46.765621+0000) 2019-11-29T21:35:10.661 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:35:10.654+0000 1694c700 -1 osd.2 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.721415+0000 front 2019-11-29T21:34:01.939370+0000 (oldest deadline 2019-11-29T21:34:44.003144+0000) 2019-11-29T21:35:10.765 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:35:10.756+0000 1694c700 -1 osd.4 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.239185+0000 front 2019-11-29T21:34:01.216873+0000 (oldest deadline 2019-11-29T21:34:45.177244+0000) 2019-11-29T21:35:10.809 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:35:10.803+0000 1694c700 -1 osd.6 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:33:59.565649+0000 front 2019-11-29T21:34:00.280209+0000 (oldest deadline 2019-11-29T21:34:45.384917+0000) 2019-11-29T21:35:10.880 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:35:10.872+0000 1694c700 -1 osd.0 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:02.234588+0000 front 2019-11-29T21:34:03.083843+0000 (oldest deadline 2019-11-29T21:34:42.945601+0000) 2019-11-29T21:35:11.288 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:35:11.280+0000 1694c700 -1 osd.5 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:34:15.039882+0000 (oldest deadline 2019-11-29T21:34:55.039882+0000) 2019-11-29T21:35:11.288 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:35:11.283+0000 1694c700 -1 osd.5 362 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e360) 2019-11-29T21:35:11.589 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:35:11.583+0000 1694c700 -1 osd.7 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.472363+0000 front 2019-11-29T21:34:01.720825+0000 (oldest deadline 2019-11-29T21:34:46.765621+0000) 2019-11-29T21:35:11.689 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:35:11.684+0000 1694c700 -1 osd.2 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.721415+0000 front 2019-11-29T21:34:01.939370+0000 (oldest deadline 2019-11-29T21:34:44.003144+0000) 2019-11-29T21:35:11.766 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:35:11.760+0000 1694c700 -1 osd.6 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:33:59.565649+0000 front 2019-11-29T21:34:00.280209+0000 (oldest deadline 2019-11-29T21:34:45.384917+0000) 2019-11-29T21:35:11.788 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:35:11.783+0000 1694c700 -1 osd.4 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.239185+0000 front 2019-11-29T21:34:01.216873+0000 (oldest deadline 2019-11-29T21:34:45.177244+0000) 2019-11-29T21:35:11.859 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:35:11.854+0000 1694c700 -1 osd.0 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:02.234588+0000 front 2019-11-29T21:34:03.083843+0000 (oldest deadline 2019-11-29T21:34:42.945601+0000) 2019-11-29T21:35:12.331 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:35:12.326+0000 1694c700 -1 osd.5 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:34:15.039882+0000 (oldest deadline 2019-11-29T21:34:55.039882+0000) 2019-11-29T21:35:12.334 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:35:12.330+0000 1694c700 -1 osd.5 362 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e360) 2019-11-29T21:35:12.559 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:35:12.553+0000 1694c700 -1 osd.7 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.472363+0000 front 2019-11-29T21:34:01.720825+0000 (oldest deadline 2019-11-29T21:34:46.765621+0000) 2019-11-29T21:35:12.694 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:35:12.689+0000 1694c700 -1 osd.2 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.721415+0000 front 2019-11-29T21:34:01.939370+0000 (oldest deadline 2019-11-29T21:34:44.003144+0000) 2019-11-29T21:35:12.744 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:35:12.738+0000 1694c700 -1 osd.6 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:33:59.565649+0000 front 2019-11-29T21:34:00.280209+0000 (oldest deadline 2019-11-29T21:34:45.384917+0000) 2019-11-29T21:35:12.773 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:35:12.767+0000 1694c700 -1 osd.4 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.239185+0000 front 2019-11-29T21:34:01.216873+0000 (oldest deadline 2019-11-29T21:34:45.177244+0000) 2019-11-29T21:35:12.817 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:35:12.811+0000 1694c700 -1 osd.0 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:02.234588+0000 front 2019-11-29T21:34:03.083843+0000 (oldest deadline 2019-11-29T21:34:42.945601+0000) 2019-11-29T21:35:13.388 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:35:13.381+0000 1694c700 -1 osd.5 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:34:15.039882+0000 (oldest deadline 2019-11-29T21:34:55.039882+0000) 2019-11-29T21:35:13.389 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:35:13.384+0000 1694c700 -1 osd.5 362 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e360) 2019-11-29T21:35:13.573 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:35:13.566+0000 1694c700 -1 osd.7 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.472363+0000 front 2019-11-29T21:34:01.720825+0000 (oldest deadline 2019-11-29T21:34:46.765621+0000) 2019-11-29T21:35:13.732 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:35:13.727+0000 1694c700 -1 osd.6 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:33:59.565649+0000 front 2019-11-29T21:34:00.280209+0000 (oldest deadline 2019-11-29T21:34:45.384917+0000) 2019-11-29T21:35:13.736 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:35:13.730+0000 1694c700 -1 osd.2 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.721415+0000 front 2019-11-29T21:34:01.939370+0000 (oldest deadline 2019-11-29T21:34:44.003144+0000) 2019-11-29T21:35:13.789 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:35:13.783+0000 1694c700 -1 osd.4 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.239185+0000 front 2019-11-29T21:34:01.216873+0000 (oldest deadline 2019-11-29T21:34:45.177244+0000) 2019-11-29T21:35:13.848 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:35:13.843+0000 1694c700 -1 osd.0 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:02.234588+0000 front 2019-11-29T21:34:03.083843+0000 (oldest deadline 2019-11-29T21:34:42.945601+0000) 2019-11-29T21:35:14.411 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:35:14.406+0000 1694c700 -1 osd.5 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:34:15.039882+0000 (oldest deadline 2019-11-29T21:34:55.039882+0000) 2019-11-29T21:35:14.413 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:35:14.408+0000 1694c700 -1 osd.5 362 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e360) 2019-11-29T21:35:14.541 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:35:14.536+0000 1694c700 -1 osd.7 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.472363+0000 front 2019-11-29T21:34:01.720825+0000 (oldest deadline 2019-11-29T21:34:46.765621+0000) 2019-11-29T21:35:14.743 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:35:14.737+0000 1694c700 -1 osd.6 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:33:59.565649+0000 front 2019-11-29T21:34:00.280209+0000 (oldest deadline 2019-11-29T21:34:45.384917+0000) 2019-11-29T21:35:14.753 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:35:14.747+0000 1694c700 -1 osd.2 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.721415+0000 front 2019-11-29T21:34:01.939370+0000 (oldest deadline 2019-11-29T21:34:44.003144+0000) 2019-11-29T21:35:14.821 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:35:14.815+0000 1694c700 -1 osd.4 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.239185+0000 front 2019-11-29T21:34:01.216873+0000 (oldest deadline 2019-11-29T21:34:45.177244+0000) 2019-11-29T21:35:14.882 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:35:14.875+0000 1694c700 -1 osd.0 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:02.234588+0000 front 2019-11-29T21:34:03.083843+0000 (oldest deadline 2019-11-29T21:34:42.945601+0000) 2019-11-29T21:35:15.416 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:35:15.403+0000 1694c700 -1 osd.5 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:34:15.039882+0000 (oldest deadline 2019-11-29T21:34:55.039882+0000) 2019-11-29T21:35:15.418 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:35:15.410+0000 1694c700 -1 osd.5 362 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e360) 2019-11-29T21:35:15.521 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:35:15.515+0000 1694c700 -1 osd.7 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.472363+0000 front 2019-11-29T21:34:01.720825+0000 (oldest deadline 2019-11-29T21:34:46.765621+0000) 2019-11-29T21:35:15.523 INFO:tasks.ceph.mon.b.smithi022.stderr:2019-11-29T21:35:15.520+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.1 [v2:172.21.15.62:6800/10370,v1:172.21.15.62:6801/10370] for 42sec e362 v362) 2019-11-29T21:35:15.735 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:35:15.728+0000 1694c700 -1 osd.6 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:33:59.565649+0000 front 2019-11-29T21:34:00.280209+0000 (oldest deadline 2019-11-29T21:34:45.384917+0000) 2019-11-29T21:35:15.760 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:35:15.754+0000 1694c700 -1 osd.2 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.721415+0000 front 2019-11-29T21:34:01.939370+0000 (oldest deadline 2019-11-29T21:34:44.003144+0000) 2019-11-29T21:35:15.789 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:35:15.784+0000 1694c700 -1 osd.4 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.239185+0000 front 2019-11-29T21:34:01.216873+0000 (oldest deadline 2019-11-29T21:34:45.177244+0000) 2019-11-29T21:35:15.899 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:35:15.894+0000 1694c700 -1 osd.0 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:02.234588+0000 front 2019-11-29T21:34:03.083843+0000 (oldest deadline 2019-11-29T21:34:42.945601+0000) 2019-11-29T21:35:16.418 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:35:16.411+0000 1694c700 -1 osd.5 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:34:15.039882+0000 (oldest deadline 2019-11-29T21:34:55.039882+0000) 2019-11-29T21:35:16.419 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:35:16.414+0000 1694c700 -1 osd.5 362 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e360) 2019-11-29T21:35:16.561 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:35:16.555+0000 1694c700 -1 osd.7 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.472363+0000 front 2019-11-29T21:34:01.720825+0000 (oldest deadline 2019-11-29T21:34:46.765621+0000) 2019-11-29T21:35:16.757 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:35:16.752+0000 1694c700 -1 osd.2 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.721415+0000 front 2019-11-29T21:34:01.939370+0000 (oldest deadline 2019-11-29T21:34:44.003144+0000) 2019-11-29T21:35:16.764 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:35:16.758+0000 1694c700 -1 osd.6 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:33:59.565649+0000 front 2019-11-29T21:34:00.280209+0000 (oldest deadline 2019-11-29T21:34:45.384917+0000) 2019-11-29T21:35:16.769 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:35:16.764+0000 1694c700 -1 osd.4 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.239185+0000 front 2019-11-29T21:34:01.216873+0000 (oldest deadline 2019-11-29T21:34:45.177244+0000) 2019-11-29T21:35:16.887 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:35:16.882+0000 1694c700 -1 osd.0 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:02.234588+0000 front 2019-11-29T21:34:03.083843+0000 (oldest deadline 2019-11-29T21:34:42.945601+0000) 2019-11-29T21:35:17.439 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:35:17.431+0000 1694c700 -1 osd.5 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:34:15.039882+0000 (oldest deadline 2019-11-29T21:34:55.039882+0000) 2019-11-29T21:35:17.440 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:35:17.433+0000 1694c700 -1 osd.5 362 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e360) 2019-11-29T21:35:17.521 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:35:17.516+0000 1694c700 -1 osd.7 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.472363+0000 front 2019-11-29T21:34:01.720825+0000 (oldest deadline 2019-11-29T21:34:46.765621+0000) 2019-11-29T21:35:17.740 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:35:17.735+0000 1694c700 -1 osd.4 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.239185+0000 front 2019-11-29T21:34:01.216873+0000 (oldest deadline 2019-11-29T21:34:45.177244+0000) 2019-11-29T21:35:17.770 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:35:17.766+0000 1694c700 -1 osd.2 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.721415+0000 front 2019-11-29T21:34:01.939370+0000 (oldest deadline 2019-11-29T21:34:44.003144+0000) 2019-11-29T21:35:17.786 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:35:17.779+0000 1694c700 -1 osd.6 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:33:59.565649+0000 front 2019-11-29T21:34:00.280209+0000 (oldest deadline 2019-11-29T21:34:45.384917+0000) 2019-11-29T21:35:17.921 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:35:17.916+0000 1694c700 -1 osd.0 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:02.234588+0000 front 2019-11-29T21:34:03.083843+0000 (oldest deadline 2019-11-29T21:34:42.945601+0000) 2019-11-29T21:35:18.457 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:35:18.450+0000 1694c700 -1 osd.5 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:34:15.039882+0000 (oldest deadline 2019-11-29T21:34:55.039882+0000) 2019-11-29T21:35:18.458 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:35:18.453+0000 1694c700 -1 osd.5 362 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e360) 2019-11-29T21:35:18.500 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:35:18.494+0000 1694c700 -1 osd.7 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.472363+0000 front 2019-11-29T21:34:01.720825+0000 (oldest deadline 2019-11-29T21:34:46.765621+0000) 2019-11-29T21:35:18.699 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:35:18.692+0000 1694c700 -1 osd.4 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.239185+0000 front 2019-11-29T21:34:01.216873+0000 (oldest deadline 2019-11-29T21:34:45.177244+0000) 2019-11-29T21:35:18.764 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:35:18.758+0000 1694c700 -1 osd.2 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.721415+0000 front 2019-11-29T21:34:01.939370+0000 (oldest deadline 2019-11-29T21:34:44.003144+0000) 2019-11-29T21:35:18.796 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:35:18.790+0000 1694c700 -1 osd.6 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:33:59.565649+0000 front 2019-11-29T21:34:00.280209+0000 (oldest deadline 2019-11-29T21:34:45.384917+0000) 2019-11-29T21:35:18.926 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:35:18.920+0000 1694c700 -1 osd.0 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:02.234588+0000 front 2019-11-29T21:34:03.083843+0000 (oldest deadline 2019-11-29T21:34:42.945601+0000) 2019-11-29T21:35:19.431 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:35:19.426+0000 1694c700 -1 osd.5 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:34:15.039882+0000 (oldest deadline 2019-11-29T21:34:55.039882+0000) 2019-11-29T21:35:19.437 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:35:19.431+0000 1694c700 -1 osd.5 362 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e360) 2019-11-29T21:35:19.528 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:35:19.522+0000 1694c700 -1 osd.7 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.472363+0000 front 2019-11-29T21:34:01.720825+0000 (oldest deadline 2019-11-29T21:34:46.765621+0000) 2019-11-29T21:35:19.707 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:35:19.702+0000 1694c700 -1 osd.4 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.239185+0000 front 2019-11-29T21:34:01.216873+0000 (oldest deadline 2019-11-29T21:34:45.177244+0000) 2019-11-29T21:35:19.767 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:35:19.762+0000 1694c700 -1 osd.2 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.721415+0000 front 2019-11-29T21:34:01.939370+0000 (oldest deadline 2019-11-29T21:34:44.003144+0000) 2019-11-29T21:35:19.773 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:35:19.768+0000 1694c700 -1 osd.6 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:33:59.565649+0000 front 2019-11-29T21:34:00.280209+0000 (oldest deadline 2019-11-29T21:34:45.384917+0000) 2019-11-29T21:35:19.895 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:35:19.889+0000 1694c700 -1 osd.0 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:02.234588+0000 front 2019-11-29T21:34:03.083843+0000 (oldest deadline 2019-11-29T21:34:42.945601+0000) 2019-11-29T21:35:20.434 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:35:20.428+0000 1694c700 -1 osd.5 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:34:15.039882+0000 (oldest deadline 2019-11-29T21:34:55.039882+0000) 2019-11-29T21:35:20.435 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:35:20.431+0000 1694c700 -1 osd.5 362 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e360) 2019-11-29T21:35:20.542 INFO:tasks.ceph.mon.b.smithi022.stderr:2019-11-29T21:35:20.535+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 3 slow ops, oldest is osd_failure(failed timeout osd.1 [v2:172.21.15.62:6800/10370,v1:172.21.15.62:6801/10370] for 42sec e362 v362) 2019-11-29T21:35:20.577 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:35:20.572+0000 1694c700 -1 osd.7 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.472363+0000 front 2019-11-29T21:34:01.720825+0000 (oldest deadline 2019-11-29T21:34:46.765621+0000) 2019-11-29T21:35:20.723 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:35:20.718+0000 1694c700 -1 osd.2 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.721415+0000 front 2019-11-29T21:34:01.939370+0000 (oldest deadline 2019-11-29T21:34:44.003144+0000) 2019-11-29T21:35:20.731 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:35:20.726+0000 1694c700 -1 osd.4 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.239185+0000 front 2019-11-29T21:34:01.216873+0000 (oldest deadline 2019-11-29T21:34:45.177244+0000) 2019-11-29T21:35:20.773 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:35:20.767+0000 1694c700 -1 osd.6 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:33:59.565649+0000 front 2019-11-29T21:34:00.280209+0000 (oldest deadline 2019-11-29T21:34:45.384917+0000) 2019-11-29T21:35:20.858 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:35:20.852+0000 1694c700 -1 osd.0 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:02.234588+0000 front 2019-11-29T21:34:03.083843+0000 (oldest deadline 2019-11-29T21:34:42.945601+0000) 2019-11-29T21:35:21.476 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:35:21.470+0000 1694c700 -1 osd.5 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:34:15.039882+0000 (oldest deadline 2019-11-29T21:34:55.039882+0000) 2019-11-29T21:35:21.477 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:35:21.472+0000 1694c700 -1 osd.5 362 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e360) 2019-11-29T21:35:21.612 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:35:21.606+0000 1694c700 -1 osd.7 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.472363+0000 front 2019-11-29T21:34:01.720825+0000 (oldest deadline 2019-11-29T21:34:46.765621+0000) 2019-11-29T21:35:21.681 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:35:21.675+0000 1694c700 -1 osd.2 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.721415+0000 front 2019-11-29T21:34:01.939370+0000 (oldest deadline 2019-11-29T21:34:44.003144+0000) 2019-11-29T21:35:21.704 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:35:21.697+0000 1694c700 -1 osd.4 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.239185+0000 front 2019-11-29T21:34:01.216873+0000 (oldest deadline 2019-11-29T21:34:45.177244+0000) 2019-11-29T21:35:21.790 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:35:21.785+0000 1694c700 -1 osd.6 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:33:59.565649+0000 front 2019-11-29T21:34:00.280209+0000 (oldest deadline 2019-11-29T21:34:45.384917+0000) 2019-11-29T21:35:21.869 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:35:21.864+0000 1694c700 -1 osd.0 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:02.234588+0000 front 2019-11-29T21:34:03.083843+0000 (oldest deadline 2019-11-29T21:34:42.945601+0000) 2019-11-29T21:35:22.458 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:35:22.453+0000 1694c700 -1 osd.5 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:34:15.039882+0000 (oldest deadline 2019-11-29T21:34:55.039882+0000) 2019-11-29T21:35:22.462 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:35:22.457+0000 1694c700 -1 osd.5 362 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e360) 2019-11-29T21:35:22.588 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:35:22.584+0000 1694c700 -1 osd.7 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.472363+0000 front 2019-11-29T21:34:01.720825+0000 (oldest deadline 2019-11-29T21:34:46.765621+0000) 2019-11-29T21:35:22.677 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:35:22.671+0000 1694c700 -1 osd.4 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.239185+0000 front 2019-11-29T21:34:01.216873+0000 (oldest deadline 2019-11-29T21:34:45.177244+0000) 2019-11-29T21:35:22.691 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:35:22.687+0000 1694c700 -1 osd.2 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.721415+0000 front 2019-11-29T21:34:01.939370+0000 (oldest deadline 2019-11-29T21:34:44.003144+0000) 2019-11-29T21:35:22.750 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:35:22.744+0000 1694c700 -1 osd.6 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:33:59.565649+0000 front 2019-11-29T21:34:00.280209+0000 (oldest deadline 2019-11-29T21:34:45.384917+0000) 2019-11-29T21:35:22.878 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:35:22.872+0000 1694c700 -1 osd.0 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:02.234588+0000 front 2019-11-29T21:34:03.083843+0000 (oldest deadline 2019-11-29T21:34:42.945601+0000) 2019-11-29T21:35:23.477 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:35:23.471+0000 1694c700 -1 osd.5 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:34:15.039882+0000 (oldest deadline 2019-11-29T21:34:55.039882+0000) 2019-11-29T21:35:23.480 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:35:23.476+0000 1694c700 -1 osd.5 362 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e360) 2019-11-29T21:35:23.593 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:35:23.588+0000 1694c700 -1 osd.7 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.472363+0000 front 2019-11-29T21:34:01.720825+0000 (oldest deadline 2019-11-29T21:34:46.765621+0000) 2019-11-29T21:35:23.678 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:35:23.668+0000 1694c700 -1 osd.4 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.239185+0000 front 2019-11-29T21:34:01.216873+0000 (oldest deadline 2019-11-29T21:34:45.177244+0000) 2019-11-29T21:35:23.687 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:35:23.683+0000 1694c700 -1 osd.2 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.721415+0000 front 2019-11-29T21:34:01.939370+0000 (oldest deadline 2019-11-29T21:34:44.003144+0000) 2019-11-29T21:35:23.791 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:35:23.786+0000 1694c700 -1 osd.6 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:33:59.565649+0000 front 2019-11-29T21:34:00.280209+0000 (oldest deadline 2019-11-29T21:34:45.384917+0000) 2019-11-29T21:35:23.922 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:35:23.917+0000 1694c700 -1 osd.0 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:02.234588+0000 front 2019-11-29T21:34:03.083843+0000 (oldest deadline 2019-11-29T21:34:42.945601+0000) 2019-11-29T21:35:24.454 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:35:24.448+0000 1694c700 -1 osd.5 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:34:15.039882+0000 (oldest deadline 2019-11-29T21:34:55.039882+0000) 2019-11-29T21:35:24.457 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:35:24.450+0000 1694c700 -1 osd.5 362 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e360) 2019-11-29T21:35:24.591 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:35:24.585+0000 1694c700 -1 osd.7 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.472363+0000 front 2019-11-29T21:34:01.720825+0000 (oldest deadline 2019-11-29T21:34:46.765621+0000) 2019-11-29T21:35:24.650 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:35:24.644+0000 1694c700 -1 osd.4 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.239185+0000 front 2019-11-29T21:34:01.216873+0000 (oldest deadline 2019-11-29T21:34:45.177244+0000) 2019-11-29T21:35:24.703 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:35:24.697+0000 1694c700 -1 osd.2 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.721415+0000 front 2019-11-29T21:34:01.939370+0000 (oldest deadline 2019-11-29T21:34:44.003144+0000) 2019-11-29T21:35:24.821 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:35:24.815+0000 1694c700 -1 osd.6 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:33:59.565649+0000 front 2019-11-29T21:34:00.280209+0000 (oldest deadline 2019-11-29T21:34:45.384917+0000) 2019-11-29T21:35:24.894 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:35:24.888+0000 1694c700 -1 osd.0 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:02.234588+0000 front 2019-11-29T21:34:03.083843+0000 (oldest deadline 2019-11-29T21:34:42.945601+0000) 2019-11-29T21:35:25.466 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:35:25.458+0000 1694c700 -1 osd.5 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:34:15.039882+0000 (oldest deadline 2019-11-29T21:34:55.039882+0000) 2019-11-29T21:35:25.473 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:35:25.461+0000 1694c700 -1 osd.5 362 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e360) 2019-11-29T21:35:25.558 INFO:tasks.ceph.mon.b.smithi022.stderr:2019-11-29T21:35:25.554+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.1 [v2:172.21.15.62:6800/10370,v1:172.21.15.62:6801/10370] for 42sec e362 v362) 2019-11-29T21:35:25.595 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:35:25.590+0000 1694c700 -1 osd.7 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.472363+0000 front 2019-11-29T21:34:01.720825+0000 (oldest deadline 2019-11-29T21:34:46.765621+0000) 2019-11-29T21:35:25.626 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:35:25.621+0000 1694c700 -1 osd.4 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.239185+0000 front 2019-11-29T21:34:01.216873+0000 (oldest deadline 2019-11-29T21:34:45.177244+0000) 2019-11-29T21:35:25.694 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:35:25.689+0000 1694c700 -1 osd.2 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.721415+0000 front 2019-11-29T21:34:01.939370+0000 (oldest deadline 2019-11-29T21:34:44.003144+0000) 2019-11-29T21:35:25.871 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:35:25.865+0000 1694c700 -1 osd.6 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:33:59.565649+0000 front 2019-11-29T21:34:00.280209+0000 (oldest deadline 2019-11-29T21:34:45.384917+0000) 2019-11-29T21:35:25.929 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:35:25.923+0000 1694c700 -1 osd.0 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:02.234588+0000 front 2019-11-29T21:34:03.083843+0000 (oldest deadline 2019-11-29T21:34:42.945601+0000) 2019-11-29T21:35:26.424 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:35:26.417+0000 1694c700 -1 osd.5 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:34:15.039882+0000 (oldest deadline 2019-11-29T21:34:55.039882+0000) 2019-11-29T21:35:26.425 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:35:26.419+0000 1694c700 -1 osd.5 362 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e360) 2019-11-29T21:35:26.602 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:35:26.595+0000 1694c700 -1 osd.7 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.472363+0000 front 2019-11-29T21:34:01.720825+0000 (oldest deadline 2019-11-29T21:34:46.765621+0000) 2019-11-29T21:35:26.665 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:35:26.659+0000 1694c700 -1 osd.4 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.239185+0000 front 2019-11-29T21:34:01.216873+0000 (oldest deadline 2019-11-29T21:34:45.177244+0000) 2019-11-29T21:35:26.732 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:35:26.727+0000 1694c700 -1 osd.2 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.721415+0000 front 2019-11-29T21:34:01.939370+0000 (oldest deadline 2019-11-29T21:34:44.003144+0000) 2019-11-29T21:35:26.903 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:35:26.896+0000 1694c700 -1 osd.6 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:33:59.565649+0000 front 2019-11-29T21:34:00.280209+0000 (oldest deadline 2019-11-29T21:34:45.384917+0000) 2019-11-29T21:35:26.916 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:35:26.908+0000 1694c700 -1 osd.0 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:02.234588+0000 front 2019-11-29T21:34:03.083843+0000 (oldest deadline 2019-11-29T21:34:42.945601+0000) 2019-11-29T21:35:27.418 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:35:27.411+0000 1694c700 -1 osd.5 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:34:15.039882+0000 (oldest deadline 2019-11-29T21:34:55.039882+0000) 2019-11-29T21:35:27.421 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:35:27.414+0000 1694c700 -1 osd.5 362 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e360) 2019-11-29T21:35:27.590 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:35:27.584+0000 1694c700 -1 osd.7 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.472363+0000 front 2019-11-29T21:34:01.720825+0000 (oldest deadline 2019-11-29T21:34:46.765621+0000) 2019-11-29T21:35:27.640 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:35:27.633+0000 1694c700 -1 osd.4 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.239185+0000 front 2019-11-29T21:34:01.216873+0000 (oldest deadline 2019-11-29T21:34:45.177244+0000) 2019-11-29T21:35:27.758 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:35:27.752+0000 1694c700 -1 osd.2 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.721415+0000 front 2019-11-29T21:34:01.939370+0000 (oldest deadline 2019-11-29T21:34:44.003144+0000) 2019-11-29T21:35:27.891 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:35:27.883+0000 1694c700 -1 osd.6 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:33:59.565649+0000 front 2019-11-29T21:34:00.280209+0000 (oldest deadline 2019-11-29T21:34:45.384917+0000) 2019-11-29T21:35:27.898 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:35:27.892+0000 1694c700 -1 osd.0 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:02.234588+0000 front 2019-11-29T21:34:03.083843+0000 (oldest deadline 2019-11-29T21:34:42.945601+0000) 2019-11-29T21:35:28.415 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:35:28.408+0000 1694c700 -1 osd.5 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:34:15.039882+0000 (oldest deadline 2019-11-29T21:34:55.039882+0000) 2019-11-29T21:35:28.416 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:35:28.410+0000 1694c700 -1 osd.5 362 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e360) 2019-11-29T21:35:28.607 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:35:28.601+0000 1694c700 -1 osd.7 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.472363+0000 front 2019-11-29T21:34:01.720825+0000 (oldest deadline 2019-11-29T21:34:46.765621+0000) 2019-11-29T21:35:28.629 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:35:28.622+0000 1694c700 -1 osd.4 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.239185+0000 front 2019-11-29T21:34:01.216873+0000 (oldest deadline 2019-11-29T21:34:45.177244+0000) 2019-11-29T21:35:28.737 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:35:28.732+0000 1694c700 -1 osd.2 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.721415+0000 front 2019-11-29T21:34:01.939370+0000 (oldest deadline 2019-11-29T21:34:44.003144+0000) 2019-11-29T21:35:28.895 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:35:28.888+0000 1694c700 -1 osd.6 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:33:59.565649+0000 front 2019-11-29T21:34:00.280209+0000 (oldest deadline 2019-11-29T21:34:45.384917+0000) 2019-11-29T21:35:28.949 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:35:28.943+0000 1694c700 -1 osd.0 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:02.234588+0000 front 2019-11-29T21:34:03.083843+0000 (oldest deadline 2019-11-29T21:34:42.945601+0000) 2019-11-29T21:35:29.444 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:35:29.438+0000 1694c700 -1 osd.5 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:34:15.039882+0000 (oldest deadline 2019-11-29T21:34:55.039882+0000) 2019-11-29T21:35:29.447 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:35:29.442+0000 1694c700 -1 osd.5 362 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e360) 2019-11-29T21:35:29.613 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:35:29.606+0000 1694c700 -1 osd.4 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.239185+0000 front 2019-11-29T21:34:01.216873+0000 (oldest deadline 2019-11-29T21:34:45.177244+0000) 2019-11-29T21:35:29.627 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:35:29.621+0000 1694c700 -1 osd.7 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.472363+0000 front 2019-11-29T21:34:01.720825+0000 (oldest deadline 2019-11-29T21:34:46.765621+0000) 2019-11-29T21:35:29.746 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:35:29.741+0000 1694c700 -1 osd.2 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.721415+0000 front 2019-11-29T21:34:01.939370+0000 (oldest deadline 2019-11-29T21:34:44.003144+0000) 2019-11-29T21:35:29.868 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:35:29.861+0000 1694c700 -1 osd.6 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:33:59.565649+0000 front 2019-11-29T21:34:00.280209+0000 (oldest deadline 2019-11-29T21:34:45.384917+0000) 2019-11-29T21:35:30.000 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:35:29.995+0000 1694c700 -1 osd.0 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:02.234588+0000 front 2019-11-29T21:34:03.083843+0000 (oldest deadline 2019-11-29T21:34:42.945601+0000) 2019-11-29T21:35:30.477 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:35:30.471+0000 1694c700 -1 osd.5 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:34:15.039882+0000 (oldest deadline 2019-11-29T21:34:55.039882+0000) 2019-11-29T21:35:30.481 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:35:30.475+0000 1694c700 -1 osd.5 362 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e360) 2019-11-29T21:35:30.577 INFO:tasks.ceph.mon.b.smithi022.stderr:2019-11-29T21:35:30.570+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.1 [v2:172.21.15.62:6800/10370,v1:172.21.15.62:6801/10370] for 42sec e362 v362) 2019-11-29T21:35:30.654 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:35:30.647+0000 1694c700 -1 osd.7 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.472363+0000 front 2019-11-29T21:34:01.720825+0000 (oldest deadline 2019-11-29T21:34:46.765621+0000) 2019-11-29T21:35:30.655 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:35:30.649+0000 1694c700 -1 osd.4 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.239185+0000 front 2019-11-29T21:34:01.216873+0000 (oldest deadline 2019-11-29T21:34:45.177244+0000) 2019-11-29T21:35:30.770 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:35:30.766+0000 1694c700 -1 osd.2 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.721415+0000 front 2019-11-29T21:34:01.939370+0000 (oldest deadline 2019-11-29T21:34:44.003144+0000) 2019-11-29T21:35:30.839 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:35:30.832+0000 1694c700 -1 osd.6 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:33:59.565649+0000 front 2019-11-29T21:34:00.280209+0000 (oldest deadline 2019-11-29T21:34:45.384917+0000) 2019-11-29T21:35:31.039 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:35:31.033+0000 1694c700 -1 osd.0 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:02.234588+0000 front 2019-11-29T21:34:03.083843+0000 (oldest deadline 2019-11-29T21:34:42.945601+0000) 2019-11-29T21:35:31.529 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:35:31.522+0000 1694c700 -1 osd.5 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:34:15.039882+0000 (oldest deadline 2019-11-29T21:34:55.039882+0000) 2019-11-29T21:35:31.530 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:35:31.524+0000 1694c700 -1 osd.5 362 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e360) 2019-11-29T21:35:31.609 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:35:31.602+0000 1694c700 -1 osd.7 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.472363+0000 front 2019-11-29T21:34:01.720825+0000 (oldest deadline 2019-11-29T21:34:46.765621+0000) 2019-11-29T21:35:31.687 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:35:31.681+0000 1694c700 -1 osd.4 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.239185+0000 front 2019-11-29T21:34:01.216873+0000 (oldest deadline 2019-11-29T21:34:45.177244+0000) 2019-11-29T21:35:31.801 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:35:31.796+0000 1694c700 -1 osd.2 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.721415+0000 front 2019-11-29T21:34:01.939370+0000 (oldest deadline 2019-11-29T21:34:44.003144+0000) 2019-11-29T21:35:31.829 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:35:31.823+0000 1694c700 -1 osd.6 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:33:59.565649+0000 front 2019-11-29T21:34:00.280209+0000 (oldest deadline 2019-11-29T21:34:45.384917+0000) 2019-11-29T21:35:32.033 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:35:32.028+0000 1694c700 -1 osd.0 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:02.234588+0000 front 2019-11-29T21:34:03.083843+0000 (oldest deadline 2019-11-29T21:34:42.945601+0000) 2019-11-29T21:35:32.565 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:35:32.557+0000 1694c700 -1 osd.5 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:34:15.039882+0000 (oldest deadline 2019-11-29T21:34:55.039882+0000) 2019-11-29T21:35:32.566 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:35:32.560+0000 1694c700 -1 osd.5 362 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e360) 2019-11-29T21:35:32.586 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:35:32.579+0000 1694c700 -1 osd.7 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.472363+0000 front 2019-11-29T21:34:01.720825+0000 (oldest deadline 2019-11-29T21:34:46.765621+0000) 2019-11-29T21:35:32.708 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:35:32.702+0000 1694c700 -1 osd.4 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.239185+0000 front 2019-11-29T21:34:01.216873+0000 (oldest deadline 2019-11-29T21:34:45.177244+0000) 2019-11-29T21:35:32.789 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:35:32.784+0000 1694c700 -1 osd.2 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.721415+0000 front 2019-11-29T21:34:01.939370+0000 (oldest deadline 2019-11-29T21:34:44.003144+0000) 2019-11-29T21:35:32.871 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:35:32.864+0000 1694c700 -1 osd.6 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:33:59.565649+0000 front 2019-11-29T21:34:00.280209+0000 (oldest deadline 2019-11-29T21:34:45.384917+0000) 2019-11-29T21:35:33.081 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:35:33.075+0000 1694c700 -1 osd.0 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:02.234588+0000 front 2019-11-29T21:34:03.083843+0000 (oldest deadline 2019-11-29T21:34:42.945601+0000) 2019-11-29T21:35:33.567 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:35:33.560+0000 1694c700 -1 osd.5 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:34:15.039882+0000 (oldest deadline 2019-11-29T21:34:55.039882+0000) 2019-11-29T21:35:33.568 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:35:33.563+0000 1694c700 -1 osd.5 362 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e360) 2019-11-29T21:35:33.614 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:35:33.605+0000 1694c700 -1 osd.7 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.472363+0000 front 2019-11-29T21:34:01.720825+0000 (oldest deadline 2019-11-29T21:34:46.765621+0000) 2019-11-29T21:35:33.670 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:35:33.665+0000 1694c700 -1 osd.4 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.239185+0000 front 2019-11-29T21:34:01.216873+0000 (oldest deadline 2019-11-29T21:34:45.177244+0000) 2019-11-29T21:35:33.780 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:35:33.775+0000 1694c700 -1 osd.2 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.721415+0000 front 2019-11-29T21:34:01.939370+0000 (oldest deadline 2019-11-29T21:34:44.003144+0000) 2019-11-29T21:35:33.921 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:35:33.915+0000 1694c700 -1 osd.6 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:33:59.565649+0000 front 2019-11-29T21:34:00.280209+0000 (oldest deadline 2019-11-29T21:34:45.384917+0000) 2019-11-29T21:35:34.050 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:35:34.044+0000 1694c700 -1 osd.0 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:02.234588+0000 front 2019-11-29T21:34:03.083843+0000 (oldest deadline 2019-11-29T21:34:42.945601+0000) 2019-11-29T21:35:34.615 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:35:34.607+0000 1694c700 -1 osd.5 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:34:15.039882+0000 (oldest deadline 2019-11-29T21:34:55.039882+0000) 2019-11-29T21:35:34.615 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:35:34.610+0000 1694c700 -1 osd.5 362 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e360) 2019-11-29T21:35:34.651 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:35:34.644+0000 1694c700 -1 osd.7 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.472363+0000 front 2019-11-29T21:34:01.720825+0000 (oldest deadline 2019-11-29T21:34:46.765621+0000) 2019-11-29T21:35:34.699 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:35:34.690+0000 1694c700 -1 osd.4 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.239185+0000 front 2019-11-29T21:34:01.216873+0000 (oldest deadline 2019-11-29T21:34:45.177244+0000) 2019-11-29T21:35:34.770 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:35:34.765+0000 1694c700 -1 osd.2 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.721415+0000 front 2019-11-29T21:34:01.939370+0000 (oldest deadline 2019-11-29T21:34:44.003144+0000) 2019-11-29T21:35:34.929 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:35:34.919+0000 1694c700 -1 osd.6 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:33:59.565649+0000 front 2019-11-29T21:34:00.280209+0000 (oldest deadline 2019-11-29T21:34:45.384917+0000) 2019-11-29T21:35:35.073 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:35:35.068+0000 1694c700 -1 osd.0 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:02.234588+0000 front 2019-11-29T21:34:03.083843+0000 (oldest deadline 2019-11-29T21:34:42.945601+0000) 2019-11-29T21:35:35.609 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:35:35.602+0000 1694c700 -1 osd.5 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:34:15.039882+0000 (oldest deadline 2019-11-29T21:34:55.039882+0000) 2019-11-29T21:35:35.610 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:35:35.604+0000 1694c700 -1 osd.5 362 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e360) 2019-11-29T21:35:35.612 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:35:35.606+0000 1694c700 -1 osd.7 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.472363+0000 front 2019-11-29T21:34:01.720825+0000 (oldest deadline 2019-11-29T21:34:46.765621+0000) 2019-11-29T21:35:35.667 INFO:tasks.ceph.mon.b.smithi022.stderr:2019-11-29T21:35:35.659+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.1 [v2:172.21.15.62:6800/10370,v1:172.21.15.62:6801/10370] for 42sec e362 v362) 2019-11-29T21:35:35.684 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:35:35.678+0000 1694c700 -1 osd.4 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.239185+0000 front 2019-11-29T21:34:01.216873+0000 (oldest deadline 2019-11-29T21:34:45.177244+0000) 2019-11-29T21:35:35.760 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:35:35.755+0000 1694c700 -1 osd.2 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.721415+0000 front 2019-11-29T21:34:01.939370+0000 (oldest deadline 2019-11-29T21:34:44.003144+0000) 2019-11-29T21:35:35.970 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:35:35.965+0000 1694c700 -1 osd.6 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:33:59.565649+0000 front 2019-11-29T21:34:00.280209+0000 (oldest deadline 2019-11-29T21:34:45.384917+0000) 2019-11-29T21:35:36.795 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:35:36.788+0000 1694c700 -1 osd.2 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:34:01.721415+0000 front 2019-11-29T21:34:01.939370+0000 (oldest deadline 2019-11-29T21:34:44.003144+0000) 2019-11-29T21:35:36.943 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:35:36.937+0000 1694c700 -1 osd.6 362 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:33:59.565649+0000 front 2019-11-29T21:34:00.280209+0000 (oldest deadline 2019-11-29T21:34:45.384917+0000) 2019-11-29T21:37:07.214 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:09:11:47.872 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T21:37:07.231 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:09:11:47.890 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T21:37:07.251 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:09:11:47.859 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T21:37:07.252 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:09:11:47.859 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T21:37:07.258 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:09:11:47.865 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T21:37:07.264 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:09:11:47.871 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T21:37:07.483 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:09:11:48.142 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T21:37:07.538 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:09:11:48.145 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T21:37:07.542 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:09:11:48.150 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T21:37:15.352 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:37:15.347+0000 1694c700 -1 osd.1 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:30.499077+0000 front 2019-11-29T21:36:35.348482+0000 (oldest deadline 2019-11-29T21:37:14.723108+0000) 2019-11-29T21:37:15.355 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:37:15.348+0000 1694c700 -1 osd.7 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:35.576181+0000 front 2019-11-29T21:36:35.005763+0000 (oldest deadline 2019-11-29T21:37:15.282766+0000) 2019-11-29T21:37:15.673 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:37:15.669+0000 1694c700 -1 osd.2 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:33.970535+0000 front 2019-11-29T21:36:35.102548+0000 (oldest deadline 2019-11-29T21:37:15.074744+0000) 2019-11-29T21:37:16.314 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:37:16.309+0000 1694c700 -1 osd.7 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:35.576181+0000 front 2019-11-29T21:36:35.005763+0000 (oldest deadline 2019-11-29T21:37:15.282766+0000) 2019-11-29T21:37:16.399 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:37:16.394+0000 1694c700 -1 osd.1 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:30.499077+0000 front 2019-11-29T21:36:35.348482+0000 (oldest deadline 2019-11-29T21:37:14.723108+0000) 2019-11-29T21:37:16.709 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:37:16.704+0000 1694c700 -1 osd.2 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:33.970535+0000 front 2019-11-29T21:36:35.102548+0000 (oldest deadline 2019-11-29T21:37:15.074744+0000) 2019-11-29T21:37:17.312 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:37:17.307+0000 1694c700 -1 osd.7 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:35.576181+0000 front 2019-11-29T21:36:35.005763+0000 (oldest deadline 2019-11-29T21:37:15.282766+0000) 2019-11-29T21:37:17.436 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:37:17.430+0000 1694c700 -1 osd.1 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:30.499077+0000 front 2019-11-29T21:36:35.348482+0000 (oldest deadline 2019-11-29T21:37:14.723108+0000) 2019-11-29T21:37:17.599 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:37:17.593+0000 1694c700 -1 osd.4 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:31.753717+0000 front 2019-11-29T21:36:31.740038+0000 (oldest deadline 2019-11-29T21:37:17.016303+0000) 2019-11-29T21:37:17.741 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:37:17.735+0000 1694c700 -1 osd.2 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:33.970535+0000 front 2019-11-29T21:36:35.102548+0000 (oldest deadline 2019-11-29T21:37:15.074744+0000) 2019-11-29T21:37:18.193 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:37:18.189+0000 1694c700 -1 osd.0 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:35.190291+0000 front 2019-11-29T21:36:35.192942+0000 (oldest deadline 2019-11-29T21:37:18.009844+0000) 2019-11-29T21:37:18.321 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:37:18.316+0000 1694c700 -1 osd.7 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:35.576181+0000 front 2019-11-29T21:36:35.005763+0000 (oldest deadline 2019-11-29T21:37:15.282766+0000) 2019-11-29T21:37:18.465 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:37:18.460+0000 1694c700 -1 osd.1 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:30.499077+0000 front 2019-11-29T21:36:35.348482+0000 (oldest deadline 2019-11-29T21:37:14.723108+0000) 2019-11-29T21:37:18.645 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:37:18.640+0000 1694c700 -1 osd.4 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:31.753717+0000 front 2019-11-29T21:36:31.740038+0000 (oldest deadline 2019-11-29T21:37:17.016303+0000) 2019-11-29T21:37:18.769 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:37:18.764+0000 1694c700 -1 osd.2 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:33.970535+0000 front 2019-11-29T21:36:35.102548+0000 (oldest deadline 2019-11-29T21:37:15.074744+0000) 2019-11-29T21:37:19.038 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:37:19.033+0000 1694c700 -1 osd.6 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:33.806443+0000 front 2019-11-29T21:36:35.212325+0000 (oldest deadline 2019-11-29T21:37:18.458552+0000) 2019-11-29T21:37:19.189 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:37:19.183+0000 1694c700 -1 osd.0 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:35.190291+0000 front 2019-11-29T21:36:35.192942+0000 (oldest deadline 2019-11-29T21:37:18.009844+0000) 2019-11-29T21:37:19.307 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:37:19.303+0000 1694c700 -1 osd.7 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:35.576181+0000 front 2019-11-29T21:36:35.005763+0000 (oldest deadline 2019-11-29T21:37:15.282766+0000) 2019-11-29T21:37:19.479 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:37:19.474+0000 1694c700 -1 osd.1 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:30.499077+0000 front 2019-11-29T21:36:35.348482+0000 (oldest deadline 2019-11-29T21:37:14.723108+0000) 2019-11-29T21:37:19.635 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:37:19.630+0000 1694c700 -1 osd.4 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:31.753717+0000 front 2019-11-29T21:36:31.740038+0000 (oldest deadline 2019-11-29T21:37:17.016303+0000) 2019-11-29T21:37:19.736 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:37:19.732+0000 1694c700 -1 osd.2 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:33.970535+0000 front 2019-11-29T21:36:35.102548+0000 (oldest deadline 2019-11-29T21:37:15.074744+0000) 2019-11-29T21:37:20.026 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:37:20.021+0000 1694c700 -1 osd.6 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:33.806443+0000 front 2019-11-29T21:36:35.212325+0000 (oldest deadline 2019-11-29T21:37:18.458552+0000) 2019-11-29T21:37:20.238 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:37:20.232+0000 1694c700 -1 osd.0 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:35.190291+0000 front 2019-11-29T21:36:35.192942+0000 (oldest deadline 2019-11-29T21:37:18.009844+0000) 2019-11-29T21:37:20.332 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:37:20.328+0000 1694c700 -1 osd.7 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:35.576181+0000 front 2019-11-29T21:36:35.005763+0000 (oldest deadline 2019-11-29T21:37:15.282766+0000) 2019-11-29T21:37:20.487 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:37:20.482+0000 1694c700 -1 osd.1 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:30.499077+0000 front 2019-11-29T21:36:35.348482+0000 (oldest deadline 2019-11-29T21:37:14.723108+0000) 2019-11-29T21:37:20.655 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:37:20.650+0000 1694c700 -1 osd.4 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:31.753717+0000 front 2019-11-29T21:36:31.740038+0000 (oldest deadline 2019-11-29T21:37:17.016303+0000) 2019-11-29T21:37:20.720 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:37:20.715+0000 1694c700 -1 osd.2 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:33.970535+0000 front 2019-11-29T21:36:35.102548+0000 (oldest deadline 2019-11-29T21:37:15.074744+0000) 2019-11-29T21:37:21.061 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:37:21.057+0000 1694c700 -1 osd.6 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:33.806443+0000 front 2019-11-29T21:36:35.212325+0000 (oldest deadline 2019-11-29T21:37:18.458552+0000) 2019-11-29T21:37:21.250 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:37:21.245+0000 1694c700 -1 osd.0 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:35.190291+0000 front 2019-11-29T21:36:35.192942+0000 (oldest deadline 2019-11-29T21:37:18.009844+0000) 2019-11-29T21:37:21.340 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:37:21.336+0000 1694c700 -1 osd.7 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:35.576181+0000 front 2019-11-29T21:36:35.005763+0000 (oldest deadline 2019-11-29T21:37:15.282766+0000) 2019-11-29T21:37:21.459 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:37:21.453+0000 1694c700 -1 osd.1 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:30.499077+0000 front 2019-11-29T21:36:35.348482+0000 (oldest deadline 2019-11-29T21:37:14.723108+0000) 2019-11-29T21:37:21.658 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:37:21.654+0000 1694c700 -1 osd.4 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:31.753717+0000 front 2019-11-29T21:36:31.740038+0000 (oldest deadline 2019-11-29T21:37:17.016303+0000) 2019-11-29T21:37:21.738 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:37:21.733+0000 1694c700 -1 osd.2 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:33.970535+0000 front 2019-11-29T21:36:35.102548+0000 (oldest deadline 2019-11-29T21:37:15.074744+0000) 2019-11-29T21:37:22.060 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:37:22.056+0000 1694c700 -1 osd.6 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:33.806443+0000 front 2019-11-29T21:36:35.212325+0000 (oldest deadline 2019-11-29T21:37:18.458552+0000) 2019-11-29T21:37:22.282 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:37:22.278+0000 1694c700 -1 osd.0 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:35.190291+0000 front 2019-11-29T21:36:35.192942+0000 (oldest deadline 2019-11-29T21:37:18.009844+0000) 2019-11-29T21:37:22.364 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:37:22.359+0000 1694c700 -1 osd.7 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:35.576181+0000 front 2019-11-29T21:36:35.005763+0000 (oldest deadline 2019-11-29T21:37:15.282766+0000) 2019-11-29T21:37:22.439 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:37:22.432+0000 1694c700 -1 osd.1 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:30.499077+0000 front 2019-11-29T21:36:35.348482+0000 (oldest deadline 2019-11-29T21:37:14.723108+0000) 2019-11-29T21:37:22.643 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:37:22.639+0000 1694c700 -1 osd.4 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:31.753717+0000 front 2019-11-29T21:36:31.740038+0000 (oldest deadline 2019-11-29T21:37:17.016303+0000) 2019-11-29T21:37:22.736 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:37:22.731+0000 1694c700 -1 osd.2 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:33.970535+0000 front 2019-11-29T21:36:35.102548+0000 (oldest deadline 2019-11-29T21:37:15.074744+0000) 2019-11-29T21:37:23.039 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:37:23.034+0000 1694c700 -1 osd.6 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:33.806443+0000 front 2019-11-29T21:36:35.212325+0000 (oldest deadline 2019-11-29T21:37:18.458552+0000) 2019-11-29T21:37:23.269 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:37:23.264+0000 1694c700 -1 osd.0 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:35.190291+0000 front 2019-11-29T21:36:35.192942+0000 (oldest deadline 2019-11-29T21:37:18.009844+0000) 2019-11-29T21:37:23.395 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:37:23.390+0000 1694c700 -1 osd.7 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:35.576181+0000 front 2019-11-29T21:36:35.005763+0000 (oldest deadline 2019-11-29T21:37:15.282766+0000) 2019-11-29T21:37:23.462 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:37:23.458+0000 1694c700 -1 osd.1 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:30.499077+0000 front 2019-11-29T21:36:35.348482+0000 (oldest deadline 2019-11-29T21:37:14.723108+0000) 2019-11-29T21:37:23.672 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:37:23.667+0000 1694c700 -1 osd.4 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:31.753717+0000 front 2019-11-29T21:36:31.740038+0000 (oldest deadline 2019-11-29T21:37:17.016303+0000) 2019-11-29T21:37:23.736 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:37:23.730+0000 1694c700 -1 osd.2 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:33.970535+0000 front 2019-11-29T21:36:35.102548+0000 (oldest deadline 2019-11-29T21:37:15.074744+0000) 2019-11-29T21:37:24.078 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:37:24.072+0000 1694c700 -1 osd.6 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:33.806443+0000 front 2019-11-29T21:36:35.212325+0000 (oldest deadline 2019-11-29T21:37:18.458552+0000) 2019-11-29T21:37:24.299 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:37:24.294+0000 1694c700 -1 osd.0 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:35.190291+0000 front 2019-11-29T21:36:35.192942+0000 (oldest deadline 2019-11-29T21:37:18.009844+0000) 2019-11-29T21:37:24.429 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:37:24.424+0000 1694c700 -1 osd.1 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:30.499077+0000 front 2019-11-29T21:36:35.348482+0000 (oldest deadline 2019-11-29T21:37:14.723108+0000) 2019-11-29T21:37:24.451 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:37:24.446+0000 1694c700 -1 osd.7 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:35.576181+0000 front 2019-11-29T21:36:35.005763+0000 (oldest deadline 2019-11-29T21:37:15.282766+0000) 2019-11-29T21:37:24.640 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:37:24.635+0000 1694c700 -1 osd.4 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:31.753717+0000 front 2019-11-29T21:36:31.740038+0000 (oldest deadline 2019-11-29T21:37:17.016303+0000) 2019-11-29T21:37:24.789 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:37:24.784+0000 1694c700 -1 osd.2 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:33.970535+0000 front 2019-11-29T21:36:35.102548+0000 (oldest deadline 2019-11-29T21:37:15.074744+0000) 2019-11-29T21:37:25.040 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:37:25.035+0000 1694c700 -1 osd.6 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:33.806443+0000 front 2019-11-29T21:36:35.212325+0000 (oldest deadline 2019-11-29T21:37:18.458552+0000) 2019-11-29T21:37:25.259 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:37:25.254+0000 1694c700 -1 osd.0 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:35.190291+0000 front 2019-11-29T21:36:35.192942+0000 (oldest deadline 2019-11-29T21:37:18.009844+0000) 2019-11-29T21:37:25.460 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:37:25.455+0000 1694c700 -1 osd.1 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:30.499077+0000 front 2019-11-29T21:36:35.348482+0000 (oldest deadline 2019-11-29T21:37:14.723108+0000) 2019-11-29T21:37:25.484 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:37:25.480+0000 1694c700 -1 osd.7 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:35.576181+0000 front 2019-11-29T21:36:35.005763+0000 (oldest deadline 2019-11-29T21:37:15.282766+0000) 2019-11-29T21:37:25.620 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:37:25.616+0000 1694c700 -1 osd.4 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:31.753717+0000 front 2019-11-29T21:36:31.740038+0000 (oldest deadline 2019-11-29T21:37:17.016303+0000) 2019-11-29T21:37:25.816 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:37:25.809+0000 1694c700 -1 osd.2 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:33.970535+0000 front 2019-11-29T21:36:35.102548+0000 (oldest deadline 2019-11-29T21:37:15.074744+0000) 2019-11-29T21:37:26.090 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:37:26.085+0000 1694c700 -1 osd.6 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:33.806443+0000 front 2019-11-29T21:36:35.212325+0000 (oldest deadline 2019-11-29T21:37:18.458552+0000) 2019-11-29T21:37:26.286 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:37:26.280+0000 1694c700 -1 osd.0 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:35.190291+0000 front 2019-11-29T21:36:35.192942+0000 (oldest deadline 2019-11-29T21:37:18.009844+0000) 2019-11-29T21:37:26.454 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:37:26.448+0000 1694c700 -1 osd.1 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:30.499077+0000 front 2019-11-29T21:36:35.348482+0000 (oldest deadline 2019-11-29T21:37:14.723108+0000) 2019-11-29T21:37:26.468 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:37:26.464+0000 1694c700 -1 osd.7 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:35.576181+0000 front 2019-11-29T21:36:35.005763+0000 (oldest deadline 2019-11-29T21:37:15.282766+0000) 2019-11-29T21:37:26.670 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:37:26.664+0000 1694c700 -1 osd.4 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:31.753717+0000 front 2019-11-29T21:36:31.740038+0000 (oldest deadline 2019-11-29T21:37:17.016303+0000) 2019-11-29T21:37:26.801 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:37:26.797+0000 1694c700 -1 osd.2 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:33.970535+0000 front 2019-11-29T21:36:35.102548+0000 (oldest deadline 2019-11-29T21:37:15.074744+0000) 2019-11-29T21:37:27.126 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:37:27.122+0000 1694c700 -1 osd.6 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:33.806443+0000 front 2019-11-29T21:36:35.212325+0000 (oldest deadline 2019-11-29T21:37:18.458552+0000) 2019-11-29T21:37:27.327 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:37:27.323+0000 1694c700 -1 osd.0 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:35.190291+0000 front 2019-11-29T21:36:35.192942+0000 (oldest deadline 2019-11-29T21:37:18.009844+0000) 2019-11-29T21:37:27.439 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:37:27.435+0000 1694c700 -1 osd.1 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:30.499077+0000 front 2019-11-29T21:36:35.348482+0000 (oldest deadline 2019-11-29T21:37:14.723108+0000) 2019-11-29T21:37:27.506 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:37:27.502+0000 1694c700 -1 osd.7 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:35.576181+0000 front 2019-11-29T21:36:35.005763+0000 (oldest deadline 2019-11-29T21:37:15.282766+0000) 2019-11-29T21:37:27.723 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:37:27.716+0000 1694c700 -1 osd.4 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:31.753717+0000 front 2019-11-29T21:36:31.740038+0000 (oldest deadline 2019-11-29T21:37:17.016303+0000) 2019-11-29T21:37:27.837 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:37:27.833+0000 1694c700 -1 osd.2 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:33.970535+0000 front 2019-11-29T21:36:35.102548+0000 (oldest deadline 2019-11-29T21:37:15.074744+0000) 2019-11-29T21:37:28.135 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:37:28.131+0000 1694c700 -1 osd.6 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:33.806443+0000 front 2019-11-29T21:36:35.212325+0000 (oldest deadline 2019-11-29T21:37:18.458552+0000) 2019-11-29T21:37:28.337 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:37:28.331+0000 1694c700 -1 osd.0 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:35.190291+0000 front 2019-11-29T21:36:35.192942+0000 (oldest deadline 2019-11-29T21:37:18.009844+0000) 2019-11-29T21:37:28.425 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:37:28.419+0000 1694c700 -1 osd.1 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:30.499077+0000 front 2019-11-29T21:36:35.348482+0000 (oldest deadline 2019-11-29T21:37:14.723108+0000) 2019-11-29T21:37:28.537 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:37:28.533+0000 1694c700 -1 osd.7 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:35.576181+0000 front 2019-11-29T21:36:35.005763+0000 (oldest deadline 2019-11-29T21:37:15.282766+0000) 2019-11-29T21:37:28.729 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:37:28.724+0000 1694c700 -1 osd.4 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:31.753717+0000 front 2019-11-29T21:36:31.740038+0000 (oldest deadline 2019-11-29T21:37:17.016303+0000) 2019-11-29T21:37:28.820 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:37:28.815+0000 1694c700 -1 osd.2 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:33.970535+0000 front 2019-11-29T21:36:35.102548+0000 (oldest deadline 2019-11-29T21:37:15.074744+0000) 2019-11-29T21:37:29.103 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:37:29.097+0000 1694c700 -1 osd.6 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:33.806443+0000 front 2019-11-29T21:36:35.212325+0000 (oldest deadline 2019-11-29T21:37:18.458552+0000) 2019-11-29T21:37:29.353 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:37:29.348+0000 1694c700 -1 osd.0 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:35.190291+0000 front 2019-11-29T21:36:35.192942+0000 (oldest deadline 2019-11-29T21:37:18.009844+0000) 2019-11-29T21:37:29.435 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:37:29.429+0000 1694c700 -1 osd.1 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:30.499077+0000 front 2019-11-29T21:36:35.348482+0000 (oldest deadline 2019-11-29T21:37:14.723108+0000) 2019-11-29T21:37:29.548 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:37:29.543+0000 1694c700 -1 osd.7 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:35.576181+0000 front 2019-11-29T21:36:35.005763+0000 (oldest deadline 2019-11-29T21:37:15.282766+0000) 2019-11-29T21:37:29.774 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:37:29.769+0000 1694c700 -1 osd.4 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:31.753717+0000 front 2019-11-29T21:36:31.740038+0000 (oldest deadline 2019-11-29T21:37:17.016303+0000) 2019-11-29T21:37:29.790 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:37:29.784+0000 1694c700 -1 osd.2 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:33.970535+0000 front 2019-11-29T21:36:35.102548+0000 (oldest deadline 2019-11-29T21:37:15.074744+0000) 2019-11-29T21:37:30.065 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:37:30.060+0000 1694c700 -1 osd.6 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:33.806443+0000 front 2019-11-29T21:36:35.212325+0000 (oldest deadline 2019-11-29T21:37:18.458552+0000) 2019-11-29T21:37:30.360 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:37:30.353+0000 1694c700 -1 osd.0 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:35.190291+0000 front 2019-11-29T21:36:35.192942+0000 (oldest deadline 2019-11-29T21:37:18.009844+0000) 2019-11-29T21:37:30.414 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:37:30.409+0000 1694c700 -1 osd.1 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:30.499077+0000 front 2019-11-29T21:36:35.348482+0000 (oldest deadline 2019-11-29T21:37:14.723108+0000) 2019-11-29T21:37:30.576 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:37:30.571+0000 1694c700 -1 osd.7 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:35.576181+0000 front 2019-11-29T21:36:35.005763+0000 (oldest deadline 2019-11-29T21:37:15.282766+0000) 2019-11-29T21:37:30.737 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:37:30.728+0000 1694c700 -1 osd.4 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:31.753717+0000 front 2019-11-29T21:36:31.740038+0000 (oldest deadline 2019-11-29T21:37:17.016303+0000) 2019-11-29T21:37:30.804 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:37:30.799+0000 1694c700 -1 osd.2 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:33.970535+0000 front 2019-11-29T21:36:35.102548+0000 (oldest deadline 2019-11-29T21:37:15.074744+0000) 2019-11-29T21:37:31.062 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:37:31.056+0000 1694c700 -1 osd.6 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:33.806443+0000 front 2019-11-29T21:36:35.212325+0000 (oldest deadline 2019-11-29T21:37:18.458552+0000) 2019-11-29T21:37:31.406 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:37:31.400+0000 1694c700 -1 osd.0 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:35.190291+0000 front 2019-11-29T21:36:35.192942+0000 (oldest deadline 2019-11-29T21:37:18.009844+0000) 2019-11-29T21:37:31.424 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:37:31.420+0000 1694c700 -1 osd.1 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:30.499077+0000 front 2019-11-29T21:36:35.348482+0000 (oldest deadline 2019-11-29T21:37:14.723108+0000) 2019-11-29T21:37:31.578 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:37:31.573+0000 1694c700 -1 osd.7 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:35.576181+0000 front 2019-11-29T21:36:35.005763+0000 (oldest deadline 2019-11-29T21:37:15.282766+0000) 2019-11-29T21:37:31.772 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:37:31.768+0000 1694c700 -1 osd.4 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:31.753717+0000 front 2019-11-29T21:36:31.740038+0000 (oldest deadline 2019-11-29T21:37:17.016303+0000) 2019-11-29T21:37:31.854 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:37:31.845+0000 1694c700 -1 osd.2 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:33.970535+0000 front 2019-11-29T21:36:35.102548+0000 (oldest deadline 2019-11-29T21:37:15.074744+0000) 2019-11-29T21:37:32.076 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:37:32.072+0000 1694c700 -1 osd.6 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:33.806443+0000 front 2019-11-29T21:36:35.212325+0000 (oldest deadline 2019-11-29T21:37:18.458552+0000) 2019-11-29T21:37:32.429 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:37:32.422+0000 1694c700 -1 osd.1 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:30.499077+0000 front 2019-11-29T21:36:35.348482+0000 (oldest deadline 2019-11-29T21:37:14.723108+0000) 2019-11-29T21:37:32.457 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:37:32.453+0000 1694c700 -1 osd.0 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:35.190291+0000 front 2019-11-29T21:36:35.192942+0000 (oldest deadline 2019-11-29T21:37:18.009844+0000) 2019-11-29T21:37:32.627 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:37:32.621+0000 1694c700 -1 osd.7 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:35.576181+0000 front 2019-11-29T21:36:35.005763+0000 (oldest deadline 2019-11-29T21:37:15.282766+0000) 2019-11-29T21:37:32.769 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:37:32.762+0000 1694c700 -1 osd.4 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:31.753717+0000 front 2019-11-29T21:36:31.740038+0000 (oldest deadline 2019-11-29T21:37:17.016303+0000) 2019-11-29T21:37:32.833 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:37:32.828+0000 1694c700 -1 osd.2 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:33.970535+0000 front 2019-11-29T21:36:35.102548+0000 (oldest deadline 2019-11-29T21:37:15.074744+0000) 2019-11-29T21:37:33.070 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:37:33.065+0000 1694c700 -1 osd.6 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:33.806443+0000 front 2019-11-29T21:36:35.212325+0000 (oldest deadline 2019-11-29T21:37:18.458552+0000) 2019-11-29T21:37:33.420 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:37:33.415+0000 1694c700 -1 osd.1 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:30.499077+0000 front 2019-11-29T21:36:35.348482+0000 (oldest deadline 2019-11-29T21:37:14.723108+0000) 2019-11-29T21:37:33.491 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:37:33.486+0000 1694c700 -1 osd.0 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:35.190291+0000 front 2019-11-29T21:36:35.192942+0000 (oldest deadline 2019-11-29T21:37:18.009844+0000) 2019-11-29T21:37:33.581 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:37:33.577+0000 1694c700 -1 osd.7 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:35.576181+0000 front 2019-11-29T21:36:35.005763+0000 (oldest deadline 2019-11-29T21:37:15.282766+0000) 2019-11-29T21:37:33.727 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:37:33.722+0000 1694c700 -1 osd.4 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:31.753717+0000 front 2019-11-29T21:36:31.740038+0000 (oldest deadline 2019-11-29T21:37:17.016303+0000) 2019-11-29T21:37:33.877 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:37:33.872+0000 1694c700 -1 osd.2 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:33.970535+0000 front 2019-11-29T21:36:35.102548+0000 (oldest deadline 2019-11-29T21:37:15.074744+0000) 2019-11-29T21:37:34.095 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:37:34.088+0000 1694c700 -1 osd.6 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:33.806443+0000 front 2019-11-29T21:36:35.212325+0000 (oldest deadline 2019-11-29T21:37:18.458552+0000) 2019-11-29T21:37:34.413 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:37:34.407+0000 1694c700 -1 osd.1 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:30.499077+0000 front 2019-11-29T21:36:35.348482+0000 (oldest deadline 2019-11-29T21:37:14.723108+0000) 2019-11-29T21:37:34.502 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:37:34.497+0000 1694c700 -1 osd.0 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:35.190291+0000 front 2019-11-29T21:36:35.192942+0000 (oldest deadline 2019-11-29T21:37:18.009844+0000) 2019-11-29T21:37:34.583 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:37:34.578+0000 1694c700 -1 osd.7 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:35.576181+0000 front 2019-11-29T21:36:35.005763+0000 (oldest deadline 2019-11-29T21:37:15.282766+0000) 2019-11-29T21:37:34.773 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:37:34.755+0000 1694c700 -1 osd.4 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:31.753717+0000 front 2019-11-29T21:36:31.740038+0000 (oldest deadline 2019-11-29T21:37:17.016303+0000) 2019-11-29T21:37:34.857 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:37:34.852+0000 1694c700 -1 osd.2 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:33.970535+0000 front 2019-11-29T21:36:35.102548+0000 (oldest deadline 2019-11-29T21:37:15.074744+0000) 2019-11-29T21:37:35.120 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:37:35.116+0000 1694c700 -1 osd.6 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:33.806443+0000 front 2019-11-29T21:36:35.212325+0000 (oldest deadline 2019-11-29T21:37:18.458552+0000) 2019-11-29T21:37:35.368 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:37:35.364+0000 1694c700 -1 osd.1 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:30.499077+0000 front 2019-11-29T21:36:35.348482+0000 (oldest deadline 2019-11-29T21:37:14.723108+0000) 2019-11-29T21:37:35.471 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:37:35.464+0000 1694c700 -1 osd.0 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:35.190291+0000 front 2019-11-29T21:36:35.192942+0000 (oldest deadline 2019-11-29T21:37:18.009844+0000) 2019-11-29T21:37:35.617 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:37:35.613+0000 1694c700 -1 osd.7 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:35.576181+0000 front 2019-11-29T21:36:35.005763+0000 (oldest deadline 2019-11-29T21:37:15.282766+0000) 2019-11-29T21:37:35.777 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:37:35.773+0000 1694c700 -1 osd.4 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:31.753717+0000 front 2019-11-29T21:36:31.740038+0000 (oldest deadline 2019-11-29T21:37:17.016303+0000) 2019-11-29T21:37:35.883 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:37:35.878+0000 1694c700 -1 osd.2 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:33.970535+0000 front 2019-11-29T21:36:35.102548+0000 (oldest deadline 2019-11-29T21:37:15.074744+0000) 2019-11-29T21:37:36.134 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:37:36.130+0000 1694c700 -1 osd.6 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:33.806443+0000 front 2019-11-29T21:36:35.212325+0000 (oldest deadline 2019-11-29T21:37:18.458552+0000) 2019-11-29T21:37:36.357 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:37:36.353+0000 1694c700 -1 osd.1 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:30.499077+0000 front 2019-11-29T21:36:35.348482+0000 (oldest deadline 2019-11-29T21:37:14.723108+0000) 2019-11-29T21:37:36.503 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:37:36.497+0000 1694c700 -1 osd.0 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:35.190291+0000 front 2019-11-29T21:36:35.192942+0000 (oldest deadline 2019-11-29T21:37:18.009844+0000) 2019-11-29T21:37:36.588 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:37:36.582+0000 1694c700 -1 osd.7 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:35.576181+0000 front 2019-11-29T21:36:35.005763+0000 (oldest deadline 2019-11-29T21:37:15.282766+0000) 2019-11-29T21:37:36.777 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:37:36.772+0000 1694c700 -1 osd.4 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:31.753717+0000 front 2019-11-29T21:36:31.740038+0000 (oldest deadline 2019-11-29T21:37:17.016303+0000) 2019-11-29T21:37:36.900 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:37:36.896+0000 1694c700 -1 osd.2 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:33.970535+0000 front 2019-11-29T21:36:35.102548+0000 (oldest deadline 2019-11-29T21:37:15.074744+0000) 2019-11-29T21:37:37.107 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:37:37.103+0000 1694c700 -1 osd.6 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:33.806443+0000 front 2019-11-29T21:36:35.212325+0000 (oldest deadline 2019-11-29T21:37:18.458552+0000) 2019-11-29T21:37:37.406 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:37:37.397+0000 1694c700 -1 osd.1 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:30.499077+0000 front 2019-11-29T21:36:35.348482+0000 (oldest deadline 2019-11-29T21:37:14.723108+0000) 2019-11-29T21:37:37.544 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:37:37.538+0000 1694c700 -1 osd.0 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:35.190291+0000 front 2019-11-29T21:36:35.192942+0000 (oldest deadline 2019-11-29T21:37:18.009844+0000) 2019-11-29T21:37:37.560 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:37:37.555+0000 1694c700 -1 osd.7 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:35.576181+0000 front 2019-11-29T21:36:35.005763+0000 (oldest deadline 2019-11-29T21:37:15.282766+0000) 2019-11-29T21:37:37.739 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:37:37.734+0000 1694c700 -1 osd.4 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:31.753717+0000 front 2019-11-29T21:36:31.740038+0000 (oldest deadline 2019-11-29T21:37:17.016303+0000) 2019-11-29T21:37:37.875 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:37:37.871+0000 1694c700 -1 osd.2 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:33.970535+0000 front 2019-11-29T21:36:35.102548+0000 (oldest deadline 2019-11-29T21:37:15.074744+0000) 2019-11-29T21:37:38.106 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:37:38.102+0000 1694c700 -1 osd.6 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:33.806443+0000 front 2019-11-29T21:36:35.212325+0000 (oldest deadline 2019-11-29T21:37:18.458552+0000) 2019-11-29T21:37:38.372 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:37:38.368+0000 1694c700 -1 osd.1 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:30.499077+0000 front 2019-11-29T21:36:35.348482+0000 (oldest deadline 2019-11-29T21:37:14.723108+0000) 2019-11-29T21:37:38.525 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:37:38.521+0000 1694c700 -1 osd.0 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:35.190291+0000 front 2019-11-29T21:36:35.192942+0000 (oldest deadline 2019-11-29T21:37:18.009844+0000) 2019-11-29T21:37:38.566 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:37:38.562+0000 1694c700 -1 osd.7 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:35.576181+0000 front 2019-11-29T21:36:35.005763+0000 (oldest deadline 2019-11-29T21:37:15.282766+0000) 2019-11-29T21:37:38.778 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:37:38.774+0000 1694c700 -1 osd.4 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:31.753717+0000 front 2019-11-29T21:36:31.740038+0000 (oldest deadline 2019-11-29T21:37:17.016303+0000) 2019-11-29T21:37:38.865 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:37:38.860+0000 1694c700 -1 osd.2 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:33.970535+0000 front 2019-11-29T21:36:35.102548+0000 (oldest deadline 2019-11-29T21:37:15.074744+0000) 2019-11-29T21:37:39.158 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:37:39.153+0000 1694c700 -1 osd.6 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:33.806443+0000 front 2019-11-29T21:36:35.212325+0000 (oldest deadline 2019-11-29T21:37:18.458552+0000) 2019-11-29T21:37:39.386 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:37:39.381+0000 1694c700 -1 osd.1 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:30.499077+0000 front 2019-11-29T21:36:35.348482+0000 (oldest deadline 2019-11-29T21:37:14.723108+0000) 2019-11-29T21:37:39.568 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:37:39.563+0000 1694c700 -1 osd.0 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:35.190291+0000 front 2019-11-29T21:36:35.192942+0000 (oldest deadline 2019-11-29T21:37:18.009844+0000) 2019-11-29T21:37:39.588 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:37:39.584+0000 1694c700 -1 osd.7 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:35.576181+0000 front 2019-11-29T21:36:35.005763+0000 (oldest deadline 2019-11-29T21:37:15.282766+0000) 2019-11-29T21:37:39.810 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:37:39.805+0000 1694c700 -1 osd.4 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:31.753717+0000 front 2019-11-29T21:36:31.740038+0000 (oldest deadline 2019-11-29T21:37:17.016303+0000) 2019-11-29T21:37:39.882 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:37:39.876+0000 1694c700 -1 osd.2 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:33.970535+0000 front 2019-11-29T21:36:35.102548+0000 (oldest deadline 2019-11-29T21:37:15.074744+0000) 2019-11-29T21:37:40.136 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:37:40.130+0000 1694c700 -1 osd.6 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:33.806443+0000 front 2019-11-29T21:36:35.212325+0000 (oldest deadline 2019-11-29T21:37:18.458552+0000) 2019-11-29T21:37:40.366 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:37:40.362+0000 1694c700 -1 osd.1 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:30.499077+0000 front 2019-11-29T21:36:35.348482+0000 (oldest deadline 2019-11-29T21:37:14.723108+0000) 2019-11-29T21:37:40.575 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:37:40.571+0000 1694c700 -1 osd.7 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:35.576181+0000 front 2019-11-29T21:36:35.005763+0000 (oldest deadline 2019-11-29T21:37:15.282766+0000) 2019-11-29T21:37:40.614 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:37:40.606+0000 1694c700 -1 osd.0 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:35.190291+0000 front 2019-11-29T21:36:35.192942+0000 (oldest deadline 2019-11-29T21:37:18.009844+0000) 2019-11-29T21:37:40.802 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:37:40.796+0000 1694c700 -1 osd.4 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:31.753717+0000 front 2019-11-29T21:36:31.740038+0000 (oldest deadline 2019-11-29T21:37:17.016303+0000) 2019-11-29T21:37:40.903 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:37:40.898+0000 1694c700 -1 osd.2 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:33.970535+0000 front 2019-11-29T21:36:35.102548+0000 (oldest deadline 2019-11-29T21:37:15.074744+0000) 2019-11-29T21:37:41.145 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:37:41.140+0000 1694c700 -1 osd.6 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:33.806443+0000 front 2019-11-29T21:36:35.212325+0000 (oldest deadline 2019-11-29T21:37:18.458552+0000) 2019-11-29T21:37:41.368 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:37:41.363+0000 1694c700 -1 osd.1 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:30.499077+0000 front 2019-11-29T21:36:35.348482+0000 (oldest deadline 2019-11-29T21:37:14.723108+0000) 2019-11-29T21:37:41.607 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:37:41.602+0000 1694c700 -1 osd.0 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:35.190291+0000 front 2019-11-29T21:36:35.192942+0000 (oldest deadline 2019-11-29T21:37:18.009844+0000) 2019-11-29T21:37:41.618 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:37:41.612+0000 1694c700 -1 osd.7 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:35.576181+0000 front 2019-11-29T21:36:35.005763+0000 (oldest deadline 2019-11-29T21:37:15.282766+0000) 2019-11-29T21:37:41.797 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:37:41.791+0000 1694c700 -1 osd.4 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:31.753717+0000 front 2019-11-29T21:36:31.740038+0000 (oldest deadline 2019-11-29T21:37:17.016303+0000) 2019-11-29T21:37:41.907 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:37:41.902+0000 1694c700 -1 osd.2 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:33.970535+0000 front 2019-11-29T21:36:35.102548+0000 (oldest deadline 2019-11-29T21:37:15.074744+0000) 2019-11-29T21:37:42.113 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:37:42.109+0000 1694c700 -1 osd.6 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:33.806443+0000 front 2019-11-29T21:36:35.212325+0000 (oldest deadline 2019-11-29T21:37:18.458552+0000) 2019-11-29T21:37:42.393 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:37:42.388+0000 1694c700 -1 osd.1 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:30.499077+0000 front 2019-11-29T21:36:35.348482+0000 (oldest deadline 2019-11-29T21:37:14.723108+0000) 2019-11-29T21:37:42.579 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:37:42.573+0000 1694c700 -1 osd.0 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:35.190291+0000 front 2019-11-29T21:36:35.192942+0000 (oldest deadline 2019-11-29T21:37:18.009844+0000) 2019-11-29T21:37:42.594 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:37:42.589+0000 1694c700 -1 osd.7 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:35.576181+0000 front 2019-11-29T21:36:35.005763+0000 (oldest deadline 2019-11-29T21:37:15.282766+0000) 2019-11-29T21:37:42.776 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:37:42.770+0000 1694c700 -1 osd.4 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:31.753717+0000 front 2019-11-29T21:36:31.740038+0000 (oldest deadline 2019-11-29T21:37:17.016303+0000) 2019-11-29T21:37:42.886 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:37:42.880+0000 1694c700 -1 osd.2 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:33.970535+0000 front 2019-11-29T21:36:35.102548+0000 (oldest deadline 2019-11-29T21:37:15.074744+0000) 2019-11-29T21:37:43.170 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:37:43.164+0000 1694c700 -1 osd.6 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:33.806443+0000 front 2019-11-29T21:36:35.212325+0000 (oldest deadline 2019-11-29T21:37:18.458552+0000) 2019-11-29T21:37:43.428 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:37:43.424+0000 1694c700 -1 osd.1 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:30.499077+0000 front 2019-11-29T21:36:35.348482+0000 (oldest deadline 2019-11-29T21:37:14.723108+0000) 2019-11-29T21:37:43.565 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:37:43.560+0000 1694c700 -1 osd.0 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:35.190291+0000 front 2019-11-29T21:36:35.192942+0000 (oldest deadline 2019-11-29T21:37:18.009844+0000) 2019-11-29T21:37:43.615 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:37:43.609+0000 1694c700 -1 osd.7 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:35.576181+0000 front 2019-11-29T21:36:35.005763+0000 (oldest deadline 2019-11-29T21:37:15.282766+0000) 2019-11-29T21:37:43.731 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:37:43.725+0000 1694c700 -1 osd.4 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:31.753717+0000 front 2019-11-29T21:36:31.740038+0000 (oldest deadline 2019-11-29T21:37:17.016303+0000) 2019-11-29T21:37:43.856 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:37:43.851+0000 1694c700 -1 osd.2 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:33.970535+0000 front 2019-11-29T21:36:35.102548+0000 (oldest deadline 2019-11-29T21:37:15.074744+0000) 2019-11-29T21:37:44.173 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:37:44.168+0000 1694c700 -1 osd.6 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:33.806443+0000 front 2019-11-29T21:36:35.212325+0000 (oldest deadline 2019-11-29T21:37:18.458552+0000) 2019-11-29T21:37:44.435 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:37:44.430+0000 1694c700 -1 osd.1 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:30.499077+0000 front 2019-11-29T21:36:35.348482+0000 (oldest deadline 2019-11-29T21:37:14.723108+0000) 2019-11-29T21:37:44.532 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:37:44.527+0000 1694c700 -1 osd.0 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:35.190291+0000 front 2019-11-29T21:36:35.192942+0000 (oldest deadline 2019-11-29T21:37:18.009844+0000) 2019-11-29T21:37:44.617 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:37:44.603+0000 1694c700 -1 osd.7 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:35.576181+0000 front 2019-11-29T21:36:35.005763+0000 (oldest deadline 2019-11-29T21:37:15.282766+0000) 2019-11-29T21:37:44.743 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:37:44.737+0000 1694c700 -1 osd.4 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:31.753717+0000 front 2019-11-29T21:36:31.740038+0000 (oldest deadline 2019-11-29T21:37:17.016303+0000) 2019-11-29T21:37:44.820 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:37:44.815+0000 1694c700 -1 osd.2 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:33.970535+0000 front 2019-11-29T21:36:35.102548+0000 (oldest deadline 2019-11-29T21:37:15.074744+0000) 2019-11-29T21:37:45.157 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:37:45.151+0000 1694c700 -1 osd.6 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:33.806443+0000 front 2019-11-29T21:36:35.212325+0000 (oldest deadline 2019-11-29T21:37:18.458552+0000) 2019-11-29T21:37:45.417 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:37:45.411+0000 1694c700 -1 osd.1 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:30.499077+0000 front 2019-11-29T21:36:35.348482+0000 (oldest deadline 2019-11-29T21:37:14.723108+0000) 2019-11-29T21:37:45.493 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:37:45.487+0000 1694c700 -1 osd.0 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:35.190291+0000 front 2019-11-29T21:36:35.192942+0000 (oldest deadline 2019-11-29T21:37:18.009844+0000) 2019-11-29T21:37:45.563 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:37:45.558+0000 1694c700 -1 osd.7 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:35.576181+0000 front 2019-11-29T21:36:35.005763+0000 (oldest deadline 2019-11-29T21:37:15.282766+0000) 2019-11-29T21:37:45.701 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:37:45.696+0000 1694c700 -1 osd.4 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:31.753717+0000 front 2019-11-29T21:36:31.740038+0000 (oldest deadline 2019-11-29T21:37:17.016303+0000) 2019-11-29T21:37:45.862 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:37:45.857+0000 1694c700 -1 osd.2 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:33.970535+0000 front 2019-11-29T21:36:35.102548+0000 (oldest deadline 2019-11-29T21:37:15.074744+0000) 2019-11-29T21:37:46.053 INFO:tasks.ceph.mon.b.smithi022.stderr:2019-11-29T21:37:46.049+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.22:6818/9264,v1:172.21.15.22:6819/9264] for 40sec e369 v369) 2019-11-29T21:37:46.166 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:37:46.162+0000 1694c700 -1 osd.6 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:33.806443+0000 front 2019-11-29T21:36:35.212325+0000 (oldest deadline 2019-11-29T21:37:18.458552+0000) 2019-11-29T21:37:46.404 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:37:46.398+0000 1694c700 -1 osd.1 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:30.499077+0000 front 2019-11-29T21:36:35.348482+0000 (oldest deadline 2019-11-29T21:37:14.723108+0000) 2019-11-29T21:37:46.530 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:37:46.525+0000 1694c700 -1 osd.0 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:35.190291+0000 front 2019-11-29T21:36:35.192942+0000 (oldest deadline 2019-11-29T21:37:18.009844+0000) 2019-11-29T21:37:46.560 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:37:46.555+0000 1694c700 -1 osd.7 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:35.576181+0000 front 2019-11-29T21:36:35.005763+0000 (oldest deadline 2019-11-29T21:37:15.282766+0000) 2019-11-29T21:37:46.733 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:37:46.729+0000 1694c700 -1 osd.4 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:31.753717+0000 front 2019-11-29T21:36:31.740038+0000 (oldest deadline 2019-11-29T21:37:17.016303+0000) 2019-11-29T21:37:46.896 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:37:46.890+0000 1694c700 -1 osd.2 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:33.970535+0000 front 2019-11-29T21:36:35.102548+0000 (oldest deadline 2019-11-29T21:37:15.074744+0000) 2019-11-29T21:37:47.140 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:37:47.135+0000 1694c700 -1 osd.6 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:33.806443+0000 front 2019-11-29T21:36:35.212325+0000 (oldest deadline 2019-11-29T21:37:18.458552+0000) 2019-11-29T21:37:47.371 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:37:47.365+0000 1694c700 -1 osd.1 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:30.499077+0000 front 2019-11-29T21:36:35.348482+0000 (oldest deadline 2019-11-29T21:37:14.723108+0000) 2019-11-29T21:37:47.487 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:37:47.482+0000 1694c700 -1 osd.0 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:35.190291+0000 front 2019-11-29T21:36:35.192942+0000 (oldest deadline 2019-11-29T21:37:18.009844+0000) 2019-11-29T21:37:47.609 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:37:47.605+0000 1694c700 -1 osd.7 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:35.576181+0000 front 2019-11-29T21:36:35.005763+0000 (oldest deadline 2019-11-29T21:37:15.282766+0000) 2019-11-29T21:37:47.788 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:37:47.783+0000 1694c700 -1 osd.4 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:31.753717+0000 front 2019-11-29T21:36:31.740038+0000 (oldest deadline 2019-11-29T21:37:17.016303+0000) 2019-11-29T21:37:47.889 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:37:47.885+0000 1694c700 -1 osd.2 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:33.970535+0000 front 2019-11-29T21:36:35.102548+0000 (oldest deadline 2019-11-29T21:37:15.074744+0000) 2019-11-29T21:37:48.184 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:37:48.179+0000 1694c700 -1 osd.6 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:33.806443+0000 front 2019-11-29T21:36:35.212325+0000 (oldest deadline 2019-11-29T21:37:18.458552+0000) 2019-11-29T21:37:48.369 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:37:48.364+0000 1694c700 -1 osd.1 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:30.499077+0000 front 2019-11-29T21:36:35.348482+0000 (oldest deadline 2019-11-29T21:37:14.723108+0000) 2019-11-29T21:37:48.504 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:37:48.499+0000 1694c700 -1 osd.0 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:35.190291+0000 front 2019-11-29T21:36:35.192942+0000 (oldest deadline 2019-11-29T21:37:18.009844+0000) 2019-11-29T21:37:48.660 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:37:48.655+0000 1694c700 -1 osd.7 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:35.576181+0000 front 2019-11-29T21:36:35.005763+0000 (oldest deadline 2019-11-29T21:37:15.282766+0000) 2019-11-29T21:37:48.834 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:37:48.828+0000 1694c700 -1 osd.4 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:31.753717+0000 front 2019-11-29T21:36:31.740038+0000 (oldest deadline 2019-11-29T21:37:17.016303+0000) 2019-11-29T21:37:48.851 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:37:48.847+0000 1694c700 -1 osd.2 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:33.970535+0000 front 2019-11-29T21:36:35.102548+0000 (oldest deadline 2019-11-29T21:37:15.074744+0000) 2019-11-29T21:37:49.233 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:37:49.223+0000 1694c700 -1 osd.6 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:33.806443+0000 front 2019-11-29T21:36:35.212325+0000 (oldest deadline 2019-11-29T21:37:18.458552+0000) 2019-11-29T21:37:49.346 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:37:49.341+0000 1694c700 -1 osd.1 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:30.499077+0000 front 2019-11-29T21:36:35.348482+0000 (oldest deadline 2019-11-29T21:37:14.723108+0000) 2019-11-29T21:37:49.498 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:37:49.493+0000 1694c700 -1 osd.0 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:35.190291+0000 front 2019-11-29T21:36:35.192942+0000 (oldest deadline 2019-11-29T21:37:18.009844+0000) 2019-11-29T21:37:49.657 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:37:49.653+0000 1694c700 -1 osd.7 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:35.576181+0000 front 2019-11-29T21:36:35.005763+0000 (oldest deadline 2019-11-29T21:37:15.282766+0000) 2019-11-29T21:37:49.845 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:37:49.841+0000 1694c700 -1 osd.2 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:33.970535+0000 front 2019-11-29T21:36:35.102548+0000 (oldest deadline 2019-11-29T21:37:15.074744+0000) 2019-11-29T21:37:49.886 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:37:49.880+0000 1694c700 -1 osd.4 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:31.753717+0000 front 2019-11-29T21:36:31.740038+0000 (oldest deadline 2019-11-29T21:37:17.016303+0000) 2019-11-29T21:37:50.211 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:37:50.206+0000 1694c700 -1 osd.6 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:33.806443+0000 front 2019-11-29T21:36:35.212325+0000 (oldest deadline 2019-11-29T21:37:18.458552+0000) 2019-11-29T21:37:50.376 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:37:50.371+0000 1694c700 -1 osd.1 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:30.499077+0000 front 2019-11-29T21:36:35.348482+0000 (oldest deadline 2019-11-29T21:37:14.723108+0000) 2019-11-29T21:37:50.491 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:37:50.485+0000 1694c700 -1 osd.0 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:35.190291+0000 front 2019-11-29T21:36:35.192942+0000 (oldest deadline 2019-11-29T21:37:18.009844+0000) 2019-11-29T21:37:50.630 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:37:50.625+0000 1694c700 -1 osd.7 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:35.576181+0000 front 2019-11-29T21:36:35.005763+0000 (oldest deadline 2019-11-29T21:37:15.282766+0000) 2019-11-29T21:37:50.885 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:37:50.879+0000 1694c700 -1 osd.2 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:33.970535+0000 front 2019-11-29T21:36:35.102548+0000 (oldest deadline 2019-11-29T21:37:15.074744+0000) 2019-11-29T21:37:50.912 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:37:50.898+0000 1694c700 -1 osd.4 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:31.753717+0000 front 2019-11-29T21:36:31.740038+0000 (oldest deadline 2019-11-29T21:37:17.016303+0000) 2019-11-29T21:37:51.070 INFO:tasks.ceph.mon.b.smithi022.stderr:2019-11-29T21:37:51.067+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.22:6818/9264,v1:172.21.15.22:6819/9264] for 40sec e369 v369) 2019-11-29T21:37:51.225 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:37:51.221+0000 1694c700 -1 osd.6 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:33.806443+0000 front 2019-11-29T21:36:35.212325+0000 (oldest deadline 2019-11-29T21:37:18.458552+0000) 2019-11-29T21:37:51.348 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:37:51.337+0000 1694c700 -1 osd.1 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:30.499077+0000 front 2019-11-29T21:36:35.348482+0000 (oldest deadline 2019-11-29T21:37:14.723108+0000) 2019-11-29T21:37:51.445 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:37:51.440+0000 1694c700 -1 osd.0 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:35.190291+0000 front 2019-11-29T21:36:35.192942+0000 (oldest deadline 2019-11-29T21:37:18.009844+0000) 2019-11-29T21:37:51.678 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:37:51.673+0000 1694c700 -1 osd.7 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:35.576181+0000 front 2019-11-29T21:36:35.005763+0000 (oldest deadline 2019-11-29T21:37:15.282766+0000) 2019-11-29T21:37:51.886 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:37:51.881+0000 1694c700 -1 osd.2 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:33.970535+0000 front 2019-11-29T21:36:35.102548+0000 (oldest deadline 2019-11-29T21:37:15.074744+0000) 2019-11-29T21:37:51.908 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:37:51.903+0000 1694c700 -1 osd.4 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:31.753717+0000 front 2019-11-29T21:36:31.740038+0000 (oldest deadline 2019-11-29T21:37:17.016303+0000) 2019-11-29T21:37:52.241 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:37:52.237+0000 1694c700 -1 osd.6 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:33.806443+0000 front 2019-11-29T21:36:35.212325+0000 (oldest deadline 2019-11-29T21:37:18.458552+0000) 2019-11-29T21:37:52.381 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:37:52.377+0000 1694c700 -1 osd.1 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:30.499077+0000 front 2019-11-29T21:36:35.348482+0000 (oldest deadline 2019-11-29T21:37:14.723108+0000) 2019-11-29T21:37:52.413 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:37:52.407+0000 1694c700 -1 osd.0 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:35.190291+0000 front 2019-11-29T21:36:35.192942+0000 (oldest deadline 2019-11-29T21:37:18.009844+0000) 2019-11-29T21:37:52.697 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:37:52.692+0000 1694c700 -1 osd.7 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:35.576181+0000 front 2019-11-29T21:36:35.005763+0000 (oldest deadline 2019-11-29T21:37:15.282766+0000) 2019-11-29T21:37:52.879 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:37:52.873+0000 1694c700 -1 osd.2 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:33.970535+0000 front 2019-11-29T21:36:35.102548+0000 (oldest deadline 2019-11-29T21:37:15.074744+0000) 2019-11-29T21:37:52.957 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:37:52.953+0000 1694c700 -1 osd.4 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:31.753717+0000 front 2019-11-29T21:36:31.740038+0000 (oldest deadline 2019-11-29T21:37:17.016303+0000) 2019-11-29T21:37:53.202 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:37:53.198+0000 1694c700 -1 osd.6 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:33.806443+0000 front 2019-11-29T21:36:35.212325+0000 (oldest deadline 2019-11-29T21:37:18.458552+0000) 2019-11-29T21:37:53.380 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:37:53.371+0000 1694c700 -1 osd.0 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:35.190291+0000 front 2019-11-29T21:36:35.192942+0000 (oldest deadline 2019-11-29T21:37:18.009844+0000) 2019-11-29T21:37:53.416 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:37:53.411+0000 1694c700 -1 osd.1 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:30.499077+0000 front 2019-11-29T21:36:35.348482+0000 (oldest deadline 2019-11-29T21:37:14.723108+0000) 2019-11-29T21:37:53.685 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:37:53.682+0000 1694c700 -1 osd.7 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:35.576181+0000 front 2019-11-29T21:36:35.005763+0000 (oldest deadline 2019-11-29T21:37:15.282766+0000) 2019-11-29T21:37:53.888 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:37:53.883+0000 1694c700 -1 osd.2 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:33.970535+0000 front 2019-11-29T21:36:35.102548+0000 (oldest deadline 2019-11-29T21:37:15.074744+0000) 2019-11-29T21:37:53.945 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:37:53.941+0000 1694c700 -1 osd.4 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:31.753717+0000 front 2019-11-29T21:36:31.740038+0000 (oldest deadline 2019-11-29T21:37:17.016303+0000) 2019-11-29T21:37:54.226 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:37:54.221+0000 1694c700 -1 osd.6 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:33.806443+0000 front 2019-11-29T21:36:35.212325+0000 (oldest deadline 2019-11-29T21:37:18.458552+0000) 2019-11-29T21:37:54.336 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:37:54.331+0000 1694c700 -1 osd.0 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:35.190291+0000 front 2019-11-29T21:36:35.192942+0000 (oldest deadline 2019-11-29T21:37:18.009844+0000) 2019-11-29T21:37:54.430 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:37:54.425+0000 1694c700 -1 osd.1 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:30.499077+0000 front 2019-11-29T21:36:35.348482+0000 (oldest deadline 2019-11-29T21:37:14.723108+0000) 2019-11-29T21:37:54.697 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:37:54.692+0000 1694c700 -1 osd.7 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:35.576181+0000 front 2019-11-29T21:36:35.005763+0000 (oldest deadline 2019-11-29T21:37:15.282766+0000) 2019-11-29T21:37:54.845 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:37:54.840+0000 1694c700 -1 osd.2 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:33.970535+0000 front 2019-11-29T21:36:35.102548+0000 (oldest deadline 2019-11-29T21:37:15.074744+0000) 2019-11-29T21:37:54.981 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:37:54.976+0000 1694c700 -1 osd.4 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:31.753717+0000 front 2019-11-29T21:36:31.740038+0000 (oldest deadline 2019-11-29T21:37:17.016303+0000) 2019-11-29T21:37:55.262 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:37:55.258+0000 1694c700 -1 osd.6 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:33.806443+0000 front 2019-11-29T21:36:35.212325+0000 (oldest deadline 2019-11-29T21:37:18.458552+0000) 2019-11-29T21:37:55.326 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:37:55.320+0000 1694c700 -1 osd.0 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:35.190291+0000 front 2019-11-29T21:36:35.192942+0000 (oldest deadline 2019-11-29T21:37:18.009844+0000) 2019-11-29T21:37:55.408 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:37:55.402+0000 1694c700 -1 osd.1 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:30.499077+0000 front 2019-11-29T21:36:35.348482+0000 (oldest deadline 2019-11-29T21:37:14.723108+0000) 2019-11-29T21:37:55.752 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:37:55.745+0000 1694c700 -1 osd.7 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:35.576181+0000 front 2019-11-29T21:36:35.005763+0000 (oldest deadline 2019-11-29T21:37:15.282766+0000) 2019-11-29T21:37:55.845 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:37:55.841+0000 1694c700 -1 osd.2 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:33.970535+0000 front 2019-11-29T21:36:35.102548+0000 (oldest deadline 2019-11-29T21:37:15.074744+0000) 2019-11-29T21:37:55.988 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:37:55.982+0000 1694c700 -1 osd.4 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:31.753717+0000 front 2019-11-29T21:36:31.740038+0000 (oldest deadline 2019-11-29T21:37:17.016303+0000) 2019-11-29T21:37:56.151 INFO:tasks.ceph.mon.b.smithi022.stderr:2019-11-29T21:37:56.146+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.22:6818/9264,v1:172.21.15.22:6819/9264] for 40sec e369 v369) 2019-11-29T21:37:56.316 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:37:56.311+0000 1694c700 -1 osd.0 369 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:36:35.190291+0000 front 2019-11-29T21:36:35.192942+0000 (oldest deadline 2019-11-29T21:37:18.009844+0000) 2019-11-29T21:38:51.559 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:09:13:32.218 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T21:38:51.563 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:09:13:32.221 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T21:38:51.624 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:09:13:32.231 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T21:38:51.634 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:09:13:32.242 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T21:38:51.641 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:09:13:32.248 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T21:38:51.644 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:09:13:32.252 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T21:38:51.689 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:09:13:32.348 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T21:38:51.785 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:09:13:32.392 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T21:38:51.793 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:09:13:32.400 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T21:38:55.306 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:38:55.300+0000 1694c700 -1 osd.0 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:13.514161+0000 front 2019-11-29T21:38:12.236952+0000 (oldest deadline 2019-11-29T21:38:54.364548+0000) 2019-11-29T21:38:55.550 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:38:55.540+0000 1694c700 -1 osd.6 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.721817+0000 front 2019-11-29T21:38:13.570295+0000 (oldest deadline 2019-11-29T21:38:54.903195+0000) 2019-11-29T21:38:56.299 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:38:56.294+0000 1694c700 -1 osd.7 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.315790+0000 front 2019-11-29T21:38:11.976961+0000 (oldest deadline 2019-11-29T21:38:55.451746+0000) 2019-11-29T21:38:56.305 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:38:56.300+0000 1694c700 -1 osd.4 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.051703+0000 front 2019-11-29T21:38:12.250923+0000 (oldest deadline 2019-11-29T21:38:56.062947+0000) 2019-11-29T21:38:56.353 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:38:56.347+0000 1694c700 -1 osd.0 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:13.514161+0000 front 2019-11-29T21:38:12.236952+0000 (oldest deadline 2019-11-29T21:38:54.364548+0000) 2019-11-29T21:38:56.554 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:38:56.548+0000 1694c700 -1 osd.6 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.721817+0000 front 2019-11-29T21:38:13.570295+0000 (oldest deadline 2019-11-29T21:38:54.903195+0000) 2019-11-29T21:38:57.309 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:38:57.300+0000 1694c700 -1 osd.7 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.315790+0000 front 2019-11-29T21:38:11.976961+0000 (oldest deadline 2019-11-29T21:38:55.451746+0000) 2019-11-29T21:38:57.324 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:38:57.318+0000 1694c700 -1 osd.4 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.051703+0000 front 2019-11-29T21:38:12.250923+0000 (oldest deadline 2019-11-29T21:38:56.062947+0000) 2019-11-29T21:38:57.360 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:38:57.354+0000 1694c700 -1 osd.0 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:13.514161+0000 front 2019-11-29T21:38:12.236952+0000 (oldest deadline 2019-11-29T21:38:54.364548+0000) 2019-11-29T21:38:57.600 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:38:57.595+0000 1694c700 -1 osd.6 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.721817+0000 front 2019-11-29T21:38:13.570295+0000 (oldest deadline 2019-11-29T21:38:54.903195+0000) 2019-11-29T21:38:57.632 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:38:57.628+0000 1694c700 -1 osd.2 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:11.447676+0000 front 2019-11-29T21:38:11.491500+0000 (oldest deadline 2019-11-29T21:38:56.706338+0000) 2019-11-29T21:38:58.354 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:38:58.349+0000 1694c700 -1 osd.4 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.051703+0000 front 2019-11-29T21:38:12.250923+0000 (oldest deadline 2019-11-29T21:38:56.062947+0000) 2019-11-29T21:38:58.360 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:38:58.354+0000 1694c700 -1 osd.0 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:13.514161+0000 front 2019-11-29T21:38:12.236952+0000 (oldest deadline 2019-11-29T21:38:54.364548+0000) 2019-11-29T21:38:58.360 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:38:58.355+0000 1694c700 -1 osd.7 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.315790+0000 front 2019-11-29T21:38:11.976961+0000 (oldest deadline 2019-11-29T21:38:55.451746+0000) 2019-11-29T21:38:58.650 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:38:58.643+0000 1694c700 -1 osd.2 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:11.447676+0000 front 2019-11-29T21:38:11.491500+0000 (oldest deadline 2019-11-29T21:38:56.706338+0000) 2019-11-29T21:38:58.673 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:38:58.654+0000 1694c700 -1 osd.6 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.721817+0000 front 2019-11-29T21:38:13.570295+0000 (oldest deadline 2019-11-29T21:38:54.903195+0000) 2019-11-29T21:38:59.380 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:38:59.375+0000 1694c700 -1 osd.7 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.315790+0000 front 2019-11-29T21:38:11.976961+0000 (oldest deadline 2019-11-29T21:38:55.451746+0000) 2019-11-29T21:38:59.384 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:38:59.377+0000 1694c700 -1 osd.4 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.051703+0000 front 2019-11-29T21:38:12.250923+0000 (oldest deadline 2019-11-29T21:38:56.062947+0000) 2019-11-29T21:38:59.401 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:38:59.395+0000 1694c700 -1 osd.0 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:13.514161+0000 front 2019-11-29T21:38:12.236952+0000 (oldest deadline 2019-11-29T21:38:54.364548+0000) 2019-11-29T21:38:59.632 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:38:59.626+0000 1694c700 -1 osd.6 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.721817+0000 front 2019-11-29T21:38:13.570295+0000 (oldest deadline 2019-11-29T21:38:54.903195+0000) 2019-11-29T21:38:59.698 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:38:59.693+0000 1694c700 -1 osd.2 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:11.447676+0000 front 2019-11-29T21:38:11.491500+0000 (oldest deadline 2019-11-29T21:38:56.706338+0000) 2019-11-29T21:39:00.364 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:39:00.357+0000 1694c700 -1 osd.0 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:13.514161+0000 front 2019-11-29T21:38:12.236952+0000 (oldest deadline 2019-11-29T21:38:54.364548+0000) 2019-11-29T21:39:00.376 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:39:00.367+0000 1694c700 -1 osd.4 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.051703+0000 front 2019-11-29T21:38:12.250923+0000 (oldest deadline 2019-11-29T21:38:56.062947+0000) 2019-11-29T21:39:00.401 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:39:00.395+0000 1694c700 -1 osd.7 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.315790+0000 front 2019-11-29T21:38:11.976961+0000 (oldest deadline 2019-11-29T21:38:55.451746+0000) 2019-11-29T21:39:00.651 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:39:00.646+0000 1694c700 -1 osd.6 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.721817+0000 front 2019-11-29T21:38:13.570295+0000 (oldest deadline 2019-11-29T21:38:54.903195+0000) 2019-11-29T21:39:00.657 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:39:00.653+0000 1694c700 -1 osd.2 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:11.447676+0000 front 2019-11-29T21:38:11.491500+0000 (oldest deadline 2019-11-29T21:38:56.706338+0000) 2019-11-29T21:39:01.345 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:39:01.341+0000 1694c700 -1 osd.4 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.051703+0000 front 2019-11-29T21:38:12.250923+0000 (oldest deadline 2019-11-29T21:38:56.062947+0000) 2019-11-29T21:39:01.383 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:39:01.378+0000 1694c700 -1 osd.0 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:13.514161+0000 front 2019-11-29T21:38:12.236952+0000 (oldest deadline 2019-11-29T21:38:54.364548+0000) 2019-11-29T21:39:01.431 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:39:01.424+0000 1694c700 -1 osd.7 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.315790+0000 front 2019-11-29T21:38:11.976961+0000 (oldest deadline 2019-11-29T21:38:55.451746+0000) 2019-11-29T21:39:01.650 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:39:01.646+0000 1694c700 -1 osd.2 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:11.447676+0000 front 2019-11-29T21:38:11.491500+0000 (oldest deadline 2019-11-29T21:38:56.706338+0000) 2019-11-29T21:39:01.656 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:39:01.650+0000 1694c700 -1 osd.6 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.721817+0000 front 2019-11-29T21:38:13.570295+0000 (oldest deadline 2019-11-29T21:38:54.903195+0000) 2019-11-29T21:39:02.312 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:39:02.306+0000 1694c700 -1 osd.4 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.051703+0000 front 2019-11-29T21:38:12.250923+0000 (oldest deadline 2019-11-29T21:38:56.062947+0000) 2019-11-29T21:39:02.409 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:39:02.403+0000 1694c700 -1 osd.0 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:13.514161+0000 front 2019-11-29T21:38:12.236952+0000 (oldest deadline 2019-11-29T21:38:54.364548+0000) 2019-11-29T21:39:02.429 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:39:02.424+0000 1694c700 -1 osd.7 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.315790+0000 front 2019-11-29T21:38:11.976961+0000 (oldest deadline 2019-11-29T21:38:55.451746+0000) 2019-11-29T21:39:02.645 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:39:02.639+0000 1694c700 -1 osd.2 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:11.447676+0000 front 2019-11-29T21:38:11.491500+0000 (oldest deadline 2019-11-29T21:38:56.706338+0000) 2019-11-29T21:39:02.697 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:39:02.692+0000 1694c700 -1 osd.6 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.721817+0000 front 2019-11-29T21:38:13.570295+0000 (oldest deadline 2019-11-29T21:38:54.903195+0000) 2019-11-29T21:39:03.293 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:39:03.287+0000 1694c700 -1 osd.4 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.051703+0000 front 2019-11-29T21:38:12.250923+0000 (oldest deadline 2019-11-29T21:38:56.062947+0000) 2019-11-29T21:39:03.373 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:39:03.368+0000 1694c700 -1 osd.0 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:13.514161+0000 front 2019-11-29T21:38:12.236952+0000 (oldest deadline 2019-11-29T21:38:54.364548+0000) 2019-11-29T21:39:03.474 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:39:03.469+0000 1694c700 -1 osd.7 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.315790+0000 front 2019-11-29T21:38:11.976961+0000 (oldest deadline 2019-11-29T21:38:55.451746+0000) 2019-11-29T21:39:03.619 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:39:03.615+0000 1694c700 -1 osd.2 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:11.447676+0000 front 2019-11-29T21:38:11.491500+0000 (oldest deadline 2019-11-29T21:38:56.706338+0000) 2019-11-29T21:39:03.715 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:39:03.710+0000 1694c700 -1 osd.6 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.721817+0000 front 2019-11-29T21:38:13.570295+0000 (oldest deadline 2019-11-29T21:38:54.903195+0000) 2019-11-29T21:39:04.271 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:39:04.266+0000 1694c700 -1 osd.4 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.051703+0000 front 2019-11-29T21:38:12.250923+0000 (oldest deadline 2019-11-29T21:38:56.062947+0000) 2019-11-29T21:39:04.343 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:39:04.337+0000 1694c700 -1 osd.0 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:13.514161+0000 front 2019-11-29T21:38:12.236952+0000 (oldest deadline 2019-11-29T21:38:54.364548+0000) 2019-11-29T21:39:04.469 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:39:04.464+0000 1694c700 -1 osd.7 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.315790+0000 front 2019-11-29T21:38:11.976961+0000 (oldest deadline 2019-11-29T21:38:55.451746+0000) 2019-11-29T21:39:04.623 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:39:04.618+0000 1694c700 -1 osd.2 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:11.447676+0000 front 2019-11-29T21:38:11.491500+0000 (oldest deadline 2019-11-29T21:38:56.706338+0000) 2019-11-29T21:39:04.696 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:39:04.690+0000 1694c700 -1 osd.6 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.721817+0000 front 2019-11-29T21:38:13.570295+0000 (oldest deadline 2019-11-29T21:38:54.903195+0000) 2019-11-29T21:39:05.234 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:39:05.229+0000 1694c700 -1 osd.4 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.051703+0000 front 2019-11-29T21:38:12.250923+0000 (oldest deadline 2019-11-29T21:38:56.062947+0000) 2019-11-29T21:39:05.325 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:39:05.320+0000 1694c700 -1 osd.0 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:13.514161+0000 front 2019-11-29T21:38:12.236952+0000 (oldest deadline 2019-11-29T21:38:54.364548+0000) 2019-11-29T21:39:05.476 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:39:05.470+0000 1694c700 -1 osd.7 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.315790+0000 front 2019-11-29T21:38:11.976961+0000 (oldest deadline 2019-11-29T21:38:55.451746+0000) 2019-11-29T21:39:05.612 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:39:05.607+0000 1694c700 -1 osd.2 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:11.447676+0000 front 2019-11-29T21:38:11.491500+0000 (oldest deadline 2019-11-29T21:38:56.706338+0000) 2019-11-29T21:39:05.739 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:39:05.729+0000 1694c700 -1 osd.6 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.721817+0000 front 2019-11-29T21:38:13.570295+0000 (oldest deadline 2019-11-29T21:38:54.903195+0000) 2019-11-29T21:39:06.279 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:39:06.273+0000 1694c700 -1 osd.4 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.051703+0000 front 2019-11-29T21:38:12.250923+0000 (oldest deadline 2019-11-29T21:38:56.062947+0000) 2019-11-29T21:39:06.322 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:39:06.317+0000 1694c700 -1 osd.0 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:13.514161+0000 front 2019-11-29T21:38:12.236952+0000 (oldest deadline 2019-11-29T21:38:54.364548+0000) 2019-11-29T21:39:06.487 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:39:06.480+0000 1694c700 -1 osd.7 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.315790+0000 front 2019-11-29T21:38:11.976961+0000 (oldest deadline 2019-11-29T21:38:55.451746+0000) 2019-11-29T21:39:06.618 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:39:06.613+0000 1694c700 -1 osd.2 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:11.447676+0000 front 2019-11-29T21:38:11.491500+0000 (oldest deadline 2019-11-29T21:38:56.706338+0000) 2019-11-29T21:39:06.779 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:39:06.773+0000 1694c700 -1 osd.6 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.721817+0000 front 2019-11-29T21:38:13.570295+0000 (oldest deadline 2019-11-29T21:38:54.903195+0000) 2019-11-29T21:39:07.238 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:39:07.232+0000 1694c700 -1 osd.4 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.051703+0000 front 2019-11-29T21:38:12.250923+0000 (oldest deadline 2019-11-29T21:38:56.062947+0000) 2019-11-29T21:39:07.300 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:39:07.296+0000 1694c700 -1 osd.0 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:13.514161+0000 front 2019-11-29T21:38:12.236952+0000 (oldest deadline 2019-11-29T21:38:54.364548+0000) 2019-11-29T21:39:07.500 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:39:07.494+0000 1694c700 -1 osd.7 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.315790+0000 front 2019-11-29T21:38:11.976961+0000 (oldest deadline 2019-11-29T21:38:55.451746+0000) 2019-11-29T21:39:07.633 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:39:07.628+0000 1694c700 -1 osd.2 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:11.447676+0000 front 2019-11-29T21:38:11.491500+0000 (oldest deadline 2019-11-29T21:38:56.706338+0000) 2019-11-29T21:39:07.658 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:39:07.654+0000 1694c700 -1 osd.5 376 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e373) 2019-11-29T21:39:07.827 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:39:07.821+0000 1694c700 -1 osd.6 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.721817+0000 front 2019-11-29T21:38:13.570295+0000 (oldest deadline 2019-11-29T21:38:54.903195+0000) 2019-11-29T21:39:08.262 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:39:08.255+0000 1694c700 -1 osd.4 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.051703+0000 front 2019-11-29T21:38:12.250923+0000 (oldest deadline 2019-11-29T21:38:56.062947+0000) 2019-11-29T21:39:08.293 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:39:08.288+0000 1694c700 -1 osd.0 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:13.514161+0000 front 2019-11-29T21:38:12.236952+0000 (oldest deadline 2019-11-29T21:38:54.364548+0000) 2019-11-29T21:39:08.479 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:39:08.473+0000 1694c700 -1 osd.7 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.315790+0000 front 2019-11-29T21:38:11.976961+0000 (oldest deadline 2019-11-29T21:38:55.451746+0000) 2019-11-29T21:39:08.639 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:39:08.634+0000 1694c700 -1 osd.5 376 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e373) 2019-11-29T21:39:08.682 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:39:08.678+0000 1694c700 -1 osd.2 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:11.447676+0000 front 2019-11-29T21:38:11.491500+0000 (oldest deadline 2019-11-29T21:38:56.706338+0000) 2019-11-29T21:39:08.828 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:39:08.822+0000 1694c700 -1 osd.6 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.721817+0000 front 2019-11-29T21:38:13.570295+0000 (oldest deadline 2019-11-29T21:38:54.903195+0000) 2019-11-29T21:39:09.255 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:39:09.250+0000 1694c700 -1 osd.4 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.051703+0000 front 2019-11-29T21:38:12.250923+0000 (oldest deadline 2019-11-29T21:38:56.062947+0000) 2019-11-29T21:39:09.322 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:39:09.316+0000 1694c700 -1 osd.0 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:13.514161+0000 front 2019-11-29T21:38:12.236952+0000 (oldest deadline 2019-11-29T21:38:54.364548+0000) 2019-11-29T21:39:09.475 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:39:09.469+0000 1694c700 -1 osd.7 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.315790+0000 front 2019-11-29T21:38:11.976961+0000 (oldest deadline 2019-11-29T21:38:55.451746+0000) 2019-11-29T21:39:09.630 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:39:09.625+0000 1694c700 -1 osd.5 376 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e373) 2019-11-29T21:39:09.670 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:39:09.664+0000 1694c700 -1 osd.2 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:11.447676+0000 front 2019-11-29T21:38:11.491500+0000 (oldest deadline 2019-11-29T21:38:56.706338+0000) 2019-11-29T21:39:09.819 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:39:09.813+0000 1694c700 -1 osd.6 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.721817+0000 front 2019-11-29T21:38:13.570295+0000 (oldest deadline 2019-11-29T21:38:54.903195+0000) 2019-11-29T21:39:10.270 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:39:10.264+0000 1694c700 -1 osd.4 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.051703+0000 front 2019-11-29T21:38:12.250923+0000 (oldest deadline 2019-11-29T21:38:56.062947+0000) 2019-11-29T21:39:10.313 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:39:10.308+0000 1694c700 -1 osd.0 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:13.514161+0000 front 2019-11-29T21:38:12.236952+0000 (oldest deadline 2019-11-29T21:38:54.364548+0000) 2019-11-29T21:39:10.445 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:39:10.439+0000 1694c700 -1 osd.7 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.315790+0000 front 2019-11-29T21:38:11.976961+0000 (oldest deadline 2019-11-29T21:38:55.451746+0000) 2019-11-29T21:39:10.651 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:39:10.646+0000 1694c700 -1 osd.5 376 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e373) 2019-11-29T21:39:10.687 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:39:10.683+0000 1694c700 -1 osd.2 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:11.447676+0000 front 2019-11-29T21:38:11.491500+0000 (oldest deadline 2019-11-29T21:38:56.706338+0000) 2019-11-29T21:39:10.876 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:39:10.867+0000 1694c700 -1 osd.6 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.721817+0000 front 2019-11-29T21:38:13.570295+0000 (oldest deadline 2019-11-29T21:38:54.903195+0000) 2019-11-29T21:39:11.263 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:39:11.256+0000 1694c700 -1 osd.4 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.051703+0000 front 2019-11-29T21:38:12.250923+0000 (oldest deadline 2019-11-29T21:38:56.062947+0000) 2019-11-29T21:39:11.284 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:39:11.279+0000 1694c700 -1 osd.0 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:13.514161+0000 front 2019-11-29T21:38:12.236952+0000 (oldest deadline 2019-11-29T21:38:54.364548+0000) 2019-11-29T21:39:11.475 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:39:11.468+0000 1694c700 -1 osd.7 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.315790+0000 front 2019-11-29T21:38:11.976961+0000 (oldest deadline 2019-11-29T21:38:55.451746+0000) 2019-11-29T21:39:11.660 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:39:11.653+0000 1694c700 -1 osd.5 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:38:31.368305+0000 (oldest deadline 2019-11-29T21:39:11.368305+0000) 2019-11-29T21:39:11.661 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:39:11.657+0000 1694c700 -1 osd.5 376 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e373) 2019-11-29T21:39:11.685 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:39:11.681+0000 1694c700 -1 osd.2 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:11.447676+0000 front 2019-11-29T21:38:11.491500+0000 (oldest deadline 2019-11-29T21:38:56.706338+0000) 2019-11-29T21:39:11.833 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:39:11.826+0000 1694c700 -1 osd.6 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.721817+0000 front 2019-11-29T21:38:13.570295+0000 (oldest deadline 2019-11-29T21:38:54.903195+0000) 2019-11-29T21:39:12.265 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:39:12.260+0000 1694c700 -1 osd.0 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:13.514161+0000 front 2019-11-29T21:38:12.236952+0000 (oldest deadline 2019-11-29T21:38:54.364548+0000) 2019-11-29T21:39:12.317 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:39:12.310+0000 1694c700 -1 osd.4 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.051703+0000 front 2019-11-29T21:38:12.250923+0000 (oldest deadline 2019-11-29T21:38:56.062947+0000) 2019-11-29T21:39:12.496 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:39:12.490+0000 1694c700 -1 osd.7 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.315790+0000 front 2019-11-29T21:38:11.976961+0000 (oldest deadline 2019-11-29T21:38:55.451746+0000) 2019-11-29T21:39:12.691 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:39:12.687+0000 1694c700 -1 osd.2 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:11.447676+0000 front 2019-11-29T21:38:11.491500+0000 (oldest deadline 2019-11-29T21:38:56.706338+0000) 2019-11-29T21:39:12.693 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:39:12.687+0000 1694c700 -1 osd.5 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:38:31.368305+0000 (oldest deadline 2019-11-29T21:39:11.368305+0000) 2019-11-29T21:39:12.696 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:39:12.692+0000 1694c700 -1 osd.5 376 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e373) 2019-11-29T21:39:12.852 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:39:12.847+0000 1694c700 -1 osd.6 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.721817+0000 front 2019-11-29T21:38:13.570295+0000 (oldest deadline 2019-11-29T21:38:54.903195+0000) 2019-11-29T21:39:13.258 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:39:13.253+0000 1694c700 -1 osd.0 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:13.514161+0000 front 2019-11-29T21:38:12.236952+0000 (oldest deadline 2019-11-29T21:38:54.364548+0000) 2019-11-29T21:39:13.347 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:39:13.341+0000 1694c700 -1 osd.4 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.051703+0000 front 2019-11-29T21:38:12.250923+0000 (oldest deadline 2019-11-29T21:38:56.062947+0000) 2019-11-29T21:39:13.457 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:39:13.452+0000 1694c700 -1 osd.7 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.315790+0000 front 2019-11-29T21:38:11.976961+0000 (oldest deadline 2019-11-29T21:38:55.451746+0000) 2019-11-29T21:39:13.714 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:39:13.706+0000 1694c700 -1 osd.5 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:38:31.368305+0000 (oldest deadline 2019-11-29T21:39:11.368305+0000) 2019-11-29T21:39:13.715 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:39:13.710+0000 1694c700 -1 osd.5 376 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e373) 2019-11-29T21:39:13.738 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:39:13.733+0000 1694c700 -1 osd.2 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:11.447676+0000 front 2019-11-29T21:38:11.491500+0000 (oldest deadline 2019-11-29T21:38:56.706338+0000) 2019-11-29T21:39:13.833 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:39:13.827+0000 1694c700 -1 osd.6 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.721817+0000 front 2019-11-29T21:38:13.570295+0000 (oldest deadline 2019-11-29T21:38:54.903195+0000) 2019-11-29T21:39:14.222 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:39:14.217+0000 1694c700 -1 osd.0 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:13.514161+0000 front 2019-11-29T21:38:12.236952+0000 (oldest deadline 2019-11-29T21:38:54.364548+0000) 2019-11-29T21:39:14.340 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:39:14.335+0000 1694c700 -1 osd.4 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.051703+0000 front 2019-11-29T21:38:12.250923+0000 (oldest deadline 2019-11-29T21:38:56.062947+0000) 2019-11-29T21:39:14.444 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:39:14.439+0000 1694c700 -1 osd.7 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.315790+0000 front 2019-11-29T21:38:11.976961+0000 (oldest deadline 2019-11-29T21:38:55.451746+0000) 2019-11-29T21:39:14.711 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:39:14.705+0000 1694c700 -1 osd.2 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:11.447676+0000 front 2019-11-29T21:38:11.491500+0000 (oldest deadline 2019-11-29T21:38:56.706338+0000) 2019-11-29T21:39:14.769 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:39:14.762+0000 1694c700 -1 osd.5 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:38:31.368305+0000 (oldest deadline 2019-11-29T21:39:11.368305+0000) 2019-11-29T21:39:14.770 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:39:14.765+0000 1694c700 -1 osd.5 376 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e373) 2019-11-29T21:39:14.814 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:39:14.809+0000 1694c700 -1 osd.6 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.721817+0000 front 2019-11-29T21:38:13.570295+0000 (oldest deadline 2019-11-29T21:38:54.903195+0000) 2019-11-29T21:39:15.242 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:39:15.236+0000 1694c700 -1 osd.0 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:13.514161+0000 front 2019-11-29T21:38:12.236952+0000 (oldest deadline 2019-11-29T21:38:54.364548+0000) 2019-11-29T21:39:15.304 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:39:15.298+0000 1694c700 -1 osd.4 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.051703+0000 front 2019-11-29T21:38:12.250923+0000 (oldest deadline 2019-11-29T21:38:56.062947+0000) 2019-11-29T21:39:15.456 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:39:15.450+0000 1694c700 -1 osd.7 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.315790+0000 front 2019-11-29T21:38:11.976961+0000 (oldest deadline 2019-11-29T21:38:55.451746+0000) 2019-11-29T21:39:15.741 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:39:15.736+0000 1694c700 -1 osd.2 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:11.447676+0000 front 2019-11-29T21:38:11.491500+0000 (oldest deadline 2019-11-29T21:38:56.706338+0000) 2019-11-29T21:39:15.800 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:39:15.794+0000 1694c700 -1 osd.5 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:38:31.368305+0000 (oldest deadline 2019-11-29T21:39:11.368305+0000) 2019-11-29T21:39:15.804 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:39:15.800+0000 1694c700 -1 osd.5 376 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e373) 2019-11-29T21:39:15.854 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:39:15.849+0000 1694c700 -1 osd.6 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.721817+0000 front 2019-11-29T21:38:13.570295+0000 (oldest deadline 2019-11-29T21:38:54.903195+0000) 2019-11-29T21:39:16.228 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:39:16.222+0000 1694c700 -1 osd.0 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:13.514161+0000 front 2019-11-29T21:38:12.236952+0000 (oldest deadline 2019-11-29T21:38:54.364548+0000) 2019-11-29T21:39:16.337 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:39:16.332+0000 1694c700 -1 osd.4 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.051703+0000 front 2019-11-29T21:38:12.250923+0000 (oldest deadline 2019-11-29T21:38:56.062947+0000) 2019-11-29T21:39:16.489 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:39:16.483+0000 1694c700 -1 osd.7 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.315790+0000 front 2019-11-29T21:38:11.976961+0000 (oldest deadline 2019-11-29T21:38:55.451746+0000) 2019-11-29T21:39:16.790 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:39:16.781+0000 1694c700 -1 osd.5 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:38:31.368305+0000 (oldest deadline 2019-11-29T21:39:11.368305+0000) 2019-11-29T21:39:16.792 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:39:16.784+0000 1694c700 -1 osd.5 376 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e373) 2019-11-29T21:39:16.798 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:39:16.788+0000 1694c700 -1 osd.2 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:11.447676+0000 front 2019-11-29T21:38:11.491500+0000 (oldest deadline 2019-11-29T21:38:56.706338+0000) 2019-11-29T21:39:16.892 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:39:16.886+0000 1694c700 -1 osd.6 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.721817+0000 front 2019-11-29T21:38:13.570295+0000 (oldest deadline 2019-11-29T21:38:54.903195+0000) 2019-11-29T21:39:17.268 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:39:17.260+0000 1694c700 -1 osd.0 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:13.514161+0000 front 2019-11-29T21:38:12.236952+0000 (oldest deadline 2019-11-29T21:38:54.364548+0000) 2019-11-29T21:39:17.390 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:39:17.385+0000 1694c700 -1 osd.4 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.051703+0000 front 2019-11-29T21:38:12.250923+0000 (oldest deadline 2019-11-29T21:38:56.062947+0000) 2019-11-29T21:39:17.454 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:39:17.446+0000 1694c700 -1 osd.7 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.315790+0000 front 2019-11-29T21:38:11.976961+0000 (oldest deadline 2019-11-29T21:38:55.451746+0000) 2019-11-29T21:39:17.794 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:39:17.788+0000 1694c700 -1 osd.5 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:38:31.368305+0000 (oldest deadline 2019-11-29T21:39:11.368305+0000) 2019-11-29T21:39:17.795 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:39:17.791+0000 1694c700 -1 osd.5 376 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e373) 2019-11-29T21:39:17.835 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:39:17.831+0000 1694c700 -1 osd.2 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:11.447676+0000 front 2019-11-29T21:38:11.491500+0000 (oldest deadline 2019-11-29T21:38:56.706338+0000) 2019-11-29T21:39:17.853 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:39:17.848+0000 1694c700 -1 osd.6 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.721817+0000 front 2019-11-29T21:38:13.570295+0000 (oldest deadline 2019-11-29T21:38:54.903195+0000) 2019-11-29T21:39:18.274 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:39:18.268+0000 1694c700 -1 osd.0 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:13.514161+0000 front 2019-11-29T21:38:12.236952+0000 (oldest deadline 2019-11-29T21:38:54.364548+0000) 2019-11-29T21:39:18.420 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:39:18.414+0000 1694c700 -1 osd.4 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.051703+0000 front 2019-11-29T21:38:12.250923+0000 (oldest deadline 2019-11-29T21:38:56.062947+0000) 2019-11-29T21:39:18.509 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:39:18.503+0000 1694c700 -1 osd.7 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.315790+0000 front 2019-11-29T21:38:11.976961+0000 (oldest deadline 2019-11-29T21:38:55.451746+0000) 2019-11-29T21:39:18.757 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:39:18.751+0000 1694c700 -1 osd.5 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:38:31.368305+0000 (oldest deadline 2019-11-29T21:39:11.368305+0000) 2019-11-29T21:39:18.758 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:39:18.754+0000 1694c700 -1 osd.5 376 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e373) 2019-11-29T21:39:18.843 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:39:18.839+0000 1694c700 -1 osd.2 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:11.447676+0000 front 2019-11-29T21:38:11.491500+0000 (oldest deadline 2019-11-29T21:38:56.706338+0000) 2019-11-29T21:39:18.869 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:39:18.863+0000 1694c700 -1 osd.6 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.721817+0000 front 2019-11-29T21:38:13.570295+0000 (oldest deadline 2019-11-29T21:38:54.903195+0000) 2019-11-29T21:39:19.280 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:39:19.275+0000 1694c700 -1 osd.0 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:13.514161+0000 front 2019-11-29T21:38:12.236952+0000 (oldest deadline 2019-11-29T21:38:54.364548+0000) 2019-11-29T21:39:19.459 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:39:19.454+0000 1694c700 -1 osd.4 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.051703+0000 front 2019-11-29T21:38:12.250923+0000 (oldest deadline 2019-11-29T21:38:56.062947+0000) 2019-11-29T21:39:19.482 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:39:19.476+0000 1694c700 -1 osd.7 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.315790+0000 front 2019-11-29T21:38:11.976961+0000 (oldest deadline 2019-11-29T21:38:55.451746+0000) 2019-11-29T21:39:19.713 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:39:19.706+0000 1694c700 -1 osd.5 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:38:31.368305+0000 (oldest deadline 2019-11-29T21:39:11.368305+0000) 2019-11-29T21:39:19.715 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:39:19.708+0000 1694c700 -1 osd.5 376 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e373) 2019-11-29T21:39:19.889 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:39:19.883+0000 1694c700 -1 osd.6 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.721817+0000 front 2019-11-29T21:38:13.570295+0000 (oldest deadline 2019-11-29T21:38:54.903195+0000) 2019-11-29T21:39:19.891 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:39:19.885+0000 1694c700 -1 osd.2 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:11.447676+0000 front 2019-11-29T21:38:11.491500+0000 (oldest deadline 2019-11-29T21:38:56.706338+0000) 2019-11-29T21:39:20.285 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:39:20.279+0000 1694c700 -1 osd.0 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:13.514161+0000 front 2019-11-29T21:38:12.236952+0000 (oldest deadline 2019-11-29T21:38:54.364548+0000) 2019-11-29T21:39:20.478 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:39:20.472+0000 1694c700 -1 osd.7 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.315790+0000 front 2019-11-29T21:38:11.976961+0000 (oldest deadline 2019-11-29T21:38:55.451746+0000) 2019-11-29T21:39:20.487 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:39:20.480+0000 1694c700 -1 osd.4 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.051703+0000 front 2019-11-29T21:38:12.250923+0000 (oldest deadline 2019-11-29T21:38:56.062947+0000) 2019-11-29T21:39:20.745 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:39:20.740+0000 1694c700 -1 osd.5 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:38:31.368305+0000 (oldest deadline 2019-11-29T21:39:11.368305+0000) 2019-11-29T21:39:20.748 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:39:20.744+0000 1694c700 -1 osd.5 376 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e373) 2019-11-29T21:39:20.856 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:39:20.851+0000 1694c700 -1 osd.6 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.721817+0000 front 2019-11-29T21:38:13.570295+0000 (oldest deadline 2019-11-29T21:38:54.903195+0000) 2019-11-29T21:39:20.862 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:39:20.857+0000 1694c700 -1 osd.2 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:11.447676+0000 front 2019-11-29T21:38:11.491500+0000 (oldest deadline 2019-11-29T21:38:56.706338+0000) 2019-11-29T21:39:21.304 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:39:21.299+0000 1694c700 -1 osd.0 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:13.514161+0000 front 2019-11-29T21:38:12.236952+0000 (oldest deadline 2019-11-29T21:38:54.364548+0000) 2019-11-29T21:39:21.454 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:39:21.448+0000 1694c700 -1 osd.4 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.051703+0000 front 2019-11-29T21:38:12.250923+0000 (oldest deadline 2019-11-29T21:38:56.062947+0000) 2019-11-29T21:39:21.473 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:39:21.468+0000 1694c700 -1 osd.7 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.315790+0000 front 2019-11-29T21:38:11.976961+0000 (oldest deadline 2019-11-29T21:38:55.451746+0000) 2019-11-29T21:39:21.714 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:39:21.709+0000 1694c700 -1 osd.5 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:38:31.368305+0000 (oldest deadline 2019-11-29T21:39:11.368305+0000) 2019-11-29T21:39:21.715 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:39:21.711+0000 1694c700 -1 osd.5 376 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e373) 2019-11-29T21:39:21.854 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:39:21.850+0000 1694c700 -1 osd.2 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:11.447676+0000 front 2019-11-29T21:38:11.491500+0000 (oldest deadline 2019-11-29T21:38:56.706338+0000) 2019-11-29T21:39:21.898 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:39:21.891+0000 1694c700 -1 osd.6 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.721817+0000 front 2019-11-29T21:38:13.570295+0000 (oldest deadline 2019-11-29T21:38:54.903195+0000) 2019-11-29T21:39:22.296 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:39:22.291+0000 1694c700 -1 osd.0 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:13.514161+0000 front 2019-11-29T21:38:12.236952+0000 (oldest deadline 2019-11-29T21:38:54.364548+0000) 2019-11-29T21:39:22.459 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:39:22.453+0000 1694c700 -1 osd.7 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.315790+0000 front 2019-11-29T21:38:11.976961+0000 (oldest deadline 2019-11-29T21:38:55.451746+0000) 2019-11-29T21:39:22.468 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:39:22.463+0000 1694c700 -1 osd.4 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.051703+0000 front 2019-11-29T21:38:12.250923+0000 (oldest deadline 2019-11-29T21:38:56.062947+0000) 2019-11-29T21:39:22.731 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:39:22.725+0000 1694c700 -1 osd.5 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:38:31.368305+0000 (oldest deadline 2019-11-29T21:39:11.368305+0000) 2019-11-29T21:39:22.732 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:39:22.727+0000 1694c700 -1 osd.5 376 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e373) 2019-11-29T21:39:22.867 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:39:22.860+0000 1694c700 -1 osd.2 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:11.447676+0000 front 2019-11-29T21:38:11.491500+0000 (oldest deadline 2019-11-29T21:38:56.706338+0000) 2019-11-29T21:39:22.946 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:39:22.941+0000 1694c700 -1 osd.6 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.721817+0000 front 2019-11-29T21:38:13.570295+0000 (oldest deadline 2019-11-29T21:38:54.903195+0000) 2019-11-29T21:39:23.345 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:39:23.339+0000 1694c700 -1 osd.0 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:13.514161+0000 front 2019-11-29T21:38:12.236952+0000 (oldest deadline 2019-11-29T21:38:54.364548+0000) 2019-11-29T21:39:23.458 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:39:23.452+0000 1694c700 -1 osd.7 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.315790+0000 front 2019-11-29T21:38:11.976961+0000 (oldest deadline 2019-11-29T21:38:55.451746+0000) 2019-11-29T21:39:23.517 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:39:23.508+0000 1694c700 -1 osd.4 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.051703+0000 front 2019-11-29T21:38:12.250923+0000 (oldest deadline 2019-11-29T21:38:56.062947+0000) 2019-11-29T21:39:23.776 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:39:23.768+0000 1694c700 -1 osd.5 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:38:31.368305+0000 (oldest deadline 2019-11-29T21:39:11.368305+0000) 2019-11-29T21:39:23.777 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:39:23.772+0000 1694c700 -1 osd.5 376 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e373) 2019-11-29T21:39:23.899 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:39:23.895+0000 1694c700 -1 osd.2 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:11.447676+0000 front 2019-11-29T21:38:11.491500+0000 (oldest deadline 2019-11-29T21:38:56.706338+0000) 2019-11-29T21:39:23.909 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:39:23.901+0000 1694c700 -1 osd.6 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.721817+0000 front 2019-11-29T21:38:13.570295+0000 (oldest deadline 2019-11-29T21:38:54.903195+0000) 2019-11-29T21:39:24.393 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:39:24.387+0000 1694c700 -1 osd.0 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:13.514161+0000 front 2019-11-29T21:38:12.236952+0000 (oldest deadline 2019-11-29T21:38:54.364548+0000) 2019-11-29T21:39:24.462 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:39:24.456+0000 1694c700 -1 osd.7 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.315790+0000 front 2019-11-29T21:38:11.976961+0000 (oldest deadline 2019-11-29T21:38:55.451746+0000) 2019-11-29T21:39:24.545 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:39:24.536+0000 1694c700 -1 osd.4 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.051703+0000 front 2019-11-29T21:38:12.250923+0000 (oldest deadline 2019-11-29T21:38:56.062947+0000) 2019-11-29T21:39:24.778 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:39:24.766+0000 1694c700 -1 osd.5 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:38:31.368305+0000 (oldest deadline 2019-11-29T21:39:11.368305+0000) 2019-11-29T21:39:24.778 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:39:24.769+0000 1694c700 -1 osd.5 376 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e373) 2019-11-29T21:39:24.894 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:39:24.889+0000 1694c700 -1 osd.2 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:11.447676+0000 front 2019-11-29T21:38:11.491500+0000 (oldest deadline 2019-11-29T21:38:56.706338+0000) 2019-11-29T21:39:24.917 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:39:24.911+0000 1694c700 -1 osd.6 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.721817+0000 front 2019-11-29T21:38:13.570295+0000 (oldest deadline 2019-11-29T21:38:54.903195+0000) 2019-11-29T21:39:25.425 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:39:25.420+0000 1694c700 -1 osd.0 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:13.514161+0000 front 2019-11-29T21:38:12.236952+0000 (oldest deadline 2019-11-29T21:38:54.364548+0000) 2019-11-29T21:39:25.505 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:39:25.498+0000 1694c700 -1 osd.7 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.315790+0000 front 2019-11-29T21:38:11.976961+0000 (oldest deadline 2019-11-29T21:38:55.451746+0000) 2019-11-29T21:39:25.595 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:39:25.590+0000 1694c700 -1 osd.4 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.051703+0000 front 2019-11-29T21:38:12.250923+0000 (oldest deadline 2019-11-29T21:38:56.062947+0000) 2019-11-29T21:39:25.772 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:39:25.766+0000 1694c700 -1 osd.5 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:38:31.368305+0000 (oldest deadline 2019-11-29T21:39:11.368305+0000) 2019-11-29T21:39:25.778 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:39:25.772+0000 1694c700 -1 osd.5 376 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e373) 2019-11-29T21:39:25.888 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:39:25.884+0000 1694c700 -1 osd.2 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:11.447676+0000 front 2019-11-29T21:38:11.491500+0000 (oldest deadline 2019-11-29T21:38:56.706338+0000) 2019-11-29T21:39:25.943 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:39:25.937+0000 1694c700 -1 osd.6 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.721817+0000 front 2019-11-29T21:38:13.570295+0000 (oldest deadline 2019-11-29T21:38:54.903195+0000) 2019-11-29T21:39:26.410 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:39:26.406+0000 1694c700 -1 osd.0 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:13.514161+0000 front 2019-11-29T21:38:12.236952+0000 (oldest deadline 2019-11-29T21:38:54.364548+0000) 2019-11-29T21:39:26.468 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:39:26.461+0000 1694c700 -1 osd.7 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.315790+0000 front 2019-11-29T21:38:11.976961+0000 (oldest deadline 2019-11-29T21:38:55.451746+0000) 2019-11-29T21:39:26.577 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:39:26.569+0000 1694c700 -1 osd.4 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.051703+0000 front 2019-11-29T21:38:12.250923+0000 (oldest deadline 2019-11-29T21:38:56.062947+0000) 2019-11-29T21:39:26.629 INFO:tasks.ceph.mon.b.smithi022.stderr:2019-11-29T21:39:26.619+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.1 [v2:172.21.15.62:6800/10370,v1:172.21.15.62:6801/10370] for 42sec e376 v376) 2019-11-29T21:39:26.767 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:39:26.759+0000 1694c700 -1 osd.5 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:38:31.368305+0000 (oldest deadline 2019-11-29T21:39:11.368305+0000) 2019-11-29T21:39:26.768 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:39:26.762+0000 1694c700 -1 osd.5 376 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e373) 2019-11-29T21:39:26.869 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:39:26.864+0000 1694c700 -1 osd.2 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:11.447676+0000 front 2019-11-29T21:38:11.491500+0000 (oldest deadline 2019-11-29T21:38:56.706338+0000) 2019-11-29T21:39:26.948 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:39:26.941+0000 1694c700 -1 osd.6 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.721817+0000 front 2019-11-29T21:38:13.570295+0000 (oldest deadline 2019-11-29T21:38:54.903195+0000) 2019-11-29T21:39:27.385 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:39:27.379+0000 1694c700 -1 osd.0 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:13.514161+0000 front 2019-11-29T21:38:12.236952+0000 (oldest deadline 2019-11-29T21:38:54.364548+0000) 2019-11-29T21:39:27.453 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:39:27.448+0000 1694c700 -1 osd.7 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.315790+0000 front 2019-11-29T21:38:11.976961+0000 (oldest deadline 2019-11-29T21:38:55.451746+0000) 2019-11-29T21:39:27.534 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:39:27.527+0000 1694c700 -1 osd.4 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.051703+0000 front 2019-11-29T21:38:12.250923+0000 (oldest deadline 2019-11-29T21:38:56.062947+0000) 2019-11-29T21:39:27.754 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:39:27.748+0000 1694c700 -1 osd.5 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:38:31.368305+0000 (oldest deadline 2019-11-29T21:39:11.368305+0000) 2019-11-29T21:39:27.758 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:39:27.753+0000 1694c700 -1 osd.5 376 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e373) 2019-11-29T21:39:27.898 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:39:27.893+0000 1694c700 -1 osd.2 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:11.447676+0000 front 2019-11-29T21:38:11.491500+0000 (oldest deadline 2019-11-29T21:38:56.706338+0000) 2019-11-29T21:39:27.918 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:39:27.912+0000 1694c700 -1 osd.6 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.721817+0000 front 2019-11-29T21:38:13.570295+0000 (oldest deadline 2019-11-29T21:38:54.903195+0000) 2019-11-29T21:39:28.401 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:39:28.396+0000 1694c700 -1 osd.0 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:13.514161+0000 front 2019-11-29T21:38:12.236952+0000 (oldest deadline 2019-11-29T21:38:54.364548+0000) 2019-11-29T21:39:28.496 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:39:28.490+0000 1694c700 -1 osd.4 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.051703+0000 front 2019-11-29T21:38:12.250923+0000 (oldest deadline 2019-11-29T21:38:56.062947+0000) 2019-11-29T21:39:28.498 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:39:28.491+0000 1694c700 -1 osd.7 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.315790+0000 front 2019-11-29T21:38:11.976961+0000 (oldest deadline 2019-11-29T21:38:55.451746+0000) 2019-11-29T21:39:28.796 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:39:28.788+0000 1694c700 -1 osd.5 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:38:31.368305+0000 (oldest deadline 2019-11-29T21:39:11.368305+0000) 2019-11-29T21:39:28.797 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:39:28.791+0000 1694c700 -1 osd.5 376 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e373) 2019-11-29T21:39:28.939 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:39:28.935+0000 1694c700 -1 osd.2 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:11.447676+0000 front 2019-11-29T21:38:11.491500+0000 (oldest deadline 2019-11-29T21:38:56.706338+0000) 2019-11-29T21:39:28.974 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:39:28.966+0000 1694c700 -1 osd.6 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.721817+0000 front 2019-11-29T21:38:13.570295+0000 (oldest deadline 2019-11-29T21:38:54.903195+0000) 2019-11-29T21:39:29.457 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:39:29.451+0000 1694c700 -1 osd.0 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:13.514161+0000 front 2019-11-29T21:38:12.236952+0000 (oldest deadline 2019-11-29T21:38:54.364548+0000) 2019-11-29T21:39:29.478 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:39:29.471+0000 1694c700 -1 osd.4 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.051703+0000 front 2019-11-29T21:38:12.250923+0000 (oldest deadline 2019-11-29T21:38:56.062947+0000) 2019-11-29T21:39:29.502 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:39:29.495+0000 1694c700 -1 osd.7 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.315790+0000 front 2019-11-29T21:38:11.976961+0000 (oldest deadline 2019-11-29T21:38:55.451746+0000) 2019-11-29T21:39:29.783 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:39:29.773+0000 1694c700 -1 osd.5 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:38:31.368305+0000 (oldest deadline 2019-11-29T21:39:11.368305+0000) 2019-11-29T21:39:29.789 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:39:29.777+0000 1694c700 -1 osd.5 376 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e373) 2019-11-29T21:39:29.933 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:39:29.928+0000 1694c700 -1 osd.2 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:11.447676+0000 front 2019-11-29T21:38:11.491500+0000 (oldest deadline 2019-11-29T21:38:56.706338+0000) 2019-11-29T21:39:29.998 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:39:29.992+0000 1694c700 -1 osd.6 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.721817+0000 front 2019-11-29T21:38:13.570295+0000 (oldest deadline 2019-11-29T21:38:54.903195+0000) 2019-11-29T21:39:30.464 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:39:30.459+0000 1694c700 -1 osd.4 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.051703+0000 front 2019-11-29T21:38:12.250923+0000 (oldest deadline 2019-11-29T21:38:56.062947+0000) 2019-11-29T21:39:30.492 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:39:30.482+0000 1694c700 -1 osd.7 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.315790+0000 front 2019-11-29T21:38:11.976961+0000 (oldest deadline 2019-11-29T21:38:55.451746+0000) 2019-11-29T21:39:30.497 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:39:30.493+0000 1694c700 -1 osd.0 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:13.514161+0000 front 2019-11-29T21:38:12.236952+0000 (oldest deadline 2019-11-29T21:38:54.364548+0000) 2019-11-29T21:39:30.830 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:39:30.822+0000 1694c700 -1 osd.5 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:38:31.368305+0000 (oldest deadline 2019-11-29T21:39:11.368305+0000) 2019-11-29T21:39:30.831 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:39:30.825+0000 1694c700 -1 osd.5 376 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e373) 2019-11-29T21:39:30.942 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:39:30.937+0000 1694c700 -1 osd.2 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:11.447676+0000 front 2019-11-29T21:38:11.491500+0000 (oldest deadline 2019-11-29T21:38:56.706338+0000) 2019-11-29T21:39:30.983 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:39:30.976+0000 1694c700 -1 osd.6 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.721817+0000 front 2019-11-29T21:38:13.570295+0000 (oldest deadline 2019-11-29T21:38:54.903195+0000) 2019-11-29T21:39:31.454 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:39:31.448+0000 1694c700 -1 osd.4 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.051703+0000 front 2019-11-29T21:38:12.250923+0000 (oldest deadline 2019-11-29T21:38:56.062947+0000) 2019-11-29T21:39:31.472 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:39:31.465+0000 1694c700 -1 osd.7 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.315790+0000 front 2019-11-29T21:38:11.976961+0000 (oldest deadline 2019-11-29T21:38:55.451746+0000) 2019-11-29T21:39:31.495 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:39:31.490+0000 1694c700 -1 osd.0 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:13.514161+0000 front 2019-11-29T21:38:12.236952+0000 (oldest deadline 2019-11-29T21:38:54.364548+0000) 2019-11-29T21:39:31.649 INFO:tasks.ceph.mon.b.smithi022.stderr:2019-11-29T21:39:31.644+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.1 [v2:172.21.15.62:6800/10370,v1:172.21.15.62:6801/10370] for 42sec e376 v376) 2019-11-29T21:39:31.855 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:39:31.847+0000 1694c700 -1 osd.5 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:38:31.368305+0000 (oldest deadline 2019-11-29T21:39:11.368305+0000) 2019-11-29T21:39:31.855 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:39:31.850+0000 1694c700 -1 osd.5 376 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e373) 2019-11-29T21:39:31.914 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:39:31.909+0000 1694c700 -1 osd.2 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:11.447676+0000 front 2019-11-29T21:38:11.491500+0000 (oldest deadline 2019-11-29T21:38:56.706338+0000) 2019-11-29T21:39:32.012 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:39:32.004+0000 1694c700 -1 osd.6 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.721817+0000 front 2019-11-29T21:38:13.570295+0000 (oldest deadline 2019-11-29T21:38:54.903195+0000) 2019-11-29T21:39:32.427 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:39:32.420+0000 1694c700 -1 osd.4 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.051703+0000 front 2019-11-29T21:38:12.250923+0000 (oldest deadline 2019-11-29T21:38:56.062947+0000) 2019-11-29T21:39:32.484 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:39:32.477+0000 1694c700 -1 osd.7 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.315790+0000 front 2019-11-29T21:38:11.976961+0000 (oldest deadline 2019-11-29T21:38:55.451746+0000) 2019-11-29T21:39:32.539 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:39:32.534+0000 1694c700 -1 osd.0 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:13.514161+0000 front 2019-11-29T21:38:12.236952+0000 (oldest deadline 2019-11-29T21:38:54.364548+0000) 2019-11-29T21:39:32.897 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:39:32.891+0000 1694c700 -1 osd.5 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:38:31.368305+0000 (oldest deadline 2019-11-29T21:39:11.368305+0000) 2019-11-29T21:39:32.900 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:39:32.895+0000 1694c700 -1 osd.5 376 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e373) 2019-11-29T21:39:32.952 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:39:32.947+0000 1694c700 -1 osd.2 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:11.447676+0000 front 2019-11-29T21:38:11.491500+0000 (oldest deadline 2019-11-29T21:38:56.706338+0000) 2019-11-29T21:39:32.990 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:39:32.984+0000 1694c700 -1 osd.6 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.721817+0000 front 2019-11-29T21:38:13.570295+0000 (oldest deadline 2019-11-29T21:38:54.903195+0000) 2019-11-29T21:39:33.426 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:39:33.419+0000 1694c700 -1 osd.4 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.051703+0000 front 2019-11-29T21:38:12.250923+0000 (oldest deadline 2019-11-29T21:38:56.062947+0000) 2019-11-29T21:39:33.510 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:39:33.504+0000 1694c700 -1 osd.7 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.315790+0000 front 2019-11-29T21:38:11.976961+0000 (oldest deadline 2019-11-29T21:38:55.451746+0000) 2019-11-29T21:39:33.548 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:39:33.543+0000 1694c700 -1 osd.0 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:13.514161+0000 front 2019-11-29T21:38:12.236952+0000 (oldest deadline 2019-11-29T21:38:54.364548+0000) 2019-11-29T21:39:33.933 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:39:33.923+0000 1694c700 -1 osd.5 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:38:31.368305+0000 (oldest deadline 2019-11-29T21:39:11.368305+0000) 2019-11-29T21:39:33.934 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:39:33.928+0000 1694c700 -1 osd.5 376 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e373) 2019-11-29T21:39:33.945 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:39:33.939+0000 1694c700 -1 osd.2 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:11.447676+0000 front 2019-11-29T21:38:11.491500+0000 (oldest deadline 2019-11-29T21:38:56.706338+0000) 2019-11-29T21:39:33.958 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:39:33.952+0000 1694c700 -1 osd.6 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.721817+0000 front 2019-11-29T21:38:13.570295+0000 (oldest deadline 2019-11-29T21:38:54.903195+0000) 2019-11-29T21:39:34.422 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:39:34.414+0000 1694c700 -1 osd.4 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.051703+0000 front 2019-11-29T21:38:12.250923+0000 (oldest deadline 2019-11-29T21:38:56.062947+0000) 2019-11-29T21:39:34.522 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:39:34.515+0000 1694c700 -1 osd.7 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.315790+0000 front 2019-11-29T21:38:11.976961+0000 (oldest deadline 2019-11-29T21:38:55.451746+0000) 2019-11-29T21:39:34.544 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:39:34.539+0000 1694c700 -1 osd.0 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:13.514161+0000 front 2019-11-29T21:38:12.236952+0000 (oldest deadline 2019-11-29T21:38:54.364548+0000) 2019-11-29T21:39:34.927 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:39:34.922+0000 1694c700 -1 osd.2 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:11.447676+0000 front 2019-11-29T21:38:11.491500+0000 (oldest deadline 2019-11-29T21:38:56.706338+0000) 2019-11-29T21:39:34.933 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:39:34.928+0000 1694c700 -1 osd.6 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.721817+0000 front 2019-11-29T21:38:13.570295+0000 (oldest deadline 2019-11-29T21:38:54.903195+0000) 2019-11-29T21:39:34.935 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:39:34.926+0000 1694c700 -1 osd.5 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:38:31.368305+0000 (oldest deadline 2019-11-29T21:39:11.368305+0000) 2019-11-29T21:39:34.936 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:39:34.929+0000 1694c700 -1 osd.5 376 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e373) 2019-11-29T21:39:35.390 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:39:35.383+0000 1694c700 -1 osd.4 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.051703+0000 front 2019-11-29T21:38:12.250923+0000 (oldest deadline 2019-11-29T21:38:56.062947+0000) 2019-11-29T21:39:35.484 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:39:35.477+0000 1694c700 -1 osd.7 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.315790+0000 front 2019-11-29T21:38:11.976961+0000 (oldest deadline 2019-11-29T21:38:55.451746+0000) 2019-11-29T21:39:35.601 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:39:35.595+0000 1694c700 -1 osd.0 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:13.514161+0000 front 2019-11-29T21:38:12.236952+0000 (oldest deadline 2019-11-29T21:38:54.364548+0000) 2019-11-29T21:39:35.902 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:39:35.896+0000 1694c700 -1 osd.2 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:11.447676+0000 front 2019-11-29T21:38:11.491500+0000 (oldest deadline 2019-11-29T21:38:56.706338+0000) 2019-11-29T21:39:35.916 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:39:35.910+0000 1694c700 -1 osd.6 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.721817+0000 front 2019-11-29T21:38:13.570295+0000 (oldest deadline 2019-11-29T21:38:54.903195+0000) 2019-11-29T21:39:35.977 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:39:35.970+0000 1694c700 -1 osd.5 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:38:31.368305+0000 (oldest deadline 2019-11-29T21:39:11.368305+0000) 2019-11-29T21:39:35.980 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:39:35.972+0000 1694c700 -1 osd.5 376 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e373) 2019-11-29T21:39:36.381 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:39:36.375+0000 1694c700 -1 osd.4 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.051703+0000 front 2019-11-29T21:38:12.250923+0000 (oldest deadline 2019-11-29T21:38:56.062947+0000) 2019-11-29T21:39:36.499 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:39:36.492+0000 1694c700 -1 osd.7 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.315790+0000 front 2019-11-29T21:38:11.976961+0000 (oldest deadline 2019-11-29T21:38:55.451746+0000) 2019-11-29T21:39:36.581 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:39:36.570+0000 1694c700 -1 osd.0 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:13.514161+0000 front 2019-11-29T21:38:12.236952+0000 (oldest deadline 2019-11-29T21:38:54.364548+0000) 2019-11-29T21:39:36.665 INFO:tasks.ceph.mon.b.smithi022.stderr:2019-11-29T21:39:36.658+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.1 [v2:172.21.15.62:6800/10370,v1:172.21.15.62:6801/10370] for 42sec e376 v376) 2019-11-29T21:39:36.867 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:39:36.861+0000 1694c700 -1 osd.2 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:11.447676+0000 front 2019-11-29T21:38:11.491500+0000 (oldest deadline 2019-11-29T21:38:56.706338+0000) 2019-11-29T21:39:36.932 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:39:36.925+0000 1694c700 -1 osd.6 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.721817+0000 front 2019-11-29T21:38:13.570295+0000 (oldest deadline 2019-11-29T21:38:54.903195+0000) 2019-11-29T21:39:36.991 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:39:36.983+0000 1694c700 -1 osd.5 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:38:31.368305+0000 (oldest deadline 2019-11-29T21:39:11.368305+0000) 2019-11-29T21:39:36.992 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:39:36.986+0000 1694c700 -1 osd.5 376 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e373) 2019-11-29T21:39:37.360 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:39:37.353+0000 1694c700 -1 osd.4 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.051703+0000 front 2019-11-29T21:38:12.250923+0000 (oldest deadline 2019-11-29T21:38:56.062947+0000) 2019-11-29T21:39:37.498 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:39:37.491+0000 1694c700 -1 osd.7 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.315790+0000 front 2019-11-29T21:38:11.976961+0000 (oldest deadline 2019-11-29T21:38:55.451746+0000) 2019-11-29T21:39:37.845 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:39:37.840+0000 1694c700 -1 osd.2 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:11.447676+0000 front 2019-11-29T21:38:11.491500+0000 (oldest deadline 2019-11-29T21:38:56.706338+0000) 2019-11-29T21:39:37.961 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:39:37.954+0000 1694c700 -1 osd.6 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.721817+0000 front 2019-11-29T21:38:13.570295+0000 (oldest deadline 2019-11-29T21:38:54.903195+0000) 2019-11-29T21:39:37.989 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:39:37.982+0000 1694c700 -1 osd.5 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:38:31.368305+0000 (oldest deadline 2019-11-29T21:39:11.368305+0000) 2019-11-29T21:39:37.990 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:39:37.984+0000 1694c700 -1 osd.5 376 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e373) 2019-11-29T21:39:38.413 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:39:38.406+0000 1694c700 -1 osd.4 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.051703+0000 front 2019-11-29T21:38:12.250923+0000 (oldest deadline 2019-11-29T21:38:56.062947+0000) 2019-11-29T21:39:38.532 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:39:38.525+0000 1694c700 -1 osd.7 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.315790+0000 front 2019-11-29T21:38:11.976961+0000 (oldest deadline 2019-11-29T21:38:55.451746+0000) 2019-11-29T21:39:38.849 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:39:38.843+0000 1694c700 -1 osd.2 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:11.447676+0000 front 2019-11-29T21:38:11.491500+0000 (oldest deadline 2019-11-29T21:38:56.706338+0000) 2019-11-29T21:39:38.938 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:39:38.931+0000 1694c700 -1 osd.6 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.721817+0000 front 2019-11-29T21:38:13.570295+0000 (oldest deadline 2019-11-29T21:38:54.903195+0000) 2019-11-29T21:39:39.013 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:39:39.005+0000 1694c700 -1 osd.5 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:38:31.368305+0000 (oldest deadline 2019-11-29T21:39:11.368305+0000) 2019-11-29T21:39:39.013 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:39:39.008+0000 1694c700 -1 osd.5 376 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e373) 2019-11-29T21:39:39.459 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:39:39.452+0000 1694c700 -1 osd.4 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.051703+0000 front 2019-11-29T21:38:12.250923+0000 (oldest deadline 2019-11-29T21:38:56.062947+0000) 2019-11-29T21:39:39.524 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:39:39.517+0000 1694c700 -1 osd.7 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.315790+0000 front 2019-11-29T21:38:11.976961+0000 (oldest deadline 2019-11-29T21:38:55.451746+0000) 2019-11-29T21:39:39.872 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:39:39.866+0000 1694c700 -1 osd.2 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:11.447676+0000 front 2019-11-29T21:38:11.491500+0000 (oldest deadline 2019-11-29T21:38:56.706338+0000) 2019-11-29T21:39:39.956 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:39:39.949+0000 1694c700 -1 osd.6 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.721817+0000 front 2019-11-29T21:38:13.570295+0000 (oldest deadline 2019-11-29T21:38:54.903195+0000) 2019-11-29T21:39:39.976 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:39:39.968+0000 1694c700 -1 osd.5 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:38:31.368305+0000 (oldest deadline 2019-11-29T21:39:11.368305+0000) 2019-11-29T21:39:39.977 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:39:39.971+0000 1694c700 -1 osd.5 376 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e373) 2019-11-29T21:39:40.492 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:39:40.486+0000 1694c700 -1 osd.4 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.051703+0000 front 2019-11-29T21:38:12.250923+0000 (oldest deadline 2019-11-29T21:38:56.062947+0000) 2019-11-29T21:39:40.518 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:39:40.513+0000 1694c700 -1 osd.7 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.315790+0000 front 2019-11-29T21:38:11.976961+0000 (oldest deadline 2019-11-29T21:38:55.451746+0000) 2019-11-29T21:39:40.914 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:39:40.909+0000 1694c700 -1 osd.2 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:11.447676+0000 front 2019-11-29T21:38:11.491500+0000 (oldest deadline 2019-11-29T21:38:56.706338+0000) 2019-11-29T21:39:40.961 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:39:40.953+0000 1694c700 -1 osd.5 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:38:31.368305+0000 (oldest deadline 2019-11-29T21:39:11.368305+0000) 2019-11-29T21:39:40.962 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:39:40.956+0000 1694c700 -1 osd.5 376 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e373) 2019-11-29T21:39:40.994 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:39:40.988+0000 1694c700 -1 osd.6 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.721817+0000 front 2019-11-29T21:38:13.570295+0000 (oldest deadline 2019-11-29T21:38:54.903195+0000) 2019-11-29T21:39:41.506 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:39:41.500+0000 1694c700 -1 osd.4 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.051703+0000 front 2019-11-29T21:38:12.250923+0000 (oldest deadline 2019-11-29T21:38:56.062947+0000) 2019-11-29T21:39:41.568 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:39:41.561+0000 1694c700 -1 osd.7 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.315790+0000 front 2019-11-29T21:38:11.976961+0000 (oldest deadline 2019-11-29T21:38:55.451746+0000) 2019-11-29T21:39:41.680 INFO:tasks.ceph.mon.b.smithi022.stderr:2019-11-29T21:39:41.675+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.1 [v2:172.21.15.62:6800/10370,v1:172.21.15.62:6801/10370] for 42sec e376 v376) 2019-11-29T21:39:41.894 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:39:41.888+0000 1694c700 -1 osd.2 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:11.447676+0000 front 2019-11-29T21:38:11.491500+0000 (oldest deadline 2019-11-29T21:38:56.706338+0000) 2019-11-29T21:39:41.951 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:39:41.946+0000 1694c700 -1 osd.6 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.721817+0000 front 2019-11-29T21:38:13.570295+0000 (oldest deadline 2019-11-29T21:38:54.903195+0000) 2019-11-29T21:39:41.967 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:39:41.961+0000 1694c700 -1 osd.5 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:38:31.368305+0000 (oldest deadline 2019-11-29T21:39:11.368305+0000) 2019-11-29T21:39:41.971 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:39:41.966+0000 1694c700 -1 osd.5 376 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e373) 2019-11-29T21:39:42.552 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:39:42.545+0000 1694c700 -1 osd.4 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.051703+0000 front 2019-11-29T21:38:12.250923+0000 (oldest deadline 2019-11-29T21:38:56.062947+0000) 2019-11-29T21:39:42.608 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:39:42.603+0000 1694c700 -1 osd.7 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.315790+0000 front 2019-11-29T21:38:11.976961+0000 (oldest deadline 2019-11-29T21:38:55.451746+0000) 2019-11-29T21:39:42.900 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:39:42.896+0000 1694c700 -1 osd.2 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:11.447676+0000 front 2019-11-29T21:38:11.491500+0000 (oldest deadline 2019-11-29T21:38:56.706338+0000) 2019-11-29T21:39:42.996 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:39:42.990+0000 1694c700 -1 osd.5 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:38:31.368305+0000 (oldest deadline 2019-11-29T21:39:11.368305+0000) 2019-11-29T21:39:42.998 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:39:42.994+0000 1694c700 -1 osd.5 376 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e373) 2019-11-29T21:39:42.999 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:39:42.994+0000 1694c700 -1 osd.6 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.721817+0000 front 2019-11-29T21:38:13.570295+0000 (oldest deadline 2019-11-29T21:38:54.903195+0000) 2019-11-29T21:39:43.524 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:39:43.517+0000 1694c700 -1 osd.4 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.051703+0000 front 2019-11-29T21:38:12.250923+0000 (oldest deadline 2019-11-29T21:38:56.062947+0000) 2019-11-29T21:39:43.661 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:39:43.654+0000 1694c700 -1 osd.7 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.315790+0000 front 2019-11-29T21:38:11.976961+0000 (oldest deadline 2019-11-29T21:38:55.451746+0000) 2019-11-29T21:39:43.896 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:39:43.891+0000 1694c700 -1 osd.2 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:11.447676+0000 front 2019-11-29T21:38:11.491500+0000 (oldest deadline 2019-11-29T21:38:56.706338+0000) 2019-11-29T21:39:43.980 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:39:43.973+0000 1694c700 -1 osd.5 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:38:31.368305+0000 (oldest deadline 2019-11-29T21:39:11.368305+0000) 2019-11-29T21:39:43.981 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:39:43.976+0000 1694c700 -1 osd.5 376 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e373) 2019-11-29T21:39:44.020 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:39:44.010+0000 1694c700 -1 osd.6 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.721817+0000 front 2019-11-29T21:38:13.570295+0000 (oldest deadline 2019-11-29T21:38:54.903195+0000) 2019-11-29T21:39:44.573 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:39:44.566+0000 1694c700 -1 osd.4 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.051703+0000 front 2019-11-29T21:38:12.250923+0000 (oldest deadline 2019-11-29T21:38:56.062947+0000) 2019-11-29T21:39:44.648 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:39:44.641+0000 1694c700 -1 osd.7 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.315790+0000 front 2019-11-29T21:38:11.976961+0000 (oldest deadline 2019-11-29T21:38:55.451746+0000) 2019-11-29T21:39:44.871 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:39:44.865+0000 1694c700 -1 osd.2 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:11.447676+0000 front 2019-11-29T21:38:11.491500+0000 (oldest deadline 2019-11-29T21:38:56.706338+0000) 2019-11-29T21:39:44.981 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:39:44.975+0000 1694c700 -1 osd.6 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.721817+0000 front 2019-11-29T21:38:13.570295+0000 (oldest deadline 2019-11-29T21:38:54.903195+0000) 2019-11-29T21:39:45.030 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:39:45.022+0000 1694c700 -1 osd.5 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:38:31.368305+0000 (oldest deadline 2019-11-29T21:39:11.368305+0000) 2019-11-29T21:39:45.032 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:39:45.025+0000 1694c700 -1 osd.5 376 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e373) 2019-11-29T21:39:45.529 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:39:45.522+0000 1694c700 -1 osd.4 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.051703+0000 front 2019-11-29T21:38:12.250923+0000 (oldest deadline 2019-11-29T21:38:56.062947+0000) 2019-11-29T21:39:45.616 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:39:45.610+0000 1694c700 -1 osd.7 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.315790+0000 front 2019-11-29T21:38:11.976961+0000 (oldest deadline 2019-11-29T21:38:55.451746+0000) 2019-11-29T21:39:45.861 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:39:45.856+0000 1694c700 -1 osd.2 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:11.447676+0000 front 2019-11-29T21:38:11.491500+0000 (oldest deadline 2019-11-29T21:38:56.706338+0000) 2019-11-29T21:39:46.012 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:39:46.006+0000 1694c700 -1 osd.5 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:38:31.368305+0000 (oldest deadline 2019-11-29T21:39:11.368305+0000) 2019-11-29T21:39:46.013 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:39:46.007+0000 1694c700 -1 osd.6 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.721817+0000 front 2019-11-29T21:38:13.570295+0000 (oldest deadline 2019-11-29T21:38:54.903195+0000) 2019-11-29T21:39:46.016 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:39:46.011+0000 1694c700 -1 osd.5 376 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e373) 2019-11-29T21:39:46.550 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:39:46.544+0000 1694c700 -1 osd.4 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.051703+0000 front 2019-11-29T21:38:12.250923+0000 (oldest deadline 2019-11-29T21:38:56.062947+0000) 2019-11-29T21:39:46.618 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:39:46.612+0000 1694c700 -1 osd.7 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.315790+0000 front 2019-11-29T21:38:11.976961+0000 (oldest deadline 2019-11-29T21:38:55.451746+0000) 2019-11-29T21:39:46.695 INFO:tasks.ceph.mon.b.smithi022.stderr:2019-11-29T21:39:46.690+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.1 [v2:172.21.15.62:6800/10370,v1:172.21.15.62:6801/10370] for 42sec e376 v376) 2019-11-29T21:39:46.877 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:39:46.871+0000 1694c700 -1 osd.2 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:11.447676+0000 front 2019-11-29T21:38:11.491500+0000 (oldest deadline 2019-11-29T21:38:56.706338+0000) 2019-11-29T21:39:47.018 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:39:47.011+0000 1694c700 -1 osd.6 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.721817+0000 front 2019-11-29T21:38:13.570295+0000 (oldest deadline 2019-11-29T21:38:54.903195+0000) 2019-11-29T21:39:47.048 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:39:47.041+0000 1694c700 -1 osd.5 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:38:31.368305+0000 (oldest deadline 2019-11-29T21:39:11.368305+0000) 2019-11-29T21:39:47.050 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:39:47.044+0000 1694c700 -1 osd.5 376 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e373) 2019-11-29T21:39:47.576 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:39:47.570+0000 1694c700 -1 osd.4 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.051703+0000 front 2019-11-29T21:38:12.250923+0000 (oldest deadline 2019-11-29T21:38:56.062947+0000) 2019-11-29T21:39:47.662 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:39:47.656+0000 1694c700 -1 osd.7 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.315790+0000 front 2019-11-29T21:38:11.976961+0000 (oldest deadline 2019-11-29T21:38:55.451746+0000) 2019-11-29T21:39:47.859 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:39:47.854+0000 1694c700 -1 osd.2 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:11.447676+0000 front 2019-11-29T21:38:11.491500+0000 (oldest deadline 2019-11-29T21:38:56.706338+0000) 2019-11-29T21:39:48.042 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:39:48.035+0000 1694c700 -1 osd.6 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.721817+0000 front 2019-11-29T21:38:13.570295+0000 (oldest deadline 2019-11-29T21:38:54.903195+0000) 2019-11-29T21:39:48.073 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:39:48.066+0000 1694c700 -1 osd.5 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:38:31.368305+0000 (oldest deadline 2019-11-29T21:39:11.368305+0000) 2019-11-29T21:39:48.077 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:39:48.072+0000 1694c700 -1 osd.5 376 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e373) 2019-11-29T21:39:48.615 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:39:48.607+0000 1694c700 -1 osd.4 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.051703+0000 front 2019-11-29T21:38:12.250923+0000 (oldest deadline 2019-11-29T21:38:56.062947+0000) 2019-11-29T21:39:48.622 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:39:48.617+0000 1694c700 -1 osd.7 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.315790+0000 front 2019-11-29T21:38:11.976961+0000 (oldest deadline 2019-11-29T21:38:55.451746+0000) 2019-11-29T21:39:48.844 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:39:48.839+0000 1694c700 -1 osd.2 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:11.447676+0000 front 2019-11-29T21:38:11.491500+0000 (oldest deadline 2019-11-29T21:38:56.706338+0000) 2019-11-29T21:39:49.030 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:39:49.023+0000 1694c700 -1 osd.6 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.721817+0000 front 2019-11-29T21:38:13.570295+0000 (oldest deadline 2019-11-29T21:38:54.903195+0000) 2019-11-29T21:39:49.061 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:39:49.054+0000 1694c700 -1 osd.5 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:38:31.368305+0000 (oldest deadline 2019-11-29T21:39:11.368305+0000) 2019-11-29T21:39:49.063 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:39:49.057+0000 1694c700 -1 osd.5 376 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e373) 2019-11-29T21:39:49.569 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:39:49.563+0000 1694c700 -1 osd.4 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.051703+0000 front 2019-11-29T21:38:12.250923+0000 (oldest deadline 2019-11-29T21:38:56.062947+0000) 2019-11-29T21:39:49.648 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:39:49.641+0000 1694c700 -1 osd.7 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.315790+0000 front 2019-11-29T21:38:11.976961+0000 (oldest deadline 2019-11-29T21:38:55.451746+0000) 2019-11-29T21:39:49.901 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:39:49.895+0000 1694c700 -1 osd.2 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:11.447676+0000 front 2019-11-29T21:38:11.491500+0000 (oldest deadline 2019-11-29T21:38:56.706338+0000) 2019-11-29T21:39:50.036 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:39:50.030+0000 1694c700 -1 osd.6 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.721817+0000 front 2019-11-29T21:38:13.570295+0000 (oldest deadline 2019-11-29T21:38:54.903195+0000) 2019-11-29T21:39:50.062 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:39:50.054+0000 1694c700 -1 osd.5 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:38:31.368305+0000 (oldest deadline 2019-11-29T21:39:11.368305+0000) 2019-11-29T21:39:50.064 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:39:50.057+0000 1694c700 -1 osd.5 376 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e373) 2019-11-29T21:39:50.549 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:39:50.543+0000 1694c700 -1 osd.4 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.051703+0000 front 2019-11-29T21:38:12.250923+0000 (oldest deadline 2019-11-29T21:38:56.062947+0000) 2019-11-29T21:39:50.652 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:39:50.646+0000 1694c700 -1 osd.7 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.315790+0000 front 2019-11-29T21:38:11.976961+0000 (oldest deadline 2019-11-29T21:38:55.451746+0000) 2019-11-29T21:39:50.903 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:39:50.898+0000 1694c700 -1 osd.2 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:11.447676+0000 front 2019-11-29T21:38:11.491500+0000 (oldest deadline 2019-11-29T21:38:56.706338+0000) 2019-11-29T21:39:51.048 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:39:51.041+0000 1694c700 -1 osd.6 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.721817+0000 front 2019-11-29T21:38:13.570295+0000 (oldest deadline 2019-11-29T21:38:54.903195+0000) 2019-11-29T21:39:51.071 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:39:51.063+0000 1694c700 -1 osd.5 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 ever on either front or back, first ping sent 2019-11-29T21:38:31.368305+0000 (oldest deadline 2019-11-29T21:39:11.368305+0000) 2019-11-29T21:39:51.072 INFO:tasks.ceph.osd.5.smithi022.stderr:2019-11-29T21:39:51.066+0000 1694c700 -1 osd.5 376 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4331.0:130504 7.8 7.b717ebe8 (undecoded) ondisk+retry+read+known_if_redirected e373) 2019-11-29T21:39:51.577 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:39:51.570+0000 1694c700 -1 osd.4 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.051703+0000 front 2019-11-29T21:38:12.250923+0000 (oldest deadline 2019-11-29T21:38:56.062947+0000) 2019-11-29T21:39:51.635 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:39:51.628+0000 1694c700 -1 osd.7 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:12.315790+0000 front 2019-11-29T21:38:11.976961+0000 (oldest deadline 2019-11-29T21:38:55.451746+0000) 2019-11-29T21:39:51.787 INFO:tasks.ceph.mon.b.smithi022.stderr:2019-11-29T21:39:51.777+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.1 [v2:172.21.15.62:6800/10370,v1:172.21.15.62:6801/10370] for 42sec e376 v376) 2019-11-29T21:39:51.908 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:39:51.903+0000 1694c700 -1 osd.2 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:11.447676+0000 front 2019-11-29T21:38:11.491500+0000 (oldest deadline 2019-11-29T21:38:56.706338+0000) 2019-11-29T21:39:52.914 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:39:52.909+0000 1694c700 -1 osd.2 376 heartbeat_check: no reply from 172.21.15.62:6804 osd.1 since back 2019-11-29T21:38:11.447676+0000 front 2019-11-29T21:38:11.491500+0000 (oldest deadline 2019-11-29T21:38:56.706338+0000) 2019-11-29T21:40:19.201 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:40:19.189+0000 2184f700 -1 reset not still connected to 0x10248f10 2019-11-29T21:40:19.225 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:40:19.190+0000 2184f700 -1 reset not still connected to 0x1c9c3250 2019-11-29T21:40:24.369 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:40:24.192+0000 114ab700 -1 osd.0 381 build_incremental_map_msg missing incremental map 381 2019-11-29T21:40:24.385 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:40:24.218+0000 11cac700 -1 osd.0 381 build_incremental_map_msg missing incremental map 381 2019-11-29T21:40:26.891 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:40:26.843+0000 31783700 -1 osd.1 383 build_incremental_map_msg missing incremental map 383 2019-11-29T21:40:26.973 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:40:26.888+0000 31783700 -1 osd.1 383 build_incremental_map_msg missing incremental map 383 2019-11-29T21:40:27.086 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:40:27.022+0000 35f8c700 -1 osd.1 383 build_incremental_map_msg missing incremental map 383 2019-11-29T21:40:27.128 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:40:27.086+0000 31f84700 -1 osd.1 383 build_incremental_map_msg missing incremental map 383 2019-11-29T21:40:28.858 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:40:28.844+0000 35f8c700 -1 osd.1 383 build_incremental_map_msg missing incremental map 383 2019-11-29T21:41:03.220 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:09:15:43.879 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T21:41:03.231 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:09:15:43.889 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T21:41:03.237 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:09:15:43.843 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T21:41:03.238 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:09:15:43.845 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T21:41:03.247 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:09:15:43.854 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T21:41:03.264 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:09:15:43.870 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T21:41:03.395 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:09:15:44.054 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T21:41:03.405 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:09:15:44.013 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T21:41:03.415 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:09:15:44.022 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T21:41:27.059 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:41:27.055+0000 1694c700 -1 osd.2 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:41.801621+0000 front 2019-11-29T21:40:41.617384+0000 (oldest deadline 2019-11-29T21:41:26.828654+0000) 2019-11-29T21:41:27.260 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:41:27.255+0000 1694c700 -1 osd.1 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:43.719545+0000 front 2019-11-29T21:40:44.534028+0000 (oldest deadline 2019-11-29T21:41:27.124438+0000) 2019-11-29T21:41:27.564 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:41:27.559+0000 1694c700 -1 osd.0 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:42.406229+0000 front 2019-11-29T21:40:42.193679+0000 (oldest deadline 2019-11-29T21:41:26.829603+0000) 2019-11-29T21:41:28.113 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:41:28.108+0000 1694c700 -1 osd.2 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:41.801621+0000 front 2019-11-29T21:40:41.617384+0000 (oldest deadline 2019-11-29T21:41:26.828654+0000) 2019-11-29T21:41:28.285 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:41:28.280+0000 1694c700 -1 osd.1 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:43.719545+0000 front 2019-11-29T21:40:44.534028+0000 (oldest deadline 2019-11-29T21:41:27.124438+0000) 2019-11-29T21:41:28.610 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:41:28.605+0000 1694c700 -1 osd.0 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:42.406229+0000 front 2019-11-29T21:40:42.193679+0000 (oldest deadline 2019-11-29T21:41:26.829603+0000) 2019-11-29T21:41:29.127 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:41:29.121+0000 1694c700 -1 osd.2 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:41.801621+0000 front 2019-11-29T21:40:41.617384+0000 (oldest deadline 2019-11-29T21:41:26.828654+0000) 2019-11-29T21:41:29.264 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:41:29.259+0000 1694c700 -1 osd.1 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:43.719545+0000 front 2019-11-29T21:40:44.534028+0000 (oldest deadline 2019-11-29T21:41:27.124438+0000) 2019-11-29T21:41:29.663 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:41:29.658+0000 1694c700 -1 osd.0 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:42.406229+0000 front 2019-11-29T21:40:42.193679+0000 (oldest deadline 2019-11-29T21:41:26.829603+0000) 2019-11-29T21:41:30.159 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:41:30.155+0000 1694c700 -1 osd.2 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:41.801621+0000 front 2019-11-29T21:40:41.617384+0000 (oldest deadline 2019-11-29T21:41:26.828654+0000) 2019-11-29T21:41:30.263 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:41:30.258+0000 1694c700 -1 osd.1 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:43.719545+0000 front 2019-11-29T21:40:44.534028+0000 (oldest deadline 2019-11-29T21:41:27.124438+0000) 2019-11-29T21:41:30.515 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:41:30.510+0000 1694c700 -1 osd.7 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:45.355645+0000 front 2019-11-29T21:40:45.354239+0000 (oldest deadline 2019-11-29T21:41:29.643688+0000) 2019-11-29T21:41:30.691 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:41:30.685+0000 1694c700 -1 osd.0 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:42.406229+0000 front 2019-11-29T21:40:42.193679+0000 (oldest deadline 2019-11-29T21:41:26.829603+0000) 2019-11-29T21:41:31.103 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:41:31.097+0000 1694c700 -1 osd.6 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:46.388959+0000 front 2019-11-29T21:40:46.410140+0000 (oldest deadline 2019-11-29T21:41:31.026803+0000) 2019-11-29T21:41:31.152 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:41:31.147+0000 1694c700 -1 osd.2 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:41.801621+0000 front 2019-11-29T21:40:41.617384+0000 (oldest deadline 2019-11-29T21:41:26.828654+0000) 2019-11-29T21:41:31.278 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:41:31.272+0000 1694c700 -1 osd.1 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:43.719545+0000 front 2019-11-29T21:40:44.534028+0000 (oldest deadline 2019-11-29T21:41:27.124438+0000) 2019-11-29T21:41:31.519 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:41:31.516+0000 1694c700 -1 osd.7 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:45.355645+0000 front 2019-11-29T21:40:45.354239+0000 (oldest deadline 2019-11-29T21:41:29.643688+0000) 2019-11-29T21:41:31.730 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:41:31.726+0000 1694c700 -1 osd.0 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:42.406229+0000 front 2019-11-29T21:40:42.193679+0000 (oldest deadline 2019-11-29T21:41:26.829603+0000) 2019-11-29T21:41:32.100 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:41:32.096+0000 1694c700 -1 osd.6 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:46.388959+0000 front 2019-11-29T21:40:46.410140+0000 (oldest deadline 2019-11-29T21:41:31.026803+0000) 2019-11-29T21:41:32.142 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:41:32.138+0000 1694c700 -1 osd.2 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:41.801621+0000 front 2019-11-29T21:40:41.617384+0000 (oldest deadline 2019-11-29T21:41:26.828654+0000) 2019-11-29T21:41:32.187 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:41:32.183+0000 1694c700 -1 osd.4 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:45.707023+0000 front 2019-11-29T21:40:45.886556+0000 (oldest deadline 2019-11-29T21:41:31.583551+0000) 2019-11-29T21:41:32.276 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:41:32.272+0000 1694c700 -1 osd.1 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:43.719545+0000 front 2019-11-29T21:40:44.534028+0000 (oldest deadline 2019-11-29T21:41:27.124438+0000) 2019-11-29T21:41:32.553 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:41:32.549+0000 1694c700 -1 osd.7 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:45.355645+0000 front 2019-11-29T21:40:45.354239+0000 (oldest deadline 2019-11-29T21:41:29.643688+0000) 2019-11-29T21:41:32.741 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:41:32.736+0000 1694c700 -1 osd.0 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:42.406229+0000 front 2019-11-29T21:40:42.193679+0000 (oldest deadline 2019-11-29T21:41:26.829603+0000) 2019-11-29T21:41:33.123 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:41:33.118+0000 1694c700 -1 osd.6 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:46.388959+0000 front 2019-11-29T21:40:46.410140+0000 (oldest deadline 2019-11-29T21:41:31.026803+0000) 2019-11-29T21:41:33.143 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:41:33.138+0000 1694c700 -1 osd.2 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:41.801621+0000 front 2019-11-29T21:40:41.617384+0000 (oldest deadline 2019-11-29T21:41:26.828654+0000) 2019-11-29T21:41:33.238 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:41:33.233+0000 1694c700 -1 osd.4 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:45.707023+0000 front 2019-11-29T21:40:45.886556+0000 (oldest deadline 2019-11-29T21:41:31.583551+0000) 2019-11-29T21:41:33.276 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:41:33.272+0000 1694c700 -1 osd.1 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:43.719545+0000 front 2019-11-29T21:40:44.534028+0000 (oldest deadline 2019-11-29T21:41:27.124438+0000) 2019-11-29T21:41:33.534 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:41:33.530+0000 1694c700 -1 osd.7 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:45.355645+0000 front 2019-11-29T21:40:45.354239+0000 (oldest deadline 2019-11-29T21:41:29.643688+0000) 2019-11-29T21:41:33.769 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:41:33.763+0000 1694c700 -1 osd.0 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:42.406229+0000 front 2019-11-29T21:40:42.193679+0000 (oldest deadline 2019-11-29T21:41:26.829603+0000) 2019-11-29T21:41:34.097 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:41:34.092+0000 1694c700 -1 osd.6 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:46.388959+0000 front 2019-11-29T21:40:46.410140+0000 (oldest deadline 2019-11-29T21:41:31.026803+0000) 2019-11-29T21:41:34.150 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:41:34.145+0000 1694c700 -1 osd.2 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:41.801621+0000 front 2019-11-29T21:40:41.617384+0000 (oldest deadline 2019-11-29T21:41:26.828654+0000) 2019-11-29T21:41:34.203 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:41:34.198+0000 1694c700 -1 osd.4 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:45.707023+0000 front 2019-11-29T21:40:45.886556+0000 (oldest deadline 2019-11-29T21:41:31.583551+0000) 2019-11-29T21:41:34.280 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:41:34.275+0000 1694c700 -1 osd.1 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:43.719545+0000 front 2019-11-29T21:40:44.534028+0000 (oldest deadline 2019-11-29T21:41:27.124438+0000) 2019-11-29T21:41:34.510 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:41:34.505+0000 1694c700 -1 osd.7 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:45.355645+0000 front 2019-11-29T21:40:45.354239+0000 (oldest deadline 2019-11-29T21:41:29.643688+0000) 2019-11-29T21:41:34.804 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:41:34.799+0000 1694c700 -1 osd.0 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:42.406229+0000 front 2019-11-29T21:40:42.193679+0000 (oldest deadline 2019-11-29T21:41:26.829603+0000) 2019-11-29T21:41:35.125 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:41:35.118+0000 1694c700 -1 osd.6 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:46.388959+0000 front 2019-11-29T21:40:46.410140+0000 (oldest deadline 2019-11-29T21:41:31.026803+0000) 2019-11-29T21:41:35.134 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:41:35.129+0000 1694c700 -1 osd.2 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:41.801621+0000 front 2019-11-29T21:40:41.617384+0000 (oldest deadline 2019-11-29T21:41:26.828654+0000) 2019-11-29T21:41:35.209 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:41:35.203+0000 1694c700 -1 osd.4 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:45.707023+0000 front 2019-11-29T21:40:45.886556+0000 (oldest deadline 2019-11-29T21:41:31.583551+0000) 2019-11-29T21:41:35.274 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:41:35.270+0000 1694c700 -1 osd.1 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:43.719545+0000 front 2019-11-29T21:40:44.534028+0000 (oldest deadline 2019-11-29T21:41:27.124438+0000) 2019-11-29T21:41:35.503 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:41:35.499+0000 1694c700 -1 osd.7 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:45.355645+0000 front 2019-11-29T21:40:45.354239+0000 (oldest deadline 2019-11-29T21:41:29.643688+0000) 2019-11-29T21:41:35.809 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:41:35.803+0000 1694c700 -1 osd.0 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:42.406229+0000 front 2019-11-29T21:40:42.193679+0000 (oldest deadline 2019-11-29T21:41:26.829603+0000) 2019-11-29T21:41:36.079 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:41:36.073+0000 1694c700 -1 osd.6 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:46.388959+0000 front 2019-11-29T21:40:46.410140+0000 (oldest deadline 2019-11-29T21:41:31.026803+0000) 2019-11-29T21:41:36.093 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:41:36.087+0000 1694c700 -1 osd.2 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:41.801621+0000 front 2019-11-29T21:40:41.617384+0000 (oldest deadline 2019-11-29T21:41:26.828654+0000) 2019-11-29T21:41:36.235 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:41:36.230+0000 1694c700 -1 osd.1 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:43.719545+0000 front 2019-11-29T21:40:44.534028+0000 (oldest deadline 2019-11-29T21:41:27.124438+0000) 2019-11-29T21:41:36.249 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:41:36.244+0000 1694c700 -1 osd.4 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:45.707023+0000 front 2019-11-29T21:40:45.886556+0000 (oldest deadline 2019-11-29T21:41:31.583551+0000) 2019-11-29T21:41:36.490 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:41:36.484+0000 1694c700 -1 osd.7 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:45.355645+0000 front 2019-11-29T21:40:45.354239+0000 (oldest deadline 2019-11-29T21:41:29.643688+0000) 2019-11-29T21:41:36.836 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:41:36.831+0000 1694c700 -1 osd.0 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:42.406229+0000 front 2019-11-29T21:40:42.193679+0000 (oldest deadline 2019-11-29T21:41:26.829603+0000) 2019-11-29T21:41:37.075 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:41:37.070+0000 1694c700 -1 osd.6 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:46.388959+0000 front 2019-11-29T21:40:46.410140+0000 (oldest deadline 2019-11-29T21:41:31.026803+0000) 2019-11-29T21:41:37.076 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:41:37.071+0000 1694c700 -1 osd.2 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:41.801621+0000 front 2019-11-29T21:40:41.617384+0000 (oldest deadline 2019-11-29T21:41:26.828654+0000) 2019-11-29T21:41:37.273 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:41:37.268+0000 1694c700 -1 osd.1 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:43.719545+0000 front 2019-11-29T21:40:44.534028+0000 (oldest deadline 2019-11-29T21:41:27.124438+0000) 2019-11-29T21:41:37.283 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:41:37.278+0000 1694c700 -1 osd.4 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:45.707023+0000 front 2019-11-29T21:40:45.886556+0000 (oldest deadline 2019-11-29T21:41:31.583551+0000) 2019-11-29T21:41:37.507 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:41:37.502+0000 1694c700 -1 osd.7 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:45.355645+0000 front 2019-11-29T21:40:45.354239+0000 (oldest deadline 2019-11-29T21:41:29.643688+0000) 2019-11-29T21:41:37.849 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:41:37.843+0000 1694c700 -1 osd.0 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:42.406229+0000 front 2019-11-29T21:40:42.193679+0000 (oldest deadline 2019-11-29T21:41:26.829603+0000) 2019-11-29T21:41:38.045 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:41:38.039+0000 1694c700 -1 osd.6 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:46.388959+0000 front 2019-11-29T21:40:46.410140+0000 (oldest deadline 2019-11-29T21:41:31.026803+0000) 2019-11-29T21:41:38.112 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:41:38.107+0000 1694c700 -1 osd.2 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:41.801621+0000 front 2019-11-29T21:40:41.617384+0000 (oldest deadline 2019-11-29T21:41:26.828654+0000) 2019-11-29T21:41:38.250 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:41:38.245+0000 1694c700 -1 osd.1 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:43.719545+0000 front 2019-11-29T21:40:44.534028+0000 (oldest deadline 2019-11-29T21:41:27.124438+0000) 2019-11-29T21:41:38.265 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:41:38.260+0000 1694c700 -1 osd.4 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:45.707023+0000 front 2019-11-29T21:40:45.886556+0000 (oldest deadline 2019-11-29T21:41:31.583551+0000) 2019-11-29T21:41:38.488 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:41:38.481+0000 1694c700 -1 osd.7 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:45.355645+0000 front 2019-11-29T21:40:45.354239+0000 (oldest deadline 2019-11-29T21:41:29.643688+0000) 2019-11-29T21:41:38.886 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:41:38.881+0000 1694c700 -1 osd.0 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:42.406229+0000 front 2019-11-29T21:40:42.193679+0000 (oldest deadline 2019-11-29T21:41:26.829603+0000) 2019-11-29T21:41:39.013 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:41:39.008+0000 1694c700 -1 osd.6 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:46.388959+0000 front 2019-11-29T21:40:46.410140+0000 (oldest deadline 2019-11-29T21:41:31.026803+0000) 2019-11-29T21:41:39.093 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:41:39.087+0000 1694c700 -1 osd.2 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:41.801621+0000 front 2019-11-29T21:40:41.617384+0000 (oldest deadline 2019-11-29T21:41:26.828654+0000) 2019-11-29T21:41:39.278 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:41:39.272+0000 1694c700 -1 osd.1 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:43.719545+0000 front 2019-11-29T21:40:44.534028+0000 (oldest deadline 2019-11-29T21:41:27.124438+0000) 2019-11-29T21:41:39.309 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:41:39.303+0000 1694c700 -1 osd.4 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:45.707023+0000 front 2019-11-29T21:40:45.886556+0000 (oldest deadline 2019-11-29T21:41:31.583551+0000) 2019-11-29T21:41:39.482 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:41:39.477+0000 1694c700 -1 osd.7 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:45.355645+0000 front 2019-11-29T21:40:45.354239+0000 (oldest deadline 2019-11-29T21:41:29.643688+0000) 2019-11-29T21:41:39.936 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:41:39.931+0000 1694c700 -1 osd.0 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:42.406229+0000 front 2019-11-29T21:40:42.193679+0000 (oldest deadline 2019-11-29T21:41:26.829603+0000) 2019-11-29T21:41:39.973 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:41:39.968+0000 1694c700 -1 osd.6 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:46.388959+0000 front 2019-11-29T21:40:46.410140+0000 (oldest deadline 2019-11-29T21:41:31.026803+0000) 2019-11-29T21:41:40.121 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:41:40.117+0000 1694c700 -1 osd.2 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:41.801621+0000 front 2019-11-29T21:40:41.617384+0000 (oldest deadline 2019-11-29T21:41:26.828654+0000) 2019-11-29T21:41:40.273 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:41:40.268+0000 1694c700 -1 osd.1 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:43.719545+0000 front 2019-11-29T21:40:44.534028+0000 (oldest deadline 2019-11-29T21:41:27.124438+0000) 2019-11-29T21:41:40.305 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:41:40.299+0000 1694c700 -1 osd.4 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:45.707023+0000 front 2019-11-29T21:40:45.886556+0000 (oldest deadline 2019-11-29T21:41:31.583551+0000) 2019-11-29T21:41:40.486 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:41:40.481+0000 1694c700 -1 osd.7 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:45.355645+0000 front 2019-11-29T21:40:45.354239+0000 (oldest deadline 2019-11-29T21:41:29.643688+0000) 2019-11-29T21:41:40.918 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:41:40.912+0000 1694c700 -1 osd.0 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:42.406229+0000 front 2019-11-29T21:40:42.193679+0000 (oldest deadline 2019-11-29T21:41:26.829603+0000) 2019-11-29T21:41:40.986 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:41:40.982+0000 1694c700 -1 osd.6 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:46.388959+0000 front 2019-11-29T21:40:46.410140+0000 (oldest deadline 2019-11-29T21:41:31.026803+0000) 2019-11-29T21:41:41.076 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:41:41.071+0000 1694c700 -1 osd.2 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:41.801621+0000 front 2019-11-29T21:40:41.617384+0000 (oldest deadline 2019-11-29T21:41:26.828654+0000) 2019-11-29T21:41:41.262 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:41:41.257+0000 1694c700 -1 osd.1 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:43.719545+0000 front 2019-11-29T21:40:44.534028+0000 (oldest deadline 2019-11-29T21:41:27.124438+0000) 2019-11-29T21:41:41.338 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:41:41.332+0000 1694c700 -1 osd.4 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:45.707023+0000 front 2019-11-29T21:40:45.886556+0000 (oldest deadline 2019-11-29T21:41:31.583551+0000) 2019-11-29T21:41:41.463 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:41:41.458+0000 1694c700 -1 osd.7 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:45.355645+0000 front 2019-11-29T21:40:45.354239+0000 (oldest deadline 2019-11-29T21:41:29.643688+0000) 2019-11-29T21:41:41.931 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:41:41.927+0000 1694c700 -1 osd.0 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:42.406229+0000 front 2019-11-29T21:40:42.193679+0000 (oldest deadline 2019-11-29T21:41:26.829603+0000) 2019-11-29T21:41:42.033 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:41:42.028+0000 1694c700 -1 osd.2 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:41.801621+0000 front 2019-11-29T21:40:41.617384+0000 (oldest deadline 2019-11-29T21:41:26.828654+0000) 2019-11-29T21:41:42.039 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:41:42.035+0000 1694c700 -1 osd.6 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:46.388959+0000 front 2019-11-29T21:40:46.410140+0000 (oldest deadline 2019-11-29T21:41:31.026803+0000) 2019-11-29T21:41:42.288 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:41:42.283+0000 1694c700 -1 osd.1 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:43.719545+0000 front 2019-11-29T21:40:44.534028+0000 (oldest deadline 2019-11-29T21:41:27.124438+0000) 2019-11-29T21:41:42.310 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:41:42.305+0000 1694c700 -1 osd.4 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:45.707023+0000 front 2019-11-29T21:40:45.886556+0000 (oldest deadline 2019-11-29T21:41:31.583551+0000) 2019-11-29T21:41:42.441 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:41:42.437+0000 1694c700 -1 osd.7 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:45.355645+0000 front 2019-11-29T21:40:45.354239+0000 (oldest deadline 2019-11-29T21:41:29.643688+0000) 2019-11-29T21:41:42.954 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:41:42.948+0000 1694c700 -1 osd.0 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:42.406229+0000 front 2019-11-29T21:40:42.193679+0000 (oldest deadline 2019-11-29T21:41:26.829603+0000) 2019-11-29T21:41:43.052 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:41:43.047+0000 1694c700 -1 osd.6 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:46.388959+0000 front 2019-11-29T21:40:46.410140+0000 (oldest deadline 2019-11-29T21:41:31.026803+0000) 2019-11-29T21:41:43.054 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:41:43.050+0000 1694c700 -1 osd.2 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:41.801621+0000 front 2019-11-29T21:40:41.617384+0000 (oldest deadline 2019-11-29T21:41:26.828654+0000) 2019-11-29T21:41:43.259 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:41:43.254+0000 1694c700 -1 osd.1 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:43.719545+0000 front 2019-11-29T21:40:44.534028+0000 (oldest deadline 2019-11-29T21:41:27.124438+0000) 2019-11-29T21:41:43.279 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:41:43.274+0000 1694c700 -1 osd.4 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:45.707023+0000 front 2019-11-29T21:40:45.886556+0000 (oldest deadline 2019-11-29T21:41:31.583551+0000) 2019-11-29T21:41:43.443 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:41:43.438+0000 1694c700 -1 osd.7 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:45.355645+0000 front 2019-11-29T21:40:45.354239+0000 (oldest deadline 2019-11-29T21:41:29.643688+0000) 2019-11-29T21:41:43.926 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:41:43.921+0000 1694c700 -1 osd.0 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:42.406229+0000 front 2019-11-29T21:40:42.193679+0000 (oldest deadline 2019-11-29T21:41:26.829603+0000) 2019-11-29T21:41:44.064 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:41:44.059+0000 1694c700 -1 osd.6 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:46.388959+0000 front 2019-11-29T21:40:46.410140+0000 (oldest deadline 2019-11-29T21:41:31.026803+0000) 2019-11-29T21:41:44.094 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:41:44.088+0000 1694c700 -1 osd.2 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:41.801621+0000 front 2019-11-29T21:40:41.617384+0000 (oldest deadline 2019-11-29T21:41:26.828654+0000) 2019-11-29T21:41:44.243 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:41:44.238+0000 1694c700 -1 osd.1 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:43.719545+0000 front 2019-11-29T21:40:44.534028+0000 (oldest deadline 2019-11-29T21:41:27.124438+0000) 2019-11-29T21:41:44.286 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:41:44.281+0000 1694c700 -1 osd.4 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:45.707023+0000 front 2019-11-29T21:40:45.886556+0000 (oldest deadline 2019-11-29T21:41:31.583551+0000) 2019-11-29T21:41:44.484 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:41:44.479+0000 1694c700 -1 osd.7 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:45.355645+0000 front 2019-11-29T21:40:45.354239+0000 (oldest deadline 2019-11-29T21:41:29.643688+0000) 2019-11-29T21:41:44.960 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:41:44.953+0000 1694c700 -1 osd.0 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:42.406229+0000 front 2019-11-29T21:40:42.193679+0000 (oldest deadline 2019-11-29T21:41:26.829603+0000) 2019-11-29T21:41:45.049 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:41:45.044+0000 1694c700 -1 osd.2 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:41.801621+0000 front 2019-11-29T21:40:41.617384+0000 (oldest deadline 2019-11-29T21:41:26.828654+0000) 2019-11-29T21:41:45.114 INFO:tasks.ceph.osd.6.smithi022.stderr:2019-11-29T21:41:45.109+0000 1694c700 -1 osd.6 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:46.388959+0000 front 2019-11-29T21:40:46.410140+0000 (oldest deadline 2019-11-29T21:41:31.026803+0000) 2019-11-29T21:41:45.246 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:41:45.240+0000 1694c700 -1 osd.1 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:43.719545+0000 front 2019-11-29T21:40:44.534028+0000 (oldest deadline 2019-11-29T21:41:27.124438+0000) 2019-11-29T21:41:45.325 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:41:45.321+0000 1694c700 -1 osd.4 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:45.707023+0000 front 2019-11-29T21:40:45.886556+0000 (oldest deadline 2019-11-29T21:41:31.583551+0000) 2019-11-29T21:41:45.536 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:41:45.532+0000 1694c700 -1 osd.7 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:45.355645+0000 front 2019-11-29T21:40:45.354239+0000 (oldest deadline 2019-11-29T21:41:29.643688+0000) 2019-11-29T21:41:45.955 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:41:45.949+0000 1694c700 -1 osd.0 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:42.406229+0000 front 2019-11-29T21:40:42.193679+0000 (oldest deadline 2019-11-29T21:41:26.829603+0000) 2019-11-29T21:41:46.081 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:41:46.076+0000 1694c700 -1 osd.2 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:41.801621+0000 front 2019-11-29T21:40:41.617384+0000 (oldest deadline 2019-11-29T21:41:26.828654+0000) 2019-11-29T21:41:46.211 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:41:46.206+0000 1694c700 -1 osd.1 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:43.719545+0000 front 2019-11-29T21:40:44.534028+0000 (oldest deadline 2019-11-29T21:41:27.124438+0000) 2019-11-29T21:41:46.377 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:41:46.373+0000 1694c700 -1 osd.4 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:45.707023+0000 front 2019-11-29T21:40:45.886556+0000 (oldest deadline 2019-11-29T21:41:31.583551+0000) 2019-11-29T21:41:46.562 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:41:46.558+0000 1694c700 -1 osd.7 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:45.355645+0000 front 2019-11-29T21:40:45.354239+0000 (oldest deadline 2019-11-29T21:41:29.643688+0000) 2019-11-29T21:41:47.003 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:41:46.997+0000 1694c700 -1 osd.0 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:42.406229+0000 front 2019-11-29T21:40:42.193679+0000 (oldest deadline 2019-11-29T21:41:26.829603+0000) 2019-11-29T21:41:47.094 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:41:47.088+0000 1694c700 -1 osd.2 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:41.801621+0000 front 2019-11-29T21:40:41.617384+0000 (oldest deadline 2019-11-29T21:41:26.828654+0000) 2019-11-29T21:41:47.238 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:41:47.234+0000 1694c700 -1 osd.1 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:43.719545+0000 front 2019-11-29T21:40:44.534028+0000 (oldest deadline 2019-11-29T21:41:27.124438+0000) 2019-11-29T21:41:47.351 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:41:47.347+0000 1694c700 -1 osd.4 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:45.707023+0000 front 2019-11-29T21:40:45.886556+0000 (oldest deadline 2019-11-29T21:41:31.583551+0000) 2019-11-29T21:41:47.528 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:41:47.523+0000 1694c700 -1 osd.7 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:45.355645+0000 front 2019-11-29T21:40:45.354239+0000 (oldest deadline 2019-11-29T21:41:29.643688+0000) 2019-11-29T21:41:47.985 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:41:47.981+0000 1694c700 -1 osd.0 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:42.406229+0000 front 2019-11-29T21:40:42.193679+0000 (oldest deadline 2019-11-29T21:41:26.829603+0000) 2019-11-29T21:41:48.115 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:41:48.109+0000 1694c700 -1 osd.2 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:41.801621+0000 front 2019-11-29T21:40:41.617384+0000 (oldest deadline 2019-11-29T21:41:26.828654+0000) 2019-11-29T21:41:48.248 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:41:48.243+0000 1694c700 -1 osd.1 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:43.719545+0000 front 2019-11-29T21:40:44.534028+0000 (oldest deadline 2019-11-29T21:41:27.124438+0000) 2019-11-29T21:41:48.348 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:41:48.339+0000 1694c700 -1 osd.4 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:45.707023+0000 front 2019-11-29T21:40:45.886556+0000 (oldest deadline 2019-11-29T21:41:31.583551+0000) 2019-11-29T21:41:48.534 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:41:48.529+0000 1694c700 -1 osd.7 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:45.355645+0000 front 2019-11-29T21:40:45.354239+0000 (oldest deadline 2019-11-29T21:41:29.643688+0000) 2019-11-29T21:41:49.007 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:41:49.002+0000 1694c700 -1 osd.0 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:42.406229+0000 front 2019-11-29T21:40:42.193679+0000 (oldest deadline 2019-11-29T21:41:26.829603+0000) 2019-11-29T21:41:49.084 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:41:49.079+0000 1694c700 -1 osd.2 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:41.801621+0000 front 2019-11-29T21:40:41.617384+0000 (oldest deadline 2019-11-29T21:41:26.828654+0000) 2019-11-29T21:41:49.253 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:41:49.249+0000 1694c700 -1 osd.1 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:43.719545+0000 front 2019-11-29T21:40:44.534028+0000 (oldest deadline 2019-11-29T21:41:27.124438+0000) 2019-11-29T21:41:49.367 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:41:49.362+0000 1694c700 -1 osd.4 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:45.707023+0000 front 2019-11-29T21:40:45.886556+0000 (oldest deadline 2019-11-29T21:41:31.583551+0000) 2019-11-29T21:41:49.529 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:41:49.524+0000 1694c700 -1 osd.7 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:45.355645+0000 front 2019-11-29T21:40:45.354239+0000 (oldest deadline 2019-11-29T21:41:29.643688+0000) 2019-11-29T21:41:50.047 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:41:50.042+0000 1694c700 -1 osd.0 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:42.406229+0000 front 2019-11-29T21:40:42.193679+0000 (oldest deadline 2019-11-29T21:41:26.829603+0000) 2019-11-29T21:41:50.109 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:41:50.105+0000 1694c700 -1 osd.2 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:41.801621+0000 front 2019-11-29T21:40:41.617384+0000 (oldest deadline 2019-11-29T21:41:26.828654+0000) 2019-11-29T21:41:50.239 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:41:50.233+0000 1694c700 -1 osd.1 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:43.719545+0000 front 2019-11-29T21:40:44.534028+0000 (oldest deadline 2019-11-29T21:41:27.124438+0000) 2019-11-29T21:41:50.387 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:41:50.383+0000 1694c700 -1 osd.4 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:45.707023+0000 front 2019-11-29T21:40:45.886556+0000 (oldest deadline 2019-11-29T21:41:31.583551+0000) 2019-11-29T21:41:50.567 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:41:50.562+0000 1694c700 -1 osd.7 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:45.355645+0000 front 2019-11-29T21:40:45.354239+0000 (oldest deadline 2019-11-29T21:41:29.643688+0000) 2019-11-29T21:41:51.099 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:41:51.094+0000 1694c700 -1 osd.0 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:42.406229+0000 front 2019-11-29T21:40:42.193679+0000 (oldest deadline 2019-11-29T21:41:26.829603+0000) 2019-11-29T21:41:51.149 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:41:51.144+0000 1694c700 -1 osd.2 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:41.801621+0000 front 2019-11-29T21:40:41.617384+0000 (oldest deadline 2019-11-29T21:41:26.828654+0000) 2019-11-29T21:41:51.267 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:41:51.262+0000 1694c700 -1 osd.1 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:43.719545+0000 front 2019-11-29T21:40:44.534028+0000 (oldest deadline 2019-11-29T21:41:27.124438+0000) 2019-11-29T21:41:51.392 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:41:51.387+0000 1694c700 -1 osd.4 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:45.707023+0000 front 2019-11-29T21:40:45.886556+0000 (oldest deadline 2019-11-29T21:41:31.583551+0000) 2019-11-29T21:41:51.603 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:41:51.598+0000 1694c700 -1 osd.7 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:45.355645+0000 front 2019-11-29T21:40:45.354239+0000 (oldest deadline 2019-11-29T21:41:29.643688+0000) 2019-11-29T21:41:52.071 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:41:52.066+0000 1694c700 -1 osd.0 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:42.406229+0000 front 2019-11-29T21:40:42.193679+0000 (oldest deadline 2019-11-29T21:41:26.829603+0000) 2019-11-29T21:41:52.126 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:41:52.120+0000 1694c700 -1 osd.2 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:41.801621+0000 front 2019-11-29T21:40:41.617384+0000 (oldest deadline 2019-11-29T21:41:26.828654+0000) 2019-11-29T21:41:52.238 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:41:52.234+0000 1694c700 -1 osd.1 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:43.719545+0000 front 2019-11-29T21:40:44.534028+0000 (oldest deadline 2019-11-29T21:41:27.124438+0000) 2019-11-29T21:41:52.425 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:41:52.421+0000 1694c700 -1 osd.4 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:45.707023+0000 front 2019-11-29T21:40:45.886556+0000 (oldest deadline 2019-11-29T21:41:31.583551+0000) 2019-11-29T21:41:52.577 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:41:52.572+0000 1694c700 -1 osd.7 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:45.355645+0000 front 2019-11-29T21:40:45.354239+0000 (oldest deadline 2019-11-29T21:41:29.643688+0000) 2019-11-29T21:41:53.026 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:41:53.021+0000 1694c700 -1 osd.0 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:42.406229+0000 front 2019-11-29T21:40:42.193679+0000 (oldest deadline 2019-11-29T21:41:26.829603+0000) 2019-11-29T21:41:53.160 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:41:53.154+0000 1694c700 -1 osd.2 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:41.801621+0000 front 2019-11-29T21:40:41.617384+0000 (oldest deadline 2019-11-29T21:41:26.828654+0000) 2019-11-29T21:41:53.250 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:41:53.245+0000 1694c700 -1 osd.1 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:43.719545+0000 front 2019-11-29T21:40:44.534028+0000 (oldest deadline 2019-11-29T21:41:27.124438+0000) 2019-11-29T21:41:53.482 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:41:53.476+0000 1694c700 -1 osd.4 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:45.707023+0000 front 2019-11-29T21:40:45.886556+0000 (oldest deadline 2019-11-29T21:41:31.583551+0000) 2019-11-29T21:41:53.577 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:41:53.573+0000 1694c700 -1 osd.7 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:45.355645+0000 front 2019-11-29T21:40:45.354239+0000 (oldest deadline 2019-11-29T21:41:29.643688+0000) 2019-11-29T21:41:54.080 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:41:54.073+0000 1694c700 -1 osd.0 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:42.406229+0000 front 2019-11-29T21:40:42.193679+0000 (oldest deadline 2019-11-29T21:41:26.829603+0000) 2019-11-29T21:41:54.212 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:41:54.207+0000 1694c700 -1 osd.2 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:41.801621+0000 front 2019-11-29T21:40:41.617384+0000 (oldest deadline 2019-11-29T21:41:26.828654+0000) 2019-11-29T21:41:54.238 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:41:54.233+0000 1694c700 -1 osd.1 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:43.719545+0000 front 2019-11-29T21:40:44.534028+0000 (oldest deadline 2019-11-29T21:41:27.124438+0000) 2019-11-29T21:41:54.526 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:41:54.522+0000 1694c700 -1 osd.4 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:45.707023+0000 front 2019-11-29T21:40:45.886556+0000 (oldest deadline 2019-11-29T21:41:31.583551+0000) 2019-11-29T21:41:54.543 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:41:54.539+0000 1694c700 -1 osd.7 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:45.355645+0000 front 2019-11-29T21:40:45.354239+0000 (oldest deadline 2019-11-29T21:41:29.643688+0000) 2019-11-29T21:41:55.131 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:41:55.126+0000 1694c700 -1 osd.0 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:42.406229+0000 front 2019-11-29T21:40:42.193679+0000 (oldest deadline 2019-11-29T21:41:26.829603+0000) 2019-11-29T21:41:55.235 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:41:55.231+0000 1694c700 -1 osd.2 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:41.801621+0000 front 2019-11-29T21:40:41.617384+0000 (oldest deadline 2019-11-29T21:41:26.828654+0000) 2019-11-29T21:41:55.256 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:41:55.244+0000 1694c700 -1 osd.1 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:43.719545+0000 front 2019-11-29T21:40:44.534028+0000 (oldest deadline 2019-11-29T21:41:27.124438+0000) 2019-11-29T21:41:55.256 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:41:55.246+0000 1694c700 -1 osd.1 383 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130660 7.0 7:02683654:reshard::reshard.0000000010:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e383) 2019-11-29T21:41:55.554 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:41:55.548+0000 1694c700 -1 osd.4 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:45.707023+0000 front 2019-11-29T21:40:45.886556+0000 (oldest deadline 2019-11-29T21:41:31.583551+0000) 2019-11-29T21:41:55.561 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:41:55.556+0000 1694c700 -1 osd.7 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:45.355645+0000 front 2019-11-29T21:40:45.354239+0000 (oldest deadline 2019-11-29T21:41:29.643688+0000) 2019-11-29T21:41:56.149 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:41:56.145+0000 1694c700 -1 osd.0 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:42.406229+0000 front 2019-11-29T21:40:42.193679+0000 (oldest deadline 2019-11-29T21:41:26.829603+0000) 2019-11-29T21:41:56.223 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:41:56.218+0000 1694c700 -1 osd.2 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:41.801621+0000 front 2019-11-29T21:40:41.617384+0000 (oldest deadline 2019-11-29T21:41:26.828654+0000) 2019-11-29T21:41:56.300 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:41:56.282+0000 1694c700 -1 osd.1 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:43.719545+0000 front 2019-11-29T21:40:44.534028+0000 (oldest deadline 2019-11-29T21:41:27.124438+0000) 2019-11-29T21:41:56.301 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:41:56.284+0000 1694c700 -1 osd.1 383 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130660 7.0 7:02683654:reshard::reshard.0000000010:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e383) 2019-11-29T21:41:56.555 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:41:56.548+0000 1694c700 -1 osd.7 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:45.355645+0000 front 2019-11-29T21:40:45.354239+0000 (oldest deadline 2019-11-29T21:41:29.643688+0000) 2019-11-29T21:41:56.584 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:41:56.579+0000 1694c700 -1 osd.4 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:45.707023+0000 front 2019-11-29T21:40:45.886556+0000 (oldest deadline 2019-11-29T21:41:31.583551+0000) 2019-11-29T21:41:57.180 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:41:57.175+0000 1694c700 -1 osd.2 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:41.801621+0000 front 2019-11-29T21:40:41.617384+0000 (oldest deadline 2019-11-29T21:41:26.828654+0000) 2019-11-29T21:41:57.200 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:41:57.194+0000 1694c700 -1 osd.0 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:42.406229+0000 front 2019-11-29T21:40:42.193679+0000 (oldest deadline 2019-11-29T21:41:26.829603+0000) 2019-11-29T21:41:57.266 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:41:57.250+0000 1694c700 -1 osd.1 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:43.719545+0000 front 2019-11-29T21:40:44.534028+0000 (oldest deadline 2019-11-29T21:41:27.124438+0000) 2019-11-29T21:41:57.266 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:41:57.252+0000 1694c700 -1 osd.1 383 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130660 7.0 7:02683654:reshard::reshard.0000000010:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e383) 2019-11-29T21:41:57.537 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:41:57.533+0000 1694c700 -1 osd.4 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:45.707023+0000 front 2019-11-29T21:40:45.886556+0000 (oldest deadline 2019-11-29T21:41:31.583551+0000) 2019-11-29T21:41:57.583 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:41:57.579+0000 1694c700 -1 osd.7 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:45.355645+0000 front 2019-11-29T21:40:45.354239+0000 (oldest deadline 2019-11-29T21:41:29.643688+0000) 2019-11-29T21:41:58.166 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:41:58.162+0000 1694c700 -1 osd.2 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:41.801621+0000 front 2019-11-29T21:40:41.617384+0000 (oldest deadline 2019-11-29T21:41:26.828654+0000) 2019-11-29T21:41:58.211 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:41:58.205+0000 1694c700 -1 osd.0 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:42.406229+0000 front 2019-11-29T21:40:42.193679+0000 (oldest deadline 2019-11-29T21:41:26.829603+0000) 2019-11-29T21:41:58.253 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:41:58.247+0000 1694c700 -1 osd.1 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:43.719545+0000 front 2019-11-29T21:40:44.534028+0000 (oldest deadline 2019-11-29T21:41:27.124438+0000) 2019-11-29T21:41:58.254 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:41:58.248+0000 1694c700 -1 osd.1 383 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130660 7.0 7:02683654:reshard::reshard.0000000010:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e383) 2019-11-29T21:41:58.521 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:41:58.516+0000 1694c700 -1 osd.4 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:45.707023+0000 front 2019-11-29T21:40:45.886556+0000 (oldest deadline 2019-11-29T21:41:31.583551+0000) 2019-11-29T21:41:58.564 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:41:58.559+0000 1694c700 -1 osd.7 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:45.355645+0000 front 2019-11-29T21:40:45.354239+0000 (oldest deadline 2019-11-29T21:41:29.643688+0000) 2019-11-29T21:41:59.168 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:41:59.163+0000 1694c700 -1 osd.2 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:41.801621+0000 front 2019-11-29T21:40:41.617384+0000 (oldest deadline 2019-11-29T21:41:26.828654+0000) 2019-11-29T21:41:59.217 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:41:59.212+0000 1694c700 -1 osd.0 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:42.406229+0000 front 2019-11-29T21:40:42.193679+0000 (oldest deadline 2019-11-29T21:41:26.829603+0000) 2019-11-29T21:41:59.221 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:41:59.216+0000 1694c700 -1 osd.1 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:43.719545+0000 front 2019-11-29T21:40:44.534028+0000 (oldest deadline 2019-11-29T21:41:27.124438+0000) 2019-11-29T21:41:59.222 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:41:59.217+0000 1694c700 -1 osd.1 383 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130660 7.0 7:02683654:reshard::reshard.0000000010:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e383) 2019-11-29T21:41:59.515 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:41:59.510+0000 1694c700 -1 osd.4 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:45.707023+0000 front 2019-11-29T21:40:45.886556+0000 (oldest deadline 2019-11-29T21:41:31.583551+0000) 2019-11-29T21:41:59.551 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:41:59.546+0000 1694c700 -1 osd.7 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:45.355645+0000 front 2019-11-29T21:40:45.354239+0000 (oldest deadline 2019-11-29T21:41:29.643688+0000) 2019-11-29T21:42:00.202 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:42:00.198+0000 1694c700 -1 osd.2 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:41.801621+0000 front 2019-11-29T21:40:41.617384+0000 (oldest deadline 2019-11-29T21:41:26.828654+0000) 2019-11-29T21:42:00.219 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:42:00.213+0000 1694c700 -1 osd.1 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:43.719545+0000 front 2019-11-29T21:40:44.534028+0000 (oldest deadline 2019-11-29T21:41:27.124438+0000) 2019-11-29T21:42:00.220 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:42:00.215+0000 1694c700 -1 osd.1 383 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130660 7.0 7:02683654:reshard::reshard.0000000010:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e383) 2019-11-29T21:42:00.220 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:42:00.214+0000 1694c700 -1 osd.0 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:42.406229+0000 front 2019-11-29T21:40:42.193679+0000 (oldest deadline 2019-11-29T21:41:26.829603+0000) 2019-11-29T21:42:00.514 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:42:00.509+0000 1694c700 -1 osd.4 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:45.707023+0000 front 2019-11-29T21:40:45.886556+0000 (oldest deadline 2019-11-29T21:41:31.583551+0000) 2019-11-29T21:42:00.565 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:42:00.561+0000 1694c700 -1 osd.7 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:45.355645+0000 front 2019-11-29T21:40:45.354239+0000 (oldest deadline 2019-11-29T21:41:29.643688+0000) 2019-11-29T21:42:01.216 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:42:01.211+0000 1694c700 -1 osd.0 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:42.406229+0000 front 2019-11-29T21:40:42.193679+0000 (oldest deadline 2019-11-29T21:41:26.829603+0000) 2019-11-29T21:42:01.216 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:42:01.212+0000 1694c700 -1 osd.2 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:41.801621+0000 front 2019-11-29T21:40:41.617384+0000 (oldest deadline 2019-11-29T21:41:26.828654+0000) 2019-11-29T21:42:01.224 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:42:01.220+0000 1694c700 -1 osd.1 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:43.719545+0000 front 2019-11-29T21:40:44.534028+0000 (oldest deadline 2019-11-29T21:41:27.124438+0000) 2019-11-29T21:42:01.227 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:42:01.223+0000 1694c700 -1 osd.1 383 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130660 7.0 7:02683654:reshard::reshard.0000000010:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e383) 2019-11-29T21:42:01.480 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:42:01.474+0000 1694c700 -1 osd.4 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:45.707023+0000 front 2019-11-29T21:40:45.886556+0000 (oldest deadline 2019-11-29T21:41:31.583551+0000) 2019-11-29T21:42:01.577 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:42:01.571+0000 1694c700 -1 osd.7 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:45.355645+0000 front 2019-11-29T21:40:45.354239+0000 (oldest deadline 2019-11-29T21:41:29.643688+0000) 2019-11-29T21:42:02.143 INFO:tasks.ceph.mon.b.smithi022.stderr:2019-11-29T21:42:02.138+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 4 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.22:6818/9264,v1:172.21.15.22:6819/9264] for 47sec e383 v383) 2019-11-29T21:42:02.184 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:42:02.178+0000 1694c700 -1 osd.1 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:43.719545+0000 front 2019-11-29T21:40:44.534028+0000 (oldest deadline 2019-11-29T21:41:27.124438+0000) 2019-11-29T21:42:02.185 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:42:02.180+0000 1694c700 -1 osd.1 383 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130660 7.0 7:02683654:reshard::reshard.0000000010:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e383) 2019-11-29T21:42:02.210 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:42:02.204+0000 1694c700 -1 osd.2 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:41.801621+0000 front 2019-11-29T21:40:41.617384+0000 (oldest deadline 2019-11-29T21:41:26.828654+0000) 2019-11-29T21:42:02.216 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:42:02.211+0000 1694c700 -1 osd.0 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:42.406229+0000 front 2019-11-29T21:40:42.193679+0000 (oldest deadline 2019-11-29T21:41:26.829603+0000) 2019-11-29T21:42:02.468 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:42:02.464+0000 1694c700 -1 osd.4 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:45.707023+0000 front 2019-11-29T21:40:45.886556+0000 (oldest deadline 2019-11-29T21:41:31.583551+0000) 2019-11-29T21:42:02.606 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:42:02.600+0000 1694c700 -1 osd.7 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:45.355645+0000 front 2019-11-29T21:40:45.354239+0000 (oldest deadline 2019-11-29T21:41:29.643688+0000) 2019-11-29T21:42:03.190 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:42:03.185+0000 1694c700 -1 osd.2 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:41.801621+0000 front 2019-11-29T21:40:41.617384+0000 (oldest deadline 2019-11-29T21:41:26.828654+0000) 2019-11-29T21:42:03.202 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:42:03.198+0000 1694c700 -1 osd.0 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:42.406229+0000 front 2019-11-29T21:40:42.193679+0000 (oldest deadline 2019-11-29T21:41:26.829603+0000) 2019-11-29T21:42:03.212 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:42:03.207+0000 1694c700 -1 osd.1 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:43.719545+0000 front 2019-11-29T21:40:44.534028+0000 (oldest deadline 2019-11-29T21:41:27.124438+0000) 2019-11-29T21:42:03.214 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:42:03.210+0000 1694c700 -1 osd.1 383 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130660 7.0 7:02683654:reshard::reshard.0000000010:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e383) 2019-11-29T21:42:03.511 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:42:03.504+0000 1694c700 -1 osd.4 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:45.707023+0000 front 2019-11-29T21:40:45.886556+0000 (oldest deadline 2019-11-29T21:41:31.583551+0000) 2019-11-29T21:42:03.626 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:42:03.620+0000 1694c700 -1 osd.7 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:45.355645+0000 front 2019-11-29T21:40:45.354239+0000 (oldest deadline 2019-11-29T21:41:29.643688+0000) 2019-11-29T21:42:04.183 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:42:04.179+0000 1694c700 -1 osd.1 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:43.719545+0000 front 2019-11-29T21:40:44.534028+0000 (oldest deadline 2019-11-29T21:41:27.124438+0000) 2019-11-29T21:42:04.186 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:42:04.182+0000 1694c700 -1 osd.1 383 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130660 7.0 7:02683654:reshard::reshard.0000000010:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e383) 2019-11-29T21:42:04.207 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:42:04.203+0000 1694c700 -1 osd.2 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:41.801621+0000 front 2019-11-29T21:40:41.617384+0000 (oldest deadline 2019-11-29T21:41:26.828654+0000) 2019-11-29T21:42:04.254 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:42:04.249+0000 1694c700 -1 osd.0 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:42.406229+0000 front 2019-11-29T21:40:42.193679+0000 (oldest deadline 2019-11-29T21:41:26.829603+0000) 2019-11-29T21:42:04.509 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:42:04.504+0000 1694c700 -1 osd.4 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:45.707023+0000 front 2019-11-29T21:40:45.886556+0000 (oldest deadline 2019-11-29T21:41:31.583551+0000) 2019-11-29T21:42:04.664 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:42:04.659+0000 1694c700 -1 osd.7 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:45.355645+0000 front 2019-11-29T21:40:45.354239+0000 (oldest deadline 2019-11-29T21:41:29.643688+0000) 2019-11-29T21:42:05.139 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:42:05.135+0000 1694c700 -1 osd.1 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:43.719545+0000 front 2019-11-29T21:40:44.534028+0000 (oldest deadline 2019-11-29T21:41:27.124438+0000) 2019-11-29T21:42:05.140 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:42:05.136+0000 1694c700 -1 osd.1 383 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130660 7.0 7:02683654:reshard::reshard.0000000010:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e383) 2019-11-29T21:42:05.229 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:42:05.224+0000 1694c700 -1 osd.2 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:41.801621+0000 front 2019-11-29T21:40:41.617384+0000 (oldest deadline 2019-11-29T21:41:26.828654+0000) 2019-11-29T21:42:05.288 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:42:05.283+0000 1694c700 -1 osd.0 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:42.406229+0000 front 2019-11-29T21:40:42.193679+0000 (oldest deadline 2019-11-29T21:41:26.829603+0000) 2019-11-29T21:42:05.494 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:42:05.488+0000 1694c700 -1 osd.4 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:45.707023+0000 front 2019-11-29T21:40:45.886556+0000 (oldest deadline 2019-11-29T21:41:31.583551+0000) 2019-11-29T21:42:05.657 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:42:05.652+0000 1694c700 -1 osd.7 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:45.355645+0000 front 2019-11-29T21:40:45.354239+0000 (oldest deadline 2019-11-29T21:41:29.643688+0000) 2019-11-29T21:42:06.192 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:42:06.187+0000 1694c700 -1 osd.1 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:43.719545+0000 front 2019-11-29T21:40:44.534028+0000 (oldest deadline 2019-11-29T21:41:27.124438+0000) 2019-11-29T21:42:06.193 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:42:06.189+0000 1694c700 -1 osd.1 383 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130660 7.0 7:02683654:reshard::reshard.0000000010:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e383) 2019-11-29T21:42:06.193 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:42:06.189+0000 1694c700 -1 osd.2 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:41.801621+0000 front 2019-11-29T21:40:41.617384+0000 (oldest deadline 2019-11-29T21:41:26.828654+0000) 2019-11-29T21:42:06.257 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:42:06.252+0000 1694c700 -1 osd.0 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:42.406229+0000 front 2019-11-29T21:40:42.193679+0000 (oldest deadline 2019-11-29T21:41:26.829603+0000) 2019-11-29T21:42:06.458 INFO:tasks.ceph.osd.4.smithi022.stderr:2019-11-29T21:42:06.453+0000 1694c700 -1 osd.4 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:45.707023+0000 front 2019-11-29T21:40:45.886556+0000 (oldest deadline 2019-11-29T21:41:31.583551+0000) 2019-11-29T21:42:06.617 INFO:tasks.ceph.osd.7.smithi022.stderr:2019-11-29T21:42:06.613+0000 1694c700 -1 osd.7 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:45.355645+0000 front 2019-11-29T21:40:45.354239+0000 (oldest deadline 2019-11-29T21:41:29.643688+0000) 2019-11-29T21:42:07.211 INFO:tasks.ceph.mon.b.smithi022.stderr:2019-11-29T21:42:07.203+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.22:6818/9264,v1:172.21.15.22:6819/9264] for 47sec e383 v383) 2019-11-29T21:42:07.220 INFO:tasks.ceph.osd.0.smithi062.stderr:2019-11-29T21:42:07.215+0000 1694c700 -1 osd.0 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:42.406229+0000 front 2019-11-29T21:40:42.193679+0000 (oldest deadline 2019-11-29T21:41:26.829603+0000) 2019-11-29T21:42:07.229 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:42:07.223+0000 1694c700 -1 osd.1 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:43.719545+0000 front 2019-11-29T21:40:44.534028+0000 (oldest deadline 2019-11-29T21:41:27.124438+0000) 2019-11-29T21:42:07.232 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:42:07.227+0000 1694c700 -1 osd.1 383 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130660 7.0 7:02683654:reshard::reshard.0000000010:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e383) 2019-11-29T21:42:07.232 INFO:tasks.ceph.osd.2.smithi062.stderr:2019-11-29T21:42:07.226+0000 1694c700 -1 osd.2 383 heartbeat_check: no reply from 172.21.15.22:6824 osd.5 since back 2019-11-29T21:40:41.801621+0000 front 2019-11-29T21:40:41.617384+0000 (oldest deadline 2019-11-29T21:41:26.828654+0000) 2019-11-29T21:42:08.243 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:42:08.240+0000 1694c700 -1 osd.1 384 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130660 7.0 7:02683654:reshard::reshard.0000000010:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e383) 2019-11-29T21:42:09.839 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:42:09.742+0000 1694c700 -1 osd.1 385 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130660 7.0 7:02683654:reshard::reshard.0000000010:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e383) 2019-11-29T21:42:11.202 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:42:10.759+0000 1694c700 -1 osd.1 385 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130660 7.0 7:02683654:reshard::reshard.0000000010:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e383) 2019-11-29T21:42:11.970 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:42:11.879+0000 1694c700 -1 osd.1 385 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130660 7.0 7:02683654:reshard::reshard.0000000010:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e383) 2019-11-29T21:42:13.046 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:42:12.906+0000 1694c700 -1 osd.1 385 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4331.0:130660 7.0 7:02683654:reshard::reshard.0000000010:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e383) 2019-11-29T21:42:52.580 INFO:tasks.ceph.osd.1.smithi062.stderr:*** Caught signal (Segmentation fault) ** 2019-11-29T21:42:52.580 INFO:tasks.ceph.osd.1.smithi062.stderr: in thread 114ab700 thread_name:msgr-worker-0 2019-11-29T21:42:52.714 INFO:tasks.ceph.osd.1.smithi062.stderr: ceph version 15.0.0-7809-g656c8e8 (656c8e8049c2c1acd363143c842c2edf1fe09b64) octopus (dev) 2019-11-29T21:42:52.714 INFO:tasks.ceph.osd.1.smithi062.stderr: 1: (()+0xf5f0) [0xc09b5f0] 2019-11-29T21:42:52.714 INFO:tasks.ceph.osd.1.smithi062.stderr: 2: (MonClient::handle_auth_done(Connection*, AuthConnectionMeta*, unsigned long, unsigned int, ceph::buffer::v14_2_0::list const&, CryptoKey*, std::string*)+0x71) [0xe89561] 2019-11-29T21:42:52.714 INFO:tasks.ceph.osd.1.smithi062.stderr: 3: (ProtocolV2::handle_auth_done(ceph::buffer::v14_2_0::list&)+0x2e0) [0x100abc0] 2019-11-29T21:42:52.715 INFO:tasks.ceph.osd.1.smithi062.stderr: 4: (ProtocolV2::handle_frame_payload()+0x1d3) [0x1017963] 2019-11-29T21:42:52.715 INFO:tasks.ceph.osd.1.smithi062.stderr: 5: (ProtocolV2::handle_read_frame_dispatch()+0x150) [0x1017be0] 2019-11-29T21:42:52.715 INFO:tasks.ceph.osd.1.smithi062.stderr: 6: (ProtocolV2::handle_read_frame_epilogue_main(std::unique_ptr&&, int)+0x44d) [0x101813d] 2019-11-29T21:42:52.715 INFO:tasks.ceph.osd.1.smithi062.stderr: 7: (ProtocolV2::run_continuation(Ct&)+0x34) [0x1000dc4] 2019-11-29T21:42:52.715 INFO:tasks.ceph.osd.1.smithi062.stderr: 8: (AsyncConnection::process()+0x794) [0xfdb414] 2019-11-29T21:42:52.715 INFO:tasks.ceph.osd.1.smithi062.stderr: 9: (EventCenter::process_events(unsigned int, std::chrono::duration >*)+0xa25) [0xe3c905] 2019-11-29T21:42:52.715 INFO:tasks.ceph.osd.1.smithi062.stderr: 10: (()+0xd3a317) [0xe42317] 2019-11-29T21:42:52.716 INFO:tasks.ceph.osd.1.smithi062.stderr: 11: (()+0x12121ff) [0x131a1ff] 2019-11-29T21:42:52.716 INFO:tasks.ceph.osd.1.smithi062.stderr: 12: (()+0x7e65) [0xc093e65] 2019-11-29T21:42:52.716 INFO:tasks.ceph.osd.1.smithi062.stderr: 13: (clone()+0x6d) [0xd20b88d] 2019-11-29T21:42:52.902 INFO:tasks.ceph.osd.1.smithi062.stderr:2019-11-29T21:42:52.894+0000 114ab700 -1 *** Caught signal (Segmentation fault) ** 2019-11-29T21:42:52.903 INFO:tasks.ceph.osd.1.smithi062.stderr: in thread 114ab700 thread_name:msgr-worker-0 2019-11-29T21:42:52.903 INFO:tasks.ceph.osd.1.smithi062.stderr: 2019-11-29T21:42:52.903 INFO:tasks.ceph.osd.1.smithi062.stderr: ceph version 15.0.0-7809-g656c8e8 (656c8e8049c2c1acd363143c842c2edf1fe09b64) octopus (dev) 2019-11-29T21:42:52.903 INFO:tasks.ceph.osd.1.smithi062.stderr: 1: (()+0xf5f0) [0xc09b5f0] 2019-11-29T21:42:52.903 INFO:tasks.ceph.osd.1.smithi062.stderr: 2: (MonClient::handle_auth_done(Connection*, AuthConnectionMeta*, unsigned long, unsigned int, ceph::buffer::v14_2_0::list const&, CryptoKey*, std::string*)+0x71) [0xe89561] 2019-11-29T21:42:52.903 INFO:tasks.ceph.osd.1.smithi062.stderr: 3: (ProtocolV2::handle_auth_done(ceph::buffer::v14_2_0::list&)+0x2e0) [0x100abc0] 2019-11-29T21:42:52.903 INFO:tasks.ceph.osd.1.smithi062.stderr: 4: (ProtocolV2::handle_frame_payload()+0x1d3) [0x1017963] 2019-11-29T21:42:52.904 INFO:tasks.ceph.osd.1.smithi062.stderr: 5: (ProtocolV2::handle_read_frame_dispatch()+0x150) [0x1017be0] 2019-11-29T21:42:52.904 INFO:tasks.ceph.osd.1.smithi062.stderr: 6: (ProtocolV2::handle_read_frame_epilogue_main(std::unique_ptr&&, int)+0x44d) [0x101813d] 2019-11-29T21:42:52.904 INFO:tasks.ceph.osd.1.smithi062.stderr: 7: (ProtocolV2::run_continuation(Ct&)+0x34) [0x1000dc4] 2019-11-29T21:42:52.904 INFO:tasks.ceph.osd.1.smithi062.stderr: 8: (AsyncConnection::process()+0x794) [0xfdb414] 2019-11-29T21:42:52.904 INFO:tasks.ceph.osd.1.smithi062.stderr: 9: (EventCenter::process_events(unsigned int, std::chrono::duration >*)+0xa25) [0xe3c905] 2019-11-29T21:42:52.904 INFO:tasks.ceph.osd.1.smithi062.stderr: 10: (()+0xd3a317) [0xe42317] 2019-11-29T21:42:52.905 INFO:tasks.ceph.osd.1.smithi062.stderr: 11: (()+0x12121ff) [0x131a1ff] 2019-11-29T21:42:52.905 INFO:tasks.ceph.osd.1.smithi062.stderr: 12: (()+0x7e65) [0xc093e65] 2019-11-29T21:42:52.905 INFO:tasks.ceph.osd.1.smithi062.stderr: 13: (clone()+0x6d) [0xd20b88d] 2019-11-29T21:42:52.905 INFO:tasks.ceph.osd.1.smithi062.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2019-11-29T21:42:52.905 INFO:tasks.ceph.osd.1.smithi062.stderr: 2019-11-29T21:42:53.791 INFO:tasks.ceph.osd.1.smithi062.stderr: 0> 2019-11-29T21:42:52.894+0000 114ab700 -1 *** Caught signal (Segmentation fault) ** 2019-11-29T21:42:53.792 INFO:tasks.ceph.osd.1.smithi062.stderr: in thread 114ab700 thread_name:msgr-worker-0 2019-11-29T21:42:53.792 INFO:tasks.ceph.osd.1.smithi062.stderr: 2019-11-29T21:42:53.792 INFO:tasks.ceph.osd.1.smithi062.stderr: ceph version 15.0.0-7809-g656c8e8 (656c8e8049c2c1acd363143c842c2edf1fe09b64) octopus (dev) 2019-11-29T21:42:53.792 INFO:tasks.ceph.osd.1.smithi062.stderr: 1: (()+0xf5f0) [0xc09b5f0] 2019-11-29T21:42:53.792 INFO:tasks.ceph.osd.1.smithi062.stderr: 2: (MonClient::handle_auth_done(Connection*, AuthConnectionMeta*, unsigned long, unsigned int, ceph::buffer::v14_2_0::list const&, CryptoKey*, std::string*)+0x71) [0xe89561] 2019-11-29T21:42:53.792 INFO:tasks.ceph.osd.1.smithi062.stderr: 3: (ProtocolV2::handle_auth_done(ceph::buffer::v14_2_0::list&)+0x2e0) [0x100abc0] 2019-11-29T21:42:53.793 INFO:tasks.ceph.osd.1.smithi062.stderr: 4: (ProtocolV2::handle_frame_payload()+0x1d3) [0x1017963] 2019-11-29T21:42:53.793 INFO:tasks.ceph.osd.1.smithi062.stderr: 5: (ProtocolV2::handle_read_frame_dispatch()+0x150) [0x1017be0] 2019-11-29T21:42:53.793 INFO:tasks.ceph.osd.1.smithi062.stderr: 6: (ProtocolV2::handle_read_frame_epilogue_main(std::unique_ptr&&, int)+0x44d) [0x101813d] 2019-11-29T21:42:53.793 INFO:tasks.ceph.osd.1.smithi062.stderr: 7: (ProtocolV2::run_continuation(Ct&)+0x34) [0x1000dc4] 2019-11-29T21:42:53.793 INFO:tasks.ceph.osd.1.smithi062.stderr: 8: (AsyncConnection::process()+0x794) [0xfdb414] 2019-11-29T21:42:53.793 INFO:tasks.ceph.osd.1.smithi062.stderr: 9: (EventCenter::process_events(unsigned int, std::chrono::duration >*)+0xa25) [0xe3c905] 2019-11-29T21:42:53.793 INFO:tasks.ceph.osd.1.smithi062.stderr: 10: (()+0xd3a317) [0xe42317] 2019-11-29T21:42:53.794 INFO:tasks.ceph.osd.1.smithi062.stderr: 11: (()+0x12121ff) [0x131a1ff] 2019-11-29T21:42:53.794 INFO:tasks.ceph.osd.1.smithi062.stderr: 12: (()+0x7e65) [0xc093e65] 2019-11-29T21:42:53.794 INFO:tasks.ceph.osd.1.smithi062.stderr: 13: (clone()+0x6d) [0xd20b88d] 2019-11-29T21:42:53.794 INFO:tasks.ceph.osd.1.smithi062.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2019-11-29T21:42:53.794 INFO:tasks.ceph.osd.1.smithi062.stderr: 2019-11-29T21:42:54.452 INFO:tasks.ceph.osd.1.smithi062.stderr: -1001> 2019-11-29T21:42:52.894+0000 114ab700 -1 *** Caught signal (Segmentation fault) ** 2019-11-29T21:42:54.452 INFO:tasks.ceph.osd.1.smithi062.stderr: in thread 114ab700 thread_name:msgr-worker-0 2019-11-29T21:42:54.452 INFO:tasks.ceph.osd.1.smithi062.stderr: 2019-11-29T21:42:54.452 INFO:tasks.ceph.osd.1.smithi062.stderr: ceph version 15.0.0-7809-g656c8e8 (656c8e8049c2c1acd363143c842c2edf1fe09b64) octopus (dev) 2019-11-29T21:42:54.452 INFO:tasks.ceph.osd.1.smithi062.stderr: 1: (()+0xf5f0) [0xc09b5f0] 2019-11-29T21:42:54.452 INFO:tasks.ceph.osd.1.smithi062.stderr: 2: (MonClient::handle_auth_done(Connection*, AuthConnectionMeta*, unsigned long, unsigned int, ceph::buffer::v14_2_0::list const&, CryptoKey*, std::string*)+0x71) [0xe89561] 2019-11-29T21:42:54.453 INFO:tasks.ceph.osd.1.smithi062.stderr: 3: (ProtocolV2::handle_auth_done(ceph::buffer::v14_2_0::list&)+0x2e0) [0x100abc0] 2019-11-29T21:42:54.453 INFO:tasks.ceph.osd.1.smithi062.stderr: 4: (ProtocolV2::handle_frame_payload()+0x1d3) [0x1017963] 2019-11-29T21:42:54.453 INFO:tasks.ceph.osd.1.smithi062.stderr: 5: (ProtocolV2::handle_read_frame_dispatch()+0x150) [0x1017be0] 2019-11-29T21:42:54.453 INFO:tasks.ceph.osd.1.smithi062.stderr: 6: (ProtocolV2::handle_read_frame_epilogue_main(std::unique_ptr&&, int)+0x44d) [0x101813d] 2019-11-29T21:42:54.453 INFO:tasks.ceph.osd.1.smithi062.stderr: 7: (ProtocolV2::run_continuation(Ct&)+0x34) [0x1000dc4] 2019-11-29T21:42:54.453 INFO:tasks.ceph.osd.1.smithi062.stderr: 8: (AsyncConnection::process()+0x794) [0xfdb414] 2019-11-29T21:42:54.453 INFO:tasks.ceph.osd.1.smithi062.stderr: 9: (EventCenter::process_events(unsigned int, std::chrono::duration >*)+0xa25) [0xe3c905] 2019-11-29T21:42:54.454 INFO:tasks.ceph.osd.1.smithi062.stderr: 10: (()+0xd3a317) [0xe42317] 2019-11-29T21:42:54.454 INFO:tasks.ceph.osd.1.smithi062.stderr: 11: (()+0x12121ff) [0x131a1ff] 2019-11-29T21:42:54.454 INFO:tasks.ceph.osd.1.smithi062.stderr: 12: (()+0x7e65) [0xc093e65] 2019-11-29T21:42:54.454 INFO:tasks.ceph.osd.1.smithi062.stderr: 13: (clone()+0x6d) [0xd20b88d] 2019-11-29T21:42:54.454 INFO:tasks.ceph.osd.1.smithi062.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2019-11-29T21:42:54.454 INFO:tasks.ceph.osd.1.smithi062.stderr: 2019-11-29T21:42:57.896 INFO:tasks.ceph.osd.1.smithi062.stderr:daemon-helper: command crashed with signal 11 2019-11-29T21:45:30.941 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:09:20:11.600 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T21:45:30.995 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:09:20:11.575 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T21:45:30.995 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:09:20:11.580 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T21:45:30.995 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:09:20:11.575 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T21:45:30.995 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:09:20:11.584 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T21:45:30.996 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:09:20:11.609 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T21:45:31.247 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:09:20:11.906 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T21:45:31.264 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:09:20:11.871 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T21:45:31.269 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:09:20:11.876 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T21:47:13.747 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:09:21:54.406 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T21:47:13.771 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:09:21:54.430 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T21:47:13.789 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:09:21:54.396 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T21:47:13.790 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:09:21:54.398 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T21:47:13.834 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:09:21:54.441 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T21:47:13.852 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:09:21:54.459 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T21:47:13.879 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:09:21:54.487 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T21:47:13.893 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:09:21:54.552 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T21:47:13.954 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:09:21:54.562 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T21:50:43.268 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:09:25:23.927 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T21:50:43.282 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:09:25:23.941 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T21:50:43.301 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:09:25:23.909 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T21:50:43.302 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:09:25:23.909 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T21:50:43.306 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:09:25:23.914 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T21:50:43.313 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:09:25:23.920 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T21:50:43.485 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:09:25:24.092 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T21:50:43.512 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:09:25:24.171 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T21:50:43.517 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:09:25:24.124 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T21:53:45.846 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:09:28:26.505 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T21:53:45.865 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:09:28:26.524 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T21:53:45.894 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:09:28:26.502 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T21:53:45.896 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:09:28:26.504 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T21:53:45.962 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:09:28:26.569 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T21:53:45.965 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:09:28:26.572 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T21:53:46.081 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:09:28:26.688 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T21:53:46.082 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:09:28:26.742 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T21:53:46.156 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:09:28:26.754 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T21:54:36.110 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:09:29:16.769 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T21:54:36.118 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:09:29:16.778 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T21:54:36.131 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:09:29:16.739 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T21:54:36.132 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:09:29:16.740 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T21:54:36.137 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:09:29:16.745 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T21:54:36.139 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:09:29:16.747 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T21:54:36.250 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:09:29:16.909 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T21:54:36.255 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:09:29:16.863 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T21:54:36.270 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:09:29:16.877 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T21:55:36.364 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:09:30:17.023 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T21:55:36.407 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:09:30:17.066 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T21:55:36.421 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:09:30:17.028 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T21:55:36.429 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:09:30:17.037 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T21:55:36.431 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:09:30:17.039 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T21:55:36.449 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:09:30:17.057 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T21:55:36.475 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:09:30:17.134 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T21:55:36.533 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:09:30:17.141 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T21:55:36.543 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:09:30:17.150 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T21:59:47.846 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:09:34:28.505 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T21:59:47.852 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:09:34:28.512 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T21:59:47.862 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:09:34:28.469 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T21:59:47.865 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:09:34:28.473 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T21:59:47.869 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:09:34:28.477 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T21:59:47.875 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:09:34:28.482 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T21:59:48.041 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:09:34:28.645 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T21:59:48.042 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:09:34:28.650 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T21:59:48.107 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:09:34:28.766 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T22:03:58.417 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:09:38:39.076 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T22:03:58.424 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:09:38:39.032 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T22:03:58.427 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:09:38:39.086 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T22:03:58.430 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:09:38:39.038 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T22:03:58.471 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:09:38:39.078 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T22:03:58.472 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:09:38:39.080 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T22:03:58.547 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:09:38:39.155 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T22:03:58.613 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:09:38:39.220 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T22:03:58.737 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:09:38:39.397 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T22:04:58.694 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:09:39:39.353 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T22:04:58.703 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:09:39:39.363 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T22:04:58.717 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:09:39:39.323 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T22:04:58.717 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:09:39:39.323 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T22:04:58.718 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:09:39:39.326 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T22:04:58.722 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:09:39:39.329 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T22:04:58.793 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:09:39:39.452 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T22:04:58.802 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:09:39:39.410 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T22:04:58.805 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:09:39:39.413 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T22:10:11.340 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:09:44:52.000 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T22:10:11.365 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:09:44:51.967 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T22:10:11.367 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:09:44:51.971 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T22:10:11.368 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:09:44:51.969 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T22:10:11.368 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:09:44:52.015 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T22:10:11.374 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:09:44:51.981 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T22:10:11.587 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:09:44:52.194 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T22:10:11.602 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:09:44:52.209 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T22:10:11.671 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:09:44:52.330 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T22:12:20.431 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:09:47:01.090 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T22:12:20.438 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:09:47:01.046 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T22:12:20.455 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:09:47:01.114 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T22:12:20.464 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:09:47:01.072 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T22:12:20.490 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:09:47:01.097 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T22:12:20.493 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:09:47:01.100 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T22:12:20.534 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:09:47:01.193 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T22:12:20.576 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:09:47:01.184 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T22:12:20.596 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:09:47:01.204 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T22:15:23.601 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:09:50:04.261 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T22:15:23.615 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:09:50:04.274 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T22:15:23.624 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:09:50:04.232 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T22:15:23.629 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:09:50:04.237 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T22:15:23.633 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:09:50:04.241 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T22:15:23.644 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:09:50:04.252 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T22:15:23.808 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:09:50:04.416 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T22:15:23.829 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:09:50:04.437 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T22:15:23.844 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:09:50:04.503 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T22:20:37.043 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:09:55:17.703 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T22:20:37.050 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:09:55:17.709 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T22:20:37.072 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:09:55:17.680 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T22:20:37.078 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:09:55:17.685 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T22:20:37.078 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:09:55:17.686 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T22:20:37.083 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:09:55:17.691 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T22:20:37.285 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:09:55:17.945 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T22:20:37.297 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:09:55:17.905 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T22:20:37.326 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:09:55:17.934 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T22:20:43.115 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:09:55:23.775 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T22:20:43.174 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:09:55:23.782 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T22:20:43.177 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:09:55:23.837 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T22:20:43.179 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:09:55:23.787 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T22:20:43.184 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:09:55:23.792 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T22:20:43.197 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:09:55:23.805 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T22:20:43.200 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:09:55:23.808 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T22:20:43.221 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:09:55:23.829 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T22:20:43.224 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:09:55:23.884 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T22:25:48.215 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:10:00:28.874 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T22:25:48.222 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:10:00:28.882 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T22:25:48.235 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:10:00:28.843 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T22:25:48.235 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:10:00:28.843 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T22:25:48.240 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:10:00:28.848 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T22:25:48.240 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:10:00:28.848 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T22:25:48.452 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:10:00:29.112 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T22:25:48.461 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:10:00:29.069 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T22:25:48.501 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:10:00:29.108 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T22:29:05.054 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:10:03:45.714 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T22:29:05.063 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:10:03:45.723 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T22:29:05.102 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:10:03:45.710 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T22:29:05.112 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:10:03:45.720 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T22:29:05.112 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:10:03:45.720 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T22:29:05.145 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:10:03:45.748 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T22:29:05.175 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:10:03:45.835 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T22:29:05.246 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:10:03:45.854 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T22:29:05.274 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:10:03:45.882 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T22:30:57.804 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:10:05:38.464 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T22:30:57.817 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:10:05:38.477 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T22:30:57.829 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:10:05:38.437 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T22:30:57.834 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:10:05:38.442 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T22:30:57.838 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:10:05:38.444 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T22:30:57.841 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:10:05:38.449 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T22:30:57.947 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:10:05:38.554 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T22:30:57.950 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:10:05:38.558 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T22:30:57.968 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:10:05:38.628 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T22:31:21.053 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:10:06:01.712 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T22:31:21.060 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:10:06:01.720 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T22:31:21.099 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:10:06:01.759 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T22:31:21.153 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:10:06:01.761 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T22:31:21.154 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:10:06:01.762 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T22:31:21.158 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:10:06:01.766 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T22:31:21.162 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:10:06:01.770 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T22:31:21.193 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:10:06:01.800 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T22:31:21.200 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:10:06:01.807 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T22:36:07.813 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:10:10:48.472 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T22:36:07.833 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:10:10:48.436 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T22:36:07.833 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:10:10:48.482 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T22:36:07.835 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:10:10:48.443 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T22:36:07.837 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:10:10:48.445 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T22:36:07.842 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:10:10:48.450 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T22:36:08.033 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:10:10:48.640 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T22:36:08.048 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:10:10:48.656 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T22:36:08.089 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:10:10:48.749 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T22:37:27.415 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:10:12:08.075 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T22:37:27.420 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:10:12:08.080 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T22:37:27.436 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:10:12:08.044 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T22:37:27.470 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:10:12:08.078 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T22:37:27.523 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:10:12:08.130 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T22:37:27.527 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:10:12:08.187 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T22:37:27.567 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:10:12:08.175 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T22:37:27.579 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:10:12:08.187 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T22:37:27.718 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:10:12:08.326 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T22:41:19.506 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:10:16:00.166 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T22:41:19.533 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:10:16:00.139 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T22:41:19.533 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:10:16:00.188 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T22:41:19.536 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:10:16:00.145 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T22:41:19.539 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:10:16:00.147 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T22:41:19.544 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:10:16:00.152 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T22:41:19.753 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:10:16:00.361 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T22:41:19.768 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:10:16:00.376 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T22:41:19.782 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:10:16:00.442 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T22:45:54.394 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:10:20:35.054 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T22:45:54.422 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:10:20:35.065 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T22:45:54.463 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:10:20:35.071 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T22:45:54.465 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:10:20:35.073 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T22:45:54.479 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:10:20:35.087 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T22:45:54.495 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:10:20:35.103 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T22:45:54.600 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:10:20:35.260 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T22:45:54.686 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:10:20:35.294 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T22:45:54.700 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:10:20:35.308 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T22:46:33.568 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:10:21:14.228 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T22:46:33.580 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:10:21:14.240 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T22:46:33.585 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:10:21:14.193 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T22:46:33.591 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:10:21:14.199 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T22:46:33.599 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:10:21:14.207 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T22:46:33.603 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:10:21:14.211 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T22:46:33.668 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:10:21:14.276 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T22:46:33.679 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:10:21:14.287 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T22:46:33.704 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:10:21:14.364 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T22:51:46.015 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:10:26:26.675 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T22:51:46.024 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:10:26:26.684 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T22:51:46.038 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:10:26:26.646 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T22:51:46.039 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:10:26:26.647 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T22:51:46.048 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:10:26:26.654 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T22:51:46.048 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:10:26:26.656 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T22:51:46.252 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:10:26:26.860 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T22:51:46.265 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:10:26:26.873 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T22:51:46.288 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:10:26:26.949 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T22:54:16.397 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:10:28:57.057 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T22:54:16.438 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:10:28:57.098 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T22:54:16.465 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:10:28:57.073 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T22:54:16.467 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:10:28:57.075 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T22:54:16.574 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:10:28:57.235 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T22:54:16.595 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:10:28:57.203 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T22:54:16.635 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:10:28:57.242 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T22:54:16.653 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:10:28:57.261 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T22:54:16.806 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:10:28:57.414 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T22:56:57.133 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:10:31:37.794 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T22:56:57.160 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:10:31:37.820 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T22:56:57.161 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:10:31:37.769 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T22:56:57.164 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:10:31:37.772 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T22:56:57.166 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:10:31:37.774 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T22:56:57.171 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:10:31:37.779 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T22:56:57.306 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:10:31:37.914 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T22:56:57.308 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:10:31:37.969 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T22:56:57.354 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:10:31:37.961 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T23:02:08.413 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:10:36:49.074 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T23:02:08.436 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:10:36:49.097 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T23:02:08.437 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:10:36:49.045 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T23:02:08.441 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:10:36:49.049 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T23:02:08.443 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:10:36:49.051 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T23:02:08.451 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:10:36:49.059 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T23:02:08.663 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:10:36:49.271 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T23:02:08.703 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:10:36:49.363 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T23:02:08.703 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:10:36:49.312 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T23:02:38.526 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:10:37:19.187 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T23:02:38.585 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:10:37:19.246 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T23:02:38.591 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:10:37:19.200 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T23:02:38.626 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:10:37:19.287 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T23:02:38.627 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:10:37:19.235 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T23:02:38.636 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:10:37:19.244 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T23:02:38.648 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:10:37:19.256 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T23:02:38.668 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:10:37:19.276 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T23:02:38.688 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:10:37:19.296 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T23:07:20.761 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:10:42:01.421 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T23:07:20.783 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:10:42:01.431 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T23:07:20.786 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:10:42:01.394 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T23:07:20.788 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:10:42:01.397 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T23:07:20.793 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:10:42:01.401 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T23:07:20.794 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:10:42:01.402 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T23:07:21.029 INFO:tasks.ceph.mon.c.smithi062.stderr:==00:10:42:01.637 8999== Warning: unimplemented fcntl command: 1036 2019-11-29T23:07:21.032 INFO:tasks.ceph.mon.a.smithi062.stderr:==00:10:42:01.640 8998== Warning: unimplemented fcntl command: 1036 2019-11-29T23:07:21.071 INFO:tasks.ceph.mon.b.smithi022.stderr:==00:10:42:01.732 8365== Warning: unimplemented fcntl command: 1036 2019-11-29T23:07:24.086 DEBUG:teuthology.exit:Got signal 15; running 2 handlers... 2019-11-29T23:07:24.086 DEBUG:teuthology.task.console_log:Killing console logger for smithi022 2019-11-29T23:07:24.087 DEBUG:teuthology.task.console_log:Killing console logger for smithi062 2019-11-29T23:07:24.087 DEBUG:teuthology.task.console_log:Killing console logger for smithi022 2019-11-29T23:07:24.087 DEBUG:teuthology.task.console_log:Killing console logger for smithi062 2019-11-29T23:07:24.087 DEBUG:teuthology.exit:Finished running handlers